mjsax / aeolus Goto Github PK
View Code? Open in Web Editor NEWBatching and optimization framework on top of Apache Storm.
License: Apache License 2.0
aeolus's People
Contributors
Stargazers
Watchers
aeolus's Issues
Use Apache commons' ReflectionToStringBuilder
Use Apache commons' ReflectionToStringBuilder in order to avoid the rather annoying construction and even more annoying changes (including field name refactoring) in toString methods.
Clarify header format
Incomplete setup of checkstyle maven plugin shows that both headers
/*
* #%L
* lrb
* $Id:$
* $HeadURL:$
* %%
* Copyright (C) 2014 - 2015 Humboldt-Universität zu Berlin
* %%
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
* #L%
*/
and
/*
* #%L
* batching
* %%
* Copyright (C) 2014 - 2015 Humboldt-Universität zu Berlin
* %%
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
* #L%
*/
are in use. Please clarify the use of the variables and adjust the automatic header generation accordingly. In case that's too much effort, please adjust check_style.xml with an appropriate regular expression in the RegexpHeader module.
LocalCluster failure due to error 'Could not locate carbonite/api__init.class'
queries/lrb/src/test/java/storm/lrb/LRBTopologyMainTest fails due to error Could not locate carbonite/api__init.class. I had to kill my local maven cache for another reason. After that the issue appeared.
I set needed to deactivate the test in c76419f in order to maintain testability. After deactivating I'm seeing the stack in de.hub.cs.dbis.lrb.operators.FileReaderSpoutITCase and others as well, but there's no failure.
The maven log:
cd /mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb; JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 M2_HOME=/home/richter/apache-maven-current /home/richter/apache-maven-current/bin/mvn -Djava.net.useSystemProxies=true clean install
Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar
Scanning for projects...
------------------------------------------------------------------------
Building lrb 1.0-SNAPSHOT
------------------------------------------------------------------------
The POM for clj-time:clj-time:jar:0.3.7 is missing, no dependency information available
The POM for ring:ring-core:jar:0.3.11 is missing, no dependency information available
--- maven-clean-plugin:2.5:clean (default-clean) @ lrb ---
Deleting /mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb/target
--- maven-java-formatter-plugin:0.4:format (default) @ lrb ---
Using 'UTF-8' encoding to format source files.
Number of files to be formatted: 45
Successfully formatted: 15 file(s)
Fail to format : 0 file(s)
Skipped : 30 file(s)
Approximate time taken: 1s
--- license-maven-plugin:1.8:update-file-header (first) @ lrb ---
Adding a license repository jar:file:/home/richter/.m2/repository/org/codehaus/mojo/license-maven-plugin/1.8/license-maven-plugin-1.8.jar!/META-INF/licenses
register COMMON DEVELOPMENT AND DISTRIBUTION LICENSE (CDDL) Version 1.0
register GNU General Public License (GPL) version 3.0
register MIT-License
register GNU General Public License (GPL) version 2.0
register GNU General Public License (GPL) version 1.0
register GNU Free Documentation License (FDL) version 1.3
register Eclipse Public + Distribution License - v 1.0
register Eclipse Public License - v 1.0
register GNU Affero General Public License (AGPL) version 3.0
register GNU General Lesser Public License (LGPL) version 3.0
register GNU General Lesser Public License (LGPL) version 2.1
register Apache License version 2.0
register European Union Public License v1.1
register BSD 3-Clause License
register BSD 2-Clause License
Will search files to update from root /mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb/src/main/java
Will search files to update from root /mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb/src/test/java
Scan 45 files header done in 172,389ms.
* update header on 1 file.
* uptodate header on 44 files.
--- maven-resources-plugin:2.6:resources (default-resources) @ lrb ---
Using 'UTF-8' encoding to copy filtered resources.
Copying 2 resources
--- maven-compiler-plugin:3.1:compile (default-compile) @ lrb ---
Changes detected - recompiling the module!
Compiling 38 source files to /mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb/target/classes
--- maven-resources-plugin:2.6:testResources (default-testResources) @ lrb ---
Using 'UTF-8' encoding to copy filtered resources.
Copying 11 resources
--- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ lrb ---
Changes detected - recompiling the module!
Compiling 7 source files to /mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb/target/test-classes
--- maven-surefire-plugin:2.12.4:test (default-test) @ lrb ---
Surefire report directory: /mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb/target/surefire-reports
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar
Running storm.lrb.bolt.AccountBalanceBoltTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.051 sec
Running storm.lrb.bolt.AccidentDetectionBoltTest
08:39:38,020 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
08:39:38,020 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
08:39:38,020 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [file:/mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb/target/classes/logback.xml]
08:39:38,020 |-WARN in ch.qos.logback.classic.LoggerContext[default] - Resource [logback.xml] occurs multiple times on the classpath.
08:39:38,020 |-WARN in ch.qos.logback.classic.LoggerContext[default] - Resource [logback.xml] occurs at [file:/mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb/target/classes/logback.xml]
08:39:38,020 |-WARN in ch.qos.logback.classic.LoggerContext[default] - Resource [logback.xml] occurs at [jar:file:/home/richter/.m2/repository/org/apache/storm/storm-core/0.9.3/storm-core-0.9.3.jar!/logback.xml]
08:39:38,101 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
08:39:38,105 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
08:39:38,111 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
08:39:38,131 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
08:39:38,172 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO
08:39:38,172 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
08:39:38,172 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
08:39:38,173 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@65d6b83b - Registering current configuration as safe fallback point
08:39:38.231 [main] INFO storm.lrb.bolt.AccidentDetectionBolt - accident is over: %s
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.486 sec
Running storm.lrb.LRBTopologyMainTest
08:39:38.380 [main] INFO storm.lrb.LRBTopology - successfully created storm topology 'test_lrb'
08:39:39.821 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
08:39:39.821 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:host.name=richter-lenovo-IdeaPad-Z500
08:39:39.821 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_45-internal
08:39:39.821 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
08:39:39.821 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-8-openjdk-amd64/jre
08:39:39.821 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:java.class.path=/mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb/target/test-classes:/mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb/target/classes:/home/richter/.m2/repository/de/hub/cs/dbis/aeolus/testUtils/1.0-SNAPSHOT/testUtils-1.0-SNAPSHOT.jar:/home/richter/.m2/repository/de/hub/cs/dbis/aeolus/utils/1.0-SNAPSHOT/utils-1.0-SNAPSHOT.jar:/home/richter/.m2/repository/com/beust/jcommander/1.47/jcommander-1.47.jar:/home/richter/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/home/richter/.m2/repository/org/apache/commons/commons-lang3/3.2/commons-lang3-3.2.jar:/home/richter/.m2/repository/org/apache/storm/storm-core/0.9.3/storm-core-0.9.3.jar:/home/richter/.m2/repository/org/clojure/clojure/1.5.1/clojure-1.5.1.jar:/home/richter/.m2/repository/clj-time/clj-time/0.4.1/clj-time-0.4.1.jar:/home/richter/.m2/repository/joda-time/joda-time/2.0/joda-time-2.0.jar:/home/richter/.m2/repository/compojure/compojure/1.1.3/compojure-1.1.3.jar:/home/richter/.m2/repository/org/clojure/core.incubator/0.1.0/core.incubator-0.1.0.jar:/home/richter/.m2/repository/org/clojure/tools.macro/0.1.0/tools.macro-0.1.0.jar:/home/richter/.m2/repository/clout/clout/1.0.1/clout-1.0.1.jar:/home/richter/.m2/repository/ring/ring-core/1.1.5/ring-core-1.1.5.jar:/home/richter/.m2/repository/commons-fileupload/commons-fileupload/1.2.1/commons-fileupload-1.2.1.jar:/home/richter/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/home/richter/.m2/repository/hiccup/hiccup/0.3.6/hiccup-0.3.6.jar:/home/richter/.m2/repository/ring/ring-devel/0.3.11/ring-devel-0.3.11.jar:/home/richter/.m2/repository/clj-stacktrace/clj-stacktrace/0.2.2/clj-stacktrace-0.2.2.jar:/home/richter/.m2/repository/ring/ring-jetty-adapter/0.3.11/ring-jetty-adapter-0.3.11.jar:/home/richter/.m2/repository/ring/ring-servlet/0.3.11/ring-servlet-0.3.11.jar:/home/richter/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/home/richter/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/richter/.m2/repository/org/clojure/tools.logging/0.2.3/tools.logging-0.2.3.jar:/home/richter/.m2/repository/org/clojure/math.numeric-tower/0.0.1/math.numeric-tower-0.0.1.jar:/home/richter/.m2/repository/org/clojure/tools.cli/0.2.4/tools.cli-0.2.4.jar:/home/richter/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/richter/.m2/repository/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar:/home/richter/.m2/repository/commons-lang/commons-lang/2.5/commons-lang-2.5.jar:/home/richter/.m2/repository/com/googlecode/json-simple/json-simple/1.1/json-simple-1.1.jar:/home/richter/.m2/repository/com/twitter/carbonite/1.4.0/carbonite-1.4.0.jar:/home/richter/.m2/repository/com/esotericsoftware/kryo/kryo/2.21/kryo-2.21.jar:/home/richter/.m2/repository/com/esotericsoftware/reflectasm/reflectasm/1.07/reflectasm-1.07-shaded.jar:/home/richter/.m2/repository/org/ow2/asm/asm/4.0/asm-4.0.jar:/home/richter/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/home/richter/.m2/repository/org/objenesis/objenesis/1.2/objenesis-1.2.jar:/home/richter/.m2/repository/com/twitter/chill-java/0.3.5/chill-java-0.3.5.jar:/home/richter/.m2/repository/org/yaml/snakeyaml/1.11/snakeyaml-1.11.jar:/home/richter/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/richter/.m2/repository/commons-codec/commons-codec/1.6/commons-codec-1.6.jar:/home/richter/.m2/repository/com/googlecode/disruptor/disruptor/2.10.1/disruptor-2.10.1.jar:/home/richter/.m2/repository/org/jgrapht/jgrapht-core/0.9.0/jgrapht-core-0.9.0.jar:/home/richter/.m2/repository/ch/qos/logback/logback-classic/1.0.13/logback-classic-1.0.13.jar:/home/richter/.m2/repository/ch/qos/logback/logback-core/1.0.13/logback-core-1.0.13.jar:/home/richter/.m2/repository/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar:/home/richter/.m2/repository/org/slf4j/log4j-over-slf4j/1.6.6/log4j-over-slf4j-1.6.6.jar:/home/richter/.m2/repository/jline/jline/2.11/jline-2.11.jar:/home/richter/.m2/repository/junit/junit/4.11/junit-4.11.jar:/home/richter/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/richter/.m2/repository/org/powermock/powermock-module-junit4/1.5.5/powermock-module-junit4-1.5.5.jar:/home/richter/.m2/repository/org/powermock/powermock-module-junit4-common/1.5.5/powermock-module-junit4-common-1.5.5.jar:/home/richter/.m2/repository/org/powermock/powermock-core/1.5.5/powermock-core-1.5.5.jar:/home/richter/.m2/repository/org/javassist/javassist/3.18.2-GA/javassist-3.18.2-GA.jar:/home/richter/.m2/repository/org/powermock/powermock-reflect/1.5.5/powermock-reflect-1.5.5.jar:/home/richter/.m2/repository/org/powermock/powermock-api-mockito/1.5.5/powermock-api-mockito-1.5.5.jar:/home/richter/.m2/repository/org/mockito/mockito-all/1.9.5/mockito-all-1.9.5.jar:/home/richter/.m2/repository/org/powermock/powermock-api-support/1.5.5/powermock-api-support-1.5.5.jar:
08:39:39.821 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
08:39:39.821 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
08:39:39.821 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
08:39:39.821 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:os.name=Linux
08:39:39.822 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:os.arch=amd64
08:39:39.822 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:os.version=4.0.1-040001-generic
08:39:39.822 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:user.name=richter
08:39:39.822 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:user.home=/home/richter
08:39:39.822 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Client environment:user.dir=/mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb
08:39:39.834 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
08:39:39.834 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:host.name=richter-lenovo-IdeaPad-Z500
08:39:39.834 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:java.version=1.8.0_45-internal
08:39:39.834 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:java.vendor=Oracle Corporation
08:39:39.834 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:java.home=/usr/lib/jvm/java-8-openjdk-amd64/jre
08:39:39.834 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:java.class.path=/mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb/target/test-classes:/mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb/target/classes:/home/richter/.m2/repository/de/hub/cs/dbis/aeolus/testUtils/1.0-SNAPSHOT/testUtils-1.0-SNAPSHOT.jar:/home/richter/.m2/repository/de/hub/cs/dbis/aeolus/utils/1.0-SNAPSHOT/utils-1.0-SNAPSHOT.jar:/home/richter/.m2/repository/com/beust/jcommander/1.47/jcommander-1.47.jar:/home/richter/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/home/richter/.m2/repository/org/apache/commons/commons-lang3/3.2/commons-lang3-3.2.jar:/home/richter/.m2/repository/org/apache/storm/storm-core/0.9.3/storm-core-0.9.3.jar:/home/richter/.m2/repository/org/clojure/clojure/1.5.1/clojure-1.5.1.jar:/home/richter/.m2/repository/clj-time/clj-time/0.4.1/clj-time-0.4.1.jar:/home/richter/.m2/repository/joda-time/joda-time/2.0/joda-time-2.0.jar:/home/richter/.m2/repository/compojure/compojure/1.1.3/compojure-1.1.3.jar:/home/richter/.m2/repository/org/clojure/core.incubator/0.1.0/core.incubator-0.1.0.jar:/home/richter/.m2/repository/org/clojure/tools.macro/0.1.0/tools.macro-0.1.0.jar:/home/richter/.m2/repository/clout/clout/1.0.1/clout-1.0.1.jar:/home/richter/.m2/repository/ring/ring-core/1.1.5/ring-core-1.1.5.jar:/home/richter/.m2/repository/commons-fileupload/commons-fileupload/1.2.1/commons-fileupload-1.2.1.jar:/home/richter/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/home/richter/.m2/repository/hiccup/hiccup/0.3.6/hiccup-0.3.6.jar:/home/richter/.m2/repository/ring/ring-devel/0.3.11/ring-devel-0.3.11.jar:/home/richter/.m2/repository/clj-stacktrace/clj-stacktrace/0.2.2/clj-stacktrace-0.2.2.jar:/home/richter/.m2/repository/ring/ring-jetty-adapter/0.3.11/ring-jetty-adapter-0.3.11.jar:/home/richter/.m2/repository/ring/ring-servlet/0.3.11/ring-servlet-0.3.11.jar:/home/richter/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/home/richter/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/richter/.m2/repository/org/clojure/tools.logging/0.2.3/tools.logging-0.2.3.jar:/home/richter/.m2/repository/org/clojure/math.numeric-tower/0.0.1/math.numeric-tower-0.0.1.jar:/home/richter/.m2/repository/org/clojure/tools.cli/0.2.4/tools.cli-0.2.4.jar:/home/richter/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/richter/.m2/repository/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar:/home/richter/.m2/repository/commons-lang/commons-lang/2.5/commons-lang-2.5.jar:/home/richter/.m2/repository/com/googlecode/json-simple/json-simple/1.1/json-simple-1.1.jar:/home/richter/.m2/repository/com/twitter/carbonite/1.4.0/carbonite-1.4.0.jar:/home/richter/.m2/repository/com/esotericsoftware/kryo/kryo/2.21/kryo-2.21.jar:/home/richter/.m2/repository/com/esotericsoftware/reflectasm/reflectasm/1.07/reflectasm-1.07-shaded.jar:/home/richter/.m2/repository/org/ow2/asm/asm/4.0/asm-4.0.jar:/home/richter/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/home/richter/.m2/repository/org/objenesis/objenesis/1.2/objenesis-1.2.jar:/home/richter/.m2/repository/com/twitter/chill-java/0.3.5/chill-java-0.3.5.jar:/home/richter/.m2/repository/org/yaml/snakeyaml/1.11/snakeyaml-1.11.jar:/home/richter/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/richter/.m2/repository/commons-codec/commons-codec/1.6/commons-codec-1.6.jar:/home/richter/.m2/repository/com/googlecode/disruptor/disruptor/2.10.1/disruptor-2.10.1.jar:/home/richter/.m2/repository/org/jgrapht/jgrapht-core/0.9.0/jgrapht-core-0.9.0.jar:/home/richter/.m2/repository/ch/qos/logback/logback-classic/1.0.13/logback-classic-1.0.13.jar:/home/richter/.m2/repository/ch/qos/logback/logback-core/1.0.13/logback-core-1.0.13.jar:/home/richter/.m2/repository/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar:/home/richter/.m2/repository/org/slf4j/log4j-over-slf4j/1.6.6/log4j-over-slf4j-1.6.6.jar:/home/richter/.m2/repository/jline/jline/2.11/jline-2.11.jar:/home/richter/.m2/repository/junit/junit/4.11/junit-4.11.jar:/home/richter/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/richter/.m2/repository/org/powermock/powermock-module-junit4/1.5.5/powermock-module-junit4-1.5.5.jar:/home/richter/.m2/repository/org/powermock/powermock-module-junit4-common/1.5.5/powermock-module-junit4-common-1.5.5.jar:/home/richter/.m2/repository/org/powermock/powermock-core/1.5.5/powermock-core-1.5.5.jar:/home/richter/.m2/repository/org/javassist/javassist/3.18.2-GA/javassist-3.18.2-GA.jar:/home/richter/.m2/repository/org/powermock/powermock-reflect/1.5.5/powermock-reflect-1.5.5.jar:/home/richter/.m2/repository/org/powermock/powermock-api-mockito/1.5.5/powermock-api-mockito-1.5.5.jar:/home/richter/.m2/repository/org/mockito/mockito-all/1.9.5/mockito-all-1.9.5.jar:/home/richter/.m2/repository/org/powermock/powermock-api-support/1.5.5/powermock-api-support-1.5.5.jar:
08:39:39.834 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
08:39:39.834 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:java.io.tmpdir=/tmp
08:39:39.834 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:java.compiler=<NA>
08:39:39.834 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:os.name=Linux
08:39:39.834 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:os.arch=amd64
08:39:39.835 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:os.version=4.0.1-040001-generic
08:39:39.835 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:user.name=richter
08:39:39.835 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:user.home=/home/richter
08:39:39.835 [main] INFO o.a.s.z.server.ZooKeeperServer - Server environment:user.dir=/mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb
08:39:40.200 [main] INFO o.a.s.z.server.ZooKeeperServer - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /tmp/30226d85-6a40-4df5-8d14-14054bb2e834/version-2 snapdir /tmp/30226d85-6a40-4df5-8d14-14054bb2e834/version-2
08:39:40.205 [main] INFO o.a.s.z.server.NIOServerCnxnFactory - binding to port 0.0.0.0/0.0.0.0:2000
08:39:40.208 [main] INFO backtype.storm.zookeeper - Starting inprocess zookeeper at port 2000 and dir /tmp/30226d85-6a40-4df5-8d14-14054bb2e834
08:39:40.308 [main] INFO backtype.storm.daemon.nimbus - Starting Nimbus with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "storm.messaging.netty.flush.check.interval.ms" 10, "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m", "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "/tmp/2da5b860-d270-4e94-9747-905f43ceb405", "storm.messaging.netty.buffer_size" 5242880, "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64, "storm.meta.serialization.delegate" "backtype.storm.serialization.DefaultSerializationDelegate", "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000, "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" nil, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "drpc.queue.size" 128, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m", "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "storm.messaging.netty.max_retries" 300, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" [6700 6701 6702 6703], "topology.environment" nil, "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.worker.receiver.thread.count" 1, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.max.task.parallelism" nil, "storm.messaging.netty.transfer.batch.size" 262144, "topology.classpath" nil}
08:39:40.316 [main] INFO backtype.storm.daemon.nimbus - Using default scheduler
08:39:40.324 [main] INFO b.s.u.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
08:39:40.367 [main] INFO o.a.s.c.f.imps.CuratorFrameworkImpl - Starting
08:39:40.371 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@c35af2a
08:39:40.383 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
08:39:40.448 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
08:39:40.448 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:58772
08:39:40.453 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:58772
08:39:40.455 [SyncThread:0] INFO o.a.s.z.s.persistence.FileTxnLog - Creating new log file: log.1
08:39:40.463 [SyncThread:0] INFO o.a.s.z.server.ZooKeeperServer - Established session 0x14d6ae630b40000 with negotiated timeout 20000 for client /127.0.0.1:58772
08:39:40.464 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14d6ae630b40000, negotiated timeout = 20000
08:39:40.467 [main-EventThread] INFO o.a.s.c.f.s.ConnectionStateManager - State change: CONNECTED
08:39:40.468 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state update: :connected:none
08:39:41.490 [ProcessThread(sid:0 cport:-1):] INFO o.a.s.z.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14d6ae630b40000
08:39:41.491 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Session: 0x14d6ae630b40000 closed
08:39:41.491 [main-EventThread] INFO o.apache.storm.zookeeper.ClientCnxn - EventThread shut down
08:39:41.492 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:58772 which had sessionid 0x14d6ae630b40000
08:39:41.493 [main] INFO b.s.u.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
08:39:41.494 [main] INFO o.a.s.c.f.imps.CuratorFrameworkImpl - Starting
08:39:41.494 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@6a4ccef7
08:39:41.497 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
08:39:41.497 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
08:39:41.497 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:58773
08:39:41.497 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:58773
08:39:41.499 [SyncThread:0] INFO o.a.s.z.server.ZooKeeperServer - Established session 0x14d6ae630b40001 with negotiated timeout 20000 for client /127.0.0.1:58773
08:39:41.499 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14d6ae630b40001, negotiated timeout = 20000
08:39:41.499 [main-EventThread] INFO o.a.s.c.f.s.ConnectionStateManager - State change: CONNECTED
08:39:41.525 [main] INFO b.s.u.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
08:39:41.526 [main] INFO o.a.s.c.f.imps.CuratorFrameworkImpl - Starting
08:39:41.526 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@10fda3d0
08:39:41.527 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
08:39:41.528 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
08:39:41.528 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:58774
08:39:41.528 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:58774
08:39:41.530 [SyncThread:0] INFO o.a.s.z.server.ZooKeeperServer - Established session 0x14d6ae630b40002 with negotiated timeout 20000 for client /127.0.0.1:58774
08:39:41.530 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14d6ae630b40002, negotiated timeout = 20000
08:39:41.530 [main-EventThread] INFO o.a.s.c.f.s.ConnectionStateManager - State change: CONNECTED
08:39:41.530 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state update: :connected:none
08:39:41.533 [ProcessThread(sid:0 cport:-1):] INFO o.a.s.z.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14d6ae630b40002
08:39:41.534 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Session: 0x14d6ae630b40002 closed
08:39:41.534 [main-EventThread] INFO o.apache.storm.zookeeper.ClientCnxn - EventThread shut down
08:39:41.534 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:58774 which had sessionid 0x14d6ae630b40002
08:39:41.534 [main] INFO b.s.u.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
08:39:41.535 [main] INFO o.a.s.c.f.imps.CuratorFrameworkImpl - Starting
08:39:41.535 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@6cfd9a54
08:39:41.537 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
08:39:41.537 [main] INFO b.s.u.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
08:39:41.537 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:58775
08:39:41.537 [main] INFO o.a.s.c.f.imps.CuratorFrameworkImpl - Starting
08:39:41.537 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@25d2f66
08:39:41.538 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
08:39:41.538 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
08:39:41.538 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:58775
08:39:41.538 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
08:39:41.538 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:58776
08:39:41.539 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:58776
08:39:41.540 [SyncThread:0] INFO o.a.s.z.server.ZooKeeperServer - Established session 0x14d6ae630b40003 with negotiated timeout 20000 for client /127.0.0.1:58775
08:39:41.540 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14d6ae630b40003, negotiated timeout = 20000
08:39:41.540 [main-EventThread] INFO o.a.s.c.f.s.ConnectionStateManager - State change: CONNECTED
08:39:41.541 [SyncThread:0] INFO o.a.s.z.server.ZooKeeperServer - Established session 0x14d6ae630b40004 with negotiated timeout 20000 for client /127.0.0.1:58776
08:39:41.541 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14d6ae630b40004, negotiated timeout = 20000
08:39:41.542 [main-EventThread] INFO o.a.s.c.f.s.ConnectionStateManager - State change: CONNECTED
08:39:41.543 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state update: :connected:none
08:39:41.544 [ProcessThread(sid:0 cport:-1):] INFO o.a.s.z.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14d6ae630b40004
08:39:41.545 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Session: 0x14d6ae630b40004 closed
08:39:41.545 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:58776 which had sessionid 0x14d6ae630b40004
08:39:41.545 [main] INFO b.s.u.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
08:39:41.545 [main-EventThread] INFO o.apache.storm.zookeeper.ClientCnxn - EventThread shut down
08:39:41.546 [main] INFO o.a.s.c.f.imps.CuratorFrameworkImpl - Starting
08:39:41.547 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@6ecdbab8
08:39:41.547 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
08:39:41.548 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:58777
08:39:41.548 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
08:39:41.548 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:58777
08:39:41.549 [SyncThread:0] INFO o.a.s.z.server.ZooKeeperServer - Established session 0x14d6ae630b40005 with negotiated timeout 20000 for client /127.0.0.1:58777
08:39:41.549 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14d6ae630b40005, negotiated timeout = 20000
08:39:41.550 [main-EventThread] INFO o.a.s.c.f.s.ConnectionStateManager - State change: CONNECTED
08:39:41.562 [main] INFO backtype.storm.daemon.supervisor - Starting Supervisor with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "storm.messaging.netty.flush.check.interval.ms" 10, "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m", "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "/tmp/2ef68ceb-76aa-481c-abd9-a6fa2cfd89fa", "storm.messaging.netty.buffer_size" 5242880, "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64, "storm.meta.serialization.delegate" "backtype.storm.serialization.DefaultSerializationDelegate", "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000, "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" nil, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "drpc.queue.size" 128, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m", "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "storm.messaging.netty.max_retries" 300, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (1024 1025 1026), "topology.environment" nil, "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.worker.receiver.thread.count" 1, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.max.task.parallelism" nil, "storm.messaging.netty.transfer.batch.size" 262144, "topology.classpath" nil}
08:39:41.569 [main] INFO b.s.u.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
08:39:41.569 [main] INFO o.a.s.c.f.imps.CuratorFrameworkImpl - Starting
08:39:41.570 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@9fc9f91
08:39:41.573 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
08:39:41.574 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
08:39:41.574 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:58778
08:39:41.574 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:58778
08:39:41.576 [SyncThread:0] INFO o.a.s.z.server.ZooKeeperServer - Established session 0x14d6ae630b40006 with negotiated timeout 20000 for client /127.0.0.1:58778
08:39:41.576 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14d6ae630b40006, negotiated timeout = 20000
08:39:41.579 [main-EventThread] INFO o.a.s.c.f.s.ConnectionStateManager - State change: CONNECTED
08:39:41.579 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state update: :connected:none
08:39:41.581 [ProcessThread(sid:0 cport:-1):] INFO o.a.s.z.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14d6ae630b40006
08:39:41.582 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:58778 which had sessionid 0x14d6ae630b40006
08:39:41.583 [main-EventThread] INFO o.apache.storm.zookeeper.ClientCnxn - EventThread shut down
08:39:41.583 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Session: 0x14d6ae630b40006 closed
08:39:41.583 [main] INFO b.s.u.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
08:39:41.584 [main] INFO o.a.s.c.f.imps.CuratorFrameworkImpl - Starting
08:39:41.584 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@6850b758
08:39:41.592 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
08:39:41.593 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
08:39:41.593 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:58779
08:39:41.593 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:58779
08:39:41.595 [SyncThread:0] INFO o.a.s.z.server.ZooKeeperServer - Established session 0x14d6ae630b40007 with negotiated timeout 20000 for client /127.0.0.1:58779
08:39:41.595 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14d6ae630b40007, negotiated timeout = 20000
08:39:41.596 [main-EventThread] INFO o.a.s.c.f.s.ConnectionStateManager - State change: CONNECTED
08:39:41.625 [main] INFO backtype.storm.daemon.supervisor - Starting supervisor with id 4c6ffc14-14ed-431d-81c1-f9b1e4d7752d at host richter-lenovo-IdeaPad-Z500
08:39:41.629 [main] INFO backtype.storm.daemon.supervisor - Starting Supervisor with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "storm.messaging.netty.flush.check.interval.ms" 10, "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m", "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "/tmp/472c4ee2-1e46-4c74-b4e3-54683dd935c8", "storm.messaging.netty.buffer_size" 5242880, "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64, "storm.meta.serialization.delegate" "backtype.storm.serialization.DefaultSerializationDelegate", "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000, "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" nil, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "drpc.queue.size" 128, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m", "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "storm.messaging.netty.max_retries" 300, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (1027 1028 1029), "topology.environment" nil, "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.worker.receiver.thread.count" 1, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.max.task.parallelism" nil, "storm.messaging.netty.transfer.batch.size" 262144, "topology.classpath" nil}
08:39:41.631 [main] INFO b.s.u.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
08:39:41.632 [main] INFO o.a.s.c.f.imps.CuratorFrameworkImpl - Starting
08:39:41.632 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@15383681
08:39:41.633 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
08:39:41.633 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
08:39:41.633 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:58780
08:39:41.633 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:58780
08:39:41.635 [SyncThread:0] INFO o.a.s.z.server.ZooKeeperServer - Established session 0x14d6ae630b40008 with negotiated timeout 20000 for client /127.0.0.1:58780
08:39:41.635 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14d6ae630b40008, negotiated timeout = 20000
08:39:41.635 [main-EventThread] INFO o.a.s.c.f.s.ConnectionStateManager - State change: CONNECTED
08:39:41.635 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state update: :connected:none
08:39:41.637 [ProcessThread(sid:0 cport:-1):] INFO o.a.s.z.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14d6ae630b40008
08:39:41.638 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Session: 0x14d6ae630b40008 closed
08:39:41.638 [main-EventThread] INFO o.apache.storm.zookeeper.ClientCnxn - EventThread shut down
08:39:41.640 [main] INFO b.s.u.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
08:39:41.640 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:58780 which had sessionid 0x14d6ae630b40008
08:39:41.641 [main] INFO o.a.s.c.f.imps.CuratorFrameworkImpl - Starting
08:39:41.641 [main] INFO org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@71978f46
08:39:41.644 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
08:39:41.644 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
08:39:41.644 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:58781
08:39:41.644 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:58781
08:39:41.646 [SyncThread:0] INFO o.a.s.z.server.ZooKeeperServer - Established session 0x14d6ae630b40009 with negotiated timeout 20000 for client /127.0.0.1:58781
08:39:41.646 [main-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14d6ae630b40009, negotiated timeout = 20000
08:39:41.646 [main-EventThread] INFO o.a.s.c.f.s.ConnectionStateManager - State change: CONNECTED
08:39:41.654 [main] INFO backtype.storm.daemon.supervisor - Starting supervisor with id 9caea9d0-6360-4cea-b845-aca77e561f0a at host richter-lenovo-IdeaPad-Z500
08:39:41.733 [main] INFO backtype.storm.daemon.nimbus - Received topology submission for test_lrb with conf {"topology.max.task.parallelism" nil, "topology.acker.executors" nil, "topology.kryo.decorators" (), "topology.name" "test_lrb", "storm.id" "test_lrb-1-1432017581", "topology.kryo.register" {"storm.lrb.model.AccidentImmutable" nil, "storm.lrb.tools.StopWatch" nil, "storm.lrb.model.LRBtuple" nil, "storm.lrb.model.VehicleInfo" nil, "storm.lrb.model.Accident" nil, "storm.lrb.model.TravelTimeRequest" nil, "storm.lrb.model.DailyExpenditureRequest" nil, "storm.lrb.model.AccountBalanceRequest" nil, "storm.lrb.model.PosReport" nil}, "topology.debug" true, "OrderedFileInputSpout.input" "/mnt/DATA/richter/Dateien/stratosphere/aeolus/queries/lrb/target/classes/datafile20seconds.dat"}
08:39:41.756 [main] INFO backtype.storm.daemon.nimbus - Activating test_lrb: test_lrb-1-1432017581
08:39:41.855 [main] INFO b.storm.scheduler.EvenScheduler - Available slots: (["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1025] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1026] ["9caea9d0-6360-4cea-b845-aca77e561f0a" 1027] ["9caea9d0-6360-4cea-b845-aca77e561f0a" 1028] ["9caea9d0-6360-4cea-b845-aca77e561f0a" 1029])
08:39:41.876 [main] INFO backtype.storm.daemon.nimbus - Setting new assignment for topology id test_lrb-1-1432017581: #backtype.storm.daemon.common.Assignment{:master-code-dir "/tmp/2da5b860-d270-4e94-9747-905f43ceb405/nimbus/stormdist/test_lrb-1-1432017581", :node->host {"4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" "richter-lenovo-IdeaPad-Z500"}, :executor->node+port {[2 2] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [3 3] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [4 4] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [36 36] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [5 5] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [6 6] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [7 7] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [8 8] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [9 9] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [10 10] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [11 11] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [12 12] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [13 13] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [14 14] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [15 15] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [16 16] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [17 17] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [18 18] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [19 19] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [20 20] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [21 21] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [22 22] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [23 23] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [32 32] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [1 1] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [33 33] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [34 35] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [24 25] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [26 27] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [28 29] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024], [30 31] ["4c6ffc14-14ed-431d-81c1-f9b1e4d7752d" 1024]}, :executor->start-time-secs {[2 2] 1432017581, [3 3] 1432017581, [4 4] 1432017581, [36 36] 1432017581, [5 5] 1432017581, [6 6] 1432017581, [7 7] 1432017581, [8 8] 1432017581, [9 9] 1432017581, [10 10] 1432017581, [11 11] 1432017581, [12 12] 1432017581, [13 13] 1432017581, [14 14] 1432017581, [15 15] 1432017581, [16 16] 1432017581, [17 17] 1432017581, [18 18] 1432017581, [19 19] 1432017581, [20 20] 1432017581, [21 21] 1432017581, [22 22] 1432017581, [23 23] 1432017581, [32 32] 1432017581, [1 1] 1432017581, [33 33] 1432017581, [34 35] 1432017581, [24 25] 1432017581, [26 27] 1432017581, [28 29] 1432017581, [30 31] 1432017581}}
08:39:42.592 [Thread-3] INFO backtype.storm.daemon.supervisor - Downloading code for storm id test_lrb-1-1432017581 from /tmp/2da5b860-d270-4e94-9747-905f43ceb405/nimbus/stormdist/test_lrb-1-1432017581
08:39:42.822 [Thread-3] INFO backtype.storm.daemon.supervisor - Finished downloading code for storm id test_lrb-1-1432017581 from /tmp/2da5b860-d270-4e94-9747-905f43ceb405/nimbus/stormdist/test_lrb-1-1432017581
08:39:42.836 [Thread-4] INFO backtype.storm.daemon.supervisor - Launching worker with assignment #backtype.storm.daemon.supervisor.LocalAssignment{:storm-id "test_lrb-1-1432017581", :executors ([2 2] [3 3] [4 4] [36 36] [5 5] [6 6] [7 7] [8 8] [9 9] [10 10] [11 11] [12 12] [13 13] [14 14] [15 15] [16 16] [17 17] [18 18] [19 19] [20 20] [21 21] [22 22] [23 23] [32 32] [1 1] [33 33] [34 35] [24 25] [26 27] [28 29] [30 31])} for this supervisor 4c6ffc14-14ed-431d-81c1-f9b1e4d7752d on port 1024 with id 885b78af-52ed-4e78-b876-4691cce54629
08:39:42.838 [Thread-4] INFO backtype.storm.daemon.worker - Launching worker for test_lrb-1-1432017581 on 4c6ffc14-14ed-431d-81c1-f9b1e4d7752d:1024 with id 885b78af-52ed-4e78-b876-4691cce54629 and conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "storm.messaging.netty.flush.check.interval.ms" 10, "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m", "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "/tmp/2ef68ceb-76aa-481c-abd9-a6fa2cfd89fa", "storm.messaging.netty.buffer_size" 5242880, "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64, "storm.meta.serialization.delegate" "backtype.storm.serialization.DefaultSerializationDelegate", "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000, "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" nil, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "drpc.queue.size" 128, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m", "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "storm.messaging.netty.max_retries" 300, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (1024 1025 1026), "topology.environment" nil, "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.worker.receiver.thread.count" 1, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.max.task.parallelism" nil, "storm.messaging.netty.transfer.batch.size" 262144, "topology.classpath" nil}
08:39:42.839 [Thread-4] INFO b.s.u.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
08:39:42.839 [Thread-4] INFO o.a.s.c.f.imps.CuratorFrameworkImpl - Starting
08:39:42.839 [Thread-4] INFO org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@5e195f10
08:39:42.841 [Thread-4-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
08:39:42.841 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:58782
08:39:42.841 [Thread-4-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
08:39:42.841 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:58782
08:39:42.845 [SyncThread:0] INFO o.a.s.z.server.ZooKeeperServer - Established session 0x14d6ae630b4000a with negotiated timeout 20000 for client /127.0.0.1:58782
08:39:42.845 [Thread-4-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14d6ae630b4000a, negotiated timeout = 20000
08:39:42.845 [Thread-4-EventThread] INFO o.a.s.c.f.s.ConnectionStateManager - State change: CONNECTED
08:39:42.845 [Thread-4-EventThread] INFO backtype.storm.zookeeper - Zookeeper state update: :connected:none
08:39:42.847 [ProcessThread(sid:0 cport:-1):] INFO o.a.s.z.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14d6ae630b4000a
08:39:42.848 [Thread-4] INFO org.apache.storm.zookeeper.ZooKeeper - Session: 0x14d6ae630b4000a closed
08:39:42.848 [Thread-4-EventThread] INFO o.apache.storm.zookeeper.ClientCnxn - EventThread shut down
08:39:42.852 [Thread-4] INFO b.s.u.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
08:39:42.852 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:58782 which had sessionid 0x14d6ae630b4000a
08:39:42.853 [Thread-4] INFO o.a.s.c.f.imps.CuratorFrameworkImpl - Starting
08:39:42.853 [Thread-4] INFO org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@6bb25f47
08:39:42.854 [Thread-4-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
08:39:42.854 [Thread-4-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
08:39:42.854 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:58783
08:39:42.854 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.z.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:58783
08:39:42.856 [SyncThread:0] INFO o.a.s.z.server.ZooKeeperServer - Established session 0x14d6ae630b4000b with negotiated timeout 20000 for client /127.0.0.1:58783
08:39:42.856 [Thread-4-SendThread(localhost:2000)] INFO o.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14d6ae630b4000b, negotiated timeout = 20000
08:39:42.856 [Thread-4-EventThread] INFO o.a.s.c.f.s.ConnectionStateManager - State change: CONNECTED
08:39:42.859 [Thread-4] INFO backtype.storm.daemon.worker - Reading Assignments.
java.io.FileNotFoundException: Could not locate carbonite/api__init.class or carbonite/api.clj on classpath:
at clojure.lang.RT.load(RT.java:443)
at clojure.lang.RT.load(RT.java:411)
at clojure.core$load$fn__5018.invoke(core.clj:5530)
at clojure.core$load.doInvoke(core.clj:5529)
at clojure.lang.RestFn.invoke(RestFn.java:408)
at clojure.core$load_one.invoke(core.clj:5336)
at clojure.core$load_lib$fn__4967.invoke(core.clj:5375)
at clojure.core$load_lib.doInvoke(core.clj:5374)
at clojure.lang.RestFn.applyTo(RestFn.java:142)
at clojure.core$apply.invoke(core.clj:619)
at clojure.core$load_libs.doInvoke(core.clj:5413)
at clojure.lang.RestFn.applyTo(RestFn.java:137)
at clojure.core$apply.invoke(core.clj:619)
at clojure.core$require.doInvoke(core.clj:5496)
at clojure.lang.RestFn.invoke(RestFn.java:408)
at clojure.lang.Var.invoke(Var.java:415)
at carbonite.JavaBridge.initialize(JavaBridge.java:24)
at carbonite.JavaBridge.registerPrimitives(JavaBridge.java:42)
at backtype.storm.serialization.SerializationFactory.getKryo(SerializationFactory.java:73)
at backtype.storm.serialization.KryoValuesDeserializer.<init>(KryoValuesDeserializer.java:33)
at backtype.storm.serialization.KryoTupleDeserializer.<init>(KryoTupleDeserializer.java:39)
at backtype.storm.daemon.executor$mk_executor_data$fn__3278.invoke(executor.clj:214)
at backtype.storm.util$assoc_apply_self.invoke(util.clj:850)
at backtype.storm.daemon.executor$mk_executor_data.invoke(executor.clj:214)
at backtype.storm.daemon.executor$mk_executor.invoke(executor.clj:319)
at backtype.storm.daemon.worker$fn__3743$exec_fn__1108__auto____3744$iter__3749__3753$fn__3754.invoke(worker.clj:382)
at clojure.lang.LazySeq.sval(LazySeq.java:42)
at clojure.lang.LazySeq.seq(LazySeq.java:60)
at clojure.lang.RT.seq(RT.java:484)
at clojure.core$seq.invoke(core.clj:133)
at clojure.core$dorun.invoke(core.clj:2780)
at clojure.core$doall.invoke(core.clj:2796)
at backtype.storm.daemon.worker$fn__3743$exec_fn__1108__auto____3744.invoke(worker.clj:382)
at clojure.lang.AFn.applyToHelper(AFn.java:185)
at clojure.lang.AFn.applyTo(AFn.java:151)
at clojure.core$apply.invoke(core.clj:617)
at backtype.storm.daemon.worker$fn__3743$mk_worker__3799.doInvoke(worker.clj:354)
at clojure.lang.RestFn.invoke(RestFn.java:512)
at backtype.storm.daemon.supervisor$fn__4277.invoke(supervisor.clj:590)
at clojure.lang.MultiFn.invoke(MultiFn.java:241)
at backtype.storm.daemon.supervisor$sync_processes$iter__4116__4120$fn__4121.invoke(supervisor.clj:285)
at clojure.lang.LazySeq.sval(LazySeq.java:42)
at clojure.lang.LazySeq.seq(LazySeq.java:60)
at clojure.lang.RT.seq(RT.java:484)
at clojure.core$seq.invoke(core.clj:133)
at clojure.core$dorun.invoke(core.clj:2780)
at clojure.core$doall.invoke(core.clj:2796)
at backtype.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:273)
at clojure.lang.AFn.applyToHelper(AFn.java:161)
at clojure.lang.AFn.applyTo(AFn.java:151)
at clojure.core$apply.invoke(core.clj:619)
at clojure.core$partial$fn__4190.doInvoke(core.clj:2396)
at clojure.lang.RestFn.invoke(RestFn.java:397)
at backtype.storm.event$event_manager$fn__2467.invoke(event.clj:40)
at clojure.lang.AFn.run(AFn.java:24)
at java.lang.Thread.run(Thread.java:745)
08:39:43.000 [Thread-4] ERROR backtype.storm.daemon.worker - Error on initialization of server mk-worker
java.lang.RuntimeException: java.lang.IllegalStateException: Attempting to call unbound fn: #'carbonite.api/register-serializers
at backtype.storm.serialization.SerializationFactory.getKryo(SerializationFactory.java:76) ~[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.serialization.KryoValuesDeserializer.<init>(KryoValuesDeserializer.java:33) ~[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.serialization.KryoTupleDeserializer.<init>(KryoTupleDeserializer.java:39) ~[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.daemon.executor$mk_executor_data$fn__3278.invoke(executor.clj:214) ~[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.util$assoc_apply_self.invoke(util.clj:850) ~[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.daemon.executor$mk_executor_data.invoke(executor.clj:214) ~[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.daemon.executor$mk_executor.invoke(executor.clj:319) ~[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.daemon.worker$fn__3743$exec_fn__1108__auto____3744$iter__3749__3753$fn__3754.invoke(worker.clj:382) ~[storm-core-0.9.3.jar:0.9.3]
at clojure.lang.LazySeq.sval(LazySeq.java:42) [clojure-1.5.1.jar:na]
at clojure.lang.LazySeq.seq(LazySeq.java:60) [clojure-1.5.1.jar:na]
at clojure.lang.RT.seq(RT.java:484) [clojure-1.5.1.jar:na]
at clojure.core$seq.invoke(core.clj:133) [clojure-1.5.1.jar:na]
at clojure.core$dorun.invoke(core.clj:2780) [clojure-1.5.1.jar:na]
at clojure.core$doall.invoke(core.clj:2796) [clojure-1.5.1.jar:na]
at backtype.storm.daemon.worker$fn__3743$exec_fn__1108__auto____3744.invoke(worker.clj:382) ~[storm-core-0.9.3.jar:0.9.3]
at clojure.lang.AFn.applyToHelper(AFn.java:185) [clojure-1.5.1.jar:na]
at clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na]
at clojure.core$apply.invoke(core.clj:617) [clojure-1.5.1.jar:na]
at backtype.storm.daemon.worker$fn__3743$mk_worker__3799.doInvoke(worker.clj:354) [storm-core-0.9.3.jar:0.9.3]
at clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.5.1.jar:na]
at backtype.storm.daemon.supervisor$fn__4277.invoke(supervisor.clj:590) [storm-core-0.9.3.jar:0.9.3]
at clojure.lang.MultiFn.invoke(MultiFn.java:241) [clojure-1.5.1.jar:na]
at backtype.storm.daemon.supervisor$sync_processes$iter__4116__4120$fn__4121.invoke(supervisor.clj:285) [storm-core-0.9.3.jar:0.9.3]
at clojure.lang.LazySeq.sval(LazySeq.java:42) [clojure-1.5.1.jar:na]
at clojure.lang.LazySeq.seq(LazySeq.java:60) [clojure-1.5.1.jar:na]
at clojure.lang.RT.seq(RT.java:484) [clojure-1.5.1.jar:na]
at clojure.core$seq.invoke(core.clj:133) [clojure-1.5.1.jar:na]
at clojure.core$dorun.invoke(core.clj:2780) [clojure-1.5.1.jar:na]
at clojure.core$doall.invoke(core.clj:2796) [clojure-1.5.1.jar:na]
at backtype.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:273) [storm-core-0.9.3.jar:0.9.3]
at clojure.lang.AFn.applyToHelper(AFn.java:161) [clojure-1.5.1.jar:na]
at clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na]
at clojure.core$apply.invoke(core.clj:619) [clojure-1.5.1.jar:na]
at clojure.core$partial$fn__4190.doInvoke(core.clj:2396) [clojure-1.5.1.jar:na]
at clojure.lang.RestFn.invoke(RestFn.java:397) [clojure-1.5.1.jar:na]
at backtype.storm.event$event_manager$fn__2467.invoke(event.clj:40) [storm-core-0.9.3.jar:0.9.3]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45-internal]
Caused by: java.lang.IllegalStateException: Attempting to call unbound fn: #'carbonite.api/register-serializers
at clojure.lang.Var$Unbound.throwArity(Var.java:43) ~[clojure-1.5.1.jar:na]
at clojure.lang.AFn.invoke(AFn.java:43) [clojure-1.5.1.jar:na]
at clojure.lang.Var.invoke(Var.java:419) ~[clojure-1.5.1.jar:na]
at carbonite.JavaBridge.registerPrimitives(JavaBridge.java:43) ~[carbonite-1.4.0.jar:na]
at backtype.storm.serialization.SerializationFactory.getKryo(SerializationFactory.java:73) ~[storm-core-0.9.3.jar:0.9.3]
... 37 common frames omitted
08:39:43.004 [Thread-4] ERROR backtype.storm.util - Halting process: ("Error on initialization")
java.lang.RuntimeException: ("Error on initialization")
at backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:325) [storm-core-0.9.3.jar:0.9.3]
at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.5.1.jar:na]
at backtype.storm.daemon.worker$fn__3743$mk_worker__3799.doInvoke(worker.clj:354) [storm-core-0.9.3.jar:0.9.3]
at clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.5.1.jar:na]
at backtype.storm.daemon.supervisor$fn__4277.invoke(supervisor.clj:590) [storm-core-0.9.3.jar:0.9.3]
at clojure.lang.MultiFn.invoke(MultiFn.java:241) [clojure-1.5.1.jar:na]
at backtype.storm.daemon.supervisor$sync_processes$iter__4116__4120$fn__4121.invoke(supervisor.clj:285) [storm-core-0.9.3.jar:0.9.3]
at clojure.lang.LazySeq.sval(LazySeq.java:42) [clojure-1.5.1.jar:na]
at clojure.lang.LazySeq.seq(LazySeq.java:60) [clojure-1.5.1.jar:na]
at clojure.lang.RT.seq(RT.java:484) [clojure-1.5.1.jar:na]
at clojure.core$seq.invoke(core.clj:133) [clojure-1.5.1.jar:na]
at clojure.core$dorun.invoke(core.clj:2780) [clojure-1.5.1.jar:na]
at clojure.core$doall.invoke(core.clj:2796) [clojure-1.5.1.jar:na]
at backtype.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:273) [storm-core-0.9.3.jar:0.9.3]
at clojure.lang.AFn.applyToHelper(AFn.java:161) [clojure-1.5.1.jar:na]
at clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na]
at clojure.core$apply.invoke(core.clj:619) [clojure-1.5.1.jar:na]
at clojure.core$partial$fn__4190.doInvoke(core.clj:2396) [clojure-1.5.1.jar:na]
at clojure.lang.RestFn.invoke(RestFn.java:397) [clojure-1.5.1.jar:na]
at backtype.storm.event$event_manager$fn__2467.invoke(event.clj:40) [storm-core-0.9.3.jar:0.9.3]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45-internal]
Results :
Tests run: 2, Failures: 0, Errors: 0, Skipped: 1
------------------------------------------------------------------------
BUILD FAILURE
------------------------------------------------------------------------
Total time: 11.970 s
Finished at: 2015-05-19T08:39:43+02:00
Final Memory: 30M/325M
------------------------------------------------------------------------
Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12.4:test (default-test) on project lrb: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12.4:test failed: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ? -> [Help 1]
To see the full stack trace of the errors, re-run Maven with the -e switch.
Re-run Maven using the -X switch to enable full debug logging.
For more information about the errors and possible solutions, please read the following articles:
[Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
Replace assembly.xml with maven-jar-plugin
Eliminate System.out
and replace with and slf4j logger (backed up by logback)
make TimestampOrderCheckerTest work with static logger in TimestampOrderChecker
If the logger is made static the mockito verification fails because the logger.error method is not invoked. It is almost certain that the test case has to be adjusted or redesigned (so that the invocation of the method is recognized).
Test Bolt.prepare
The
@Override
public void prepare(@SuppressWarnings("rawtypes") Map stormConf,
TopologyContext context,
OutputCollector collector) {
this.collector = collector;
}
idiom should cause failure of cluster setup if it isn't present. Shouldn't we test correct invokation nevertheless? I'd suggest
@Test
public void testPrepare() {
Map<?, ?> stormConf = null;
TopologyContext context = mock(TopologyContext.class);
OutputCollector collector = mock(OutputCollector.class);
AccidentNotificationBolt instance = new AccidentNotificationBolt();
instance.prepare(stormConf, context, collector);
assertEquals(collector, instance.getCollector());
}
We only need to expose Bolt.getCollector() with protected scope which is absolutely fine.
Setup code formatter
Due to the incapacity of the maven-checkstyle-plugin to check for tab character used for indentation (usage of tab character is a requirement) setup a code formatter. Candidates are
- https://github.com/velo/maven-formatter-plugin (might suffer from limited configuration)
uncrustify(can definitely do everything and could be configured withuniversalindentguiand run with maven ant plugin)
How do you want to deal with whitespace which has been created by IDE to help indentation but which is not used as such, e.g.
public class Clazz {
private String x = null;
xxxx
public Clazz(String x) {
this.x = x;
}
where xxxx would be one tab character or n spaces which breaks common patch format (e.g. git diff marks such whitespace red).
Thoughts?!
Update meta files
CONTRIBUTING.md (crustify not used any longer)
Why do we have COPYING and NOTICE ?
Can we remove codetemplates.xml ?
Make AccidentNotificationBolt listen to two streams
Currently it listens to one stream and seperates tuples for accident from accident detection bolt and vehicle tracking by evaluating tuples. Listening to seperate streams is much more elegant.
Check TestingApiDemo in storm-lib for useful integration test routines to extract
Just noticed https://github.com/xumingming/storm-lib/blob/master/src/jvm/storm/TestingApiDemo.java on the storm mailing list. It's worth a check, especially the shutdown routine with Runnables seems more elegant.
Get rid of unused branches
I merged everything needed into master branch. Branch code_review is still useful (and is up to date). Please, delete other branches if you don't need them any more.
Define a level of indentation and define it in check_style.xml
Please adjust
<property name="basicOffset" value="4" />
<!-- how far brace should be indented when on next line -->
<property name="braceAdjustment" value="0"/>
<!-- how much to indent a case label -->
<property name="caseIndent" value="4"/>
in Indentation module to a value you like (tabs are not supported by the checkstyle plugin because they're considered bad stylehttp://stackoverflow.com/questions/5678705/is-there-a-way-to-enforce-using-tabs-instead-of-spaces-in-java, please comment if you'd like to have those), pull e55196a or later, format your code with an IDE, a plugin, by hand, etc. before next merge. All future contributions should run mvn site and check that there're no checkstyle errors or target/site/checkstyle.html of each(!) subproject and fix them. At one point we might enforce failure if checkstyle errors occur.
We talked about what to use, I forgot it and find two spaces and tab in your code.
Implement storage interface for daily expenditure requests
"Given the
approximately 150,000 vehicles generated in a 3 hour sim-
ulation, this amounts to 150, 000 · L · 70 (roughly between
10 million and 100 million) rows." -> storage in a file will definitely become a bottleneck if we start scaling with L. Better abstract an interface early to plug in a database (embedded or with a network driver) instead of a file later (database backend doesn't need to be implemented before trouble occurs).
Database storage should occur with Java Persistence API after encapsulating toll account better then with Map<Integer, Map<Pair<Integer, Integer>, Integer>>.
Update/add HACKING with information where to synchronize storm conf map keys
Those should be stored and be accessible in one place in order to KISS and avoid (very improbable) duplicate usage.
Convert all tuple and stream structure checks to assertions
Checks in Bolt.execute and other methods for length of Tuples, types of Tuple fields and source streams make the live of developers more easy (by letting the application crash on check failure rather than constantly keep the bolt output scheme in mind), but should be optional and the user should be able to disable them in gain thoughput. Existing checks should be converted to asserts and missing check be added as assertions.
Figure out use of different timers in incorporated source code
The incorporated source code contains different timers ("systemTimer", "stormTimer", "time") which are undocumented. The number should be reduced to a minimum to increase maintainability.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.