Storm编程入门API系列之Storm的定时任务实现

时间:2023-01-22 22:17:53

  

  概念,见博客

Storm概念学习系列之storm的定时任务

  Storm的定时任务,分为两种实现方式,都是可以达到目的的。

  我这里,分为StormTopologyTimer1.java   和  StormTopologyTimer2.java

  编写代码StormTopologyTimer1.java

  我这里,用的是shuffleGrouping方式。若大家不懂的话,见我下面的博客

Storm编程入门API系列之Storm的Topology的stream grouping

    //设置定时任务
config.put(Config.TOPOLOGY_TICK_TUPLE_FREQ_SECS, );//表示storm每隔10秒都会给topology里面的所有bolt发送一个系统级别的tuple
String topology_name = StormTopologyTimer1.class.getSimpleName();

Storm编程入门API系列之Storm的定时任务实现

package zhouls.bigdata.stormDemo;

import java.util.Map;

import org.apache.storm.Config;
import org.apache.storm.Constants;
import org.apache.storm.LocalCluster;
import org.apache.storm.StormSubmitter;
import org.apache.storm.generated.AlreadyAliveException;
import org.apache.storm.generated.AuthorizationException;
import org.apache.storm.generated.InvalidTopologyException;
import org.apache.storm.spout.SpoutOutputCollector;
import org.apache.storm.task.OutputCollector;
import org.apache.storm.task.TopologyContext;
import org.apache.storm.topology.OutputFieldsDeclarer;
import org.apache.storm.topology.TopologyBuilder;
import org.apache.storm.topology.base.BaseRichBolt;
import org.apache.storm.topology.base.BaseRichSpout;
import org.apache.storm.tuple.Fields;
import org.apache.storm.tuple.Tuple;
import org.apache.storm.tuple.Values;
import org.apache.storm.utils.Utils; public class StormTopologyTimer1 { public static class MySpout extends BaseRichSpout{
private Map conf;
private TopologyContext context;
private SpoutOutputCollector collector; public void open(Map conf, TopologyContext context,
SpoutOutputCollector collector) {
this.conf = conf;
this.collector = collector;
this.context = context;
} int num = ; public void nextTuple() {
num++;
System.out.println("spout:"+num);
this.collector.emit(new Values(num));
Utils.sleep();
} public void declareOutputFields(OutputFieldsDeclarer declarer) {
declarer.declare(new Fields("num"));
} } public static class MyBolt extends BaseRichBolt{ private Map stormConf;
private TopologyContext context;
private OutputCollector collector; public void prepare(Map stormConf, TopologyContext context,
OutputCollector collector) {
this.stormConf = stormConf;
this.context = context;
this.collector = collector;
} int sum = ; public void execute(Tuple input) {
if(input.getSourceComponent().equals(Constants.SYSTEM_COMPONENT_ID)){
System.out.println("定时时间到了");
}else{
Integer num = input.getIntegerByField("num");
sum += num;
System.out.println("sum="+sum);
}
} public void declareOutputFields(OutputFieldsDeclarer declarer) { } } public static void main(String[] args) {
TopologyBuilder topologyBuilder = new TopologyBuilder();
String spout_id = MySpout.class.getSimpleName();
String bolt_id = MyBolt.class.getSimpleName(); topologyBuilder.setSpout(spout_id, new MySpout());
topologyBuilder.setBolt(bolt_id, new MyBolt()).shuffleGrouping(spout_id); Config config = new Config();
//设置定时任务
config.put(Config.TOPOLOGY_TICK_TUPLE_FREQ_SECS, );//表示storm每隔10秒都会给topology里面的所有bolt发送一个系统级别的tuple
String topology_name = StormTopologyTimer1.class.getSimpleName();
if(args.length==){
//在本地运行
LocalCluster localCluster = new LocalCluster();
localCluster.submitTopology(topology_name, config, topologyBuilder.createTopology());
}else{
//在集群运行
try {
StormSubmitter.submitTopology(topology_name, config, topologyBuilder.createTopology());
} catch (AlreadyAliveException e) {
e.printStackTrace();
} catch (InvalidTopologyException e) {
e.printStackTrace();
} catch (AuthorizationException e) {
e.printStackTrace();
}
} } }

Storm编程入门API系列之Storm的定时任务实现

  Storm编程入门API系列之Storm的定时任务实现

  停掉,我们复制粘贴来分析分析

Storm编程入门API系列之Storm的定时任务实现

Storm编程入门API系列之Storm的定时任务实现

 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:zookeeper.version=3.4.-, built on // : GMT
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:host.name=WIN-BQOBV63OBNM
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.version=1.8.0_66
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.vendor=Oracle Corporation
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.home=C:\Program Files\Java\jre1..0_66
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.class.path=D:\Code\eclipseMarsCode\stormDemo\target\classes;D:\SoftWare\maven\repository\org\apache\storm\storm-core\1.0.\storm-core-1.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\kryo\3.0.\kryo-3.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\reflectasm\1.10.\reflectasm-1.10..jar;D:\SoftWare\maven\repository\org\ow2\asm\asm\5.0.\asm-5.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\minlog\1.3.\minlog-1.3..jar;D:\SoftWare\maven\repository\org\objenesis\objenesis\2.1\objenesis-2.1.jar;D:\SoftWare\maven\repository\org\clojure\clojure\1.7.\clojure-1.7..jar;D:\SoftWare\maven\repository\com\lmax\disruptor\3.3.\disruptor-3.3..jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-api\2.1\log4j-api-2.1.jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-core\2.1\log4j-core-2.1.jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-slf4j-impl\2.1\log4j-slf4j-impl-2.1.jar;D:\SoftWare\maven\repository\org\slf4j\log4j-over-slf4j\1.6.\log4j-over-slf4j-1.6..jar;D:\SoftWare\maven\repository\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;D:\SoftWare\maven\repository\org\slf4j\slf4j-api\1.7.\slf4j-api-1.7..jar
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.library.path=C:\Program Files\Java\jre1..0_66\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:/Program Files/Java/jre1..0_66/bin/server;C:/Program Files/Java/jre1..0_66/bin;C:/Program Files/Java/jre1..0_66/lib/amd64;%WEKA39_HOME%\lib\mysql-connector-java-5.1.-bin.jar;%WEKA37_HOME%\lib\mysql-connector-java-5.1.-bin.jar;C:\Program Files\Java\jdk1..0_66\jre\lib\ext\mysql-connector-java-5.1.-bin.jar;C:\ProgramData\Oracle\Java\javapath;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.\;D:\SoftWare\MATLAB R2013a\runtime\win64;D:\SoftWare\MATLAB R2013a\bin;C:\Program Files (x86)\IDM Computer Solutions\UltraCompare;C:\Program Files\Java\jdk1..0_66\bin;C:\Program Files\Java\jdk1..0_66\jre\bin;D:\SoftWare\apache-ant-1.9.\bin;HADOOP_HOME\bin;D:\SoftWare\apache-maven-3.3.\bin;D:\SoftWare\Scala\bin;D:\SoftWare\Scala\jre\bin;%MYSQL_HOME\bin;D:\SoftWare\MySQL\mysql-5.7.-winx64;;D:\SoftWare\apache-tomcat-7.0.\bin;%C:\Windows\System32;%C:\Windows\SysWOW64;;D:\SoftWare\apache-maven-3.3.\bin;D:\SoftWare\apache-tomcat-7.0.\bin;D:\SoftWare\apache-tomcat-7.0.\bin;D:\SoftWare\Anaconda2;D:\SoftWare\Anaconda2\Scripts;D:\SoftWare\Anaconda2\Library\bin;D:\SoftWare\MySQL Server\MySQL Server 5.0\bin;D:\SoftWare\Python\Python36\Scripts\;D:\SoftWare\Python\Python36\;D:\SoftWare\SSH Secure Shell;D:\SoftWare\eclipse;;.
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.io.tmpdir=C:\Users\ADMINI~\AppData\Local\Temp\
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.compiler=<NA>
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:os.name=Windows
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:os.arch=amd64
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:os.version=6.1
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:user.name=Administrator
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:user.home=C:\Users\Administrator
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:user.dir=D:\Code\eclipseMarsCode\stormDemo
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Created server with tickTime minSessionTimeout maxSessionTimeout datadir C:\Users\ADMINI~\AppData\Local\Temp\32d8c475-84fc-4fb3-baff-b04ab7a8dc5c\version- snapdir C:\Users\ADMINI~\AppData\Local\Temp\32d8c475-84fc-4fb3-baff-b04ab7a8dc5c\version-
[main] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - binding to port 0.0.0.0/0.0.0.0:
[main] INFO o.a.s.zookeeper - Starting inprocess zookeeper at port and dir C:\Users\ADMINI~\AppData\Local\Temp\32d8c475-84fc-4fb3-baff-b04ab7a8dc5c
[main] INFO o.a.s.d.nimbus - Starting Nimbus with conf {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\fcc1cd09-238a-499f-967b-da2e3564a331", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" [ ], "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:zookeeper.version=3.4.-, built on // : GMT
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:host.name=WIN-BQOBV63OBNM
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.version=1.8.0_66
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.vendor=Oracle Corporation
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.home=C:\Program Files\Java\jre1..0_66
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.class.path=D:\Code\eclipseMarsCode\stormDemo\target\classes;D:\SoftWare\maven\repository\org\apache\storm\storm-core\1.0.\storm-core-1.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\kryo\3.0.\kryo-3.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\reflectasm\1.10.\reflectasm-1.10..jar;D:\SoftWare\maven\repository\org\ow2\asm\asm\5.0.\asm-5.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\minlog\1.3.\minlog-1.3..jar;D:\SoftWare\maven\repository\org\objenesis\objenesis\2.1\objenesis-2.1.jar;D:\SoftWare\maven\repository\org\clojure\clojure\1.7.\clojure-1.7..jar;D:\SoftWare\maven\repository\com\lmax\disruptor\3.3.\disruptor-3.3..jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-api\2.1\log4j-api-2.1.jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-core\2.1\log4j-core-2.1.jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-slf4j-impl\2.1\log4j-slf4j-impl-2.1.jar;D:\SoftWare\maven\repository\org\slf4j\log4j-over-slf4j\1.6.\log4j-over-slf4j-1.6..jar;D:\SoftWare\maven\repository\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;D:\SoftWare\maven\repository\org\slf4j\slf4j-api\1.7.\slf4j-api-1.7..jar
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.library.path=C:\Program Files\Java\jre1..0_66\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:/Program Files/Java/jre1..0_66/bin/server;C:/Program Files/Java/jre1..0_66/bin;C:/Program Files/Java/jre1..0_66/lib/amd64;%WEKA39_HOME%\lib\mysql-connector-java-5.1.-bin.jar;%WEKA37_HOME%\lib\mysql-connector-java-5.1.-bin.jar;C:\Program Files\Java\jdk1..0_66\jre\lib\ext\mysql-connector-java-5.1.-bin.jar;C:\ProgramData\Oracle\Java\javapath;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.\;D:\SoftWare\MATLAB R2013a\runtime\win64;D:\SoftWare\MATLAB R2013a\bin;C:\Program Files (x86)\IDM Computer Solutions\UltraCompare;C:\Program Files\Java\jdk1..0_66\bin;C:\Program Files\Java\jdk1..0_66\jre\bin;D:\SoftWare\apache-ant-1.9.\bin;HADOOP_HOME\bin;D:\SoftWare\apache-maven-3.3.\bin;D:\SoftWare\Scala\bin;D:\SoftWare\Scala\jre\bin;%MYSQL_HOME\bin;D:\SoftWare\MySQL\mysql-5.7.-winx64;;D:\SoftWare\apache-tomcat-7.0.\bin;%C:\Windows\System32;%C:\Windows\SysWOW64;;D:\SoftWare\apache-maven-3.3.\bin;D:\SoftWare\apache-tomcat-7.0.\bin;D:\SoftWare\apache-tomcat-7.0.\bin;D:\SoftWare\Anaconda2;D:\SoftWare\Anaconda2\Scripts;D:\SoftWare\Anaconda2\Library\bin;D:\SoftWare\MySQL Server\MySQL Server 5.0\bin;D:\SoftWare\Python\Python36\Scripts\;D:\SoftWare\Python\Python36\;D:\SoftWare\SSH Secure Shell;D:\SoftWare\eclipse;;.
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.io.tmpdir=C:\Users\ADMINI~\AppData\Local\Temp\
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.compiler=<NA>
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:os.name=Windows
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:os.arch=amd64
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:os.version=6.1
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:user.name=Administrator
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:user.home=C:\Users\Administrator
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:user.dir=D:\Code\eclipseMarsCode\stormDemo
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@3330f3ad
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[main] INFO o.a.s.b.FileBlobStoreImpl - Creating new blob store based in C:\Users\ADMINI~\AppData\Local\Temp\fcc1cd09-238a-499f-967b-da2e3564a331\blobs
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main] INFO o.a.s.d.nimbus - Using default scheduler
[SyncThread:] INFO o.a.s.s.o.a.z.s.p.FileTxnLog - Creating new log file: log.
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@32f96bba
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@3a2e9f5b
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f52580000 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f52580000, negotiated timeout =
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f52580001 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f52580001, negotiated timeout =
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f52580002 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f52580002, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d880f52580002
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d880f52580002 closed
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d880f52580002
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@3e1fd62b
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@40de8f93
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f52580003, negotiated timeout =
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f52580003 with negotiated timeout for client /127.0.0.1:
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f52580004, negotiated timeout =
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f52580004 with negotiated timeout for client /127.0.0.1:
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main] INFO o.a.s.zookeeper - Queued up for leader lock.
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Got user-level KeeperException when processing sessionid:0x15d880f52580001 type:create cxid:0x1 zxid:0x12 txntype:- reqpath:n/a Error Path:/storm/leader-lock Error:KeeperErrorCode = NoNode for /storm/leader-lock
[Curator-Framework-] WARN o.a.s.s.o.a.c.u.ZKPaths - The version of ZooKeeper being used doesn't support Container nodes. CreateMode.PERSISTENT will be used instead.
[main] INFO o.a.s.d.m.MetricsUtils - Using statistics reporter plugin:org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter
[main] INFO o.a.s.d.m.r.JmxPreparableReporter - Preparing...
[main] INFO o.a.s.d.common - Started statistics report plugin...
[main-EventThread] INFO o.a.s.zookeeper - WIN-BQOBV63OBNM gained leadership, checking if it has all the topology code locally.
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@889a8a8
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f52580005 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f52580005, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[main-EventThread] INFO o.a.s.zookeeper - active-topology-ids [] local-topology-ids [] diff-topology []
[main-EventThread] INFO o.a.s.zookeeper - Accepting leadership, all active topology found localy.
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d880f52580005
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d880f52580005 closed
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d880f52580005
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@d919544
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@4eea94a4
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f52580006 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f52580006, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f52580007 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f52580007, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d880f52580007
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d880f52580007 closed
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d880f52580007
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@f8a6243
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f52580008 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f52580008, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main] INFO o.a.s.d.supervisor - Starting Supervisor with conf {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\ee27d0b2-acb3-4e6d-bc2b-fccd2bd03438", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" ( ), "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[main] INFO o.a.s.l.Localizer - Reconstruct localized resource: C:\Users\ADMINI~\AppData\Local\Temp\ee27d0b2-acb3-4e6d-bc2b-fccd2bd03438\supervisor\usercache
[main] WARN o.a.s.l.Localizer - No left over resources found for any user during reconstructing of local resources at: C:\Users\ADMINI~\AppData\Local\Temp\ee27d0b2-acb3-4e6d-bc2b-fccd2bd03438\supervisor\usercache
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@78ec89a6
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f52580009 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f52580009, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d880f52580009
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d880f52580009 closed
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@642ee49c
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] WARN o.a.s.s.o.a.z.s.NIOServerCnxn - caught end of stream exception
org.apache.storm.shade.org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client sessionid 0x15d880f52580009, likely client has closed socket
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:) [storm-core-1.0..jar:1.0.]
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:) [storm-core-1.0..jar:1.0.]
at java.lang.Thread.run(Unknown Source) [?:1.8.0_66]
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d880f52580009
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f5258000a with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f5258000a, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main] INFO o.a.s.d.supervisor - Starting supervisor with id 69e4ec2d-f43f-458c-b65f-563a0a1a3094 at host WIN-BQOBV63OBNM
[main] INFO o.a.s.d.supervisor - Starting Supervisor with conf {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\4a59ac17-0114-497f-8254-9ae1ae28a531", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" ( ), "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[main] INFO o.a.s.l.Localizer - Reconstruct localized resource: C:\Users\ADMINI~\AppData\Local\Temp\4a59ac17--497f--9ae1ae28a531\supervisor\usercache
[main] WARN o.a.s.l.Localizer - No left over resources found for any user during reconstructing of local resources at: C:\Users\ADMINI~\AppData\Local\Temp\4a59ac17--497f--9ae1ae28a531\supervisor\usercache
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@1290ed28
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f5258000b with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f5258000b, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d880f5258000b
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d880f5258000b closed
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@29050de5
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] WARN o.a.s.s.o.a.z.s.NIOServerCnxn - caught end of stream exception
org.apache.storm.shade.org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client sessionid 0x15d880f5258000b, likely client has closed socket
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:) [storm-core-1.0..jar:1.0.]
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:) [storm-core-1.0..jar:1.0.]
at java.lang.Thread.run(Unknown Source) [?:1.8.0_66]
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d880f5258000b
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f5258000c with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f5258000c, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main] INFO o.a.s.d.supervisor - Starting supervisor with id 121423ef-8c7e-4a2d-b149-1b1b15c58907 at host WIN-BQOBV63OBNM
[main] INFO o.a.s.l.ThriftAccessLogger - Request ID: access from: principal: operation: submitTopology
[main] INFO o.a.s.d.nimbus - Received topology submission for StormTopologyTimer1 with conf {"topology.max.task.parallelism" nil, "topology.submitter.principal" "", "topology.acker.executors" nil, "topology.eventlogger.executors" , "storm.zookeeper.superACL" nil, "topology.users" (), "topology.submitter.user" "Administrator", "topology.tick.tuple.freq.secs" , "topology.kryo.register" nil, "topology.kryo.decorators" (), "storm.id" "StormTopologyTimer1-1-1501226298", "topology.name" "StormTopologyTimer1"}
[main] INFO o.a.s.d.nimbus - uploadedJar
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@718f805a
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f5258000d with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f5258000d, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Got user-level KeeperException when processing sessionid:0x15d880f5258000d type:create cxid:0x2 zxid:0x26 txntype:- reqpath:n/a Error Path:/storm/blobstoremaxkeysequencenumber Error:KeeperErrorCode = NoNode for /storm/blobstoremaxkeysequencenumber
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d880f5258000d
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] WARN o.a.s.s.o.a.z.s.NIOServerCnxn - caught end of stream exception
org.apache.storm.shade.org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client sessionid 0x15d880f5258000d, likely client has closed socket
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:) [storm-core-1.0..jar:1.0.]
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:) [storm-core-1.0..jar:1.0.]
at java.lang.Thread.run(Unknown Source) [?:1.8.0_66]
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d880f5258000d closed
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d880f5258000d
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main] INFO o.a.s.cluster - setup-path/blobstore/StormTopologyTimer1---stormconf.ser/WIN-BQOBV63OBNM:-
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@4735d6e5
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f5258000e with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f5258000e, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d880f5258000e
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d880f5258000e closed
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d880f5258000e
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main] INFO o.a.s.cluster - setup-path/blobstore/StormTopologyTimer1---stormcode.ser/WIN-BQOBV63OBNM:-
[main] INFO o.a.s.d.nimbus - desired replication count achieved, current-replication-count for conf key = , current-replication-count for code key = , current-replication-count for jar key =
[main] INFO o.a.s.d.nimbus - Activating StormTopologyTimer1: StormTopologyTimer1--
[timer] INFO o.a.s.s.EvenScheduler - Available slots: (["121423ef-8c7e-4a2d-b149-1b1b15c58907" ] ["121423ef-8c7e-4a2d-b149-1b1b15c58907" ] ["121423ef-8c7e-4a2d-b149-1b1b15c58907" ] ["69e4ec2d-f43f-458c-b65f-563a0a1a3094" ] ["69e4ec2d-f43f-458c-b65f-563a0a1a3094" ] ["69e4ec2d-f43f-458c-b65f-563a0a1a3094" ])
[timer] INFO o.a.s.d.nimbus - Setting new assignment for topology id StormTopologyTimer1--: #org.apache.storm.daemon.common.Assignment{:master-code-dir "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\fcc1cd09-238a-499f-967b-da2e3564a331", :node->host {"121423ef-8c7e-4a2d-b149-1b1b15c58907" "WIN-BQOBV63OBNM"}, :executor->node+port {[ ] ["121423ef-8c7e-4a2d-b149-1b1b15c58907" ], [ ] ["121423ef-8c7e-4a2d-b149-1b1b15c58907" ], [ ] ["121423ef-8c7e-4a2d-b149-1b1b15c58907" ]}, :executor->start-time-secs {[ ] , [ ] , [ ] }, :worker->resources {["121423ef-8c7e-4a2d-b149-1b1b15c58907" ] [0.0 0.0 0.0]}}
[Thread-] INFO o.a.s.d.supervisor - Downloading code for storm id StormTopologyTimer1--
[Thread-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@3eb818f8
[Thread-] INFO o.a.s.b.FileBlobStoreImpl - Creating new blob store based in C:\Users\ADMINI~\AppData\Local\Temp\fcc1cd09-238a-499f-967b-da2e3564a331\blobs
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f5258000f with negotiated timeout for client /127.0.0.1:
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f5258000f, negotiated timeout =
[Thread--EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d880f5258000f
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d880f5258000f closed
[Thread--EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d880f5258000f
[Thread-] INFO o.a.s.d.supervisor - Finished downloading code for storm id StormTopologyTimer1--
[Thread-] INFO o.a.s.d.supervisor - Launching worker with assignment {:storm-id "StormTopologyTimer1-1-1501226298", :executors [[ ] [ ] [ ]], :resources #object[org.apache.storm.generated.WorkerResources 0x7b1f583d "WorkerResources(mem_on_heap:0.0, mem_off_heap:0.0, cpu:0.0)"]} for this supervisor 121423ef-8c7e-4a2d-b149-1b1b15c58907 on port with id 1f2b5f14--43ac-878e-3cc52c3af546
[Thread-] INFO o.a.s.d.worker - Launching worker for StormTopologyTimer1-- on 121423ef-8c7e-4a2d-b149-1b1b15c58907: with id 1f2b5f14--43ac-878e-3cc52c3af546 and conf {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\4a59ac17-0114-497f-8254-9ae1ae28a531", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" ( ), "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[Thread-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@1a782438
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f52580010 with negotiated timeout for client /127.0.0.1:
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f52580010, negotiated timeout =
[Thread--EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[Thread--EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d880f52580010
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d880f52580010 closed
[Thread--EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d880f52580010
[Thread-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@64d6a1d9
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d880f52580011 with negotiated timeout for client /127.0.0.1:
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d880f52580011, negotiated timeout =
[Thread--EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[Thread-] INFO o.a.s.s.a.AuthUtils - Got AutoCreds []
[Thread-] INFO o.a.s.d.worker - Reading Assignments.
[Thread-] INFO o.a.s.d.worker - Registering IConnectionCallbacks for 121423ef-8c7e-4a2d-b149-1b1b15c58907:
[Thread-] INFO o.a.s.d.executor - Loading executor MySpout:[ ]
[Thread-] INFO o.a.s.d.executor - Loaded executor tasks MySpout:[ ]
[refresh-active-timer] INFO o.a.s.d.worker - All connections are ready for worker 121423ef-8c7e-4a2d-b149-1b1b15c58907: with id 1f2b5f14--43ac-878e-3cc52c3af546
[Thread-] INFO o.a.s.d.executor - Finished loading executor MySpout:[ ]
[Thread-] INFO o.a.s.d.executor - Loading executor __acker:[ ]
[Thread-] INFO o.a.s.d.executor - Loaded executor tasks __acker:[ ]
[Thread-] INFO o.a.s.d.executor - Timeouts disabled for executor __acker:[ ]
[Thread-] INFO o.a.s.d.executor - Finished loading executor __acker:[ ]
[Thread-] INFO o.a.s.d.executor - Loading executor MyBolt:[ ]
[Thread-] INFO o.a.s.d.executor - Loaded executor tasks MyBolt:[ ]
[Thread-] INFO o.a.s.d.executor - Finished loading executor MyBolt:[ ]
[Thread-] INFO o.a.s.d.executor - Loading executor __system:[- -]
[Thread-] INFO o.a.s.d.executor - Loaded executor tasks __system:[- -]
[Thread-] INFO o.a.s.d.executor - Timeouts disabled for executor __system:[- -]
[Thread-] INFO o.a.s.d.executor - Finished loading executor __system:[- -]
[Thread-] INFO o.a.s.d.worker - Started with log levels: {"" #object[org.apache.logging.log4j.Level 0x126958a3 "INFO"], "org.apache.zookeeper" #object[org.apache.logging.log4j.Level 0x5f681a7b "WARN"]}
[Thread-] INFO o.a.s.d.worker - Worker has topology config {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "topology.submitter.principal" "", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\fcc1cd09-238a-499f-967b-da2e3564a331", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "storm.zookeeper.superACL" nil, "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" [ ], "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "topology.users" [], "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.submitter.user" "Administrator", "topology.tick.tuple.freq.secs" , "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "topology.kryo.register" nil, "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "topology.kryo.decorators" [], "storm.id" "StormTopologyTimer1-1-1501226298", "topology.name" "StormTopologyTimer1", "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[Thread-] INFO o.a.s.d.worker - Worker 1f2b5f14--43ac-878e-3cc52c3af546 for storm StormTopologyTimer1-- on 121423ef-8c7e-4a2d-b149-1b1b15c58907: has finished loading
[Thread-] INFO o.a.s.config - SET worker-user 1f2b5f14--43ac-878e-3cc52c3af546
[Thread--__system-executor[- -]] INFO o.a.s.d.executor - Preparing bolt __system:(-)
[Thread--__acker-executor[ ]] INFO o.a.s.d.executor - Preparing bolt __acker:()
[Thread--MyBolt-executor[ ]] INFO o.a.s.d.executor - Preparing bolt MyBolt:()
[Thread--MyBolt-executor[ ]] INFO o.a.s.d.executor - Prepared bolt MyBolt:()
[Thread--MySpout-executor[ ]] INFO o.a.s.d.executor - Opening spout MySpout:()
[Thread--__system-executor[- -]] INFO o.a.s.d.executor - Prepared bolt __system:(-)
[Thread--MySpout-executor[ ]] INFO o.a.s.d.executor - Opened spout MySpout:()
[Thread--__acker-executor[ ]] INFO o.a.s.d.executor - Prepared bolt __acker:()
[Thread--MySpout-executor[ ]] INFO o.a.s.d.executor - Activating spout MySpout:()
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=

  编写代码

StormTopologyTimer2.java

Storm编程入门API系列之Storm的定时任务实现

package zhouls.bigdata.stormDemo;

import java.util.HashMap;
import java.util.Map; import org.apache.storm.Config;
import org.apache.storm.Constants;
import org.apache.storm.LocalCluster;
import org.apache.storm.StormSubmitter;
import org.apache.storm.generated.AlreadyAliveException;
import org.apache.storm.generated.AuthorizationException;
import org.apache.storm.generated.InvalidTopologyException;
import org.apache.storm.spout.SpoutOutputCollector;
import org.apache.storm.task.OutputCollector;
import org.apache.storm.task.TopologyContext;
import org.apache.storm.topology.OutputFieldsDeclarer;
import org.apache.storm.topology.TopologyBuilder;
import org.apache.storm.topology.base.BaseRichBolt;
import org.apache.storm.topology.base.BaseRichSpout;
import org.apache.storm.tuple.Fields;
import org.apache.storm.tuple.Tuple;
import org.apache.storm.tuple.Values;
import org.apache.storm.utils.Utils; public class StormTopologyTimer2 { public static class MySpout extends BaseRichSpout{
private Map conf;
private TopologyContext context;
private SpoutOutputCollector collector; public void open(Map conf, TopologyContext context,
SpoutOutputCollector collector) {
this.conf = conf;
this.collector = collector;
this.context = context;
} int num = ; public void nextTuple() {
num++;
System.out.println("spout:"+num);
this.collector.emit(new Values(num));
Utils.sleep();
} public void declareOutputFields(OutputFieldsDeclarer declarer) {
declarer.declare(new Fields("num"));
} } public static class MyBolt extends BaseRichBolt{ private Map stormConf;
private TopologyContext context;
private OutputCollector collector; public void prepare(Map stormConf, TopologyContext context,
OutputCollector collector) {
this.stormConf = stormConf;
this.context = context;
this.collector = collector;
} int sum = ; public void execute(Tuple input) {
if(input.getSourceComponent().equals(Constants.SYSTEM_COMPONENT_ID)){
System.out.println("定时时间到了");
}else{
Integer num = input.getIntegerByField("num");
sum += num;
System.out.println("sum="+sum);
}
} public void declareOutputFields(OutputFieldsDeclarer declarer) { } public Map<String, Object> getComponentConfiguration() {
HashMap<String, Object> hashMap = new HashMap<String, Object>();
hashMap.put(Config.TOPOLOGY_TICK_TUPLE_FREQ_SECS, );//给当前bolt设置定时任务
return hashMap;
} } public static void main(String[] args) {
TopologyBuilder topologyBuilder = new TopologyBuilder();
String spout_id = MySpout.class.getSimpleName();
String bolt_id = MyBolt.class.getSimpleName(); topologyBuilder.setSpout(spout_id, new MySpout());
topologyBuilder.setBolt(bolt_id, new MyBolt()).shuffleGrouping(spout_id); Config config = new Config();
String topology_name = StormTopologyTimer2.class.getSimpleName();
if(args.length==){
//在本地运行
LocalCluster localCluster = new LocalCluster();
localCluster.submitTopology(topology_name, config, topologyBuilder.createTopology());
}else{
//在集群运行
try {
StormSubmitter.submitTopology(topology_name, config, topologyBuilder.createTopology());
} catch (AlreadyAliveException e) {
e.printStackTrace();
} catch (InvalidTopologyException e) {
e.printStackTrace();
} catch (AuthorizationException e) {
e.printStackTrace();
}
} } }

Storm编程入门API系列之Storm的定时任务实现

Storm编程入门API系列之Storm的定时任务实现

  停掉,复制粘贴分析分析

Storm编程入门API系列之Storm的定时任务实现

Storm编程入门API系列之Storm的定时任务实现

 [main] INFO  o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:zookeeper.version=3.4.-, built on // : GMT
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:host.name=WIN-BQOBV63OBNM
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.version=1.8.0_66
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.vendor=Oracle Corporation
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.home=C:\Program Files\Java\jre1..0_66
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.class.path=D:\Code\eclipseMarsCode\stormDemo\target\classes;D:\SoftWare\maven\repository\org\apache\storm\storm-core\1.0.\storm-core-1.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\kryo\3.0.\kryo-3.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\reflectasm\1.10.\reflectasm-1.10..jar;D:\SoftWare\maven\repository\org\ow2\asm\asm\5.0.\asm-5.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\minlog\1.3.\minlog-1.3..jar;D:\SoftWare\maven\repository\org\objenesis\objenesis\2.1\objenesis-2.1.jar;D:\SoftWare\maven\repository\org\clojure\clojure\1.7.\clojure-1.7..jar;D:\SoftWare\maven\repository\com\lmax\disruptor\3.3.\disruptor-3.3..jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-api\2.1\log4j-api-2.1.jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-core\2.1\log4j-core-2.1.jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-slf4j-impl\2.1\log4j-slf4j-impl-2.1.jar;D:\SoftWare\maven\repository\org\slf4j\log4j-over-slf4j\1.6.\log4j-over-slf4j-1.6..jar;D:\SoftWare\maven\repository\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;D:\SoftWare\maven\repository\org\slf4j\slf4j-api\1.7.\slf4j-api-1.7..jar
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.library.path=C:\Program Files\Java\jre1..0_66\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:/Program Files/Java/jre1..0_66/bin/server;C:/Program Files/Java/jre1..0_66/bin;C:/Program Files/Java/jre1..0_66/lib/amd64;%WEKA39_HOME%\lib\mysql-connector-java-5.1.-bin.jar;%WEKA37_HOME%\lib\mysql-connector-java-5.1.-bin.jar;C:\Program Files\Java\jdk1..0_66\jre\lib\ext\mysql-connector-java-5.1.-bin.jar;C:\ProgramData\Oracle\Java\javapath;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.\;D:\SoftWare\MATLAB R2013a\runtime\win64;D:\SoftWare\MATLAB R2013a\bin;C:\Program Files (x86)\IDM Computer Solutions\UltraCompare;C:\Program Files\Java\jdk1..0_66\bin;C:\Program Files\Java\jdk1..0_66\jre\bin;D:\SoftWare\apache-ant-1.9.\bin;HADOOP_HOME\bin;D:\SoftWare\apache-maven-3.3.\bin;D:\SoftWare\Scala\bin;D:\SoftWare\Scala\jre\bin;%MYSQL_HOME\bin;D:\SoftWare\MySQL\mysql-5.7.-winx64;;D:\SoftWare\apache-tomcat-7.0.\bin;%C:\Windows\System32;%C:\Windows\SysWOW64;;D:\SoftWare\apache-maven-3.3.\bin;D:\SoftWare\apache-tomcat-7.0.\bin;D:\SoftWare\apache-tomcat-7.0.\bin;D:\SoftWare\Anaconda2;D:\SoftWare\Anaconda2\Scripts;D:\SoftWare\Anaconda2\Library\bin;D:\SoftWare\MySQL Server\MySQL Server 5.0\bin;D:\SoftWare\Python\Python36\Scripts\;D:\SoftWare\Python\Python36\;D:\SoftWare\SSH Secure Shell;D:\SoftWare\eclipse;;.
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.io.tmpdir=C:\Users\ADMINI~\AppData\Local\Temp\
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:java.compiler=<NA>
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:os.name=Windows
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:os.arch=amd64
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:os.version=6.1
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:user.name=Administrator
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:user.home=C:\Users\Administrator
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Server environment:user.dir=D:\Code\eclipseMarsCode\stormDemo
[main] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Created server with tickTime minSessionTimeout maxSessionTimeout datadir C:\Users\ADMINI~\AppData\Local\Temp\978708b6-e98a-460b--bbb047754867\version- snapdir C:\Users\ADMINI~\AppData\Local\Temp\978708b6-e98a-460b--bbb047754867\version-
[main] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - binding to port 0.0.0.0/0.0.0.0:
[main] INFO o.a.s.zookeeper - Starting inprocess zookeeper at port and dir C:\Users\ADMINI~\AppData\Local\Temp\978708b6-e98a-460b--bbb047754867
[main] INFO o.a.s.d.nimbus - Starting Nimbus with conf {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\98bd25da-d0be-4fe9-91f6-7d84d1b38bbc", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" [ ], "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:zookeeper.version=3.4.-, built on // : GMT
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:host.name=WIN-BQOBV63OBNM
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.version=1.8.0_66
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.vendor=Oracle Corporation
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.home=C:\Program Files\Java\jre1..0_66
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.class.path=D:\Code\eclipseMarsCode\stormDemo\target\classes;D:\SoftWare\maven\repository\org\apache\storm\storm-core\1.0.\storm-core-1.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\kryo\3.0.\kryo-3.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\reflectasm\1.10.\reflectasm-1.10..jar;D:\SoftWare\maven\repository\org\ow2\asm\asm\5.0.\asm-5.0..jar;D:\SoftWare\maven\repository\com\esotericsoftware\minlog\1.3.\minlog-1.3..jar;D:\SoftWare\maven\repository\org\objenesis\objenesis\2.1\objenesis-2.1.jar;D:\SoftWare\maven\repository\org\clojure\clojure\1.7.\clojure-1.7..jar;D:\SoftWare\maven\repository\com\lmax\disruptor\3.3.\disruptor-3.3..jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-api\2.1\log4j-api-2.1.jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-core\2.1\log4j-core-2.1.jar;D:\SoftWare\maven\repository\org\apache\logging\log4j\log4j-slf4j-impl\2.1\log4j-slf4j-impl-2.1.jar;D:\SoftWare\maven\repository\org\slf4j\log4j-over-slf4j\1.6.\log4j-over-slf4j-1.6..jar;D:\SoftWare\maven\repository\javax\servlet\servlet-api\2.5\servlet-api-2.5.jar;D:\SoftWare\maven\repository\org\slf4j\slf4j-api\1.7.\slf4j-api-1.7..jar
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.library.path=C:\Program Files\Java\jre1..0_66\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:/Program Files/Java/jre1..0_66/bin/server;C:/Program Files/Java/jre1..0_66/bin;C:/Program Files/Java/jre1..0_66/lib/amd64;%WEKA39_HOME%\lib\mysql-connector-java-5.1.-bin.jar;%WEKA37_HOME%\lib\mysql-connector-java-5.1.-bin.jar;C:\Program Files\Java\jdk1..0_66\jre\lib\ext\mysql-connector-java-5.1.-bin.jar;C:\ProgramData\Oracle\Java\javapath;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.\;D:\SoftWare\MATLAB R2013a\runtime\win64;D:\SoftWare\MATLAB R2013a\bin;C:\Program Files (x86)\IDM Computer Solutions\UltraCompare;C:\Program Files\Java\jdk1..0_66\bin;C:\Program Files\Java\jdk1..0_66\jre\bin;D:\SoftWare\apache-ant-1.9.\bin;HADOOP_HOME\bin;D:\SoftWare\apache-maven-3.3.\bin;D:\SoftWare\Scala\bin;D:\SoftWare\Scala\jre\bin;%MYSQL_HOME\bin;D:\SoftWare\MySQL\mysql-5.7.-winx64;;D:\SoftWare\apache-tomcat-7.0.\bin;%C:\Windows\System32;%C:\Windows\SysWOW64;;D:\SoftWare\apache-maven-3.3.\bin;D:\SoftWare\apache-tomcat-7.0.\bin;D:\SoftWare\apache-tomcat-7.0.\bin;D:\SoftWare\Anaconda2;D:\SoftWare\Anaconda2\Scripts;D:\SoftWare\Anaconda2\Library\bin;D:\SoftWare\MySQL Server\MySQL Server 5.0\bin;D:\SoftWare\Python\Python36\Scripts\;D:\SoftWare\Python\Python36\;D:\SoftWare\SSH Secure Shell;D:\SoftWare\eclipse;;.
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.io.tmpdir=C:\Users\ADMINI~\AppData\Local\Temp\
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:java.compiler=<NA>
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:os.name=Windows
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:os.arch=amd64
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:os.version=6.1
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:user.name=Administrator
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:user.home=C:\Users\Administrator
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Client environment:user.dir=D:\Code\eclipseMarsCode\stormDemo
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@6824b913
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main] INFO o.a.s.b.FileBlobStoreImpl - Creating new blob store based in C:\Users\ADMINI~\AppData\Local\Temp\98bd25da-d0be-4fe9-91f6-7d84d1b38bbc\blobs
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.p.FileTxnLog - Creating new log file: log.
[main] INFO o.a.s.d.nimbus - Using default scheduler
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@21a9a705
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@753fd7a1
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d881632490000 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d881632490000, negotiated timeout =
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d881632490001 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d881632490001, negotiated timeout =
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d881632490002 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d881632490002, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d881632490002
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d881632490002 closed
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d881632490002
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@40de8f93
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@45ab3bdd
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d881632490003 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d881632490003, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d881632490004 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d881632490004, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main] INFO o.a.s.zookeeper - Queued up for leader lock.
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Got user-level KeeperException when processing sessionid:0x15d881632490001 type:create cxid:0x1 zxid:0x12 txntype:- reqpath:n/a Error Path:/storm/leader-lock Error:KeeperErrorCode = NoNode for /storm/leader-lock
[Curator-Framework-] WARN o.a.s.s.o.a.c.u.ZKPaths - The version of ZooKeeper being used doesn't support Container nodes. CreateMode.PERSISTENT will be used instead.
[main] INFO o.a.s.d.m.MetricsUtils - Using statistics reporter plugin:org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter
[main] INFO o.a.s.d.m.r.JmxPreparableReporter - Preparing...
[main] INFO o.a.s.d.common - Started statistics report plugin...
[main-EventThread] INFO o.a.s.zookeeper - WIN-BQOBV63OBNM gained leadership, checking if it has all the topology code locally.
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@ed2f2f6
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main-EventThread] INFO o.a.s.zookeeper - active-topology-ids [] local-topology-ids [] diff-topology []
[main-EventThread] INFO o.a.s.zookeeper - Accepting leadership, all active topology found localy.
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d881632490005 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d881632490005, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d881632490005
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d881632490005
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d881632490005 closed
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@29be997f
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@7f9e8421
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d881632490006 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d881632490006, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d881632490007 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d881632490007, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d881632490007
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d881632490007
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d881632490007 closed
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@45545e7a
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d881632490008 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d881632490008, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main] INFO o.a.s.d.supervisor - Starting Supervisor with conf {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\38142031-1760-4799-88a0-6af62e350c0b", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" ( ), "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[main] INFO o.a.s.l.Localizer - Reconstruct localized resource: C:\Users\ADMINI~\AppData\Local\Temp\---88a0-6af62e350c0b\supervisor\usercache
[main] WARN o.a.s.l.Localizer - No left over resources found for any user during reconstructing of local resources at: C:\Users\ADMINI~\AppData\Local\Temp\---88a0-6af62e350c0b\supervisor\usercache
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@5d3b58ca
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d881632490009 with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d881632490009, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d881632490009
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d881632490009
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d881632490009 closed
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@4337afd
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d88163249000a with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d88163249000a, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main] INFO o.a.s.d.supervisor - Starting supervisor with id 3d60cbca-37e4-4a07--da32c2c69d5f at host WIN-BQOBV63OBNM
[main] INFO o.a.s.d.supervisor - Starting Supervisor with conf {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\4f443481-417d-4ab8-ba97-c9be8a0e64a1", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" ( ), "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[main] INFO o.a.s.l.Localizer - Reconstruct localized resource: C:\Users\ADMINI~\AppData\Local\Temp\4f443481-417d-4ab8-ba97-c9be8a0e64a1\supervisor\usercache
[main] WARN o.a.s.l.Localizer - No left over resources found for any user during reconstructing of local resources at: C:\Users\ADMINI~\AppData\Local\Temp\4f443481-417d-4ab8-ba97-c9be8a0e64a1\supervisor\usercache
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d88163249000b with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d88163249000b, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d88163249000b
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d88163249000b
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d88163249000b closed
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@c889805
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d88163249000c, negotiated timeout =
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d88163249000c with negotiated timeout for client /127.0.0.1:
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[main] INFO o.a.s.d.supervisor - Starting supervisor with id 51b9a22b--41c4-b6a4-f375c04a6dfa at host WIN-BQOBV63OBNM
[main] INFO o.a.s.l.ThriftAccessLogger - Request ID: access from: principal: operation: submitTopology
[main] INFO o.a.s.d.nimbus - Received topology submission for StormTopologyTimer2 with conf {"topology.max.task.parallelism" nil, "topology.submitter.principal" "", "topology.acker.executors" nil, "topology.eventlogger.executors" , "storm.zookeeper.superACL" nil, "topology.users" (), "topology.submitter.user" "Administrator", "topology.kryo.register" nil, "topology.kryo.decorators" (), "storm.id" "StormTopologyTimer2-1-1501226746", "topology.name" "StormTopologyTimer2"}
[main] INFO o.a.s.d.nimbus - uploadedJar
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@5df63359
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d88163249000d with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d88163249000d, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Got user-level KeeperException when processing sessionid:0x15d88163249000d type:create cxid:0x2 zxid:0x27 txntype:- reqpath:n/a Error Path:/storm/blobstoremaxkeysequencenumber Error:KeeperErrorCode = NoNode for /storm/blobstoremaxkeysequencenumber
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d88163249000d
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d88163249000d closed
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d88163249000d
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[main] INFO o.a.s.cluster - setup-path/blobstore/StormTopologyTimer2---stormconf.ser/WIN-BQOBV63OBNM:-
[main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@75cf0de5
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d88163249000e with negotiated timeout for client /127.0.0.1:
[main-SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d88163249000e, negotiated timeout =
[main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d88163249000e
[main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d88163249000e closed
[main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d88163249000e
[main] INFO o.a.s.cluster - setup-path/blobstore/StormTopologyTimer2---stormcode.ser/WIN-BQOBV63OBNM:-
[main] INFO o.a.s.d.nimbus - desired replication count achieved, current-replication-count for conf key = , current-replication-count for code key = , current-replication-count for jar key =
[main] INFO o.a.s.d.nimbus - Activating StormTopologyTimer2: StormTopologyTimer2--
[timer] INFO o.a.s.s.EvenScheduler - Available slots: (["3d60cbca-37e4-4a07-9840-da32c2c69d5f" ] ["3d60cbca-37e4-4a07-9840-da32c2c69d5f" ] ["3d60cbca-37e4-4a07-9840-da32c2c69d5f" ] ["51b9a22b-9917-41c4-b6a4-f375c04a6dfa" ] ["51b9a22b-9917-41c4-b6a4-f375c04a6dfa" ] ["51b9a22b-9917-41c4-b6a4-f375c04a6dfa" ])
[timer] INFO o.a.s.d.nimbus - Setting new assignment for topology id StormTopologyTimer2--: #org.apache.storm.daemon.common.Assignment{:master-code-dir "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\98bd25da-d0be-4fe9-91f6-7d84d1b38bbc", :node->host {"3d60cbca-37e4-4a07-9840-da32c2c69d5f" "WIN-BQOBV63OBNM"}, :executor->node+port {[ ] ["3d60cbca-37e4-4a07-9840-da32c2c69d5f" ], [ ] ["3d60cbca-37e4-4a07-9840-da32c2c69d5f" ], [ ] ["3d60cbca-37e4-4a07-9840-da32c2c69d5f" ]}, :executor->start-time-secs {[ ] , [ ] , [ ] }, :worker->resources {["3d60cbca-37e4-4a07-9840-da32c2c69d5f" ] [0.0 0.0 0.0]}}
[Thread-] INFO o.a.s.d.supervisor - Downloading code for storm id StormTopologyTimer2--
[Thread-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@708fd3c7
[Thread-] INFO o.a.s.b.FileBlobStoreImpl - Creating new blob store based in C:\Users\ADMINI~\AppData\Local\Temp\98bd25da-d0be-4fe9-91f6-7d84d1b38bbc\blobs
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d88163249000f, negotiated timeout =
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d88163249000f with negotiated timeout for client /127.0.0.1:
[Thread--EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d88163249000f
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d88163249000f
[Thread--EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d88163249000f closed
[Thread-] INFO o.a.s.d.supervisor - Finished downloading code for storm id StormTopologyTimer2--
[Thread-] INFO o.a.s.d.supervisor - Launching worker with assignment {:storm-id "StormTopologyTimer2-1-1501226746", :executors [[ ] [ ] [ ]], :resources #object[org.apache.storm.generated.WorkerResources 0x10d7c7cb "WorkerResources(mem_on_heap:0.0, mem_off_heap:0.0, cpu:0.0)"]} for this supervisor 3d60cbca-37e4-4a07--da32c2c69d5f on port with id 236ee43c-e918-40b8--56a1077bc4f4
[Thread-] INFO o.a.s.d.worker - Launching worker for StormTopologyTimer2-- on 3d60cbca-37e4-4a07--da32c2c69d5f: with id 236ee43c-e918-40b8--56a1077bc4f4 and conf {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\38142031-1760-4799-88a0-6af62e350c0b", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" ( ), "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[Thread-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost: sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@36f45ef3
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d881632490010 with negotiated timeout for client /127.0.0.1:
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d881632490010, negotiated timeout =
[Thread--EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[Thread--EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none
[Curator-Framework-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
[ProcessThread(sid: cport:-):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x15d881632490010
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x15d881632490010 closed
[Thread--EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
[Thread-] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
[Thread-] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:/storm sessionTimeout= watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@2091870b
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] WARN o.a.s.s.o.a.z.s.NIOServerCnxn - caught end of stream exception
org.apache.storm.shade.org.apache.zookeeper.server.ServerCnxn$EndOfStreamException: Unable to read additional data from client sessionid 0x15d881632490010, likely client has closed socket
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:) [storm-core-1.0..jar:1.0.]
at org.apache.storm.shade.org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:) [storm-core-1.0..jar:1.0.]
at java.lang.Thread.run(Unknown Source) [?:1.8.0_66]
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1: which had sessionid 0x15d881632490010
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:. Will not attempt to authenticate using SASL (unknown error)
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to 127.0.0.1/127.0.0.1:, initiating session
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:
[Thread--SendThread(127.0.0.1:)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server 127.0.0.1/127.0.0.1:, sessionid = 0x15d881632490011, negotiated timeout =
[SyncThread:] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x15d881632490011 with negotiated timeout for client /127.0.0.1:
[Thread--EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
[Thread-] INFO o.a.s.s.a.AuthUtils - Got AutoCreds []
[Thread-] INFO o.a.s.d.worker - Reading Assignments.
[Thread-] INFO o.a.s.d.worker - Registering IConnectionCallbacks for 3d60cbca-37e4-4a07--da32c2c69d5f:
[Thread-] INFO o.a.s.d.executor - Loading executor MySpout:[ ]
[Thread-] INFO o.a.s.d.executor - Loaded executor tasks MySpout:[ ]
[Thread-] INFO o.a.s.d.executor - Finished loading executor MySpout:[ ]
[Thread-] INFO o.a.s.d.executor - Loading executor __acker:[ ]
[Thread-] INFO o.a.s.d.executor - Loaded executor tasks __acker:[ ]
[Thread-] INFO o.a.s.d.executor - Timeouts disabled for executor __acker:[ ]
[Thread-] INFO o.a.s.d.executor - Finished loading executor __acker:[ ]
[Thread-] INFO o.a.s.d.executor - Loading executor MyBolt:[ ]
[Thread-] INFO o.a.s.d.executor - Loaded executor tasks MyBolt:[ ]
[Thread-] INFO o.a.s.d.executor - Finished loading executor MyBolt:[ ]
[Thread-] INFO o.a.s.d.executor - Loading executor __system:[- -]
[Thread-] INFO o.a.s.d.executor - Loaded executor tasks __system:[- -]
[Thread-] INFO o.a.s.d.executor - Finished loading executor __system:[- -]
[Thread-] INFO o.a.s.d.worker - Started with log levels: {"" #object[org.apache.logging.log4j.Level 0x3399ad7 "INFO"], "org.apache.zookeeper" #object[org.apache.logging.log4j.Level 0x3075a1a9 "WARN"]}
[Thread-] INFO o.a.s.d.worker - Worker has topology config {"topology.builtin.metrics.bucket.size.secs" , "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "local", "storm.messaging.netty.client_worker_threads" , "logviewer.max.per.worker.logs.size.mb" , "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" , "zmq.threads" , "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" , "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" , "drpc.invocations.port" , "supervisor.localizer.cache.target.size.mb" , "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" , "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" , "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" , "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" , "pacemaker.host" "localhost", "storm.zookeeper.retry.times" , "ui.actions.enabled" true, "zmq.linger.millis" , "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.messaging.netty.min_wait_ms" , "worker.log.level.reset.poll.secs" , "storm.zookeeper.port" , "supervisor.heartbeat.frequency.secs" , "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" , "supervisor.blobstore.download.thread.count" , "drpc.queue.size" , "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" , "topology.shellbolt.max.pending" , "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" , "logviewer.port" , "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" , "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "topology.submitter.principal" "", "storm.nimbus.retry.interval.millis" , "nimbus.inbox.jar.expiration.secs" , "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" , "supervisor.localizer.cleanup.interval.ms" , "storm.zookeeper.servers" ["localhost"], "nimbus.thrift.threads" , "logviewer.cleanup.age.mins" , "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" , "nimbus.credential.renewers.freq.secs" , "topology.skip.missing.kryo.registrations" true, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" , "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" , "storm.health.check.timeout.ms" , "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" , "topology.workers" , "pacemaker.base.threads" , "storm.local.dir" "C:\\Users\\ADMINI~1\\AppData\\Local\\Temp\\98bd25da-d0be-4fe9-91f6-7d84d1b38bbc", "topology.disable.loadaware" false, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" , "topology.message.timeout.secs" , "topology.state.synchronization.timeout.secs" , "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" , "logviewer.childopts" "-Xmx128m", "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" , "storm.messaging.netty.max_retries" , "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" , "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" , "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" , "nimbus.task.timeout.secs" , "storm.zookeeper.superACL" nil, "drpc.port" , "pacemaker.max.threads" , "storm.zookeeper.retry.intervalceiling.millis" , "nimbus.thrift.port" , "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" , "supervisor.worker.start.timeout.secs" , "storm.zookeeper.retry.interval" , "logs.users" nil, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" , "pacemaker.thread.timeout" , "task.credentials.poll.secs" , "blobstore.superuser" "Administrator", "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" , "topology.state.checkpoint.interval.ms" , "supervisor.slots.ports" [ ], "topology.transfer.buffer.size" , "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" , "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" , "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" , "backpressure.disruptor.low.watermark" 0.4, "topology.users" [], "nimbus.task.launch.secs" , "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" , "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" , "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.submitter.user" "Administrator", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" , "task.refresh.poll.secs" , "storm.exhibitor.port" , "task.heartbeat.frequency.secs" , "pacemaker.port" , "storm.messaging.netty.max_wait_ms" , "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" , "topology.error.throttle.interval.secs" , "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "topology.kryo.register" nil, "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["localhost"], "nimbus.queue.size" , "nimbus.cleanup.inbox.freq.secs" , "storm.blobstore.replication.factor" , "worker.heap.memory.mb" , "logviewer.max.sum.worker.logs.size.mb" , "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" , "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" , "topology.min.replication.count" , "topology.disruptor.wait.timeout.millis" , "storm.nimbus.retry.intervalceiling.millis" , "topology.trident.batch.emit.interval.millis" , "storm.auth.simple-acl.users" [], "drpc.invocations.threads" , "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" , "topology.kryo.decorators" [], "storm.id" "StormTopologyTimer2-1-1501226746", "topology.name" "StormTopologyTimer2", "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" , "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" , "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" }
[Thread-] INFO o.a.s.d.worker - Worker 236ee43c-e918-40b8--56a1077bc4f4 for storm StormTopologyTimer2-- on 3d60cbca-37e4-4a07--da32c2c69d5f: has finished loading
[Thread-] INFO o.a.s.config - SET worker-user 236ee43c-e918-40b8--56a1077bc4f4
[refresh-active-timer] INFO o.a.s.d.worker - All connections are ready for worker 3d60cbca-37e4-4a07--da32c2c69d5f: with id 236ee43c-e918-40b8--56a1077bc4f4
[Thread--MySpout-executor[ ]] INFO o.a.s.d.executor - Opening spout MySpout:()
[Thread--MySpout-executor[ ]] INFO o.a.s.d.executor - Opened spout MySpout:()
[Thread--MySpout-executor[ ]] INFO o.a.s.d.executor - Activating spout MySpout:()
spout:
[Thread--__acker-executor[ ]] INFO o.a.s.d.executor - Preparing bolt __acker:()
[Thread--__acker-executor[ ]] INFO o.a.s.d.executor - Prepared bolt __acker:()
[Thread--MyBolt-executor[ ]] INFO o.a.s.d.executor - Preparing bolt MyBolt:()
[Thread--MyBolt-executor[ ]] INFO o.a.s.d.executor - Prepared bolt MyBolt:()
sum=
[Thread--__system-executor[- -]] INFO o.a.s.d.executor - Preparing bolt __system:(-)
[Thread--__system-executor[- -]] INFO o.a.s.d.executor - Prepared bolt __system:(-)
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
[SyncThread:] WARN o.a.s.s.o.a.z.s.p.FileTxnLog - fsync-ing the write ahead log in SyncThread: took 1140ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
spout:
sum=
[SyncThread:] WARN o.a.s.s.o.a.z.s.p.FileTxnLog - fsync-ing the write ahead log in SyncThread: took 1002ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
定时时间到了
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=
spout:
sum=

Storm编程入门API系列之Storm的定时任务实现的更多相关文章

  1. Storm编程入门API系列之Storm的Topology多个Workers数目控制实现

    前期博客 Storm编程入门API系列之Storm的Topology默认Workers.默认executors和默认tasks数目 继续编写 StormTopologyMoreWorker.java ...

  2. Storm编程入门API系列之Storm的Topology多个Executors数目控制实现

    前期博客 Storm编程入门API系列之Storm的Topology默认Workers.默认executors和默认tasks数目 Storm编程入门API系列之Storm的Topology多个Wor ...

  3. Storm编程入门API系列之Storm的Topology多个tasks数目控制实现

    前期博客 Storm编程入门API系列之Storm的Topology默认Workers.默认executors和默认tasks数目 Storm编程入门API系列之Storm的Topology多个Wor ...

  4. Storm编程入门API系列之Storm的Topology的stream grouping

    概念,见博客 Storm概念学习系列之stream grouping(流分组) Storm的stream grouping的Shuffle Grouping 它是随机分组,随机派发stream里面的t ...

  5. Storm编程入门API系列之Storm的可靠性的ACK消息确认机制

    概念,见博客 Storm概念学习系列之storm的可靠性  什么业务场景需要storm可靠性的ACK确认机制? 答:想要保住数据不丢,或者保住数据总是被处理.即若没被处理的,得让我们知道. publi ...

  6. Storm编程入门API系列之Storm的Topology默认Workers、默认executors和默认tasks数目

    关于,storm的启动我这里不多说了. 见博客 storm的3节点集群详细启动步骤(非HA和HA)(图文详解) 建立stormDemo项目 Group Id :  zhouls.bigdata Art ...

  7. Storm概念学习系列之storm的定时任务

    不多说,直接上干货! 至于为什么,有storm的定时任务.这个很简单.但是,这个在工作中非常重要! 假设有如下的业务场景 这个spoult源源不断地发送数据,boilt呢会进行处理.然后呢,处理后的结 ...

  8. Storm概念学习系列之storm的可靠性

    这个概念,对于理解storm很有必要. 1.worker进程死掉 worker是真实存在的.可以jps查看. 正是因为有了storm的可靠性,所以storm会重新启动一个新的worker进程. 2.s ...

  9. 第1节 storm编程:2、storm的基本介绍

    课程大纲: 1.storm的基本介绍 2.storm的架构模型 3.storm的安装 4.storm的UI管理界面 5.storm的编程模型 6.storm的入门程序 7.storm的并行度 8.st ...

随机推荐

  1. PL&sol;SQL如何导入dmp文件

    -------------创建表空间 create tablespace portal_data datafile'E:\OracleDB\System_TableSpace\portal_data0 ...

  2. Shell文本处理 - 分割合并与过滤

    sort分类操作 示例文件 Boys in Company C:HK:192:2192 Alien:HK:119:1982 The Hill:KL:63:2972 Aliens:HK:532:4892 ...

  3. Android 中的selector

    今天做程序时,发现了selector 选择器不单单能用系统的自定义属性(比如,  <item android:state_selected="true" android:co ...

  4. JavaScript DOM动态创建(声明)Object元素

    http://www.cnblogs.com/GuominQiu/archive/2011/04/01/2002783.html 一文提及“等整个页面加载完毕后,根据用户所选的阅读机类型,再用Java ...

  5. HDU 5781 ATM Mechine 期望dp

    题目链接: http://acm.hdu.edu.cn/showproblem.php?pid=5781 ATM Mechine Time Limit: 6000/3000 MS (Java/Othe ...

  6. 层模型--相对定位&lpar;position&colon;relative&rpar;

    如果想为元素设置层模型中的相对定位,需要设置position:relative(表示相对定位),它通过left.right.top.bottom属性确定元素在正常文档流中的偏移位置.相对定位完成的过程 ...

  7. Android 驱动(二) IIC简单介绍

    一. I2C简单介绍 I2C(Inter-Integrated Circuit)总线是一种由 Philips 公司开发的两线式串行总线,用于连接微控制器及其外围设备.I2C 总线最基本的长处就是简单性 ...

  8. php与微信基础的学习

    我们要搞的是用php来与微信进行信息交互,现在是一个学习过程...结合慕课网渔夫老师的讲解. 微信公众号的申请具体可百度,太简单不予说明,微信本身功能也挺多,也有相关第三方平台,然而我们学习编程--具 ...

  9. jQuery控制a标签不可点击 不跳转

    jquery禁用a标签方法1 01 02 03 04 05 06 07 08 09 10 11 12 $(document).ready(function () {         $("a ...

  10. 怎么样通过php使用html5实现多文件上传?(php多图上传)

    <!DOCTYPE html><html lang="zh-cn"> <head> <meta charset="utf-8&q ...