java - Error After Storm Execution -
i execute storm topology drpc service. but, see error below. don't know why indexoutofboundsexception
. maybe multiple emit in spout ...
============== drpc spout source (customized) =======================
_collector.emit(new values("0:"+endnum*1/9, jsonvalue.tojsonstring(returninfo)), new drpcmessageid(req.get_request_id(), 0)); _collector.emit(new values(math.round(endnum*1.0/9.0)+":"+math.round(endnum*2.0/9.0), jsonvalue.tojsonstring(returninfo)), new drpcmessageid(req.get_request_id(), 1)); _collector.emit(new values(math.round(endnum*2.0/9.0)+":"+math.round(endnum*3.0/9.0), jsonvalue.tojsonstring(returninfo)), new drpcmessageid(req.get_request_id(), 2));
===================error=============================
java.lang.runtimeexception: java.lang.indexoutofboundsexception: index: 3, size: 1 @ backtype.storm.utils.disruptorqueue.consumebatchtocursor(disruptorqueue.java:128) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.utils.disruptorqueue.consumebatch(disruptorqueue.java:87) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.disruptor$consume_batch.invoke(disruptor.clj:76) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.daemon.executor$fn__6579$fn__6594$fn__6623.invoke(executor.clj:542) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.util$async_loop$fn__459.invoke(util.clj:463) ~[storm-core-0.9.5.jar:0.9.5] @ clojure.lang.afn.run(afn.java:24) [clojure-1.5.1.jar:na] @ java.lang.thread.run(thread.java:745) [na:1.8.0_11] caused by: java.lang.indexoutofboundsexception: index: 3, size: 1 @ java.util.arraylist.rangecheck(arraylist.java:638) ~[na:1.8.0_11] @ java.util.arraylist.get(arraylist.java:414) ~[na:1.8.0_11] @ com.skcc.drpctest.newdrpcspout.fail(newdrpcspout.java:198) ~[stormjar.jar:na] @ backtype.storm.daemon.executor$fail_spout_msg.invoke(executor.clj:372) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.daemon.executor$fn$reify__6582.expire(executor.clj:432) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.utils.rotatingmap.rotate(rotatingmap.java:73) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.daemon.executor$fn__6579$tuple_action_fn__6585.invoke(executor.clj:437) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.daemon.executor$mk_task_receiver$fn__6570.invoke(executor.clj:404) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.disruptor$clojure_handler$reify__1605.onevent(disruptor.clj:58) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.utils.disruptorqueue.consumebatchtocursor(disruptorqueue.java:125) ~[storm-core-0.9.5.jar:0.9.5] ... 6 common frames omitted 2015-07-02t11:22:41.944+0900 b.s.d.executor [error] java.lang.runtimeexception: java.lang.indexoutofboundsexception: index: 3, size: 1 @ backtype.storm.utils.disruptorqueue.consumebatchtocursor(disruptorqueue.java:128) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.utils.disruptorqueue.consumebatch(disruptorqueue.java:87) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.disruptor$consume_batch.invoke(disruptor.clj:76) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.daemon.executor$fn__6579$fn__6594$fn__6623.invoke(executor.clj:542) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.util$async_loop$fn__459.invoke(util.clj:463) ~[storm-core-0.9.5.jar:0.9.5] @ clojure.lang.afn.run(afn.java:24) [clojure-1.5.1.jar:na] @ java.lang.thread.run(thread.java:745) [na:1.8.0_11] caused by: java.lang.indexoutofboundsexception: index: 3, size: 1 @ java.util.arraylist.rangecheck(arraylist.java:638) ~[na:1.8.0_11] @ java.util.arraylist.get(arraylist.java:414) ~[na:1.8.0_11] @ com.skcc.drpctest.newdrpcspout.fail(newdrpcspout.java:198) ~[stormjar.jar:na] @ backtype.storm.daemon.executor$fail_spout_msg.invoke(executor.clj:372) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.daemon.executor$fn$reify__6582.expire(executor.clj:432) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.utils.rotatingmap.rotate(rotatingmap.java:73) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.daemon.executor$fn__6579$tuple_action_fn__6585.invoke(executor.clj:437) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.daemon.executor$mk_task_receiver$fn__6570.invoke(executor.clj:404) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.disruptor$clojure_handler$reify__1605.onevent(disruptor.clj:58) ~[storm-core-0.9.5.jar:0.9.5] @ backtype.storm.utils.disruptorqueue.consumebatchtocursor(disruptorqueue.java:125) ~[storm-core-0.9.5.jar:0.9.5] ... 6 common frames omitted 2015-07-02t11:22:41.963+0900 b.s.util [error] halting process: ("worker died") java.lang.runtimeexception: ("worker died") @ backtype.storm.util$exit_process_bang_.doinvoke(util.clj:325) [storm-core-0.9.5.jar:0.9.5] @ clojure.lang.restfn.invoke(restfn.java:423) [clojure-1.5.1.jar:na] @ backtype.storm.daemon.worker$fn__7028$fn__7029.invoke(worker.clj:497) [storm-core-0.9.5.jar:0.9.5] @ backtype.storm.daemon.executor$mk_executor_data$fn__6480$fn__6481.invoke(executor.clj:240) [storm-core-0.9.5.jar:0.9.5] @ backtype.storm.util$async_loop$fn__459.invoke(util.clj:473) [storm-core-0.9.5.jar:0.9.5] @ clojure.lang.afn.run(afn.java:24) [clojure-1.5.1.jar:na] @ java.lang.thread.run(thread.java:745) [na:1.8.0_11] 2015-07-02t11:22:41.965+0900 b.s.d.worker [info] shutting down worker drpc-topology-5-1435802568 6f57193f-afa0-416d-9cae-d9b7fd66ff3d 54 2015-07-02t11:22:41.965+0900 b.s.m.n.client [info] closing netty client netty-client-com.skcc.bigdata00/203.235.192.35:49 2015-07-02t11:22:41.965+0900 b.s.m.n.client [info] waiting 600000 ms send 0 pending messages netty-client-com.skcc.bigdata00/203.235.192.35:49 2015-07-02t11:22:41.968+0900 b.s.m.n.client [info] closing netty client netty-client-com.skcc.bigdata00/203.235.192.35:50 2015-07-02t11:22:41.969+0900 b.s.m.n.client [info] waiting 600000 ms send 0 pending messages netty-client-com.skcc.bigdata00/203.235.192.35:50 2015-07-02t11:22:41.969+0900 b.s.d.worker [info] shutting down receive thread 2015-07-02t11:22:41.970+0900 b.s.m.n.client [info] creating netty client, connecting localhost:54, buffersize: 5242880 2015-07-02t11:22:41.970+0900 o.a.s.c.r.exponentialbackoffretry [warn] maxretries large (300). pinning 29 2015-07-02t11:22:41.970+0900 b.s.u.stormboundedexponentialbackoffretry [info] basesleeptimems [100] maxsleeptimems [1000] maxretries [300] 2015-07-02t11:22:41.974+0900 b.s.m.n.client [info] connection attempt 1 netty-client-localhost/127.0.0.1:54 scheduled run in 0 ms 2015-07-02t11:22:41.975+0900 b.s.m.loader [info] shutting down receiving-thread: [drpc-topology-5-1435802568, 54] 2015-07-02t11:22:41.975+0900 b.s.m.n.client [error] connection netty-client-localhost/127.0.0.1:54 unavailable 2015-07-02t11:22:41.975+0900 b.s.m.n.client [error] dropping 1 message(s) destined netty-client-localhost/127.0.0.1:54 2015-07-02t11:22:41.975+0900 b.s.m.n.client [info] closing netty client netty-client-localhost/127.0.0.1:54 2015-07-02t11:22:41.975+0900 b.s.m.n.client [info] waiting 600000 ms send 0 pending messages netty-client-localhost/127.0.0.1:54 2015-07-02t11:22:41.975+0900 b.s.m.loader [info] waiting receiving-thread:[drpc-topology-5-1435802568, 54] die 2015-07-02t11:22:41.978+0900 b.s.m.n.client [info] connection established netty-client-localhost/127.0.0.1:54 2015-07-02t11:22:41.978+0900 b.s.m.loader [info] shutdown receiving-thread: [drpc-topology-5-1435802568, 54] 2015-07-02t11:22:41.978+0900 b.s.d.worker [info] shut down receive thread 2015-07-02t11:22:41.978+0900 b.s.d.worker [info] terminating messaging context 2015-07-02t11:22:41.978+0900 b.s.d.worker [info] shutting down executors 2015-07-02t11:22:41.979+0900 b.s.d.executor [info] shutting down executor drpc:[4 4] 2015-07-02t11:22:41.980+0900 b.s.util [info] async loop interrupted!
the stack trace says have indexoutofboundsexception. you're attempting read incorrect array index in spout, (newdrpcspout.java).
Comments
Post a Comment