Apache Storm - Kinesis Spout throwing AmazonClientException backing off -
2016-02-02 16:15:18 c.a.s.k.s.u.infiniteconstantbackoffretry [debug] caught exception of type com.amazonaws.amazonclientexception, backing off 1000 ms.
i tested , put using streams , requests - both worked flawless. have 3 variants batch, storm , spark. spark - used kinesisstreams - working batch: can , put - working storm: planning use kinesisspout library kinesis. failing no clue.
final kinesisspoutconfig config = new kinesisspoutconfig(streamname, zookeeperurl); config.withinitialpositioninstream(ipis); config.withregion(regions.fromname(regionname)); config.withcheckpointintervalmillis(integer.parseint(checkinterval)); config.withzookeeperprefix("kinesis-zooprefix-" + name); system.setproperty("aws.accesskeyid", key); system.setproperty("aws.secretkey", keysecret); systempropertiescredentialsprovider scp = new systempropertiescredentialsprovider(); final kinesisspout spout = new kinesisspoutconflux(config, scp, new clientconfiguration());
what doing wrong?
storm logs:
2016-02-02 16:15:17 c.a.s.k.s.kinesisspout [info] kinesisspoutconflux[taskindex=0] open() called topoconfig task index 0 processing stream kinesis-conflux 2016-02-02 16:15:17 c.a.s.k.s.kinesisspout [debug] kinesisspoutconflux[taskindex=0] activating. starting process stream kinesis-test 2016-02-02 16:15:17 c.a.s.k.s.kinesishelper [info] using us-east-1 region
i don't see "nexttuple" getting called.
my versions:
- storm = 0.9.3
- kinesis-storm-spout = 1.1.1
Comments
Post a Comment