Apache storm ApacheStorm-Kinesis喷口抛出AmazonClientException后退
我使用流和GET请求测试了GET和PUT,两者都工作得完美无缺。我有所有3个变种批,风暴和火花。Spark-used KinesisStreams-working Batch:您可以获取并放置-working Storm:计划使用KinesisSpout库。它在毫无线索地失败Apache storm ApacheStorm-Kinesis喷口抛出AmazonClientException后退,apache-storm,amazon-kinesis,Apache Storm,Amazon Kinesis,我使用流和GET请求测试了GET和PUT,两者都工作得完美无缺。我有所有3个变种批,风暴和火花。Spark-used KinesisStreams-working Batch:您可以获取并放置-working Storm:计划使用KinesisSpout库。它在毫无线索地失败 2016-02-02 16:15:18 c.a.s.k.s.u.InfiniteConstantBackoffRetry [DEBUG] Caught exception of type com.amazonaws.Ama
2016-02-02 16:15:18 c.a.s.k.s.u.InfiniteConstantBackoffRetry [DEBUG] Caught exception of type com.amazonaws.AmazonClientException, backing off for 1000 ms.
我做错了什么
风暴日志:
final KinesisSpoutConfig config = new KinesisSpoutConfig(streamname, zookeeperurl);
config.withInitialPositionInStream(ipis);
config.withRegion(Regions.fromName(regionName));
config.withCheckpointIntervalMillis(Integer.parseInt(checkinterval));
config.withZookeeperPrefix("kinesis-zooprefix-" + name);
System.setProperty("aws.accessKeyId", key);
System.setProperty("aws.secretKey", keysecret);
SystemPropertiesCredentialsProvider scp = new SystemPropertiesCredentialsProvider();
final KinesisSpout spout = new KinesisSpoutConflux(config, scp, new ClientConfiguration());
我看不到有人打电话给“nextTuple”
我的版本:
- 风暴=0.9.3
- 动力风暴喷口=1.1.1
2016-02-02 16:15:17 c.a.s.k.s.KinesisSpout [INFO] KinesisSpoutConflux[taskIndex=0] open() called with topoConfig task index 0 for processing stream Kinesis-Conflux
2016-02-02 16:15:17 c.a.s.k.s.KinesisSpout [DEBUG] KinesisSpoutConflux[taskIndex=0] activating. Starting to process stream Kinesis-Test
2016-02-02 16:15:17 c.a.s.k.s.KinesisHelper [INFO] Using us-east-1 region