Java 无法打开到Cassandra的thrift连接
只需使用spark cassandra connector从键空间Java 无法打开到Cassandra的thrift连接,java,cassandra,apache-spark,Java,Cassandra,Apache Spark,只需使用spark cassandra connector从键空间播放器访问表播放器信息 import org.apache.commons.lang3.StringUtils; import org.apache.spark.SparkConf; import org.apache.spark.api.java.JavaRDD; import org.apache.spark.api.java.JavaSparkContext; import org.apache.spark.api.jav
播放器
访问表播放器信息
import org.apache.commons.lang3.StringUtils;
import org.apache.spark.SparkConf;
import org.apache.spark.api.java.JavaRDD;
import org.apache.spark.api.java.JavaSparkContext;
import org.apache.spark.api.java.function.Function;
import com.datastax.spark.connector.cql.CassandraConnector;
import static com.datastax.spark.connector.japi.CassandraJavaUtil.*;
import com.datastax.spark.connector.japi.CassandraRow;
public class SparkTest implements Serializable {
private transient SparkConf conf;
private SparkTest(SparkConf conf) {
this.conf = conf;
}
private void run() {
JavaSparkContext sc = new JavaSparkContext(conf);
CassandraConnector connector = CassandraConnector.apply(sc.getConf());
JavaRDD<String> rdd = javaFunctions(sc).cassandraTable("player", "playerinfo")
.select("id").map(new Function<CassandraRow, String>() {
@Override
public String call(CassandraRow cassandraRow) throws Exception {
return cassandraRow.toString();
}
});
System.out.println("Data with only 'id' column fetched: \n" + StringUtils.join(rdd.toArray(), "\n"));
System.out.println("finished!");
}
public static void main(String[] args) {
SparkConf conf = new SparkConf();
conf.setAppName("Java API demo");
conf.setMaster("local[1]");
System.out.println("---------------------------------");
conf.set("spark.cassandra.connection.host", "10.6.1.244");
SparkTest app = new SparkTest(conf);
app.run();
}
}
我为什么会犯这样的错误:
Failed to open thrift connection to Cassandra at 10.6.1.244:9160
有人知道是什么问题吗?这个bug让我抓狂……10.6.1.244上的卡桑德拉似乎没有在端口9160上监听Thrift客户端。您可以通过telnet 10.6.1.244 9160来确认这一点。如果您看到“连接被拒绝”消息,那么您的Cassandra没有监听端口号。请检查您的Cassandra配置。事实上,这个问题是由于添加了同一Jar包的不同版本造成的。
Failed to open thrift connection to Cassandra at 10.6.1.244:9160