Apache spark Azure Cosmos(MongoDB API)-来自Spark的错误
我正在使用Spark REPL Shell测试与Cosmos DB的连接Apache spark Azure Cosmos(MongoDB API)-来自Spark的错误,apache-spark,azure-cosmosdb-mongoapi,Apache Spark,Azure Cosmosdb Mongoapi,我正在使用Spark REPL Shell测试与Cosmos DB的连接 ./spark-shell --master local[4] --jars /home/Flexplmadm/Downloads/lib/mongo-spark-connector_2.11-2.4.1.jar --conf "spark.mongodb.input.uri=mongodb://plum-dev-azure-cosmosdb:fd0f9d0f90fd==@xyz-dev-azure-cosmosdb.do
./spark-shell --master local[4] --jars /home/Flexplmadm/Downloads/lib/mongo-spark-connector_2.11-2.4.1.jar --conf "spark.mongodb.input.uri=mongodb://plum-dev-azure-cosmosdb:fd0f9d0f90fd==@xyz-dev-azure-cosmosdb.documents.azure.com:10255/?ssl=true&replicaSet=globaldb" --conf "spark.mongodb.input.collection=Users" --packages org.mongodb.spark:mongo-spark-connector_2.11:0.3
import com.mongodb.spark.MongoSpark
val UsersDF = MongoSpark.load(sc)
但是我得到了下面的错误,有人能告诉我我是否做错了什么吗
java.lang.IllegalArgumentException: Missing database name. Set via the 'spark.mongodb.input.uri' or 'spark.mongodb.input.database' property
at com.mongodb.spark.config.MongoCompanionConfig$class.databaseName(MongoCompanionConfig.scala:260)
at com.mongodb.spark.config.ReadConfig$.databaseName(ReadConfig.scala:42)
at com.mongodb.spark.config.ReadConfig$.apply(ReadConfig.scala:70)
at com.mongodb.spark.config.ReadConfig$.apply(ReadConfig.scala:42)
at com.mongodb.spark.config.MongoCompanionConfig$class.apply(MongoCompanionConfig.scala:124)
at com.mongodb.spark.config.ReadConfig$.apply(ReadConfig.scala:42)
at com.mongodb.spark.config.MongoCompanionConfig$class.apply(MongoCompanionConfig.scala:113)
at com.mongodb.spark.config.ReadConfig$.apply(ReadConfig.scala:42)
at com.mongodb.spark.config.MongoCompanionConfig$class.apply(MongoCompanionConfig.scala:100)
at com.mongodb.spark.config.ReadConfig$.apply(ReadConfig.scala:42)
at com.mongodb.spark.config.MongoCompanionConfig$class.apply(MongoCompanionConfig.scala:66)
at com.mongodb.spark.config.ReadConfig$.apply(ReadConfig.scala:42)
at com.mongodb.spark.MongoSpark$.load(MongoSpark.scala:65)
... 49 elided
CosmosDb是db帐户,所以您需要手动创建数据库。然后在正确配置属性之后,您应该能够连接到它。但是CosmosDb只是作为Mongo工作,而不是一个真正的Mongo。因此,您需要查看文档以了解您想要使用的mongo功能的详细信息