Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/5.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Apache spark Azure Cosmos(MongoDB API)-来自Spark的错误_Apache Spark_Azure Cosmosdb Mongoapi - Fatal编程技术网

Apache spark Azure Cosmos(MongoDB API)-来自Spark的错误

Apache spark Azure Cosmos(MongoDB API)-来自Spark的错误,apache-spark,azure-cosmosdb-mongoapi,Apache Spark,Azure Cosmosdb Mongoapi,我正在使用Spark REPL Shell测试与Cosmos DB的连接 ./spark-shell --master local[4] --jars /home/Flexplmadm/Downloads/lib/mongo-spark-connector_2.11-2.4.1.jar --conf "spark.mongodb.input.uri=mongodb://plum-dev-azure-cosmosdb:fd0f9d0f90fd==@xyz-dev-azure-cosmosdb.do

我正在使用Spark REPL Shell测试与Cosmos DB的连接

./spark-shell --master local[4] --jars /home/Flexplmadm/Downloads/lib/mongo-spark-connector_2.11-2.4.1.jar --conf "spark.mongodb.input.uri=mongodb://plum-dev-azure-cosmosdb:fd0f9d0f90fd==@xyz-dev-azure-cosmosdb.documents.azure.com:10255/?ssl=true&replicaSet=globaldb" --conf  "spark.mongodb.input.collection=Users" --packages org.mongodb.spark:mongo-spark-connector_2.11:0.3

import com.mongodb.spark.MongoSpark
val UsersDF = MongoSpark.load(sc)
但是我得到了下面的错误,有人能告诉我我是否做错了什么吗

java.lang.IllegalArgumentException: Missing database name. Set via the 'spark.mongodb.input.uri' or 'spark.mongodb.input.database' property
  at com.mongodb.spark.config.MongoCompanionConfig$class.databaseName(MongoCompanionConfig.scala:260)
  at com.mongodb.spark.config.ReadConfig$.databaseName(ReadConfig.scala:42)
  at com.mongodb.spark.config.ReadConfig$.apply(ReadConfig.scala:70)
  at com.mongodb.spark.config.ReadConfig$.apply(ReadConfig.scala:42)
  at com.mongodb.spark.config.MongoCompanionConfig$class.apply(MongoCompanionConfig.scala:124)
  at com.mongodb.spark.config.ReadConfig$.apply(ReadConfig.scala:42)
  at com.mongodb.spark.config.MongoCompanionConfig$class.apply(MongoCompanionConfig.scala:113)
  at com.mongodb.spark.config.ReadConfig$.apply(ReadConfig.scala:42)
  at com.mongodb.spark.config.MongoCompanionConfig$class.apply(MongoCompanionConfig.scala:100)
  at com.mongodb.spark.config.ReadConfig$.apply(ReadConfig.scala:42)
  at com.mongodb.spark.config.MongoCompanionConfig$class.apply(MongoCompanionConfig.scala:66)
  at com.mongodb.spark.config.ReadConfig$.apply(ReadConfig.scala:42)
  at com.mongodb.spark.MongoSpark$.load(MongoSpark.scala:65)
  ... 49 elided

CosmosDb是db帐户,所以您需要手动创建数据库。然后在正确配置属性之后,您应该能够连接到它。但是CosmosDb只是作为Mongo工作,而不是一个真正的Mongo。因此,您需要查看文档以了解您想要使用的mongo功能的详细信息