Apache spark 我可以直接从maven/jfrog artifactory提交spark应用程序jar吗

Apache spark 我可以直接从maven/jfrog artifactory提交spark应用程序jar吗,apache-spark,Apache Spark,我正在尝试使用spark submit应用程序jar,其中应用程序jar实际上托管在远程repo中(不是本地或HDFS或S3) 下面是我尝试直接从Maven运行SparkPi的示例: spark-submit --class org.apache.examples.SparkPi --repositories https://mvnrepository.com/repos/central,https://repo.eclipse.org/content/repositories/paho-rel

我正在尝试使用spark submit应用程序jar,其中应用程序jar实际上托管在远程repo中(不是本地或HDFS或S3) 下面是我尝试直接从Maven运行SparkPi的示例:

spark-submit --class org.apache.examples.SparkPi --repositories https://mvnrepository.com/repos/central,https://repo.eclipse.org/content/repositories/paho-releases --packages org.apache.spark:spark-examples_2.10:0.9.0-incubating  --jars https://repo1.maven.org/maven2/org/apache/spark/spark-examples_2.10/0.9.0-incubating/spark-examples_2.10-0.9.0-incubating.jar spark-examples_2.10-0.9.0-incubating.jar 10000
它似乎既不工作也不失败,以下是输出:

---------------------------------------------------------------------
|                  |            modules            ||   artifacts   |
|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
|      default     |  123  |   0   |   0   |   21  ||  102  |   0   |
---------------------------------------------------------------------

:: retrieving :: org.apache.spark#spark-submit-parent-a0c4af8a-2537-45f2-a26d-d9d697abfb2b


confs: [default]
    0 artifacts copied, 102 already retrieved (0kB/50ms)
20/07/17 09:53:35 WARN Utils: Your hostname, ****.local resolves to a loopback address: 127.0.0.1; using **** instead (on interface en0)
20/07/17 09:53:35 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address
20/07/17 09:53:36 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
log4j:WARN No appenders could be found for logger (org.apache.spark.deploy.SparkSubmit$$anon$2).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

我可能错误地认为它应该有效,但感谢任何反馈

我也有类似的要求。你能解决这个问题吗?还没有,目前首先使用wget,我有一个类似的要求。你能解决这个问题吗?还没有,目前先使用wget