Amazon ec2 如何阻止火花从火花壳开始
我只是在用spark shell玩spark。 我已经在EC2实例中使用hive构建了spark。由于网络问题,我与EC2实例断开了连接 现在,当我重新连接并启动spark shell以及尝试创建hiveContext时,我遇到以下错误Amazon ec2 如何阻止火花从火花壳开始,amazon-ec2,apache-spark,Amazon Ec2,Apache Spark,我只是在用spark shell玩spark。 我已经在EC2实例中使用hive构建了spark。由于网络问题,我与EC2实例断开了连接 现在,当我重新连接并启动spark shell以及尝试创建hiveContext时,我遇到以下错误 Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database /home/ubuntu/work/software/spark/spark-1.2.2
Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database /home/ubuntu/work/software/spark/spark-1.2.2/metastore_db.
at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown Source)
at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown Source)
at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.boot(Unknown Source)
这是因为之前的spark shell仍在运行并获得derby DB
有没有办法找到杀死它的pid
从中,我发现./bin/spark class org.apache.spark.deploy.Client kill将杀死spark。但是如何找到driverId?您应该能够通过http://:8088连接到web UI,然后从那里看到活动的驱动程序?您是指Spark UI吗?我只看到来自Spark UI的活动作业,没有看到活动驱动程序。请注意,我使用的是Spark 1.2.2