Spark Kubernetes构建docker镜像失败
我在Kubernetes上试Spark。刚刚在我的VPC中的EC2实例上下载了Spark 2.4.3。我已经在/etc/sysconfig/docker中设置了我的代理,并且能够从docker hub导入和运行docker映像 命令:bin/docker-image-tool.sh-t k8s-spark-2.4.3 buildSpark Kubernetes构建docker镜像失败,docker,apache-spark,Docker,Apache Spark,我在Kubernetes上试Spark。刚刚在我的VPC中的EC2实例上下载了Spark 2.4.3。我已经在/etc/sysconfig/docker中设置了我的代理,并且能够从docker hub导入和运行docker映像 命令:bin/docker-image-tool.sh-t k8s-spark-2.4.3 build Sending build context to Docker daemon 261.4MB Step 1/15 : FROM openjdk:8-alpine -
Sending build context to Docker daemon 261.4MB
Step 1/15 : FROM openjdk:8-alpine
---> a3562aa0b991
Step 2/15 : ARG spark_jars=jars
---> Using cache
---> 2f9744e85911
Step 3/15 : ARG img_path=kubernetes/dockerfiles
---> Using cache
---> ba02760dc2df
Step 4/15 : ARG k8s_tests=kubernetes/tests
---> Using cache
---> a630900ca584
Step 5/15 : RUN set -ex && apk upgrade --no-cache && apk add --no-cache bash tini libc6-compat linux-pam nss && mkdir -p /opt/spark && mkdir -p /opt/spark/work-dir && touch /opt/spark/RELEASE && rm /bin/sh && ln -sv /bin/bash /bin/sh && echo "auth required pam_wheel.so use_uid" >> /etc/pam.d/su && chgrp root /etc/passwd && chmod ug+rw /etc/passwd
---> Running in 6b2fe7f7fcc6
+ apk upgrade --no-cache
fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/main/x86_64/APKINDEX.tar.gz
WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.9/main/x86_64/APKINDEX.tar.gz: network error (check Internet connection and firewall)
fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/community/x86_64/APKINDEX.tar.gz
WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.9/community/x86_64/APKINDEX.tar.gz: network error (check Internet connection and firewall)
+ apk add --no-cache bash tini libc6-compat linux-pam nss
OK: 103 MiB in 54 packages
fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/main/x86_64/APKINDEX.tar.gz
WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.9/main/x86_64/APKINDEX.tar.gz: network error (check Internet connec tion and firewall)
fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/community/x86_64/APKINDEX.tar.gz
WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.9/community/x86_64/APKINDEX.tar.gz: network error (check Internet connection and firewall)
bash (missing):
required by: world[bash]
libc6-compat (missing):
required by: world[libc6-compat]
linux-pam (missing):
required by: world[linux-pam]
tini (missing):
required by: world[tini]
ERROR: unsatisfiable constraints:
The command '/bin/sh -c set -ex && apk upgrade --no-cache && apk add --no-cache bash tini libc6-compat linux-pam nss && mkdir -p /opt/spark && mkdir -p /opt/spark/work-dir && touch /opt/spark/RELEASE && rm /bin/sh && ln -sv /bin/bash /bin/sh && echo "auth required pam_wheel.so use_uid" >> /etc/pam.d/su && chgrp root /etc/passwd && chmod ug+rw /etc/passwd' returned a non-zero code: 4
Sending build context to Docker daemon 261.4MB
Step 1/9 : ARG base_img
Step 2/9 : FROM $base_img
pull access denied for spark, repository does not exist or may require 'docker login'
Sending build context to Docker daemon 261.4MB
Step 1/9 : ARG base_img
Step 2/9 : FROM $base_img
pull access denied for spark, repository does not exist or may require 'docker login'
你知道怎么解决这个问题吗?
我也试着在“docker登录”后运行这个。结果是一样的 您的EC2实例似乎与internet没有连接
WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.9/main/x86_64/APKINDEX.tar.gz:
network error (check Internet connection and firewall)
我在笔记本电脑上运行的Ubuntu 16.04虚拟机中遇到了完全相同的问题 我能够用curl下载软件包,并使用web浏览器访问alpine存储库目录,因此我知道问题不在于网络连接 信不信由你,解决方案是重新启动虚拟机中运行的docker服务
我在搜索apline软件包加载错误时发现这是一个建议的解决方案,它成功了 它有互联网连接。它位于proxy的后面,但我确实按照我的问题中提到的设置了proxy。@VenkatAnkam您为dockerhub指定了一个代理,而不是AlpineLinux Packages的代理dockerhub的代理或任何其他代理都是相同的,对吗?您不需要
docker登录
。错误只是说从$base\u img执行时找不到第一个容器映像spark
,这是因为它没有构建(因为无法访问Alpine linux repos)