Python 连接到Databricks CLI时遇到问题
因此,我需要连接到Databricks CLI,以便在本地机器上下载dbfs jar文件。为此,我使用Databricks CLI。我试着使用这个命令,下面是我得到的信息。您能解释一下为什么会出现此错误,以及为了成功连接到Databricks CLI,我需要做些什么吗Python 连接到Databricks CLI时遇到问题,python,databricks,databricks-connect,Python,Databricks,Databricks Connect,因此,我需要连接到Databricks CLI,以便在本地机器上下载dbfs jar文件。为此,我使用Databricks CLI。我试着使用这个命令,下面是我得到的信息。您能解释一下为什么会出现此错误,以及为了成功连接到Databricks CLI,我需要做些什么吗 C:\Users\Vedan>py -m pip install -U databricks-connect==5.5.* #command I wrote Collecting databricks-connect==
C:\Users\Vedan>py -m pip install -U databricks-connect==5.5.* #command I wrote
Collecting databricks-connect==5.5.*
Using cached databricks-connect-5.5.3.tar.gz (237.8 MB)
ERROR: Command errored out with exit status 1:
command: 'C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\python.exe' -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\Vedan\\AppData\\Local\\Temp\\pip-install-u_38_c96\\databricks-connect\\setup.py'"'"'; __file__='"'"'C:\\Users\\Vedan\\AppData\\Local\\Temp\\pip-install-u_38_c96\\databricks-connect\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\Vedan\AppData\Local\Temp\pip-pip-egg-info-bqyokfsw'
cwd: C:\Users\Vedan\AppData\Local\Temp\pip-install-u_38_c96\databricks-connect\
Complete output (47 lines):
Could not import pypandoc - required to package PySpark
WARNING: The wheel package is not available.
ERROR: Command errored out with exit status 1:
command: 'C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\python.exe' -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\Vedan\\AppData\\Local\\Temp\\pip-wheel-drn6k8ho\\pypandoc\\setup.py'"'"'; __file__='"'"'C:\\Users\\Vedan\\AppData\\Local\\Temp\\pip-wheel-drn6k8ho\\pypandoc\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d 'C:\Users\Vedan\AppData\Local\Temp\pip-wheel-q1to7105'
cwd: C:\Users\Vedan\AppData\Local\Temp\pip-wheel-drn6k8ho\pypandoc\
Complete output (8 lines):
no pandoc found, building platform unspecific wheel...
use 'python setup.py download_pandoc' to download pandoc.
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'bdist_wheel'
----------------------------------------
ERROR: Failed building wheel for pypandoc
ERROR: Failed to build one or more wheels
Traceback (most recent call last):
File "C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site-packages\setuptools\installer.py", line 128, in fetch_build_egg
subprocess.check_call(cmd)
File "C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\subprocess.py", line 364, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['C:\\Users\\Vedan\\AppData\\Local\\Programs\\Python\\Python38-32\\python.exe', '-m', 'pip', '--disable-pip-version-check', 'wheel', '--no-deps', '-w', 'C:\\Users\\Vedan\\AppData\\Local\\Temp\\tmplpeqb0pi', '--quiet', 'pypandoc']' returned non-zero exit status 1.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "C:\Users\Vedan\AppData\Local\Temp\pip-install-u_38_c96\databricks-connect\setup.py", line 210, in <module>
setup(
File "C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site-packages\setuptools\__init__.py", line 143, in setup
_install_setup_requires(attrs)
File "C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site-packages\setuptools\__init__.py", line 138, in _install_setup_requires
dist.fetch_build_eggs(dist.setup_requires)
File "C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site-packages\setuptools\dist.py", line 695, in fetch_build_eggs
resolved_dists = pkg_resources.working_set.resolve(
File "C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site-packages\pkg_resources\__init__.py", line 781, in resolve
dist = best[req.key] = env.best_match(
File "C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site-packages\pkg_resources\__init__.py", line 1066, in best_match
return self.obtain(req, installer)
File "C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site-packages\pkg_resources\__init__.py", line 1078, in obtain
return installer(requirement)
File "C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site-packages\setuptools\dist.py", line 754, in fetch_build_egg
return fetch_build_egg(self, req)
File "C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site-packages\setuptools\installer.py", line 130, in fetch_build_egg
raise DistutilsError(str(e))
distutils.errors.DistutilsError: Command '['C:\\Users\\Vedan\\AppData\\Local\\Programs\\Python\\Python38-32\\python.exe', '-m', 'pip', '--disable-pip-version-check', 'wheel', '--no-deps', '-w', 'C:\\Users\\Vedan\\AppData\\Local\\Temp\\tmplpeqb0pi', '--quiet', 'pypandoc']' returned non-zero exit status 1.
----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
C:\Users\Vedan>py-mpip安装-U databricks connect==5.5.#我编写的命令
正在收集数据块连接==5.5*
使用缓存的databricks-connect-5.5.3.tar.gz(237.8 MB)
错误:命令出错,退出状态为1:
命令:“C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\Python.exe'-C”import sys,setuptools,tokenize;sys.argv[0]=“C:\\Users\\Vedan\\AppData\\Local\\Temp\\pip-install-u\u 38\u c96\\databricks connect\\setup.py'”__文件“''''C:\\Users\\Vedan\\AppData\\Local\\Temp\\pip-install-u\u 38\u c96\\databricks connect\\setup.py''”;f=getattr(标记化,“'open'”,open)(\uuuuu文件);code=f.read().replace(“\r\n”“”、“\n”“”);f、 close();exec(编译(代码,“'exec'”)“鸡蛋信息——鸡蛋库”C:\Users\Vedan\AppData\Local\Temp\pip-pip-egg-info-bqyokfsw”
cwd:C:\Users\Vedan\AppData\Local\Temp\pip-install-u\u 38\u c96\databricks connect\
完整输出(47行):
无法导入pypandoc-打包PySpark所需
警告:车轮组件不可用。
错误:命令出错,退出状态为1:
命令:“C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\Python.exe'-u-C'import sys,setuptools,tokenize;sys.argv[0]=“C:\\Users\\Vedan\\AppData\\Local\\Temp\\pip-wheel-drn6k8ho\\pypandoc\\setup.py”“”__文件“''''C:\\Users\\Vedan\\AppData\\Local\\Temp\\pip-wheel-drn6k8ho\\pypandoc\\setup.py''”;f=getattr(标记化,“'open'”,open)(\uuuuu文件);code=f.read().replace(“\r\n”“”、“\n”“”);f、 close();exec(编译(代码,“文件”“exec”))“bdist\u wheel-d'C:\Users\Vedan\AppData\Local\Temp\pip-wheel-q1to7105”
cwd:C:\Users\Vedan\AppData\Local\Temp\pip-wheel-drn6k8ho\pypandoc\
完整输出(8行):
未找到pandoc,建筑平台非特定车轮。。。
使用“python setup.py download_pandoc”下载pandoc。
用法:setup.py[global\u opts]cmd1[cmd1\u opts][cmd2[cmd2\u opts]…]
或:setup.py--帮助[cmd1 cmd2…]
或:setup.py--帮助命令
或者:setup.py cmd--帮助
错误:无效命令“bdist\u wheel”
----------------------------------------
错误:为pypandoc生成控制盘失败
错误:无法生成一个或多个控制盘
回溯(最近一次呼叫最后一次):
文件“C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site packages\setuptools\installer.py”,第128行,在fetch\u build\u egg中
子进程检查调用(cmd)
文件“C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\subprocess.py”,第364行,在check\u调用中
引发被调用的进程错误(retcode,cmd)
subprocess.CalledProcessError:Command'['C:\\Users\\Vedan\\AppData\\Local\\Programs\\Python\\Python38-32\\Python.exe','-m','pip','--禁用pip版本检查','wheel','--无deps','-w','C:\\Users\\Vedan\\AppData\\Local\\Temp\\tmplpeqb0pi','--quiet','pypandoc']返回非零退出状态1。
在处理上述异常期间,发生了另一个异常:
回溯(最近一次呼叫最后一次):
文件“”,第1行,在
文件“C:\Users\Vedan\AppData\Local\Temp\pip-install-u\u 38\u c96\databricks connect\setup.py”,第210行,在
设置(
文件“C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site packages\setuptools\\uuuuuu init\uuuuuuu.py”,安装程序中第143行
_安装\u安装\u需要(属性)
文件“C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site packages\setuptools\\ uuuuu init\uuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuu
dist.fetch\u build\u鸡蛋(dist.setup\u需要)
文件“C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site packages\setuptools\dist.py”,第695行,在fetch\u build\u中
resolved_dists=pkg_resources.working_set.resolve(
文件“C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site packages\pkg\u resources\uuuuu init\uuuuu.py”,第781行,解析
dist=best[req.key]=env.best\u匹配(
文件“C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site packages\pkg\u resources\uuuu init\uuuu.py”,第1066行,最佳匹配
返回自获取(请求,安装程序)
文件“C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site packages\pkg\u resources\uuuuu init\uuuuu.py”,第1078行,在获取中
返回安装程序(要求)
文件“C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site packages\setuptools\dist.py”,第754行,在fetch\u build\u egg中
返回获取\构建\蛋(自身,需要)
文件“C:\Users\Vedan\AppData\Local\Programs\Python\Python38-32\lib\site packages\setuptools\installer.py”,第130行,在fetch\u build\u egg中
升高距离错误(str(e))
distutils.errors.DistutilsError:Command'['C:\\Users\\Vedan\\AppData\\Local\\Programs\\Python\\Python38-32\\Python.exe','-m','pip','--disable pip version check','wheel','--no deps','-w','C:\\Users\\Vedan AppData\\Local Temp\\tmplpeqb0pi','--quiet','pypandoc返回非零退出状态1。
----------------------------------------
错误:命令出错,退出状态为1:python setup.py egg_info检查日志以获得完整的命令输出。
在安装databricks cli之前,您可能必须先安装控制盘软件包
试一试
然后重试安装databricks cli
pip install wheel