如何使用virtualenv安装软件包,但仍使用system tensorflow安装

如何使用virtualenv安装软件包,但仍使用system tensorflow安装,tensorflow,virtualenv,google-dl-platform,Tensorflow,Virtualenv,Google Dl Platform,在我的本地机器上,我设置了它,以便在进行ML测试时在虚拟环境中安装这些依赖项 tensorflow keras h5py requests pillow tensorflow-hub 我有一些脚本,这些脚本将经过测试,生成一个venv,安装需求,并执行培训。如果我可以在任何地方使用这些脚本,包括在Google Deep Learning Platform VMs上,那就太好了,但是当我尝试在venv中安装tensorflow时,它不再使用GPU,所以我假设它不再使用tensorflow的系统安

在我的本地机器上,我设置了它,以便在进行ML测试时在虚拟环境中安装这些依赖项

tensorflow
keras
h5py
requests
pillow
tensorflow-hub
我有一些脚本,这些脚本将经过测试,生成一个venv,安装需求,并执行培训。如果我可以在任何地方使用这些脚本,包括在Google Deep Learning Platform VMs上,那就太好了,但是当我尝试在venv中安装tensorflow时,它不再使用GPU,所以我假设它不再使用tensorflow的系统安装

我还尝试了
--system site packages
标志,该标志表示tensorflow已经安装,但随后它停止使用GPU

假设我做了以下几件事

$ virtualenv --sysem-site-packages venv/
$ source venv/bin/activate
$ pip install -r requirements.txt
Collecting tensorflow (from -r requirements.txt (line 1))
  Using cached https://files.pythonhosted.org/packages/1a/c4/8cb95df0bf06089014259b25997c3921a87aa08e2cd981417d91ca92f7e9/tensorflow-1.10.1-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: keras in /usr/local/lib/python2.7/dist-packages (from -r requirements.txt (line 2)) (2.2.2)
Requirement already satisfied: h5py in /usr/lib/python2.7/dist-packages (from -r requirements.txt (line 3)) (2.7.0)
Requirement already satisfied: requests in /usr/lib/python2.7/dist-packages (from -r requirements.txt (line 4)) (2.12.4)
Requirement already satisfied: pillow in /usr/lib/python2.7/dist-packages (from -r requirements.txt (line 5)) (4.0.0)
Requirement already satisfied: tensorflow-hub in /home/john/.local/lib/python2.7/site-packages (from -r requirements.txt (line 6)) (0.1.1)
Collecting numpy<=1.14.5,>=1.13.3 (from tensorflow->-r requirements.txt (line 1))
  Using cached https://files.pythonhosted.org/packages/6a/a9/c01a2d5f7b045f508c8cefef3b079fe8c413d05498ca0ae877cffa230564/numpy-1.14.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: grpcio>=1.8.6 in /usr/local/lib/python2.7/dist-packages (from tensorflow->-r requirements.txt (line 1)) (1.14.1)
Requirement already satisfied: protobuf>=3.6.0 in /home/john/.local/lib/python2.7/site-packages (from tensorflow->-r requirements.txt (line 1)) (3.6.1)
Requirement already satisfied: termcolor>=1.1.0 in /usr/local/lib/python2.7/dist-packages (from tensorflow->-r requirements.txt (line 1)) (1.1.0)
Requirement already satisfied: backports.weakref>=1.0rc1 in /usr/local/lib/python2.7/dist-packages (from tensorflow->-r requirements.txt (line 1)) (1.0.post1)
Requirement already satisfied: absl-py>=0.1.6 in /usr/local/lib/python2.7/dist-packages (from tensorflow->-r requirements.txt (line 1)) (0.3.0)
Requirement already satisfied: wheel in ./venv/lib/python2.7/site-packages (from tensorflow->-r requirements.txt (line 1)) (0.31.1)
Requirement already satisfied: tensorboard<1.11.0,>=1.10.0 in /usr/local/lib/python2.7/dist-packages (from tensorflow->-r requirements.txt (line 1)) (1.10.0)
Requirement already satisfied: six>=1.10.0 in /home/john/.local/lib/python2.7/site-packages (from tensorflow->-r requirements.txt (line 1)) (1.11.0)
Requirement already satisfied: gast>=0.2.0 in /usr/local/lib/python2.7/dist-packages (from tensorflow->-r requirements.txt (line 1)) (0.2.0)
Requirement already satisfied: mock>=2.0.0 in /usr/lib/python2.7/dist-packages (from tensorflow->-r requirements.txt (line 1)) (2.0.0)
Requirement already satisfied: enum34>=1.1.6 in /usr/lib/python2.7/dist-packages (from tensorflow->-r requirements.txt (line 1)) (1.1.6)
Requirement already satisfied: astor>=0.6.0 in /usr/local/lib/python2.7/dist-packages (from tensorflow->-r requirements.txt (line 1)) (0.7.1)
Collecting setuptools<=39.1.0 (from tensorflow->-r requirements.txt (line 1))
  Using cached https://files.pythonhosted.org/packages/8c/10/79282747f9169f21c053c562a0baa21815a8c7879be97abd930dbcf862e8/setuptools-39.1.0-py2.py3-none-any.whl
Requirement already satisfied: pyyaml in /usr/lib/python2.7/dist-packages (from keras->-r requirements.txt (line 2)) (3.12)
Requirement already satisfied: scipy>=0.14 in /usr/lib/python2.7/dist-packages (from keras->-r requirements.txt (line 2)) (0.18.1)
Requirement already satisfied: keras-applications==1.0.4 in /usr/local/lib/python2.7/dist-packages (from keras->-r requirements.txt (line 2)) (1.0.4)
Requirement already satisfied: keras-preprocessing==1.0.2 in /usr/local/lib/python2.7/dist-packages (from keras->-r requirements.txt (line 2)) (1.0.2)
Requirement already satisfied: futures>=2.2.0 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.8.6->tensorflow->-r requirements.txt (line 1)) (3.2.0)
Requirement already satisfied: markdown>=2.6.8 in /usr/lib/python2.7/dist-packages (from tensorboard<1.11.0,>=1.10.0->tensorflow->-r requirements.txt (line 1)) (2.6.8)
Requirement already satisfied: werkzeug>=0.11.10 in /usr/lib/python2.7/dist-packages (from tensorboard<1.11.0,>=1.10.0->tensorflow->-r requirements.txt (line 1)) (0.11.15)
tensorflow-serving-api 1.10.0 has requirement protobuf==3.6.0, but you'll have protobuf 3.6.1 which is incompatible.
Installing collected packages: numpy, setuptools, tensorflow
  Found existing installation: numpy 1.15.1
    Not uninstalling numpy at /home/john/.local/lib/python2.7/site-packages, outside environment /home/john/retrain/venv
    Can't uninstall 'numpy'. No files were found to uninstall.
  Found existing installation: setuptools 40.2.0
    Uninstalling setuptools-40.2.0:
      Successfully uninstalled setuptools-40.2.0
Successfully installed numpy-1.14.5 setuptools-39.1.0 tensorflow-1.10.1
$virtualenv--sysem站点包/
$source venv/bin/激活
$pip安装-r requirements.txt
收集tensorflow(来自-r requirements.txt(第1行))
使用缓存https://files.pythonhosted.org/packages/1a/c4/8cb95df0bf06089014259b25997c3921a87aa08e2cd981417d91ca92f7e9/tensorflow-1.10.1-cp27-cp27mu-manylinux1_x86_64.whl
已满足要求:keras在/usr/local/lib/python2.7/dist-packages中(来自-r requirements.txt(第2行))(2.2.2)
已满足要求:h5py in/usr/lib/python2.7/dist-packages(来自-r requirements.txt(第3行))(2.7.0)
已满足需求:在/usr/lib/python2.7/dist-packages中的请求(来自-r requirements.txt(第4行))(2.12.4)
已满足要求:枕在/usr/lib/python2.7/dist-packages中(来自-r requirements.txt(第5行))(4.0.0)
已满足要求:tensorflow hub in/home/john/.local/lib/python2.7/site-packages(来自-r requirements.txt(第6行))(0.1.1)
收集numpy=1.13.3(来自tensorflow->-r requirements.txt(第1行))
使用缓存https://files.pythonhosted.org/packages/6a/a9/c01a2d5f7b045f508c8cefef3b079fe8c413d05498ca0ae877cffa230564/numpy-1.14.5-cp27-cp27mu-manylinux1_x86_64.whl
已满足要求:grpcio>=1.8.6 in/usr/local/lib/python2.7/dist-packages(来自tensorflow->-r requirements.txt(第1行))(1.14.1)
已满足要求:protobuf>=3.6.0 in/home/john/.local/lib/python2.7/site-packages(来自tensorflow->-r requirements.txt(第1行))(3.6.1)
已满足要求:termcolor>=1.1.0 in/usr/local/lib/python2.7/dist-packages(来自tensorflow->-r requirements.txt(第1行))(1.1.0)
已满足要求:backports.weakref>=1.0rc1 in/usr/local/lib/python2.7/dist-packages(来自tensorflow->-r requirements.txt(第1行))(1.0.post1)
已满足要求:absl py>=0.1.6 in/usr/local/lib/python2.7/dist-packages(来自tensorflow->-r requirements.txt(第1行))(0.3.0)
已满足要求:轮入。/venv/lib/python2.7/site-packages(来自tensorflow->-r requirements.txt(第1行))(0.31.1)
已满足要求:tensorboard=1.10.0 in/usr/local/lib/python2.7/dist-packages(来自tensorflow->-r requirements.txt(第1行))(1.10.0)
已满足要求:六个>=1.10.0 in/home/john/.local/lib/python2.7/site-packages(来自tensorflow->-r requirements.txt(第1行))(1.11.0)
已满足要求:gast>=0.2.0 in/usr/local/lib/python2.7/dist-packages(来自tensorflow->-r requirements.txt(第1行))(0.2.0)
已满足要求:mock>=2.0.0 in/usr/lib/python2.7/dist-packages(来自tensorflow->-r requirements.txt(第1行))(2.0.0)
已满足要求:enum34>=1.1.6 in/usr/lib/python2.7/dist-packages(来自tensorflow->-r requirements.txt(第1行))(1.1.6)
已满足要求:astor>=0.6.0 in/usr/local/lib/python2.7/dist-packages(来自tensorflow->-r requirements.txt(第1行))(0.7.1)
收集setuptools-r requirements.txt(第1行))
使用缓存https://files.pythonhosted.org/packages/8c/10/79282747f9169f21c053c562a0baa21815a8c7879be97abd930dbcf862e8/setuptools-39.1.0-py2.py3-none-any.whl
已满足要求:pyyaml in/usr/lib/python2.7/dist-packages(来自keras->-r requirements.txt(第2行))(3.12)
已满足要求:scipy>=0.14 in/usr/lib/python2.7/dist-packages(来自keras->-r requirements.txt(第2行))(0.18.1)
已满足要求:keras应用程序==1.0.4 in/usr/local/lib/python2.7/dist-packages(来自keras->-r requirements.txt(第2行))(1.0.4)
已满足要求:keras预处理==1.0.2 in/usr/local/lib/python2.7/dist-packages(来自keras->-r requirements.txt(第2行))(1.0.2)
已满足要求:futures>=2.2.0 in/usr/local/lib/python2.7/dist-packages(来自grpcio>=1.8.6->tensorflow->-r requirements.txt(第1行))(3.2.0)
已满足要求:在/usr/lib/python2.7/dist-packages中降价>=2.6.8(来自tensorboard=1.10.0->tensorflow->-r requirements.txt(第1行))(2.6.8)
已满足要求:werkzeug>=0.11.10 in/usr/lib/python2.7/dist-packages(来自tensorboard=1.10.0->tensorflow->-r requirements.txt(第1行))(0.11.15)
为api 1.10.0提供服务的tensorflow具有protobuf==3.6.0的需求,但protobuf 3.6.1是不兼容的。
安装收集的软件包:numpy、setuptools、tensorflow
找到现有安装:numpy 1.15.1
不在/home/john/.local/lib/python2.7/site-packages、外部环境/home/john/retain/venv卸载numpy
无法卸载“numpy”。找不到要卸载的文件。
找到现有安装:setuptools 40.2.0
卸载setuptools-40.2.0:
已成功卸载setuptools-40.2.0
已成功安装numpy-1.14.5 setuptools-39.1.0 tensorflow-1.10.1

对于所有依赖项tensorflow,它显示了系统上存在的所有依赖项,因此它不会安装它们,但它会继续安装tensorflow。为什么会这样?

在您的需求文件中,列出了
tensorflow
包,它是仅CPU的包。要获得GPU支持,请改为安装tensorflow GPU。

不幸的是,tensorflow没有针对
sudo ln -s /usr/local/cuda/lib64/stubs/libcuda.so /usr/libcuda.so.1
sudo ln -s /usr/local/cuda/lib64/stubs/libcuda.so /usr/libcuda.so