Python &引用;DenseToSparseBatchDataset“;设备“U型:”;中央处理器;对于未知op:DenseToSparseBatchDataset
经过大量的修改,tensorflow从源代码构建并安装到Python3.5中(它似乎不喜欢3.6),现在一个Keras程序在笔记本中运行,而tensorflow没有像以前那样抱怨,有些东西没有按照标准安装。但是,它似乎确实大量使用了CPU: 和GPU:Python &引用;DenseToSparseBatchDataset“;设备“U型:”;中央处理器;对于未知op:DenseToSparseBatchDataset,python,linux,tensorflow,keras,tensorflow-gpu,Python,Linux,Tensorflow,Keras,Tensorflow Gpu,经过大量的修改,tensorflow从源代码构建并安装到Python3.5中(它似乎不喜欢3.6),现在一个Keras程序在笔记本中运行,而tensorflow没有像以前那样抱怨,有些东西没有按照标准安装。但是,它似乎确实大量使用了CPU: 和GPU: $ nvidia-smi Fri Nov 10 18:13:11 2017 +----------------------------------------------------------------------------
$ nvidia-smi
Fri Nov 10 18:13:11 2017
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 375.26 Driver Version: 375.26 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 GeForce GTX 105... Off | 0000:01:00.0 On | N/A |
| 0% 49C P0 36W / 72W | 3740MiB / 4030MiB | 28% Default |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
| 0 2283 G /usr/lib/xorg/Xorg 273MiB |
| 0 3411 G cinnamon 155MiB |
| 0 14388 C /storageHDD/tensorflow/bin/python3 3307MiB |
+-----------------------------------------------------------------------------+
从jupyter内核输出中的消息来看,它似乎有意识地决定使用CPU而不是GPU:
[I 17:20:45.588 NotebookApp] Adapting to protocol v5.1 for kernel a3c0afcc-e525-48e5-8f54-75a349214f96
2017-11-10 17:20:50.857309: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:900] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2017-11-10 17:20:50.857625: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1061] Found device 0 with properties:
name: GeForce GTX 1050 Ti major: 6 minor: 1 memoryClockRate(GHz): 1.43
pciBusID: 0000:01:00.0
totalMemory: 3.94GiB freeMemory: 3.45GiB
2017-11-10 17:20:50.857643: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1151] Creating TensorFlow device (/device:GPU:0) -> (device: 0, name: GeForce GTX 1050 Ti, pci bus id: 0000:01:00.0, compute capability: 6.1)
2017-11-10 17:21:43.862726: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "DenseToSparseBatchDataset" device_type: "CPU"') for unknown op: DenseToSparseBatchDataset
2017-11-10 17:21:43.862770: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "GroupByWindowDataset" device_type: "CPU"') for unknown op: GroupByWindowDataset
2017-11-10 17:21:43.862783: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "IgnoreErrorsDataset" device_type: "CPU"') for unknown op: IgnoreErrorsDataset
2017-11-10 17:21:43.862803: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "DatasetToSingleElement" device_type: "CPU"') for unknown op: DatasetToSingleElement
2017-11-10 17:21:43.862817: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "SerializeIterator" device_type: "CPU"') for unknown op: SerializeIterator
2017-11-10 17:21:43.862836: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "DeserializeIterator" device_type: "CPU"') for unknown op: DeserializeIterator
2017-11-10 17:21:43.862845: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "MapAndBatchDataset" device_type: "CPU"') for unknown op: MapAndBatchDataset
2017-11-10 17:21:43.862867: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "ParallelInterleaveDataset" device_type: "CPU"') for unknown op: ParallelInterleaveDataset
2017-11-10 17:21:43.862891: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "ScanDataset" device_type: "CPU"') for unknown op: ScanDataset
2017-11-10 17:21:43.862910: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "SqlDataset" device_type: "CPU"') for unknown op: SqlDataset
2017-11-10 17:21:45.342326: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1151] Creating TensorFlow device (/device:GPU:0) -> (device: 0, name: GeForce GTX 1050 Ti, pci bus id: 0000:01:00.0, compute capability: 6.1)
2017-11-10 17:21:45.621793: W tensorflow/core/grappler/utils.cc:48] Node ConstantFolding/training/Adam/gradients/batch_normalization_1/batchnorm/add_grad/BroadcastGradientArgs-0 is not in the graph.
2017-11-10 17:21:45.621852: W tensorflow/core/grappler/utils.cc:48] Node ConstantFolding/training/Adam/gradients/batch_normalization_1/batchnorm/add_grad/BroadcastGradientArgs-1 is not in the graph.
2017-11-10 17:21:45.622311: W tensorflow/core/grappler/utils.cc:48] Node ConstantFolding/training/Adam/gradients/batch_normalization_1/cond/batchnorm/sub_grad/BroadcastGradientArgs-0 is not in the graph.
2017-11-10 17:21:45.622332: W tensorflow/core/grappler/utils.cc:48] Node ConstantFolding/training/Adam/gradients/batch_normalization_1/cond/batchnorm/sub_grad/BroadcastGradientArgs-1 is not in the graph.
2017-11-10 17:21:45.622394: W tensorflow/core/grappler/utils.cc:48] Node ConstantFolding/training/Adam/gradients/batch_normalization_1/batchnorm/sub_grad/BroadcastGradientArgs-0 is not in the graph.
2017-11-10 17:21:45.622411: W tensorflow/core/grappler/utils.cc:48] Node ConstantFolding/training/Adam/gradients/batch_normalization_1/batchnorm/sub_grad/BroadcastGradientArgs-1 is not in the graph.
2017-11-10 17:21:45.622470: W tensorflow/core/grappler/utils.cc:48] Node ConstantFolding/training/Adam/gradients/batch_normalization_2/batchnorm/add_grad/BroadcastGradientArgs-0 is not in the graph.
所有包含设备类型:“CPU”
的行是什么意思
有人知道这是否正常,或者这可能是某个地方缺少依赖项的迹象吗?以下包含警告消息的行是由某个用户意外添加的:
这一变化已经发生,警告信息不应再打印。谢谢@mrry我查看了“这一变化将contrib级别的数据集ops移出核心op库…”我几天前才重新安装了Tensorflow,你是说“unknow op”现在已知并且可能发生在GPU上,或者仍然未知,但只是消息会消失?如果是前者,也许应该再次从源代码处进行整个安装,以从这一更改中获益,尽管构建车轮文件确实需要半个多小时。。
2017-11-10 17:21:43.862726: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "DenseToSparseBatchDataset" device_type: "CPU"') for unknown op: DenseToSparseBatchDataset
2017-11-10 17:21:43.862770: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "GroupByWindowDataset" device_type: "CPU"') for unknown op: GroupByWindowDataset
2017-11-10 17:21:43.862783: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "IgnoreErrorsDataset" device_type: "CPU"') for unknown op: IgnoreErrorsDataset
2017-11-10 17:21:43.862803: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "DatasetToSingleElement" device_type: "CPU"') for unknown op: DatasetToSingleElement
2017-11-10 17:21:43.862817: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "SerializeIterator" device_type: "CPU"') for unknown op: SerializeIterator
2017-11-10 17:21:43.862836: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "DeserializeIterator" device_type: "CPU"') for unknown op: DeserializeIterator
2017-11-10 17:21:43.862845: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "MapAndBatchDataset" device_type: "CPU"') for unknown op: MapAndBatchDataset
2017-11-10 17:21:43.862867: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "ParallelInterleaveDataset" device_type: "CPU"') for unknown op: ParallelInterleaveDataset
2017-11-10 17:21:43.862891: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "ScanDataset" device_type: "CPU"') for unknown op: ScanDataset
2017-11-10 17:21:43.862910: E tensorflow/core/framework/op_kernel.cc:1142] OpKernel ('op: "SqlDataset" device_type: "CPU"') for unknown op: SqlDataset