Python 无法在windows上运行tensorflow对象检测api

Python 无法在windows上运行tensorflow对象检测api,python,tensorflow,deep-learning,object-detection-api,Python,Tensorflow,Deep Learning,Object Detection Api,我在我的Windows 10 pc上安装了tensorflow gpu1.4。我尝试使用ssd\u mobilenet检查点来训练一个测试点。虽然我在谷歌云上成功地实现了这一点,但它无法在本地运行,并具有以下输出(显然,它无法加载预训练模型): python object\u detection/train.py--logtostderr--pipeline\u config\u path=“C://raccoon/training/cfg.config”--train\u dir=“C://r

我在我的Windows 10 pc上安装了
tensorflow gpu
1.4。我尝试使用
ssd\u mobilenet
检查点来训练一个测试点。虽然我在谷歌云上成功地实现了这一点,但它无法在本地运行,并具有以下输出(显然,它无法加载预训练模型):

python object\u detection/train.py--logtostderr--pipeline\u config\u path=“C://raccoon/training/cfg.config”--train\u dir=“C://raccoon/training”>out.txt
更新说明:
警告:tensorflow:From C:\Users\orona\Dropbox\projects\models\research\object\u detection\trainer.py:210:create\u global\u步骤(来自tensorflow.contrib.framework.python.ops.variables)已弃用,将在未来版本中删除。
请切换到tf.train.create\u global\u步骤
信息:tensorflow:框预测值之前的附加转换深度:0
信息:tensorflow:框预测值之前的附加转换深度:0
信息:tensorflow:框预测值之前的附加转换深度:0
信息:tensorflow:框预测值之前的附加转换深度:0
信息:tensorflow:框预测值之前的附加转换深度:0
信息:tensorflow:框预测值之前的附加转换深度:0
信息:tensorflow:摘要名称/克隆丢失非法;改为使用克隆丢失。
2018-01-22 17:53:34.358048:ic:\tf\u jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\platform\cpu\u feature\u guard.cc:137]您的cpu支持该tensorflow二进制文件未编译为使用的指令:AVX AVX2
2018-01-22 17:53:34.685205:IC:\tf\u jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\common\u runtime\gpu\gpu\device.cc:1030]找到具有以下属性的设备0:
名称:GeForce GTX 1080 Ti大调:6小调:1记忆锁定率(GHz):1.683
pciBusID:0000:01:00.0
总内存:11.00GiB自由内存:9.10GiB
2018-01-22 17:53:34.685312:IC:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\common\u runtime\gpu\gpu\device.cc:1120]创建tensorflow设备(/设备:gpu:0)->(设备:0,名称:GeForce GTX 1080 Ti,pci总线id:0000:01:00.0,计算能力:6.1)
信息:tensorflow:从C://raccoon/training\model.ckpt恢复参数
2018-01-22 17:53:41.215719:W C:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192]未找到:关键功能提取器/MobilenetV1/Conv2d\u 13\u逐点Conv2d\u 3 x3\u s2\u 256/检查点未找到权重/指数移动平均值
2018-01-22 17:53:41.216292:W C:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192]未找到:关键功能提取器/mobilenev1/Conv2d_9_pointwise/weights/RMSProp_1未在检查点中找到
2018-01-22 17:53:41.217017:W C:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op\u kernel.cc:1192]未找到:关键功能提取器/MobilenetV1/Conv2d\u 13\u逐点方式\u 2\u Conv2d\u 3\u 3x3\u s2\u 256/weights/RMSProp未在检查点中找到
2018-01-22 17:53:41.217942:W C:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op\u kernel.cc:1192]未找到:关键功能提取器/MobilenetV1/Conv2d\u 13\u逐点式Conv2d\u 3\u 3x3\u s2\u 256/weights/RMSProp\u 1未在检查点中找到
2018-01-22 17:53:41.219617:W C:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192]未找到:关键功能提取器/mobilenev1/Conv2d_9_pointwise/weights/RMSProp未在检查点中找到
2018-01-22 17:53:41.220835:W C:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192]未找到:关键功能提取器/mobilenev1/Conv2d\u 13\u逐点Conv2d\u 4\u 3x3\u s2\u 256/BatchNorm/beta/指数移动平均值未在检查点中找到
2018-01-22 17:53:41.221508:W C:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op\u kernel.cc:1192]未找到:关键功能提取器/MobilenetV1/Conv2d\u 13\u逐点式Conv2d\u 4\u 3x3\u s2\u 256/BatchNorm/beta/RMSProp未在检查点中找到
2018-01-22 17:53:41.223914:W C:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192]未找到:关键功能提取器/mobilenev1/Conv2d_9_逐点/权重/指数移动平均值未在检查点中找到
2018-01-22 17:53:41.223936:W C:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op\u kernel.cc:1192]未找到:关键功能提取器/MobilenetV1/Conv2d\u 13\u逐点式Conv2d\u 4\u 3x3\u s2\u 256/BatchNorm/beta/RMSProp\u 1未在检查点中找到
2018-01-22 17:53:41.225563:W C:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192]未找到:关键功能提取器/mobilenev1/Conv2d\u 13\u逐点Conv2d\u 4\u 3x3\u s2\u 256/BatchNorm/gamma/指数移动平均值未在检查点中找到
2018-01-22 17:53:41.229052:W C:\tf\u jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op\u kernel.cc:1192]未找到:关键功能提取器/mobilenev1/Conv2d\u 13\u逐点式Conv2d\u 4\u 3x3\u s2\u 256/BatchNorm/gamma/RMSProp未在检查点中找到
2018-01-22 17:53:41.229776:W C:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op\u kernel.cc:1192]未找到:关键功能提取器/MobilenetV1/Conv2d\u 13\u逐点式Conv2d\u 4\u 3x3\u s2\u 256/BatchNorm/gamma/RMSProp\u 1未在检查点中找到
2018-01-22 17:53:41.234741:W C:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192]未找到:关键功能提取器/mobilenev1/Conv2d\u 13\u逐点式Conv2d\u 4\u 3x3\u s2\u 256/检查点未找到权重/指数移动平均值
.
.
.
.
2018-01-22 17:53:41.726224:W C:\tf_jenkins\home\workspace\rel win\M\windows gpu\PY\36\tensorflow\core\framework\op\u kernel.cc:1192]未找到:检查点中未找到关键功能提取器/MobilenetV1/Conv2d\u 4\u逐点/BatchNorm/gamma/RMSProp\u 1
信息:tensorflow:向协调器报告的错误:,关键功能提取器/MobilenetV1/Conv2d\u 13\u逐点\u 2\u Conv2d\u 3\u 3x3\u s2\u 256/权重/指数移动平均值未
python object_detection/train.py --logtostderr --pipeline_config_path="C://raccoon/training/cfg.config" --train_dir="C://raccoon/training" > out.txt
Instructions for updating:
WARNING:tensorflow:From C:\Users\orona\Dropbox\projects\models\research\object_detection\trainer.py:210: create_global_step (from tensorflow.contrib.framework.python.ops.variables) is deprecated and will be removed in a future version.
Please switch to tf.train.create_global_step
INFO:tensorflow:depth of additional conv before box predictor: 0
INFO:tensorflow:depth of additional conv before box predictor: 0
INFO:tensorflow:depth of additional conv before box predictor: 0
INFO:tensorflow:depth of additional conv before box predictor: 0
INFO:tensorflow:depth of additional conv before box predictor: 0
INFO:tensorflow:depth of additional conv before box predictor: 0
INFO:tensorflow:Summary name /clone_loss is illegal; using clone_loss instead.
2018-01-22 17:53:34.358048: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\platform\cpu_feature_guard.cc:137] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2
2018-01-22 17:53:34.685205: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\common_runtime\gpu\gpu_device.cc:1030] Found device 0 with properties:
name: GeForce GTX 1080 Ti major: 6 minor: 1 memoryClockRate(GHz): 1.683
pciBusID: 0000:01:00.0
totalMemory: 11.00GiB freeMemory: 9.10GiB
2018-01-22 17:53:34.685312: I C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\common_runtime\gpu\gpu_device.cc:1120] Creating TensorFlow device (/device:GPU:0) -> (device: 0, name: GeForce GTX 1080 Ti, pci bus id: 0000:01:00.0, compute capability: 6.1)
INFO:tensorflow:Restoring parameters from C://raccoon/training\model.ckpt
2018-01-22 17:53:41.215719: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/weights/ExponentialMovingAverage not found in checkpoint
2018-01-22 17:53:41.216292: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_9_pointwise/weights/RMSProp_1 not found in checkpoint
2018-01-22 17:53:41.217017: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/weights/RMSProp not found in checkpoint
2018-01-22 17:53:41.217942: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/weights/RMSProp_1 not found in checkpoint
2018-01-22 17:53:41.219617: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_9_pointwise/weights/RMSProp not found in checkpoint
2018-01-22 17:53:41.220835: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/beta/ExponentialMovingAverage not found in checkpoint
2018-01-22 17:53:41.221508: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/beta/RMSProp not found in checkpoint
2018-01-22 17:53:41.223914: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_9_pointwise/weights/ExponentialMovingAverage not found in checkpoint
2018-01-22 17:53:41.223936: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/beta/RMSProp_1 not found in checkpoint
2018-01-22 17:53:41.225563: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/gamma/ExponentialMovingAverage not found in checkpoint
2018-01-22 17:53:41.229052: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/gamma/RMSProp not found in checkpoint
2018-01-22 17:53:41.229776: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/gamma/RMSProp_1 not found in checkpoint
2018-01-22 17:53:41.234741: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/weights/ExponentialMovingAverage not found in checkpoint
.
.
.
.
2018-01-22 17:53:41.726224: W C:\tf_jenkins\home\workspace\rel-win\M\windows-gpu\PY\36\tensorflow\core\framework\op_kernel.cc:1192] Not found: Key FeatureExtractor/MobilenetV1/Conv2d_4_pointwise/BatchNorm/gamma/RMSProp_1 not found in checkpoint
INFO:tensorflow:Error reported to Coordinator: <class 'tensorflow.python.framework.errors_impl.NotFoundError'>, Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/weights/ExponentialMovingAverage not found in checkpoint
         [[Node: save_1/RestoreV2_303 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2_303/tensor_names, save_1/RestoreV2_303/shape_and_slices)]]

Caused by op 'save_1/RestoreV2_303', defined at:
  File "object_detection/train.py", line 164, in <module>
    tf.app.run()
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\platform\app.py", line 48, in run
    _sys.exit(main(_sys.argv[:1] + flags_passthrough))
  File "object_detection/train.py", line 160, in main
    worker_job_name, is_chief, FLAGS.train_dir)
  File "C:\Users\orona\Dropbox\projects\models\research\object_detection\trainer.py", line 317, in train
    keep_checkpoint_every_n_hours=keep_checkpoint_every_n_hours)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\saver.py", line 1218, in __init__
    self.build()
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\saver.py", line 1227, in build
    self._build(self._filename, build_save=True, build_restore=True)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\saver.py", line 1263, in _build
    build_save=build_save, build_restore=build_restore)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\saver.py", line 751, in _build_internal
    restore_sequentially, reshape)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\saver.py", line 427, in _AddRestoreOps
    tensors = self.restore_op(filename_tensor, saveable, preferred_shard)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\saver.py", line 267, in restore_op
    [spec.tensor.dtype])[0])
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\ops\gen_io_ops.py", line 1020, in restore_v2
    shape_and_slices=shape_and_slices, dtypes=dtypes, name=name)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\framework\op_def_library.py", line 787, in _apply_op_helper
    op_def=op_def)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\framework\ops.py", line 2956, in create_op
    op_def=op_def)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\framework\ops.py", line 1470, in __init__
    self._traceback = self._graph._extract_stack()  # pylint: disable=protected-access

NotFoundError (see above for traceback): Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/weights/ExponentialMovingAverage not found in checkpoint
         [[Node: save_1/RestoreV2_303 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2_303/tensor_names, save_1/RestoreV2_303/shape_and_slices)]]

Traceback (most recent call last):
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\client\session.py", line 1323, in _do_call
    return fn(*args)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\client\session.py", line 1302, in _run_fn
    status, run_metadata)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\framework\errors_impl.py", line 473, in __exit__
    c_api.TF_GetCode(self.status.status))
tensorflow.python.framework.errors_impl.NotFoundError: Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/weights/ExponentialMovingAverage not found in checkpoint
         [[Node: save_1/RestoreV2_303 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2_303/tensor_names, save_1/RestoreV2_303/shape_and_slices)]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "object_detection/train.py", line 164, in <module>
    tf.app.run()
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\platform\app.py", line 48, in run
    _sys.exit(main(_sys.argv[:1] + flags_passthrough))
  File "object_detection/train.py", line 160, in main
    worker_job_name, is_chief, FLAGS.train_dir)
  File "C:\Users\orona\Dropbox\projects\models\research\object_detection\trainer.py", line 332, in train
    saver=saver)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\contrib\slim\python\slim\learning.py", line 742, in train
    master, start_standard_services=False, config=session_config) as sess:
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\contextlib.py", line 81, in __enter__
    return next(self.gen)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\supervisor.py", line 964, in managed_session
    self.stop(close_summary_writer=close_summary_writer)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\supervisor.py", line 792, in stop
    stop_grace_period_secs=self._stop_grace_secs)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\coordinator.py", line 389, in join
    six.reraise(*self._exc_info_to_raise)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\six.py", line 693, in reraise
    raise value
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\supervisor.py", line 953, in managed_session
    start_standard_services=start_standard_services)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\supervisor.py", line 708, in prepare_or_wait_for_session
    init_feed_dict=self._init_feed_dict, init_fn=self._init_fn)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\session_manager.py", line 273, in prepare_session
    config=config)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\session_manager.py", line 205, in _restore_checkpoint
    saver.restore(sess, ckpt.model_checkpoint_path)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\saver.py", line 1666, in restore
    {self.saver_def.filename_tensor_name: save_path})
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\client\session.py", line 889, in run
    run_metadata_ptr)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\client\session.py", line 1120, in _run
    feed_dict_tensor, options, run_metadata)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\client\session.py", line 1317, in _do_run
    options, run_metadata)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\client\session.py", line 1336, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.NotFoundError: Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/weights/ExponentialMovingAverage not found in checkpoint
         [[Node: save_1/RestoreV2_303 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2_303/tensor_names, save_1/RestoreV2_303/shape_and_slices)]]

Caused by op 'save_1/RestoreV2_303', defined at:
  File "object_detection/train.py", line 164, in <module>
    tf.app.run()
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\platform\app.py", line 48, in run
    _sys.exit(main(_sys.argv[:1] + flags_passthrough))
  File "object_detection/train.py", line 160, in main
    worker_job_name, is_chief, FLAGS.train_dir)
  File "C:\Users\orona\Dropbox\projects\models\research\object_detection\trainer.py", line 317, in train
    keep_checkpoint_every_n_hours=keep_checkpoint_every_n_hours)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\saver.py", line 1218, in __init__
    self.build()
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\saver.py", line 1227, in build
    self._build(self._filename, build_save=True, build_restore=True)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\saver.py", line 1263, in _build
    build_save=build_save, build_restore=build_restore)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\saver.py", line 751, in _build_internal
    restore_sequentially, reshape)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\saver.py", line 427, in _AddRestoreOps
    tensors = self.restore_op(filename_tensor, saveable, preferred_shard)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\training\saver.py", line 267, in restore_op
    [spec.tensor.dtype])[0])
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\ops\gen_io_ops.py", line 1020, in restore_v2
    shape_and_slices=shape_and_slices, dtypes=dtypes, name=name)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\framework\op_def_library.py", line 787, in _apply_op_helper
    op_def=op_def)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\framework\ops.py", line 2956, in create_op
    op_def=op_def)
  File "C:\Users\orona\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\framework\ops.py", line 1470, in __init__
    self._traceback = self._graph._extract_stack()  # pylint: disable=protected-access

NotFoundError (see above for traceback): Key FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/weights/ExponentialMovingAverage not found in checkpoint
         [[Node: save_1/RestoreV2_303 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2_303/tensor_names, save_1/RestoreV2_303/shape_and_slices)]]