Amazon web services 由于使用wandb,PyTorch Lightning希望在导入时创建文件夹,这会在AWS Lambda上引发错误
所以我想用PyTorch Lightning构建一个Docker图像,可以与AWS lambda一起使用。然而,当调用该函数时,它会引发一个操作系统错误,该错误声称它使用了只读文件系统,而wandb.py想要写一些东西 我试过这些东西:Amazon web services 由于使用wandb,PyTorch Lightning希望在导入时创建文件夹,这会在AWS Lambda上引发错误,amazon-web-services,aws-lambda,pytorch,pytorch-lightning,Amazon Web Services,Aws Lambda,Pytorch,Pytorch Lightning,所以我想用PyTorch Lightning构建一个Docker图像,可以与AWS lambda一起使用。然而,当调用该函数时,它会引发一个操作系统错误,该错误声称它使用了只读文件系统,而wandb.py想要写一些东西 我试过这些东西: 覆盖pytroch lightning的wandb.py文件,如果该文件不初始化wandb-->将引发错误 在Dockerfile中执行python脚本,确保在调用lambda函数-->相同操作系统错误时,文件在docker build上创建并存在 有人知道跳过
START RequestId: ddae284d-4f32-4dc6-8160-d1fa62ba9772 Version: $LATEST
OpenBLAS WARNING - could not determine the L2 cache size on this system, assuming 256k
[ERROR] OSError: [Errno 30] Read-only file system: '/home/sbx_user1051'
Traceback (most recent call last):
File "/var/lang/lib/python3.8/imp.py", line 234, in load_module
return load_source(name, filename, file)
File "/var/lang/lib/python3.8/imp.py", line 171, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 702, in _load
File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 783, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/var/task/inference.py", line 5, in <module>
import pytorch_lightning as pl
File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/__init__.py", line 63, in <module>
from pytorch_lightning.callbacks import Callback
File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/callbacks/__init__.py", line 25, in <module>
from pytorch_lightning.callbacks.swa import StochasticWeightAveraging
File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/callbacks/swa.py", line 26, in <module>
from pytorch_lightning.trainer.optimizers import _get_default_scheduler_config
File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/trainer/__init__.py", line 18, in <module>
from pytorch_lightning.trainer.trainer import Trainer
File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 30, in <module>
from pytorch_lightning.loggers import LightningLoggerBase
File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/loggers/__init__.py", line 31, in <module>
from pytorch_lightning.loggers.wandb import _WANDB_AVAILABLE, WandbLogger # noqa: F401
File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/loggers/wandb.py", line 34, in <module>
import wandb
File "/var/lang/lib/python3.8/site-packages/wandb/__init__.py", line 131, in <module>
api = InternalApi()
File "/var/lang/lib/python3.8/site-packages/wandb/apis/internal.py", line 17, in __init__
self.api = InternalApi(*args, **kwargs)
File "/var/lang/lib/python3.8/site-packages/wandb/sdk/internal/internal_api.py", line 73, in __init__
self._settings = Settings(
File "/var/lang/lib/python3.8/site-packages/wandb/old/settings.py", line 25, in __init__
self._global_settings.read([Settings._global_path()])
File "/var/lang/lib/python3.8/site-packages/wandb/old/settings.py", line 105, in _global_path
util.mkdir_exists_ok(config_dir)
File "/var/lang/lib/python3.8/site-packages/wandb/util.py", line 687, in mkdir_exists_ok
os.makedirs(path)
File "/var/lang/lib/python3.8/os.py", line 213, in makedirs
makedirs(head, exist_ok=exist_ok)
File "/var/lang/lib/python3.8/os.py", line 213, in makedirs
makedirs(head, exist_ok=exist_ok)
File "/var/lang/lib/python3.8/os.py", line 223, in makedirs
mkdir(name, mode)
END RequestId: ddae284d-4f32-4dc6-8160-d1fa62ba9772
REPORT RequestId: ddae284d-4f32-4dc6-8160-d1fa62ba9772 Duration: 27000.33 ms Billed Duration: 27001 ms Memory Size: 10240 MB Max Memory Used: 241 MB
Unknown application error occurred
START RequestId:ddae284d-4f32-4dc6-8160-d1fa62ba9772版本:$LATEST
OpenBLAS警告-无法确定此系统上的二级缓存大小,假设为256k
[错误]OS错误:[Errno 30]只读文件系统:'/home/sbx_user1051'
回溯(最近一次呼叫最后一次):
加载模块中的文件“/var/lang/lib/python3.8/imp.py”,第234行
返回加载源(名称、文件名、文件)
文件“/var/lang/lib/python3.8/imp.py”,第171行,在load_source中
模块=_负载(规格)
文件“”,第702行,正在加载
文件“”,第671行,在\u加载\u解锁
exec_模块中第783行的文件“”
文件“”,第219行,在“调用”中,删除了“帧”
文件“/var/task/inference.py”,第5行,在
导入pytorch_lightning作为pl
文件“/var/lang/lib/python3.8/site packages/pytorch_lightning/_init__.py”,第63行,在
从pytorch_lightning.callbacks导入回调
文件“/var/lang/lib/python3.8/site packages/pytorch_lightning/callbacks/_init__.py”,第25行,在
从pytorch_lightning.callbacks.swa导入随机加权平均
文件“/var/lang/lib/python3.8/site packages/pytorch\u lightning/callbacks/swa.py”,第26行,在
从pytorch\u lightning.trainer.optimizers导入\u获取\u默认\u调度程序\u配置
文件“/var/lang/lib/python3.8/site packages/pytorch_lightning/trainer/_init__.py”,第18行,在
来自pytorch_lightning.trainer.trainer进口培训师
文件“/var/lang/lib/python3.8/site packages/pytorch_lightning/trainer/trainer.py”,第30行,在
从pytorch_lightning.loggers导入LightningLoggerBase
文件“/var/lang/lib/python3.8/site packages/pytorch_lightning/loggers/_init__.py”,第31行,在
从pytorch_lightning.loggers.wandb import _wandb_可获得,WandbLogger#noqa:F401
文件“/var/lang/lib/python3.8/site packages/pytorch_lightning/loggers/wandb.py”,第34行,在
进口万达
文件“/var/lang/lib/python3.8/site packages/wandb/_init__.py”,第131行,在
api=内部api()
文件“/var/lang/lib/python3.8/site packages/wandb/api/internal.py”,第17行,在__
self.api=InternalApi(*args,**kwargs)
文件“/var/lang/lib/python3.8/site packages/wandb/sdk/internal/internal_api.py”,第73行,在__
self.\u设置=设置(
文件“/var/lang/lib/python3.8/site packages/wandb/old/settings.py”,第25行,在__
self.\u global\u settings.read([settings.\u global\u path()]))
文件“/var/lang/lib/python3.8/site packages/wandb/old/settings.py”,第105行,在全局路径中
util.mkdir\u存在\u确定(配置\u目录)
文件“/var/lang/lib/python3.8/site packages/wandb/util.py”,第687行,在mkdir\u存在\u确定
os.makedirs(路径)
makedirs中的文件“/var/lang/lib/python3.8/os.py”,第213行
makedirs(head,exist\u ok=exist\u ok)
makedirs中的文件“/var/lang/lib/python3.8/os.py”,第213行
makedirs(head,exist\u ok=exist\u ok)
makedirs中的文件“/var/lang/lib/python3.8/os.py”,第223行
mkdir(名称、模式)
结束请求ID:ddae284d-4f32-4dc6-8160-d1fa62ba9772
报告请求ID:ddae284d-4f32-4dc6-8160-d1fa62ba9772持续时间:27000.33毫秒计费持续时间:27001毫秒内存大小:10240 MB最大使用内存:241 MB
发生未知的应用程序错误
您需要确保您在某处具有写访问权限
然后,您可以使用修改本地保存文件的默认位置,特别是查看WANDB_DIR、WANDB_CONFIG_DIR和WANDB_CACHE_DIR