Amazon web services 由于使用wandb,PyTorch Lightning希望在导入时创建文件夹,这会在AWS Lambda上引发错误

Amazon web services 由于使用wandb,PyTorch Lightning希望在导入时创建文件夹,这会在AWS Lambda上引发错误,amazon-web-services,aws-lambda,pytorch,pytorch-lightning,Amazon Web Services,Aws Lambda,Pytorch,Pytorch Lightning,所以我想用PyTorch Lightning构建一个Docker图像,可以与AWS lambda一起使用。然而,当调用该函数时,它会引发一个操作系统错误,该错误声称它使用了只读文件系统,而wandb.py想要写一些东西 我试过这些东西: 覆盖pytroch lightning的wandb.py文件,如果该文件不初始化wandb-->将引发错误 在Dockerfile中执行python脚本,确保在调用lambda函数-->相同操作系统错误时,文件在docker build上创建并存在 有人知道跳过

所以我想用PyTorch Lightning构建一个Docker图像,可以与AWS lambda一起使用。然而,当调用该函数时,它会引发一个操作系统错误,该错误声称它使用了只读文件系统,而wandb.py想要写一些东西

我试过这些东西:

  • 覆盖pytroch lightning的wandb.py文件,如果该文件不初始化wandb-->将引发错误
  • 在Dockerfile中执行python脚本,确保在调用lambda函数-->相同操作系统错误时,文件在docker build上创建并存在
  • 有人知道跳过魔杖的方法吗

    这是错误消息:

    START RequestId: ddae284d-4f32-4dc6-8160-d1fa62ba9772 Version: $LATEST
    OpenBLAS WARNING - could not determine the L2 cache size on this system, assuming 256k
    [ERROR] OSError: [Errno 30] Read-only file system: '/home/sbx_user1051'
    Traceback (most recent call last):
      File "/var/lang/lib/python3.8/imp.py", line 234, in load_module
        return load_source(name, filename, file)
      File "/var/lang/lib/python3.8/imp.py", line 171, in load_source
        module = _load(spec)
      File "<frozen importlib._bootstrap>", line 702, in _load
      File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
      File "<frozen importlib._bootstrap_external>", line 783, in exec_module
      File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
      File "/var/task/inference.py", line 5, in <module>
        import pytorch_lightning as pl
      File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/__init__.py", line 63, in <module>
        from pytorch_lightning.callbacks import Callback
      File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/callbacks/__init__.py", line 25, in <module>
        from pytorch_lightning.callbacks.swa import StochasticWeightAveraging
      File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/callbacks/swa.py", line 26, in <module>
        from pytorch_lightning.trainer.optimizers import _get_default_scheduler_config
      File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/trainer/__init__.py", line 18, in <module>
        from pytorch_lightning.trainer.trainer import Trainer
      File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 30, in <module>
        from pytorch_lightning.loggers import LightningLoggerBase
      File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/loggers/__init__.py", line 31, in <module>
        from pytorch_lightning.loggers.wandb import _WANDB_AVAILABLE, WandbLogger  # noqa: F401
      File "/var/lang/lib/python3.8/site-packages/pytorch_lightning/loggers/wandb.py", line 34, in <module>
        import wandb
      File "/var/lang/lib/python3.8/site-packages/wandb/__init__.py", line 131, in <module>
        api = InternalApi()
      File "/var/lang/lib/python3.8/site-packages/wandb/apis/internal.py", line 17, in __init__
        self.api = InternalApi(*args, **kwargs)
      File "/var/lang/lib/python3.8/site-packages/wandb/sdk/internal/internal_api.py", line 73, in __init__
        self._settings = Settings(
      File "/var/lang/lib/python3.8/site-packages/wandb/old/settings.py", line 25, in __init__
        self._global_settings.read([Settings._global_path()])
      File "/var/lang/lib/python3.8/site-packages/wandb/old/settings.py", line 105, in _global_path
        util.mkdir_exists_ok(config_dir)
      File "/var/lang/lib/python3.8/site-packages/wandb/util.py", line 687, in mkdir_exists_ok
        os.makedirs(path)
      File "/var/lang/lib/python3.8/os.py", line 213, in makedirs
        makedirs(head, exist_ok=exist_ok)
      File "/var/lang/lib/python3.8/os.py", line 213, in makedirs
        makedirs(head, exist_ok=exist_ok)
      File "/var/lang/lib/python3.8/os.py", line 223, in makedirs
        mkdir(name, mode)
    END RequestId: ddae284d-4f32-4dc6-8160-d1fa62ba9772
    REPORT RequestId: ddae284d-4f32-4dc6-8160-d1fa62ba9772  Duration: 27000.33 ms   Billed Duration: 27001 ms   Memory Size: 10240 MB   Max Memory Used: 241 MB 
    Unknown application error occurred
    
    START RequestId:ddae284d-4f32-4dc6-8160-d1fa62ba9772版本:$LATEST
    OpenBLAS警告-无法确定此系统上的二级缓存大小,假设为256k
    [错误]OS错误:[Errno 30]只读文件系统:'/home/sbx_user1051'
    回溯(最近一次呼叫最后一次):
    加载模块中的文件“/var/lang/lib/python3.8/imp.py”,第234行
    返回加载源(名称、文件名、文件)
    文件“/var/lang/lib/python3.8/imp.py”,第171行,在load_source中
    模块=_负载(规格)
    文件“”,第702行,正在加载
    文件“”,第671行,在\u加载\u解锁
    exec_模块中第783行的文件“”
    文件“”,第219行,在“调用”中,删除了“帧”
    文件“/var/task/inference.py”,第5行,在
    导入pytorch_lightning作为pl
    文件“/var/lang/lib/python3.8/site packages/pytorch_lightning/_init__.py”,第63行,在
    从pytorch_lightning.callbacks导入回调
    文件“/var/lang/lib/python3.8/site packages/pytorch_lightning/callbacks/_init__.py”,第25行,在
    从pytorch_lightning.callbacks.swa导入随机加权平均
    文件“/var/lang/lib/python3.8/site packages/pytorch\u lightning/callbacks/swa.py”,第26行,在
    从pytorch\u lightning.trainer.optimizers导入\u获取\u默认\u调度程序\u配置
    文件“/var/lang/lib/python3.8/site packages/pytorch_lightning/trainer/_init__.py”,第18行,在
    来自pytorch_lightning.trainer.trainer进口培训师
    文件“/var/lang/lib/python3.8/site packages/pytorch_lightning/trainer/trainer.py”,第30行,在
    从pytorch_lightning.loggers导入LightningLoggerBase
    文件“/var/lang/lib/python3.8/site packages/pytorch_lightning/loggers/_init__.py”,第31行,在
    从pytorch_lightning.loggers.wandb import _wandb_可获得,WandbLogger#noqa:F401
    文件“/var/lang/lib/python3.8/site packages/pytorch_lightning/loggers/wandb.py”,第34行,在
    进口万达
    文件“/var/lang/lib/python3.8/site packages/wandb/_init__.py”,第131行,在
    api=内部api()
    文件“/var/lang/lib/python3.8/site packages/wandb/api/internal.py”,第17行,在__
    self.api=InternalApi(*args,**kwargs)
    文件“/var/lang/lib/python3.8/site packages/wandb/sdk/internal/internal_api.py”,第73行,在__
    self.\u设置=设置(
    文件“/var/lang/lib/python3.8/site packages/wandb/old/settings.py”,第25行,在__
    self.\u global\u settings.read([settings.\u global\u path()]))
    文件“/var/lang/lib/python3.8/site packages/wandb/old/settings.py”,第105行,在全局路径中
    util.mkdir\u存在\u确定(配置\u目录)
    文件“/var/lang/lib/python3.8/site packages/wandb/util.py”,第687行,在mkdir\u存在\u确定
    os.makedirs(路径)
    makedirs中的文件“/var/lang/lib/python3.8/os.py”,第213行
    makedirs(head,exist\u ok=exist\u ok)
    makedirs中的文件“/var/lang/lib/python3.8/os.py”,第213行
    makedirs(head,exist\u ok=exist\u ok)
    makedirs中的文件“/var/lang/lib/python3.8/os.py”,第223行
    mkdir(名称、模式)
    结束请求ID:ddae284d-4f32-4dc6-8160-d1fa62ba9772
    报告请求ID:ddae284d-4f32-4dc6-8160-d1fa62ba9772持续时间:27000.33毫秒计费持续时间:27001毫秒内存大小:10240 MB最大使用内存:241 MB
    发生未知的应用程序错误
    
    您需要确保您在某处具有写访问权限

    然后,您可以使用修改本地保存文件的默认位置,特别是查看WANDB_DIR、WANDB_CONFIG_DIR和WANDB_CACHE_DIR