Amazon ec2 使用Systemd在EC2 Centos上运行Airflow Web服务器:权限被拒绝

Amazon ec2 使用Systemd在EC2 Centos上运行Airflow Web服务器:权限被拒绝,amazon-ec2,airflow,systemd,Amazon Ec2,Airflow,Systemd,我在EC2 CentOS中使用来管理用于启动进程的守护进程(即:Web服务器、工作进程和调度程序)。 当我运行sudo systemctl启动气流web服务器时 : ec2-user : TTY=pts/0 ; PWD=/ ; USER=root ; COMMAND=/bin/systemctl enable airflow-webserver Oct 30 01:27:37 ip-171-32-6-92.us-east-2.compute.internal sudo[11680]: ec2-u

我在EC2 CentOS中使用来管理用于启动进程的守护进程(即:Web服务器、工作进程和调度程序)。 当我运行
sudo systemctl启动气流web服务器时

: ec2-user : TTY=pts/0 ; PWD=/ ; USER=root ; COMMAND=/bin/systemctl enable airflow-webserver
Oct 30 01:27:37 ip-171-32-6-92.us-east-2.compute.internal sudo[11680]: ec2-user : TTY=pts/0 ; PWD=/ ; USER=root ; COMMAND=/bin/systemctl start airflow-webserver
Oct 30 01:27:37 ip-171-32-6-92.us-east-2.compute.internal systemd[11684]: Failed at step EXEC spawning /home/ec2-user/.local/bin/airflow: Permission denied
Oct 30 01:27:37 ip-171-32-6-92.us-east-2.compute.internal systemd[1]: airflow-webserver.service: main process exited, code=exited, status=203/EXEC
Oct 30 01:27:37 ip-171-32-6-92.us-east-2.compute.internal systemd[1]: Unit airflow-webserver.service entered failed state.
Oct 30 01:27:37 ip-171-32-6-92.us-east-2.compute.internal systemd[1]: airflow-webserver.service failed
Web服务器服务

气流组和用户存在:

$ less /etc/group
# airflow:x:1001:ec2-user
$less etc/psswd
# ec2-user:x:1000:1000:EC2 Default User:/home/ec2-user:/bin/bash
# tss:x:59:59:Account used by the trousers package to sandbox the tcsd # daemon:/dev/null:/sbin/nologin
# airflow:x:1001:1001::/home/airflow:/bin/bash
没有帮助

更新

创建
aiffair
用户并在
usr/local/bin
下安装aiffair之后,将
ExecStart
更改为
usr/local/bin/aiffair-webserver--pid/run/aiffair/webserver.pid
I能够通过最初的拒绝权限。但是现在我得到了这个错误:

Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: PermissionError: [Errno 13] Permission denied: '${AIRFLOW_HOME}'
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: During handling of the above exception, another exception occurred:
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: Traceback (most recent call last):
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/bin/airflow", line 25, in <module>
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: from airflow.configuration import conf
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/lib/python3.7/site-packages/airflow/__init__.py", line 31, in <module>
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: from airflow.utils.log.logging_mixin import LoggingMixin
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/lib/python3.7/site-packages/airflow/utils/__init__.py", line 24, in <module>
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: from .decorators import apply_defaults as _apply_defaults
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/lib/python3.7/site-packages/airflow/utils/decorators.py", line 34, in <module>
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: from airflow import settings
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/lib/python3.7/site-packages/airflow/settings.py", line 36, in <module>
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: from airflow.configuration import conf, AIRFLOW_HOME, WEBSERVER_CONFIG  # NOQA F401
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/lib/python3.7/site-packages/airflow/configuration.py", line 523, in <module>
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: mkdir_p(AIRFLOW_HOME)
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/lib/python3.7/site-packages/airflow/configuration.py", line 505, in mkdir_p
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: 'Error creating {}: {}'.format(path, exc.strerror))
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: airflow.exceptions.AirflowConfigException: Error creating ${AIRFLOW_HOME}: Permission denied
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]:许可错误:[Errno 13]许可被拒绝:“${airflow_HOME}”
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]:在处理上述异常期间,发生了另一个异常:
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]:回溯(最近一次呼叫最后一次):
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]:文件“/usr/local/bin/airflow”,第25行,in
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]:来自airflow.configuration导入配置
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal afflow[31430]:文件“/usr/local/lib/python3.7/site packages/afflow/_______.py”,第31行,in
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]:来自aiffort.utils.log.logging\u mixin导入logging mixin
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal afflow[31430]:文件“/usr/local/lib/python3.7/site packages/afflow/utils/__________.py”,第24行,in
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]:from.decorators导入应用默认值作为应用默认值
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal afflow[31430]:文件“/usr/local/lib/python3.7/site packages/afflow/utils/decorators.py”,第34行,in
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]:来自气流导入设置
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal afflow[31430]:文件“/usr/local/lib/python3.7/site packages/afflow/settings.py”,第36行,in
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]:来自airflow.configuration导入配置、airflow\u HOME、WEBSERVER\u CONFIG\NOQA F401
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal afflow[31430]:文件“/usr/local/lib/python3.7/site packages/afflow/configuration.py”,第523行,in
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]:mkdir_p(airflow_HOME)
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal afflow[31430]:文件“/usr/local/lib/python3.7/site packages/afflow/configuration.py”,第505行,在mkdir\u p中
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]:“创建{}:{}时出错”。格式(路径,exc.strerror))
10月31日18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]:airflow.exceptions.AirflowConfigException:创建${airflow_HOME}时出错:权限被拒绝

这是因为您试图以
airflow
用户身份运行,但
airflow
二进制文件的路径位于
/home/ec2 user/.local/bin/airflow
中,这是
ec2用户的主目录


将airflow安装到您的
airflow
用户有权访问的目录中。

我创建了一个airflow用户和组。通过该用户安装的气流随后运行systemd,但仍然出现以下错误“
在步骤EXEC spawning/home/aiffort/.local/bin失败:权限被拒绝
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: PermissionError: [Errno 13] Permission denied: '${AIRFLOW_HOME}'
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: During handling of the above exception, another exception occurred:
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: Traceback (most recent call last):
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/bin/airflow", line 25, in <module>
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: from airflow.configuration import conf
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/lib/python3.7/site-packages/airflow/__init__.py", line 31, in <module>
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: from airflow.utils.log.logging_mixin import LoggingMixin
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/lib/python3.7/site-packages/airflow/utils/__init__.py", line 24, in <module>
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: from .decorators import apply_defaults as _apply_defaults
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/lib/python3.7/site-packages/airflow/utils/decorators.py", line 34, in <module>
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: from airflow import settings
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/lib/python3.7/site-packages/airflow/settings.py", line 36, in <module>
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: from airflow.configuration import conf, AIRFLOW_HOME, WEBSERVER_CONFIG  # NOQA F401
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/lib/python3.7/site-packages/airflow/configuration.py", line 523, in <module>
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: mkdir_p(AIRFLOW_HOME)
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: File "/usr/local/lib/python3.7/site-packages/airflow/configuration.py", line 505, in mkdir_p
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: 'Error creating {}: {}'.format(path, exc.strerror))
Oct 31 18:44:12 ip-172-31-6-92.us-east-2.compute.internal airflow[31430]: airflow.exceptions.AirflowConfigException: Error creating ${AIRFLOW_HOME}: Permission denied