Postgresql 尽管配置了postgres,但docker compose始终试图访问sqlite
我尝试设置一个停靠的airflow实例,但无论我做什么(到目前为止…),它都会一直尝试访问一些sqlite3数据库,而我不知道该指令来自何处。我通过Postgresql 尽管配置了postgres,但docker compose始终试图访问sqlite,postgresql,docker,docker-compose,airflow,Postgresql,Docker,Docker Compose,Airflow,我尝试设置一个停靠的airflow实例,但无论我做什么(到目前为止…),它都会一直尝试访问一些sqlite3数据库,而我不知道该指令来自何处。我通过aiffair\uuuuu CORE\uuuu SQL\u ALCHEMY\u CONN,甚至aiffair\u CONN\u METADATA\u DB,指向所有可能的Postgres实例 启动时的典型错误消息如下: sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) no suc
aiffair\uuuuu CORE\uuuu SQL\u ALCHEMY\u CONN
,甚至aiffair\u CONN\u METADATA\u DB
,指向所有可能的Postgres实例
启动时的典型错误消息如下:
sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) no such table: job
完整docker-compose.yml:
version: '3'
x-airflow-common:
&airflow-common
image: apache/airflow:2.0.0
environment:
- AIRFLOW__CORE__EXECUTOR=LocalExecutor
- AIRFLOW__CORE__SQL_ALCHEMY_CONN=postgresql+psycopg2://postgres:postgres@db:9501/airflow
- AIRFLOW_CONN_METADATA_DB=postgres+psycopg2://postgres:postgres@db:9501/airflow
- AIRFLOW__CORE__FERNET_KEY=FB0o_zt4e3Ziq3LdUUO7F2Z95cvFFx16hU8jTeR1ASM=
- AIRFLOW__CORE__LOAD_EXAMPLES=True
- AIRFLOW__CORE__LOGGING_LEVEL=INFO
volumes:
- /home/x/docker/airflow/dags:/opt/airflow/dags
- /home/x/docker/airflow/airflow-data/logs:/opt/airflow/logs
- /home/x/docker/airflow/airflow-data/plugins:/opt/airflow/plugins
- /home/x/docker/airflow/airflow-data/airflow.cfg:/opt/airlfow/airflow.cfg
depends_on:
- db
services:
db:
image: postgres:12
#image: postgres:12.1-alpine
environment:
- POSTGRES_USER=postgres
- POSTGRES_PASSWORD=postgres
- POSTGRES_DB=airflow
- POSTGRES_PORT=9501
- POSTGRES_HOST_AUTH_METHOD=trust
ports:
- 9501:9501
command:
- -p 9501
airflow-init:
<< : *airflow-common
container_name: airflow_init
entrypoint: /bin/bash
environment:
- SQL_ALCHEMY_CONN=postgresql://postgres:postgres@db:9501/airflow
- AIRFLOW_CONN_METADATA_DB=postgres://postgres:postgres@db:9501/airflow
command:
- -c
- airflow users list || ( airflow db init &&
airflow users create
--role Admin
--username airflow
--password airflow
--email airflow@airflow.com
--firstname airflow
--lastname airflow )
restart: on-failure
airflow-webserver:
<< : *airflow-common
command: airflow webserver
ports:
- 9500:8080
container_name: airflow_webserver
environment:
- AIRFLOW_USERNAME=airflow
- AIRFLOW_PASSWORD=airflow
- SQL_ALCHEMY_CONN=postgresql://postgres:postgres@db:9501/airflow
- AIRFLOW_CONN_METADATA_DB=postgres://postgres:postgres@db:9501/airflow
restart: always
airflow-scheduler:
<< : *airflow-common
command: airflow scheduler
container_name: airflow_scheduler
environment:
- SQL_ALCHEMY_CONN=postgresql://postgres:postgres@db:9501/airflow
- AIRFLOW_CONN_METADATA_DB=postgres://postgres:postgres@db:9501/airflow
restart: always
版本:“3”
x-通用:
&普通气流
图片:apache/airflow:2.0.0
环境:
-气流\uuuu核心\uuuu执行器=本地执行器
-气流核心炼金术CONN=postgresql+psycopg2://postgres:postgres@db:9501/气流
-气流连接元数据DB=postgres+psycopg2://postgres:postgres@db:9501/气流
-空气流量\uuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuu=
-气流\uuuuu芯\uuuuu负载\u示例=真
-气流\uuuuu芯\uuuuu记录\u级别=信息
卷数:
-/home/x/docker/airflow/dags:/opt/airflow/dags
-/home/x/docker/airflow/airflow data/logs:/opt/airflow/logs
-/home/x/docker/airflow/airflow data/plugins:/opt/airflow/plugins
-/home/x/docker/airflow/airflow data/airflow.cfg:/opt/airlfow/airflow.cfg
取决于:
-分贝
服务:
db:
图片:博士后:12
#图片:postgres:12.1-1
环境:
-POSTGRES\u USER=POSTGRES
-POSTGRES\u密码=POSTGRES
-POSTGRES_DB=气流
-POSTGRES_端口=9501
-POSTGRES\u HOST\u AUTH\u METHOD=信任
端口:
- 9501:9501
命令:
--第9501页
气流初始:
通过以下docker-compose.yaml文件解决:
而不是试图调整postgres(和redis)的端口,而是使用了“expose”选项,这样可以避免与同一主机上的其他容器发生冲突
所以不是:
environment:
POSTGRES_PORT: 9501
ports:
- 9501:9501
但是:使用默认端口(内部)运行它,不要尝试在外部共享它们:
expose:
- 5432
仍然不确定使用更高端口的问题是什么。当配置的数据库由于某种原因无法连接时,这可能是sqlite的默认回退