如何使用修改过的telegraf配置文件运行docker compose文件?
我试图在MacOS上运行docker compose文件来运行Telegraf、Mosquitto(MQTT)、Grafana和XDB。我试图用修改过的配置文件运行Telegraf。最终目的是存储和显示从arduino肌肉传感器发送的数据 docker compose文件当前如下所示:如何使用修改过的telegraf配置文件运行docker compose文件?,docker,docker-compose,influxdb,telegraf,Docker,Docker Compose,Influxdb,Telegraf,我试图在MacOS上运行docker compose文件来运行Telegraf、Mosquitto(MQTT)、Grafana和XDB。我试图用修改过的配置文件运行Telegraf。最终目的是存储和显示从arduino肌肉传感器发送的数据 docker compose文件当前如下所示: version: '3' services: influxdb: container_name: influxdb image: influxdb ports: -
version: '3'
services:
influxdb:
container_name: influxdb
image: influxdb
ports:
- "8086:8086"
environment:
- INFLUXDB_DB=sensors
- INFLUXDB_ADMIN_USER=telegraf
- INFLUXDB_ADMIN_PASSWORD=telegraf
restart: always
telegraf:
image: telegraf
restart: always
ports:
- "5050:5050"
volumes:
- $PWD/telegraf.conf:/etc/telegraf/telegraf.conf:ro
grafana:
container_name: grafana
image: grafana/grafana
links:
- influxdb
hostname: grafana
ports:
- "3000:3000"
mosquitto:
container_name: mosquitto
image: eclipse-mosquitto
ports:
- "1883:1883"
- "9001:9001"
depends_on:
- influxdb
restart: always
[[inputs.mqtt_consumer]]
servers = ["tcp://mosquitto:1883"]
topics = [
"home/sensor/bme280/temperature",
]
username = "mqttuser"
password = "mqttpassword"
data_format = "value"
data_type = "float"
[[outputs.influxdb]]
urls = ["http://influxdb:8086"]
database = "sensors"
skip_database_creation = true
timeout = "5s"
username = "telegraf-username"
password = "telegraf-password"
user_agent = "telegraf"
udp_payload = "512B"
我可以运行build命令,Mosquitto、Grafana和InfluxDB似乎都可以运行,但是Telegraf有很多问题。无论对compose文件中的卷做了什么更改,都会使用Telegraf的默认配置文件,而不是我修改的配置,它似乎会阻止数据发送到XDB
Telegraf post to XDB错误如下所示:
telegraf | 2020-03-03T11:40:49Z E! [outputs.influxdb] When writing to [http://localhost:8086]: Post http://localhost:8086/write?db=telegraf: dial tcp 127.0.0.1:8086: connect: connection refused
telegraf | 2020-03-03T11:40:49Z E! [agent] Error writing to outputs.influxdb: could not write any address
Mosquitto的工作方式似乎是MQTT.fx应用程序能够连接并发布/订阅容器。但是,存在使用未知名称建立和删除的常规连接
以下连接错误持续记录:
mosquitto | 1583247033: New connection from 172.25.0.1 on port 1883.
mosquitto | 1583247033: Client <unknown> disconnected due to protocol error.
mosquitto | 1583247033:端口1883上172.25.0.1的新连接。
MOSQUITO | 1583247033:由于协议错误,客户端已断开连接。
我曾考虑编写一个Telegraf dockerfile来设置配置文件,但这似乎有些过分,因为我的理解是,撰写文件的卷部分应该允许使用此配置文件
我的telegraf.conf文件与docker-compose.yml文件位于同一目录中
问题是
a) 我认为容器使用的默认telegraf文件正确吗
b) 如何将修改后的telegraf.conf文件保存到容器中如果没有您的telegraf config文件,很难判断它是否正确加载并且存在网络问题 我发现与其使用:
$PWD/telegraf.conf:/etc/telegraf/telegraf.conf:ro
,不如在本地子目录中包含docker的配置文件:
.docker/telegraf/telegraf.conf:/etc/telegraf/telegraf.conf:ro
如果您想对PWD使用完整路径,我建议${PWD}
。根据我的经验,$PWD
正在使用来自终端的变量(您可以测试它是否被分配了echo$PWD
),其中as${PWD}
实际运行打印工作目录并输出结果(您可以使用echo${PWD}
使用终端进行测试)
为了完整性,该堆栈(基于BME280传感器和Ardunio)应该可以工作(为了安全-我已经更改了凭据,因此如果它不工作,请从那里开始!)。我已经对其进行了注释,以供我自己参考,希望它能帮助您:
version: '3'
# To Do:
# - Setup defined networks to protect influxdb and telegraf
# - Define a backup process for data
# - Monitor implications of version tags/docker container lifecycles
services:
# MQTT Broker, handles data from sensors
# https://hub.docker.com/_/eclipse-mosquitto
mosquitto:
# Name this container so other containers can find it easily
# Name used in:
# - Telegraf config
container_name: mosquitto
image: eclipse-mosquitto:1.6
ports:
- "1883:1883"
- "9001:9001"
depends_on:
- influxdb
restart: always
volumes:
# Use a volume for storage
# since influxdb stores data long term this might not be needed?
- mosquitto-storage:/mosquitto/data
# Data storage
# https://hub.docker.com/_/influxdb
influxdb:
# Name this container so other containers can find it easily
# Name used in:
# - Grafana data source
# - Telegraf config
container_name: influxdb
image: influxdb:1.5
ports:
- "8086:8086"
environment:
- INFLUXDB_DB=sensors
- INFLUXDB_ADMIN_USER=admin-user
- INFLUXDB_ADMIN_PASSWORD=telegraf-admin-password
- INFLUXDB_USER=telegraf-username
- INFLUXDB_PASSWORD=telegraf-password
restart: always
volumes:
# Data persistence (could also be a bind mount: /srv/docker/influxdb/data:/var/lib/influxdb)
- influxdb-storage:/var/lib/influxdb
# Backups...
- ./influxdb-backup:/backup
# Host can run the following on a crontab, then rsnapshot can pickup:
# docker exec -it influxdb influxd backup -database sensors /backup
# Message formattet (MQTT -> InfluxDB)
# https://hub.docker.com/_/telegraf
telegraf:
image: telegraf:1.11
restart: always
ports:
- "5050:5050"
depends_on:
- influxdb
volumes:
# This file needs edited with your MQTT topics, host, etc
- .docker/telegraf/telegraf.conf:/etc/telegraf/telegraf.conf:ro
# Dashboard/graphing
# https://hub.docker.com/r/grafana/grafana
grafana:
# Grafana tags are a mess! just use whatever...
image: grafana/grafana
links:
- influxdb
hostname: grafana
ports:
- "3000:3000"
depends_on:
- influxdb
volumes:
# Grafana gets grumpy over bind mount permissions, use a volume
- grafana-storage:/var/lib/grafana
volumes:
mosquitto-storage:
influxdb-storage:
grafana-storage:
我的telegraf配置文件如下所示:
version: '3'
services:
influxdb:
container_name: influxdb
image: influxdb
ports:
- "8086:8086"
environment:
- INFLUXDB_DB=sensors
- INFLUXDB_ADMIN_USER=telegraf
- INFLUXDB_ADMIN_PASSWORD=telegraf
restart: always
telegraf:
image: telegraf
restart: always
ports:
- "5050:5050"
volumes:
- $PWD/telegraf.conf:/etc/telegraf/telegraf.conf:ro
grafana:
container_name: grafana
image: grafana/grafana
links:
- influxdb
hostname: grafana
ports:
- "3000:3000"
mosquitto:
container_name: mosquitto
image: eclipse-mosquitto
ports:
- "1883:1883"
- "9001:9001"
depends_on:
- influxdb
restart: always
[[inputs.mqtt_consumer]]
servers = ["tcp://mosquitto:1883"]
topics = [
"home/sensor/bme280/temperature",
]
username = "mqttuser"
password = "mqttpassword"
data_format = "value"
data_type = "float"
[[outputs.influxdb]]
urls = ["http://influxdb:8086"]
database = "sensors"
skip_database_creation = true
timeout = "5s"
username = "telegraf-username"
password = "telegraf-password"
user_agent = "telegraf"
udp_payload = "512B"
请注意,我在docker中使用的是容器名称,而不是本地IP地址