如何使用修改过的telegraf配置文件运行docker compose文件?

如何使用修改过的telegraf配置文件运行docker compose文件?,docker,docker-compose,influxdb,telegraf,Docker,Docker Compose,Influxdb,Telegraf,我试图在MacOS上运行docker compose文件来运行Telegraf、Mosquitto(MQTT)、Grafana和XDB。我试图用修改过的配置文件运行Telegraf。最终目的是存储和显示从arduino肌肉传感器发送的数据 docker compose文件当前如下所示: version: '3' services: influxdb: container_name: influxdb image: influxdb ports: -

我试图在MacOS上运行docker compose文件来运行Telegraf、Mosquitto(MQTT)、Grafana和XDB。我试图用修改过的配置文件运行Telegraf。最终目的是存储和显示从arduino肌肉传感器发送的数据

docker compose文件当前如下所示:

version: '3'

services: 
  influxdb:
    container_name: influxdb
    image: influxdb
    ports:
        - "8086:8086"
    environment:
      - INFLUXDB_DB=sensors
      - INFLUXDB_ADMIN_USER=telegraf
      - INFLUXDB_ADMIN_PASSWORD=telegraf
    restart: always

  telegraf: 
    image: telegraf
    restart: always
    ports: 
      - "5050:5050"
    volumes:
    - $PWD/telegraf.conf:/etc/telegraf/telegraf.conf:ro  

  grafana: 
    container_name: grafana
    image: grafana/grafana
    links:
      - influxdb
    hostname: grafana
    ports:
        - "3000:3000"

  mosquitto:
    container_name: mosquitto
    image: eclipse-mosquitto
    ports:
      - "1883:1883"
      - "9001:9001"
    depends_on: 
      - influxdb
    restart: always
[[inputs.mqtt_consumer]]
  servers = ["tcp://mosquitto:1883"]

  topics = [
    "home/sensor/bme280/temperature",
  ]

  username = "mqttuser"
  password = "mqttpassword"
  data_format = "value"
  data_type = "float"

[[outputs.influxdb]]

  urls = ["http://influxdb:8086"]
  database = "sensors"
  skip_database_creation = true
  timeout = "5s"
  username = "telegraf-username"
  password = "telegraf-password" 
  user_agent = "telegraf"
  udp_payload = "512B"
我可以运行build命令,Mosquitto、Grafana和InfluxDB似乎都可以运行,但是Telegraf有很多问题。无论对compose文件中的卷做了什么更改,都会使用Telegraf的默认配置文件,而不是我修改的配置,它似乎会阻止数据发送到XDB

Telegraf post to XDB错误如下所示:

telegraf     | 2020-03-03T11:40:49Z E! [outputs.influxdb] When writing to [http://localhost:8086]: Post http://localhost:8086/write?db=telegraf: dial tcp 127.0.0.1:8086: connect: connection refused
telegraf     | 2020-03-03T11:40:49Z E! [agent] Error writing to outputs.influxdb: could not write any address
Mosquitto的工作方式似乎是MQTT.fx应用程序能够连接并发布/订阅容器。但是,存在使用未知名称建立和删除的常规连接

以下连接错误持续记录:

mosquitto    | 1583247033: New connection from 172.25.0.1 on port 1883.
mosquitto    | 1583247033: Client <unknown> disconnected due to protocol error.
mosquitto | 1583247033:端口1883上172.25.0.1的新连接。
MOSQUITO | 1583247033:由于协议错误,客户端已断开连接。
我曾考虑编写一个Telegraf dockerfile来设置配置文件,但这似乎有些过分,因为我的理解是,撰写文件的卷部分应该允许使用此配置文件

我的telegraf.conf文件与docker-compose.yml文件位于同一目录中

问题是 a) 我认为容器使用的默认telegraf文件正确吗
b) 如何将修改后的telegraf.conf文件保存到容器中

如果没有您的telegraf config文件,很难判断它是否正确加载并且存在网络问题

我发现与其使用:
$PWD/telegraf.conf:/etc/telegraf/telegraf.conf:ro
,不如在本地子目录中包含docker的配置文件:
.docker/telegraf/telegraf.conf:/etc/telegraf/telegraf.conf:ro

如果您想对PWD使用完整路径,我建议
${PWD}
。根据我的经验,
$PWD
正在使用来自终端的变量(您可以测试它是否被分配了
echo$PWD
),其中as
${PWD}
实际运行打印工作目录并输出结果(您可以使用
echo${PWD}
使用终端进行测试)

为了完整性,该堆栈(基于BME280传感器和Ardunio)应该可以工作(为了安全-我已经更改了凭据,因此如果它不工作,请从那里开始!)。我已经对其进行了注释,以供我自己参考,希望它能帮助您:

version: '3'

# To Do:
# - Setup defined networks to protect influxdb and telegraf
# - Define a backup process for data
# - Monitor implications of version tags/docker container lifecycles

services: 

    # MQTT Broker, handles data from sensors
    # https://hub.docker.com/_/eclipse-mosquitto
    mosquitto:
        # Name this container so other containers can find it easily
        # Name used in: 
        # - Telegraf config
        container_name: mosquitto
        image: eclipse-mosquitto:1.6
        ports:
            - "1883:1883"
            - "9001:9001"
        depends_on: 
            - influxdb
        restart: always
        volumes:
            # Use a volume for storage
            # since influxdb stores data long term this might not be needed?
            - mosquitto-storage:/mosquitto/data

    # Data storage
    # https://hub.docker.com/_/influxdb
    influxdb:
        # Name this container so other containers can find it easily
        # Name used in: 
        # - Grafana data source 
        # - Telegraf config
        container_name: influxdb
        image: influxdb:1.5
        ports:
            - "8086:8086"
        environment:
            - INFLUXDB_DB=sensors
            - INFLUXDB_ADMIN_USER=admin-user
            - INFLUXDB_ADMIN_PASSWORD=telegraf-admin-password
            - INFLUXDB_USER=telegraf-username
            - INFLUXDB_PASSWORD=telegraf-password
        restart: always
        volumes:
          # Data persistence (could also be a bind mount: /srv/docker/influxdb/data:/var/lib/influxdb)
          - influxdb-storage:/var/lib/influxdb
          # Backups...
          - ./influxdb-backup:/backup
          # Host can run the following on a crontab, then rsnapshot can pickup:
          # docker exec -it influxdb influxd backup -database sensors /backup

    # Message formattet (MQTT -> InfluxDB)
    # https://hub.docker.com/_/telegraf
    telegraf: 
        image: telegraf:1.11
        restart: always
        ports: 
            - "5050:5050"
        depends_on: 
            - influxdb
        volumes:
            # This file needs edited with your MQTT topics, host, etc
            - .docker/telegraf/telegraf.conf:/etc/telegraf/telegraf.conf:ro

    # Dashboard/graphing
    # https://hub.docker.com/r/grafana/grafana
    grafana: 
        # Grafana tags are a mess! just use whatever...
        image: grafana/grafana
        links:
            - influxdb
        hostname: grafana
        ports:
            - "3000:3000"
        depends_on: 
            - influxdb
        volumes:
            # Grafana gets grumpy over bind mount permissions, use a volume
            - grafana-storage:/var/lib/grafana

volumes:
    mosquitto-storage:
    influxdb-storage:
    grafana-storage:

我的telegraf配置文件如下所示:

version: '3'

services: 
  influxdb:
    container_name: influxdb
    image: influxdb
    ports:
        - "8086:8086"
    environment:
      - INFLUXDB_DB=sensors
      - INFLUXDB_ADMIN_USER=telegraf
      - INFLUXDB_ADMIN_PASSWORD=telegraf
    restart: always

  telegraf: 
    image: telegraf
    restart: always
    ports: 
      - "5050:5050"
    volumes:
    - $PWD/telegraf.conf:/etc/telegraf/telegraf.conf:ro  

  grafana: 
    container_name: grafana
    image: grafana/grafana
    links:
      - influxdb
    hostname: grafana
    ports:
        - "3000:3000"

  mosquitto:
    container_name: mosquitto
    image: eclipse-mosquitto
    ports:
      - "1883:1883"
      - "9001:9001"
    depends_on: 
      - influxdb
    restart: always
[[inputs.mqtt_consumer]]
  servers = ["tcp://mosquitto:1883"]

  topics = [
    "home/sensor/bme280/temperature",
  ]

  username = "mqttuser"
  password = "mqttpassword"
  data_format = "value"
  data_type = "float"

[[outputs.influxdb]]

  urls = ["http://influxdb:8086"]
  database = "sensors"
  skip_database_creation = true
  timeout = "5s"
  username = "telegraf-username"
  password = "telegraf-password" 
  user_agent = "telegraf"
  udp_payload = "512B"
请注意,我在docker中使用的是容器名称,而不是本地IP地址