elasticsearch logstash kafka输入不工作,elasticsearch,apache-kafka,logstash,logstash-configuration,elasticsearch,Apache Kafka,Logstash,Logstash Configuration" /> elasticsearch logstash kafka输入不工作,elasticsearch,apache-kafka,logstash,logstash-configuration,elasticsearch,Apache Kafka,Logstash,Logstash Configuration" />

elasticsearch logstash kafka输入不工作

elasticsearch logstash kafka输入不工作,elasticsearch,apache-kafka,logstash,logstash-configuration,elasticsearch,Apache Kafka,Logstash,Logstash Configuration,我正试图从卡夫卡那里获取数据,并将其推送到ElasticSearch 以下是我正在使用的日志存储配置: input { kafka { zk_connect => "localhost:2181" topic_id => "beats" } } output { elasticsearch { hosts => ["localhost:9200"] index => "elasticse" } } 这里有人能帮我配置logstash吗?如果我运行此命令,则会出现无效的配

我正试图从卡夫卡那里获取数据,并将其推送到ElasticSearch

以下是我正在使用的日志存储配置:

input {
kafka {
zk_connect => "localhost:2181"
topic_id => "beats"
}
}
output {
elasticsearch {
hosts => ["localhost:9200"]
index => "elasticse"
}
}
这里有人能帮我配置logstash吗?如果我运行此命令,则会出现无效的配置错误

D:\logstash-5.0.0\bin>logstash -f log-uf.conf
Sending Logstash logs to D:\logstash-5.0.0\logs\logstash-plain.txt which is now
configured via log4j2.properties.
[2016-11-11T16:31:32,429][ERROR][logstash.inputs.kafka    ] Unknown setting 'zk_
connect' for kafka
[2016-11-11T16:31:32,438][ERROR][logstash.inputs.kafka    ] Unknown setting 'top
ic_id' for kafka
[2016-11-11T16:31:32,452][ERROR][logstash.agent           ] fetched an invalid c
onfig {:config=>"input {\n   kafka {\n   zk_connect => \"localhost:2181\"\n   to
pic_id => \"beats\"\n   consumer_threads => 16\n  }\n}\noutput {\nelasticsearch
{\nhosts => [\"localhost:9200\"]\nindex => \"elasticse\"\n}\n}\n", :reason=>"Som
ething is wrong with your configuration."}

有人能帮忙吗

您正在运行logstash5,其中包含logstash2.4的配置

zk_connect
(Zookeeper主机)在5.0中被
bootstrap_服务器(卡夫卡代理)和
topic_id
取代

请尝试此配置:

input {
  kafka {
    bootstrap_servers => "localhost:9092"
    topics => ["beats"]
  }
}
output {
  elasticsearch {
    hosts => ["localhost:9200"]
    index => "elasticse"
  }
}

您正在运行logstash5,其中包含logstash2.4的配置

zk_connect
(Zookeeper主机)在5.0中被
bootstrap_服务器(卡夫卡代理)和
topic_id
取代

请尝试此配置:

input {
  kafka {
    bootstrap_servers => "localhost:9092"
    topics => ["beats"]
  }
}
output {
  elasticsearch {
    hosts => ["localhost:9200"]
    index => "elasticse"
  }
}

瓦尔,我还需要一个人帮忙。如果我想把卡夫卡作为输出,我可以像下面提到的答案那样提出来吗:输入{Kafka{bootstrap\u servers=>“localhost:9092”topics=>[“beatsab”]}}输出{Kafka{bootstrap\u servers=>“localhost:9092”topics=>[“sound”}}不在输出中,你需要
topic id
而不是
topics
Val,我还需要一个人帮忙。如果我想把卡夫卡作为输出,如果我像下面提到的答案那样提出来可以吗:输入{Kafka{bootstrap\u servers=>“localhost:9092”topics=>[“beatsab”]}}输出{Kafka{bootstrap\u servers=>“localhost:9092”topics=>[“sound”}}不在输出中,你需要
topic id
而不是
topics