elasticsearch 用于ElasticSearch 2.x的Rabbitmq插件,elasticsearch,rabbitmq,logstash,elasticsearch,Rabbitmq,Logstash" /> elasticsearch 用于ElasticSearch 2.x的Rabbitmq插件,elasticsearch,rabbitmq,logstash,elasticsearch,Rabbitmq,Logstash" />

elasticsearch 用于ElasticSearch 2.x的Rabbitmq插件

elasticsearch 用于ElasticSearch 2.x的Rabbitmq插件,elasticsearch,rabbitmq,logstash,elasticsearch,Rabbitmq,Logstash,我已经在ubuntu 14.04中安装了elastic search 2.3.4 我在不同的系统(10.x.x.12)上运行rabbitmq服务器。现在,我正在尝试将rabbitmq服务器与elasticsearch连接,以便使用队列中发布的所有消息并将其插入elasticsearch /etc/logstash/conf.d/rabbit.conf包含 rabbitmq { host => "10.x.x.12" queue => "integration"

我已经在ubuntu 14.04中安装了elastic search 2.3.4

我在不同的系统(10.x.x.12)上运行rabbitmq服务器。现在,我正在尝试将rabbitmq服务器与elasticsearch连接,以便使用队列中发布的所有消息并将其插入elasticsearch

/etc/logstash/conf.d/rabbit.conf包含

rabbitmq {
    host => "10.x.x.12"
    queue => "integration"
    durable => true
    key => "#"
    exchange => "integ"
    threads => 3
    prefetch_count => 50
    port => 5672
    user => "guest"
    password => "guest"
}
由于插件问题,logstash没有出现

service logstash configtest
Error: Expected one of #, input, filter, output at line 1, column 1 (byte 1) after  {:level=>:error}
我相信我们需要安装弹性搜索插件。在这个网站上,我没有看到可用于elastic search>2.0的插件


是否有人可以帮助查找apt插件,以便在队列中发布消息

rabbit.conf
文件中,需要将
rabbitmq
输入添加到
input{}
部分。您还需要一个带有
elasticsearch
输出的
output{}
部分将文档发送到ES服务器

input {
  rabbitmq {
    host => "10.x.x.12"
    queue => "integration"
    durable => true
    key => "#"
    exchange => "integ"
    threads => 3
    prefetch_count => 50
    port => 5672
    user => "guest"
    password => "guest"
  }
}
output {
   elasticsearch {
       hosts => ["10.x.x.11:9200"]
       index => "your_index"
       document_type => "your_type"
   }
}

默认情况下,
rabbitmq
输入插件包含在Logstash中。。它是。。伟大的让我试试看,接受答案。。谢谢你的工作。。可以声明多个索引吗?当我们在输出部分中声明索引时,是否也可以包含“类型”呢?我已经修改了答案以包含映射类型。如果需要,您可以声明多个
elasticsearch
输出,每个输出都有不同的索引。
input {
  rabbitmq {
    host => "10.x.x.12"
    queue => "integration"
    durable => true
    key => "#"
    exchange => "integ"
    threads => 3
    prefetch_count => 50
    port => 5672
    user => "guest"
    password => "guest"
  }
}
output {
   elasticsearch {
       hosts => ["10.x.x.11:9200"]
       index => "your_index"
       document_type => "your_type"
   }
}