logstash消耗的activeMQ(使用stomp)

logstash消耗的activeMQ(使用stomp),activemq,logstash,Activemq,Logstash,我正在使用logstash使用activeMQ中的消息,我需要使用“stomp”使logstash支持activeMQ。在我的activeMQ配置文件“activeMQ.xml”中,我在“”部分中已经有以下行 这会产生错误: C:\logstash>rem java -jar logstash-1.1.13-flatjar.jar agent -f logstash-indexer.conf -- web --backend elasticsearch://127.0.0.1/volarb

我正在使用logstash使用activeMQ中的消息,我需要使用“stomp”使logstash支持activeMQ。在我的activeMQ配置文件“activeMQ.xml”中,我在“”部分中已经有以下行

这会产生错误:

C:\logstash>rem java -jar logstash-1.1.13-flatjar.jar agent -f logstash-indexer.conf -- web --backend elasticsearch://127.0.0.1/volarb

C:\logstash>java -cp c:/logstash/logstash-1.1.13-monolithic logstash.runner agent -f logstash-indexer.conf
Exception in thread "LogStash::Runner" org.jruby.exceptions.RaiseException: (InvalidLocaleData) can not load translations from file:C:/logstash/locales/en.yml: #<Errno::ENOENT: No such file or directory - file:C:/logstash/locales/en.yml>
        at RUBY.load_yml(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/base.rb:180)
        at org.jruby.RubyBasicObject.__send__(org/jruby/RubyBasicObject.java:1683)
        at org.jruby.RubyKernel.send(org/jruby/RubyKernel.java:2107)
        at RUBY.load_file(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/base.rb:161)
        at RUBY.load_translations(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/base.rb:15)
        at org.jruby.RubyArray.each(org/jruby/RubyArray.java:1613)
        at RUBY.load_translations(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/base.rb:15)
        at RUBY.init_translations(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/simple.rb:57)
        at RUBY.lookup(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/simple.rb:71)
        at RUBY.translate(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/base.rb:26)
        at RUBY.translate(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n.rb:156)
        at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1174)
        at RUBY.translate(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n.rb:152)
        at RUBY.validate_check_required_parameter_names(C:/logstash/logstash-1.1.13-monolithic/logstash/config/mixin.rb:233)
        at org.jruby.RubyHash.each(org/jruby/RubyHash.java:1257)
        at RUBY.validate_check_required_parameter_names(C:/logstash/logstash-1.1.13-monolithic/logstash/config/mixin.rb:225)
        at RUBY.validate(C:/logstash/logstash-1.1.13-monolithic/logstash/config/mixin.rb:174)
        at RUBY.config_init(C:/logstash/logstash-1.1.13-monolithic/logstash/config/mixin.rb:52)
        at RUBY.initialize(C:/logstash/logstash-1.1.13-monolithic/logstash/inputs/base.rb:67)
        at RUBY.parse_config(C:/logstash/logstash-1.1.13-monolithic/logstash/agent.rb:333)
        at RUBY.parse(C:/logstash/logstash-1.1.13-monolithic/logstash/config/file.rb:53)
        at RUBY.each(C:/logstash/logstash-1.1.13-monolithic/logstash/config/file.rb:91)
        at org.jruby.RubyArray.each(org/jruby/RubyArray.java:1613)
        at RUBY.each(C:/logstash/logstash-1.1.13-monolithic/logstash/config/file.rb:90)
        at org.jruby.RubyHash.each(org/jruby/RubyHash.java:1257)
        at RUBY.each(C:/logstash/logstash-1.1.13-monolithic/logstash/config/file.rb:83)
        at RUBY.parse(C:/logstash/logstash-1.1.13-monolithic/logstash/config/file.rb:39)
        at RUBY.parse_config(C:/logstash/logstash-1.1.13-monolithic/logstash/agent.rb:323)
        at RUBY.run_with_config(C:/logstash/logstash-1.1.13-monolithic/logstash/agent.rb:427)
        at org.jruby.ext.thread.Mutex.synchronize(org/jruby/ext/thread/Mutex.java:149)
        at RUBY.run_with_config(C:/logstash/logstash-1.1.13-monolithic/logstash/agent.rb:426)
        at RUBY.run(C:/logstash/logstash-1.1.13-monolithic/logstash/agent.rb:373)
        at org.jruby.RubyProc.call(org/jruby/RubyProc.java:249)
        at RUBY.initialize(C:/logstash/logstash-1.1.13-monolithic/gems/stud-0.0.13/lib/stud/task.rb:12)
我的问题是如何使activeMQ(stomp)部分工作: 1、我的输入部分是否需要“queue=>elasticsearch”; 2、有人举过一个例子,让logstash在acitveMQ中从一个队列中消费(使用stomp plubin)

下面是使用stomp的链接:


看起来您没有放入主机,尽管它应该默认为localhost,但在文档中说这是一个必需属性。下面是我的logstash 1.5

stomp {
    destination   => "/topic/topic.name"
    codec         => "json"
    host          => "mq.company.com"
    type          => "mq_message" 
}

如果这还不够,请尝试添加rubydebug输出并将其发送到stdout,以便您可以实时查看情况。

我强烈建议您升级到比1.1.13版更新的logstash版本,尤其是在该版本的beta版stomp上。请参阅
C:\logstash>rem java -jar logstash-1.1.13-flatjar.jar agent -f logstash-indexer.conf -- web --backend elasticsearch://127.0.0.1/volarb

C:\logstash>java -cp c:/logstash/logstash-1.1.13-monolithic logstash.runner agent -f logstash-indexer.conf
Exception in thread "LogStash::Runner" org.jruby.exceptions.RaiseException: (InvalidLocaleData) can not load translations from file:C:/logstash/locales/en.yml: #<Errno::ENOENT: No such file or directory - file:C:/logstash/locales/en.yml>
        at RUBY.load_yml(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/base.rb:180)
        at org.jruby.RubyBasicObject.__send__(org/jruby/RubyBasicObject.java:1683)
        at org.jruby.RubyKernel.send(org/jruby/RubyKernel.java:2107)
        at RUBY.load_file(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/base.rb:161)
        at RUBY.load_translations(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/base.rb:15)
        at org.jruby.RubyArray.each(org/jruby/RubyArray.java:1613)
        at RUBY.load_translations(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/base.rb:15)
        at RUBY.init_translations(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/simple.rb:57)
        at RUBY.lookup(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/simple.rb:71)
        at RUBY.translate(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n/backend/base.rb:26)
        at RUBY.translate(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n.rb:156)
        at org.jruby.RubyKernel.catch(org/jruby/RubyKernel.java:1174)
        at RUBY.translate(C:/logstash/logstash-1.1.13-monolithic/gems/i18n-0.6.4/lib/i18n.rb:152)
        at RUBY.validate_check_required_parameter_names(C:/logstash/logstash-1.1.13-monolithic/logstash/config/mixin.rb:233)
        at org.jruby.RubyHash.each(org/jruby/RubyHash.java:1257)
        at RUBY.validate_check_required_parameter_names(C:/logstash/logstash-1.1.13-monolithic/logstash/config/mixin.rb:225)
        at RUBY.validate(C:/logstash/logstash-1.1.13-monolithic/logstash/config/mixin.rb:174)
        at RUBY.config_init(C:/logstash/logstash-1.1.13-monolithic/logstash/config/mixin.rb:52)
        at RUBY.initialize(C:/logstash/logstash-1.1.13-monolithic/logstash/inputs/base.rb:67)
        at RUBY.parse_config(C:/logstash/logstash-1.1.13-monolithic/logstash/agent.rb:333)
        at RUBY.parse(C:/logstash/logstash-1.1.13-monolithic/logstash/config/file.rb:53)
        at RUBY.each(C:/logstash/logstash-1.1.13-monolithic/logstash/config/file.rb:91)
        at org.jruby.RubyArray.each(org/jruby/RubyArray.java:1613)
        at RUBY.each(C:/logstash/logstash-1.1.13-monolithic/logstash/config/file.rb:90)
        at org.jruby.RubyHash.each(org/jruby/RubyHash.java:1257)
        at RUBY.each(C:/logstash/logstash-1.1.13-monolithic/logstash/config/file.rb:83)
        at RUBY.parse(C:/logstash/logstash-1.1.13-monolithic/logstash/config/file.rb:39)
        at RUBY.parse_config(C:/logstash/logstash-1.1.13-monolithic/logstash/agent.rb:323)
        at RUBY.run_with_config(C:/logstash/logstash-1.1.13-monolithic/logstash/agent.rb:427)
        at org.jruby.ext.thread.Mutex.synchronize(org/jruby/ext/thread/Mutex.java:149)
        at RUBY.run_with_config(C:/logstash/logstash-1.1.13-monolithic/logstash/agent.rb:426)
        at RUBY.run(C:/logstash/logstash-1.1.13-monolithic/logstash/agent.rb:373)
        at org.jruby.RubyProc.call(org/jruby/RubyProc.java:249)
        at RUBY.initialize(C:/logstash/logstash-1.1.13-monolithic/gems/stud-0.0.13/lib/stud/task.rb:12)
input {
  rabbitmq {
    host => "volarb-amqp"
    queue => "elasticsearch"
    key => "elasticsearch"
    exchange => "elasticsearch"
    type => "all"
    durable => true
    auto_delete => false
    exclusive => false
    format => "json_event"
    debug => false
  }
}

output {
  file {
    path => "C:\logstash\cosumedfromstomp.txt"
  }
}
stomp {
    destination   => "/topic/topic.name"
    codec         => "json"
    host          => "mq.company.com"
    type          => "mq_message" 
}