mongodb是否有任何Logstash过滤器插件,用于从多个集合中选择字段并将其保存到一个Elasticsearch文档中?
我是logstash的新手,我想将来自多个mongo集合的数据合并到ES中的一个文档中。有人可以帮助识别这个用例或指针文档的过滤器插件吗 Sample.confmongodb是否有任何Logstash过滤器插件,用于从多个集合中选择字段并将其保存到一个Elasticsearch文档中?,logstash,logstash-grok,Logstash,Logstash Grok,我是logstash的新手,我想将来自多个mongo集合的数据合并到ES中的一个文档中。有人可以帮助识别这个用例或指针文档的过滤器插件吗 Sample.conf input { mongodb { uri => 'mongodb://localhost:27017/UserDB' placeholder_db_dir => '/var/lib/mongodb/' placeholder_db_name => '
input {
mongodb {
uri => 'mongodb://localhost:27017/UserDB'
placeholder_db_dir => '/var/lib/mongodb/'
placeholder_db_name => 'logstash_sqlite.db'
collection => 'Users'
batch_size => 202
}
mongodb {
uri => 'mongodb://localhost:27017/ProjectDB'
placeholder_db_dir => '/var/lib/mongodb/'
placeholder_db_name => 'logstash_sqlite.db'
collection => 'Projects'
batch_size => 202
}
}
filter {
mutate {
remove_field => [ "_id" ]
}
}
output {
stdout {
codec => rubydebug
}
elasticsearch {
action => "index"
index => "mongo_log_data"
hosts => ["localhost:9200"]
}
} ```
Output :
In Elastic Index they get inserted as separate documents, I wanted to filter few fields from Users and few from Project and insert as one document.
i.e
{
Users.name
Users.id
Project.title
Project.details
}
Any examples would be really appreciated.
如果它们共享唯一id,则可以使用聚合筛选器。