logstash:Connection reset by peer==>filebeat:Failed to publish events
默认分类 | 作者 juneryang | 发布于2017年07月14日 | 阅读数:17120
问题描述:filebeat-->logstash-->elasticsearch-->kibana这种架构。
问题:logstash-->到es
[ERROR][org.logstash.beats.BeatsHandler] Exception: Connection reset by peer
有这累的报错后,
filebeat--> 到logstash
ERR Failed to publish events caused by: read tcp xxxx:47752->xxxx:5516: i/o timeout
ERR Failed to publish events caused by: client is not connected
然后就开始停止发送数据了
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
请问大神有没有碰到过类似的问题的?是怎么解决的?
现在基本状况是:
es filebeat都做过优化,目前es是一台机器2实例,4分片0副本,索引按天算,一天500多G,有5个logstash进程往es写入数据,5台机器的10个filebeat往logstash发送数据。
问题:logstash-->到es
[ERROR][org.logstash.beats.BeatsHandler] Exception: Connection reset by peer
有这累的报错后,
filebeat--> 到logstash
ERR Failed to publish events caused by: read tcp xxxx:47752->xxxx:5516: i/o timeout
ERR Failed to publish events caused by: client is not connected
然后就开始停止发送数据了
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
请问大神有没有碰到过类似的问题的?是怎么解决的?
现在基本状况是:
es filebeat都做过优化,目前es是一台机器2实例,4分片0副本,索引按天算,一天500多G,有5个logstash进程往es写入数据,5台机器的10个filebeat往logstash发送数据。
3 个回复
kennywu76 - Wood
赞同来自: laoyang360
参考:
https://github.com/logstash-pl ... s/163
https://github.com/logstash-pl ... s/185
mingfeng.zhang
赞同来自:
我这里的filebeat版本是5.4
logstash版本测试过5.4.0,5.4.2都存在这个问题无论是打开ssl验证还是关闭ssl验证。
测试过:
filebeat-logstash在同一网段两台机器
filebeat-logstash在同一网段一台机器
ruicai.li
赞同来自:
从节点的日志:ERR Failed to publish events caused by: write tcp 10.233.75.48:52710->10.233.23.172:5000: write: connection reset by peer
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
主节点的日志:ERR Not loading modules. Module directory not found: /usr/local/bin/module