ES7.9.3写入数据一段时间后提示Data is large，经常出现节点频繁离线和加入，查看集群节点cpu、jvm内存、磁盘io、load都很低。ES是容器化环境。集群写入当日的1个索引，大小在2T左右。JVM内存单节点设置30G。没找到解决办法。
Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [parent] Data too large, data for [internal:cluster/nodes/indices/shard/store[n]] would be [25272026148/23.5gb], which is larger than the limit of [22548578304/21gb], real usage: [25272025976/23.5gb], new bytes reserved: [172/172b], usages [request=0/0b, fielddata=1579973790/1.4gb, in_flight_requests=33052/32.2kb, model_inference=0/0b, accounting=3500340/3.3mb]
Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [parent] Data too large, data for [internal:cluster/nodes/indices/shard/store[n]] would be [25272026148/23.5gb], which is larger than the limit of [22548578304/21gb], real usage: [25272025976/23.5gb], new bytes reserved: [172/172b], usages [request=0/0b, fielddata=1579973790/1.4gb, in_flight_requests=33052/32.2kb, model_inference=0/0b, accounting=3500340/3.3mb]
1 个回复
Charele - Cisco4321
赞同来自:
具体意义可以自己了解，这不是几句话能说清的
不管是副分片恢复失败，还是data too large报错，
都不会引起“出现节点频繁离线和加入”，
所以我说要先找到“出现节点频繁离线和加入”的原因