k8s helm efk 问题

weir2016 发布于 09/10 20:56
阅读 166
收藏 0

[root@master03 ~]#  kubectl logs -n efk efk-es-elasticsearch-client-786d9b46c9-cmn2w
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[2019-09-10T12:46:37,711][INFO ][o.e.n.Node               ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] initializing ...
[2019-09-10T12:46:37,992][INFO ][o.e.e.NodeEnvironment    ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] using [1] data paths, mounts [[/ (overlay)]], net usable_space [8gb], net total_space [16.9gb], types [overlay]
[2019-09-10T12:46:37,993][INFO ][o.e.e.NodeEnvironment    ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] heap size [503.6mb], compressed ordinary object pointers [true]
[2019-09-10T12:46:37,996][INFO ][o.e.n.Node               ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] node name [efk-es-elasticsearch-client-786d9b46c9-cmn2w], node ID [OJp8nLKhSayZwyftM019MQ]
[2019-09-10T12:46:37,996][INFO ][o.e.n.Node               ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] version[6.4.2], pid[1], build[oss/tar/04711c2/2018-09-26T13:34:09.098244Z], OS[Linux/4.4.191-1.el7.elrepo.x86_64/amd64], JVM["Oracle Corporation"/OpenJDK 64-Bit Server VM/10.0.2/10.0.2+13]
[2019-09-10T12:46:37,998][INFO ][o.e.n.Node               ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.lMqyBfk2, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -XX:UseAVX=2, -Des.cgroups.hierarchy.override=/, -Djava.net.preferIPv4Stack=true, -Xms512m, -Xmx512m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=oss, -Des.distribution.type=tar]
[2019-09-10T12:46:42,377][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [aggs-matrix-stats]
[2019-09-10T12:46:42,377][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [analysis-common]
[2019-09-10T12:46:42,378][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [ingest-common]
[2019-09-10T12:46:42,378][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [lang-expression]
[2019-09-10T12:46:42,378][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [lang-mustache]
[2019-09-10T12:46:42,378][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [lang-painless]
[2019-09-10T12:46:42,378][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [mapper-extras]
[2019-09-10T12:46:42,379][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [parent-join]
[2019-09-10T12:46:42,379][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [percolator]
[2019-09-10T12:46:42,379][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [rank-eval]
[2019-09-10T12:46:42,379][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [reindex]
[2019-09-10T12:46:42,380][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [repository-url]
[2019-09-10T12:46:42,380][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [transport-netty4]
[2019-09-10T12:46:42,380][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded module [tribe]
[2019-09-10T12:46:42,381][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded plugin [ingest-geoip]
[2019-09-10T12:46:42,381][INFO ][o.e.p.PluginsService     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] loaded plugin [ingest-user-agent]
[2019-09-10T12:46:48,819][WARN ][o.e.d.s.ScriptModule     ] Script: returning default values for missing document values is deprecated. Set system property '-Des.scripting.exception_for_missing_value=true' to make behaviour compatible with future major versions.
[2019-09-10T12:46:55,588][INFO ][o.e.d.DiscoveryModule    ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] using discovery type [zen]
[2019-09-10T12:46:58,595][INFO ][o.e.n.Node               ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] initialized
[2019-09-10T12:46:58,596][INFO ][o.e.n.Node               ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] starting ...
[2019-09-10T12:46:58,997][INFO ][o.e.t.TransportService   ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] publish_address {10.244.3.50:9300}, bound_addresses {0.0.0.0:9300}
[2019-09-10T12:46:59,006][INFO ][o.e.b.BootstrapChecks    ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] bound or publishing to a non-loopback address, enforcing bootstrap checks
[2019-09-10T12:46:59,097][WARN ][o.e.d.z.UnicastZenPing   ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] failed to resolve host [efk-es-elasticsearch-discovery]
java.net.UnknownHostException: efk-es-elasticsearch-discovery: Name or service not known
        at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) ~[?:?]
        at java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:925) ~[?:?]
        at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1505) ~[?:?]
        at java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:844) ~[?:?]
        at java.net.InetAddress.getAllByName0(InetAddress.java:1495) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1354) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1288) ~[?:?]
        at org.elasticsearch.transport.TcpTransport.parse(TcpTransport.java:945) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TcpTransport.addressesFromString(TcpTransport.java:900) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TransportService.addressesFromString(TransportService.java:711) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.discovery.zen.UnicastZenPing.lambda$resolveHostsLists$0(UnicastZenPing.java:184) ~[elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:624) [elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135) [?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
        at java.lang.Thread.run(Thread.java:844) [?:?]
[2019-09-10T12:47:02,117][WARN ][o.e.d.z.ZenDiscovery     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] not enough master nodes discovered during pinging (found [[]], but needed [1]), pinging again
[2019-09-10T12:47:02,118][WARN ][o.e.d.z.UnicastZenPing   ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] failed to resolve host [efk-es-elasticsearch-discovery]
java.net.UnknownHostException: efk-es-elasticsearch-discovery
        at java.net.InetAddress$CachedAddresses.get(InetAddress.java:793) ~[?:?]
        at java.net.InetAddress.getAllByName0(InetAddress.java:1495) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1354) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1288) ~[?:?]
        at org.elasticsearch.transport.TcpTransport.parse(TcpTransport.java:945) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TcpTransport.addressesFromString(TcpTransport.java:900) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TransportService.addressesFromString(TransportService.java:711) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.discovery.zen.UnicastZenPing.lambda$resolveHostsLists$0(UnicastZenPing.java:184) ~[elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:624) [elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135) [?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
        at java.lang.Thread.run(Thread.java:844) [?:?]
[2019-09-10T12:47:05,121][WARN ][o.e.d.z.ZenDiscovery     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] not enough master nodes discovered during pinging (found [[]], but needed [1]), pinging again
[2019-09-10T12:47:05,122][WARN ][o.e.d.z.UnicastZenPing   ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] failed to resolve host [efk-es-elasticsearch-discovery]
java.net.UnknownHostException: efk-es-elasticsearch-discovery
        at java.net.InetAddress$CachedAddresses.get(InetAddress.java:793) ~[?:?]
        at java.net.InetAddress.getAllByName0(InetAddress.java:1495) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1354) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1288) ~[?:?]
        at org.elasticsearch.transport.TcpTransport.parse(TcpTransport.java:945) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TcpTransport.addressesFromString(TcpTransport.java:900) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TransportService.addressesFromString(TransportService.java:711) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.discovery.zen.UnicastZenPing.lambda$resolveHostsLists$0(UnicastZenPing.java:184) ~[elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:624) [elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135) [?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
        at java.lang.Thread.run(Thread.java:844) [?:?]
[2019-09-10T12:47:08,129][WARN ][o.e.d.z.ZenDiscovery     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] not enough master nodes discovered during pinging (found [[]], but needed [1]), pinging again
[2019-09-10T12:47:08,130][WARN ][o.e.d.z.UnicastZenPing   ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] failed to resolve host [efk-es-elasticsearch-discovery]
java.net.UnknownHostException: efk-es-elasticsearch-discovery
        at java.net.InetAddress$CachedAddresses.get(InetAddress.java:793) ~[?:?]
        at java.net.InetAddress.getAllByName0(InetAddress.java:1495) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1354) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1288) ~[?:?]
        at org.elasticsearch.transport.TcpTransport.parse(TcpTransport.java:945) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TcpTransport.addressesFromString(TcpTransport.java:900) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TransportService.addressesFromString(TransportService.java:711) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.discovery.zen.UnicastZenPing.lambda$resolveHostsLists$0(UnicastZenPing.java:184) ~[elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:624) [elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135) [?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
        at java.lang.Thread.run(Thread.java:844) [?:?]
[2019-09-10T12:47:11,133][WARN ][o.e.d.z.ZenDiscovery     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] not enough master nodes discovered during pinging (found [[]], but needed [1]), pinging again
[2019-09-10T12:47:11,176][WARN ][o.e.d.z.UnicastZenPing   ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] failed to resolve host [efk-es-elasticsearch-discovery]
java.net.UnknownHostException: efk-es-elasticsearch-discovery: Name or service not known
        at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) ~[?:?]
        at java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:925) ~[?:?]
        at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1505) ~[?:?]
        at java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:844) ~[?:?]
        at java.net.InetAddress.getAllByName0(InetAddress.java:1495) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1354) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1288) ~[?:?]
        at org.elasticsearch.transport.TcpTransport.parse(TcpTransport.java:945) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TcpTransport.addressesFromString(TcpTransport.java:900) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TransportService.addressesFromString(TransportService.java:711) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.discovery.zen.UnicastZenPing.lambda$resolveHostsLists$0(UnicastZenPing.java:184) ~[elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:624) [elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135) [?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
        at java.lang.Thread.run(Thread.java:844) [?:?]
[2019-09-10T12:47:14,180][WARN ][o.e.d.z.ZenDiscovery     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] not enough master nodes discovered during pinging (found [[]], but needed [1]), pinging again
[2019-09-10T12:47:14,183][WARN ][o.e.d.z.UnicastZenPing   ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] failed to resolve host [efk-es-elasticsearch-discovery]
java.net.UnknownHostException: efk-es-elasticsearch-discovery
        at java.net.InetAddress$CachedAddresses.get(InetAddress.java:793) ~[?:?]
        at java.net.InetAddress.getAllByName0(InetAddress.java:1495) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1354) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1288) ~[?:?]
        at org.elasticsearch.transport.TcpTransport.parse(TcpTransport.java:945) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TcpTransport.addressesFromString(TcpTransport.java:900) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TransportService.addressesFromString(TransportService.java:711) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.discovery.zen.UnicastZenPing.lambda$resolveHostsLists$0(UnicastZenPing.java:184) ~[elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:624) [elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135) [?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
        at java.lang.Thread.run(Thread.java:844) [?:?]
[2019-09-10T12:47:17,185][WARN ][o.e.d.z.ZenDiscovery     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] not enough master nodes discovered during pinging (found [[]], but needed [1]), pinging again
[2019-09-10T12:47:17,187][WARN ][o.e.d.z.UnicastZenPing   ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] failed to resolve host [efk-es-elasticsearch-discovery]
java.net.UnknownHostException: efk-es-elasticsearch-discovery
        at java.net.InetAddress$CachedAddresses.get(InetAddress.java:793) ~[?:?]
        at java.net.InetAddress.getAllByName0(InetAddress.java:1495) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1354) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1288) ~[?:?]
        at org.elasticsearch.transport.TcpTransport.parse(TcpTransport.java:945) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TcpTransport.addressesFromString(TcpTransport.java:900) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TransportService.addressesFromString(TransportService.java:711) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.discovery.zen.UnicastZenPing.lambda$resolveHostsLists$0(UnicastZenPing.java:184) ~[elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:624) [elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135) [?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
        at java.lang.Thread.run(Thread.java:844) [?:?]
[2019-09-10T12:47:20,190][WARN ][o.e.d.z.ZenDiscovery     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] not enough master nodes discovered during pinging (found [[]], but needed [1]), pinging again
[2019-09-10T12:47:20,191][WARN ][o.e.d.z.UnicastZenPing   ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] failed to resolve host [efk-es-elasticsearch-discovery]
java.net.UnknownHostException: efk-es-elasticsearch-discovery
        at java.net.InetAddress$CachedAddresses.get(InetAddress.java:793) ~[?:?]
        at java.net.InetAddress.getAllByName0(InetAddress.java:1495) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1354) ~[?:?]
        at java.net.InetAddress.getAllByName(InetAddress.java:1288) ~[?:?]
        at org.elasticsearch.transport.TcpTransport.parse(TcpTransport.java:945) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TcpTransport.addressesFromString(TcpTransport.java:900) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.transport.TransportService.addressesFromString(TransportService.java:711) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.discovery.zen.UnicastZenPing.lambda$resolveHostsLists$0(UnicastZenPing.java:184) ~[elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:624) [elasticsearch-6.4.2.jar:6.4.2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135) [?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
        at java.lang.Thread.run(Thread.java:844) [?:?]
[2019-09-10T12:47:23,193][WARN ][o.e.d.z.ZenDiscovery     ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] not enough master nodes discovered during pinging (found [[]], but needed [1]), pinging again
[2019-09-10T12:47:26,768][INFO ][o.e.c.s.ClusterApplierService] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] detected_master {efk-es-elasticsearch-master-0}{QZwZJ9EfQdGOhaCYYDcwDA}{kepbFM-CSjKe361URqamuA}{10.244.4.73}{10.244.4.73:9300}, added {{efk-es-elasticsearch-data-0}{EJXtgtA0SVOkobWe5APlfQ}{Jmu2oPbZSPyAc4T511jRcg}{10.244.3.46}{10.244.3.46:9300},{efk-es-elasticsearch-master-0}{QZwZJ9EfQdGOhaCYYDcwDA}{kepbFM-CSjKe361URqamuA}{10.244.4.73}{10.244.4.73:9300},}, reason: apply cluster state (from master [master {efk-es-elasticsearch-master-0}{QZwZJ9EfQdGOhaCYYDcwDA}{kepbFM-CSjKe361URqamuA}{10.244.4.73}{10.244.4.73:9300} committed version [3]])
[2019-09-10T12:47:26,879][INFO ][o.e.h.n.Netty4HttpServerTransport] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] publish_address {10.244.3.50:9200}, bound_addresses {0.0.0.0:9200}
[2019-09-10T12:47:26,880][INFO ][o.e.n.Node               ] [efk-es-elasticsearch-client-786d9b46c9-cmn2w] started
[2019-09-10T12:54:07,142][WARN ][r.suppressed             ] path: /.kibana/doc/config%3A6.4.2, params: {index=.kibana, id=config:6.4.2, type=doc}
org.elasticsearch.cluster.block.ClusterBlockException: blocked by: [SERVICE_UNAVAILABLE/1/state not recovered / initialized];
        at org.elasticsearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:166) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.action.support.single.shard.TransportSingleShardAction.checkGlobalBlock(TransportSingleShardAction.java:105) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.action.support.single.shard.TransportSingleShardAction$AsyncSingleAction.<init>(TransportSingleShardAction.java:139) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.action.support.single.shard.TransportSingleShardAction$AsyncSingleAction.<init>(TransportSingleShardAction.java:123) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.action.support.single.shard.TransportSingleShardAction.doExecute(TransportSingleShardAction.java:95) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.action.support.single.shard.TransportSingleShardAction.doExecute(TransportSingleShardAction.java:59) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.action.support.TransportAction.doExecute(TransportAction.java:143) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:81) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.client.node.NodeClient.executeLocally(NodeClient.java:87) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.client.node.NodeClient.doExecute(NodeClient.java:76) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:407) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.client.support.AbstractClient.get(AbstractClient.java:499) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.rest.action.document.RestGetAction.lambda$prepareRequest$0(RestGetAction.java:81) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.rest.BaseRestHandler.handleRequest(BaseRestHandler.java:97) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:239) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.rest.RestController.tryAllHandlers(RestController.java:335) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:173) [elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.http.netty4.Netty4HttpServerTransport.dispatchRequest(Netty4HttpServerTransport.java:538) [transport-netty4-6.4.2.jar:6.4.2]
        at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:137) [transport-netty4-6.4.2.jar:6.4.2]
        at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at org.elasticsearch.http.netty4.pipelining.HttpPipeliningHandler.channelRead(HttpPipeliningHandler.java:68) [transport-netty4-6.4.2.jar:6.4.2]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) [netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.MessageToMessageCodec.channelRead(MessageToMessageCodec.java:111) [netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) [netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) [netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:310) [netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:284) [netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) [netty-handler-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1359) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:935) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:545) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:499) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) [netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-common-4.1.16.Final.jar:4.1.16.Final]
        at java.lang.Thread.run(Thread.java:844) [?:?]
[root@master03 ~]# 

加载中
0
冷川
冷川

有可能是coredns的问题,之前有遇到过类似的情况,DNS服务器切换后,域名无法解析。

0
w
weir2016

谢谢 在排查

返回顶部
顶部