titan使用kryo内存溢出

低调牛人 发布于 2015/10/19 15:38
阅读 1K+
收藏 0
[WARN]-[Thread: TitanID(23)(3)[0]]-[com.thinkaurelius.titan.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock()]: Temporary storage exception while acquiring id block - retrying in Duration[600 ms]: com.thinkaurelius.titan.diskstorage.TemporaryBackendException: Wrote claim for id block [3520001, 3600001) in Duration[511000 μs] => too slow, threshold is: Duration[300 ms]
[WARN]-[Thread: TitanID(48)(3)[0]]-[com.thinkaurelius.titan.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock()]: Temporary storage exception while acquiring id block - retrying in Duration[600 ms]: com.thinkaurelius.titan.diskstorage.TemporaryBackendException: Wrote claim for id block [7680001, 7760001) in Duration[719000 μs] => too slow, threshold is: Duration[300 ms]
com.thinkaurelius.titan.core.TitanException: Serializer Restriction: Cannot serialize object of type: class java.lang.String
Caused by: com.esotericsoftware.kryo.KryoException: Buffer overflow. Available: 2097152, required: 2098318
[INFO]-[Thread: pool-2-thread-1]-[com.bocom.qbfx.service.ExecuteWashDateService.begin()]: com.thinkaurelius.titan.core.TitanException: Could not commit transaction due to exception during persistence
com.thinkaurelius.titan.core.TitanException: Could not commit transaction due to exception during persistence
Caused by: com.thinkaurelius.titan.core.TitanException: Serializer Restriction: Cannot serialize object of type: class java.lang.String
Caused by: com.esotericsoftware.kryo.KryoException: Buffer overflow. Available: 2097152, required: 2098318
[root@zqqb2 qb_aplication]# more SnowManager-test.log|grep -n  Exception
62987:[WARN]-[Thread: TitanID(23)(3)[0]]-[com.thinkaurelius.titan.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock()]: Temporary storage exception while acquiring id block - retrying in Duration[600 ms]: com.thinkaurelius.titan.diskstorage.TemporaryBackendException: Wrote claim for id block [3520001, 3600001) in Duration[511000 μs] => too slow, threshold is: Duration[300 ms]
162861:[WARN]-[Thread: TitanID(48)(3)[0]]-[com.thinkaurelius.titan.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock()]: Temporary storage exception while acquiring id block - retrying in Duration[600 ms]: com.thinkaurelius.titan.diskstorage.TemporaryBackendException: Wrote claim for id block [7680001, 7760001) in Duration[719000 μs] => too slow, threshold is: Duration[300 ms]
377754:com.thinkaurelius.titan.core.TitanException: Serializer Restriction: Cannot serialize object of type: class java.lang.String
377780:Caused by: com.esotericsoftware.kryo.KryoException: Buffer overflow. Available: 2097152, required: 2098318
377795:[INFO]-[Thread: pool-2-thread-1]-[com.bocom.qbfx.service.ExecuteWashDateService.begin()]: com.thinkaurelius.titan.core.TitanException: Could not commit transaction due to exception during persistence
377796:com.thinkaurelius.titan.core.TitanException: Could not commit transaction due to exception during persistence
377816:Caused by: com.thinkaurelius.titan.core.TitanException: Serializer Restriction: Cannot serialize object of type: class java.lang.String
377825:Caused by: com.esotericsoftware.kryo.KryoException: Buffer overflow. Available: 2097152, required: 2098318
[root@zqqb2 qb_aplication]# cat SnowManager-test.log|head -377896|tail -100
at com.thinkaurelius.titan.graphdb.transaction.StandardTitanTx.commit(StandardTitanTx.java:1348)
at com.thinkaurelius.titan.graphdb.blueprints.TitanBlueprintsGraph.commit(TitanBlueprintsGraph.java:60)
at com.bocom.titan.graph.TitanOperate.genTitanVertexMap(TitanOperate.java:686)
at com.bocom.titan.graph.TitanOperate.generateNeoNodeBatchDataMap(TitanOperate.java:549)
at com.bocom.qbfx.service.CacheWashData.addNodeVo(CacheWashData.java:545)
at com.bocom.qbfx.service.WashSnowService.publicWashNode(WashSnowService.java:421)
at com.bocom.qbfx.service.WashSnowService.searchHbaseData(WashSnowService.java:633)
at com.bocom.qbfx.service.WashSnowService.washTempNodes(WashSnowService.java:135)
at com.bocom.qbfx.service.WashSnowService.init(WashSnowService.java:106)
at com.bocom.qbfx.service.ExecuteWashDateService.snowInitWashData(ExecuteWashDateService.java:125)
at com.bocom.qbfx.service.ExecuteWashDateService.begin(ExecuteWashDateService.java:79)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.bocom.qbfx.util.ExecutThread.run(ExecutThread.java:52)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: com.thinkaurelius.titan.core.TitanException: Serializer Restriction: Cannot serialize object of type: class java.lang.String
at com.thinkaurelius.titan.graphdb.database.serialize.StandardSerializer$StandardDataOutput.writeClassAndObject(StandardSerializer.java:178)
at com.thinkaurelius.titan.graphdb.database.EdgeSerializer.writePropertyValue(EdgeSerializer.java:382)
at com.thinkaurelius.titan.graphdb.database.EdgeSerializer.writePropertyValue(EdgeSerializer.java:376)
at com.thinkaurelius.titan.graphdb.database.EdgeSerializer.writeRelation(EdgeSerializer.java:292)
at com.thinkaurelius.titan.graphdb.database.StandardTitanGraph.prepareCommit(StandardTitanGraph.java:526)
at com.thinkaurelius.titan.graphdb.database.StandardTitanGraph.commit(StandardTitanGraph.java:654)
at com.thinkaurelius.titan.graphdb.transaction.StandardTitanTx.commit(StandardTitanTx.java:1337)
... 18 more
Caused by: com.esotericsoftware.kryo.KryoException: Buffer overflow. Available: 2097152, required: 2098318
at com.esotericsoftware.kryo.io.Output.require(Output.java:144)
at com.esotericsoftware.kryo.io.Output.writeString_slow(Output.java:437)
at com.esotericsoftware.kryo.io.Output.writeString(Output.java:343)
at com.esotericsoftware.kryo.serializers.DefaultSerializers$StringSerializer.write(DefaultSerializers.java:167)
at com.esotericsoftware.kryo.serializers.DefaultSerializers$StringSerializer.write(DefaultSerializers.java:160)
at com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:614)
at com.thinkaurelius.titan.graphdb.database.serialize.kryo.KryoSerializer.writeClassAndObject(KryoSerializer.java:143)
at com.thinkaurelius.titan.graphdb.database.serialize.StandardSerializer$StandardDataOutput.writeClassAndObject(StandardSerializer.java:176)
... 24 more


2015-10-16 17:07:30
[INFO]-[Thread: pool-9-thread-1]-[org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.<init>()]: Process identifier=catalogtracker-on-hconnection-0x5797aef5 connecting to ZooKeeper ensemble=zqqb9:2181,zqqb5:2181,zqqb8:2181


2015-10-16 17:07:30
[INFO]-[Thread: pool-9-thread-1]-[org.apache.zookeeper.ZooKeeper.<init>()]: Initiating client connection, connectString=zqqb9:2181,zqqb5:2181,zqqb8:2181 sessionTimeout=180000 watcher=catalogtracker-on-hconnection-0x5797aef5, quorum=zqqb9:2181,zqqb5:2181,zqqb8:2181, baseZNode=/hyperbase1


2015-10-16 17:07:30
[INFO]-[Thread: pool-9-thread-1-SendThread(zqqb9:2181)]-[org.apache.zookeeper.ClientCnxn$SendThread.logStartConnect()]: Opening socket connection to server zqqb9/192.168.1.229:2181. Will not attempt to authenticate using SASL (unknown error)


2015-10-16 17:07:30
[INFO]-[Thread: pool-9-thread-1-SendThread(zqqb9:2181)]-[org.apache.zookeeper.ClientCnxn$SendThread.primeConnection()]: Socket connection established to zqqb9/192.168.1.229:2181, initiating session


2015-10-16 17:07:30
[INFO]-[Thread: pool-9-thread-1-SendThread(zqqb9:2181)]-[org.apache.zookeeper.ClientCnxn$SendThread.onConnected()]: Session establishment complete on server zqqb9/192.168.1.229:2181, sessionid = 0x24ff54722ce7a96, negotiated timeout = 180000


2015-10-16 17:07:30
[INFO]-[Thread: pool-9-thread-1]-[org.apache.zookeeper.ZooKeeper.close()]: Session: 0x24ff54722ce7a96 closed


2015-10-16 17:07:30
[INFO]-[Thread: pool-9-thread-1-EventThread]-[org.apache.zookeeper.ClientCnxn$EventThread.run()]: EventThread shut down


2015-10-16 17:07:35
[INFO]-[Thread: pool-9-thread-1]-[org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.<init>()]: Process identifier=catalogtracker-on-hconnection-0x5797aef5 connecting to ZooKeeper ensemble=zqqb9:2181,zqqb5:2181,zqqb8:2181


2015-10-16 17:07:35
[INFO]-[Thread: pool-9-thread-1]-[org.apache.zookeeper.ZooKeeper.<init>()]: Initiating client connection, connectString=zqqb9:2181,zqqb5:2181,zqqb8:2181 sessionTimeout=180000 watcher=catalogtracker-on-hconnection-0x5797aef5, quorum=zqqb9:2181,zqqb5:2181,zqqb8:2181, baseZNode=/hyperbase1


2015-10-16 17:07:35
[INFO]-[Thread: pool-9-thread-1-SendThread(zqqb5:2181)]-[org.apache.zookeeper.ClientCnxn$SendThread.logStartConnect()]: Opening socket connection to server zqqb5/192.168.1.225:2181. Will not attempt to authenticate using SASL (unknown error)


2015-10-16 17:07:35
[INFO]-[Thread: pool-9-thread-1-SendThread(zqqb5:2181)]-[org.apache.zookeeper.ClientCnxn$SendThread.primeConnection()]: Socket connection established to zqqb5/192.168.1.225:2181, initiating session


2015-10-16 17:07:35
[INFO]-[Thread: pool-9-thread-1-SendThread(zqqb5:2181)]-[org.apache.zookeeper.ClientCnxn$SendThread.onConnected()]: Session establishment complete on server zqqb5/192.168.1.225:2181, sessionid = 0x4ff54723258195, negotiated timeout = 180000


2015-10-16 17:07:35
[INFO]-[Thread: pool-9-thread-1]-[org.apache.zookeeper.ZooKeeper.close()]: Session: 0x4ff54723258195 closed


2015-10-16 17:07:35
[INFO]-[Thread: pool-9-thread-1-EventThread]-[org.apache.zookeeper.ClientCnxn$EventThread.run()]: EventThread shut down


2015-10-16 17:07:40
[INFO]-[Thread: pool-9-thread-1]-[org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.<init>()]: Process identifier=catalogtracker-on-hconnection-0x5797aef5 connecting to ZooKeeper ensemble=zqqb9:2181,zqqb5:2181,zqqb8:2181


2015-10-16 17:07:40
[INFO]-[Thread: pool-9-thread-1]-[org.apache.zookeeper.ZooKeeper.<init>()]: Initiating client connection, connectString=zqqb9:2181,zqqb5:2181,zqqb8:2181 sessionTimeout=180000 watcher=catalogtracker-on-hconnection-0x5797aef5, quorum=zqqb9:2181,zqqb5:2181,zqqb8:2181, baseZNode=/hyperbase1


2015-10-16 17:07:40
[INFO]-[Thread: pool-9-thread-1-SendThread(zqqb8:2181)]-[org.apache.zookeeper.ClientCnxn$SendThread.logStartConnect()]: Opening socket connection to server zqqb8/192.168.1.228:2181. Will not attempt to authenticate using SASL (unknown error)


2015-10-16 17:07:40
[INFO]-[Thread: pool-9-thread-1-SendThread(zqqb8:2181)]-[org.apache.zookeeper.ClientCnxn$SendThread.primeConnection()]: Socket connection established to zqqb8/192.168.1.228:2181, initiating session


2015-10-16 17:07:40
[INFO]-[Thread: pool-9-thread-1-SendThread(zqqb8:2181)]-[org.apache.zookeeper.ClientCnxn$SendThread.onConnected()]: Session establishment complete on server zqqb8/192.168.1.228:2181, sessionid = 0x14ff547238f786f, negotiated timeout = 180000


2015-10-16 17:07:40
[INFO]-[Thread: pool-9-thread-1]-[org.apache.zookeeper.ZooKeeper.close()]: Session: 0x14ff547238f786f cl
加载中
返回顶部
顶部