【有偿解答】nutch2.2.1+MySQL爬取一天后报错,求大神相助。

潜意识忧伤 发布于 2016/12/23 12:59
阅读 230
收藏 0

我是在win下搭建的MySQL+nutch2.2.1在抓取到10009个页面时报Aborting with 10 hung threads.然后就报com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.求大神相助。下面是详细日志:

2016-12-21 17:03:42,678 INFO  fetcher.FetcherJob - fetching http://jobs.51job.com/chengdu-px/83993132.html?s=02 (queue crawl delay=5000ms)
2016-12-21 17:03:46,758 INFO  fetcher.FetcherJob - 3/10 spinwaiting/active, 10006 pages, 2 errors, 0.2 0 pages/s, 94 93 kb/s, 500 URLs in 1 queues
2016-12-21 17:03:48,184 INFO  fetcher.FetcherJob - fetching http://jobs.51job.com/chengdu-chq/75457435.html?s=02 (queue crawl delay=5000ms)
2016-12-21 17:03:51,759 INFO  fetcher.FetcherJob - 2/10 spinwaiting/active, 10007 pages, 2 errors, 0.2 0 pages/s, 94 94 kb/s, 500 URLs in 1 queues
2016-12-21 17:03:53,698 INFO  fetcher.FetcherJob - fetching http://jobs.51job.com/chengdu-gxq/83979630.html?s=02 (queue crawl delay=5000ms)
2016-12-21 17:03:56,759 INFO  fetcher.FetcherJob - 1/10 spinwaiting/active, 10008 pages, 2 errors, 0.2 0 pages/s, 94 94 kb/s, 500 URLs in 1 queues
2016-12-21 17:03:59,256 INFO  fetcher.FetcherJob - fetching http://jobs.51job.com/chengdu-whq/84278256.html?s=02 (queue crawl delay=5000ms)
2016-12-21 17:04:01,759 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 101 kb/s, 500 URLs in 1 queues
2016-12-21 17:04:06,803 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:04:11,804 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:04:16,923 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:04:21,928 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:04:26,929 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:04:31,929 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:04:36,930 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:04:41,931 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:04:46,937 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:04:51,959 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:04:57,523 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:05:02,524 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:05:07,537 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:05:12,538 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:05:17,538 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:05:22,539 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:05:27,573 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:05:32,638 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:05:37,640 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:05:42,646 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:05:47,646 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:05:52,647 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:05:57,648 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:06:02,648 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:06:07,662 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:06:12,663 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:06:17,663 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:06:22,664 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 94 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:06:27,667 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:06:32,725 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:06:37,740 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:06:42,754 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:06:47,754 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:06:52,766 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:06:57,770 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:07:02,772 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:07:07,776 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:07:12,781 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:07:17,781 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:07:22,782 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:07:27,784 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:07:32,791 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:07:37,803 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:07:42,804 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:07:47,804 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:07:52,805 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:07:58,539 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:08:03,881 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:08:08,897 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:08:13,898 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:08:18,904 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:08:23,912 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:08:28,913 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:08:33,913 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:08:38,914 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:08:44,339 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:08:49,339 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:08:54,341 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:08:59,343 INFO  fetcher.FetcherJob - 0/10 spinwaiting/active, 10009 pages, 2 errors, 0.2 0 pages/s, 93 0 kb/s, 500 URLs in 1 queues
2016-12-21 17:08:59,545 WARN  fetcher.FetcherJob - Aborting with 10 hung threads.
2016-12-21 17:13:30,754 INFO  fetcher.FetcherJob - fetching http://jobs.51job.com/chengdu-px/79979486.html?s=02 (queue crawl delay=5000ms)
2016-12-21 17:13:33,457 WARN  mapred.FileOutputCommitter - Output path is null in cleanup
2016-12-21 17:13:33,370 ERROR fetcher.FetcherJob - Unexpected error for http://jobs.51job.com/chengdu-px/79979486.html?s=02
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:538)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:13:35,397 INFO  parse.ParserJob - ParserJob: resuming: false
2016-12-21 17:13:35,397 INFO  parse.ParserJob - ParserJob: forced reparse: false
2016-12-21 17:13:35,397 INFO  parse.ParserJob - ParserJob: parsing all
2016-12-21 17:13:35,448 ERROR fetcher.FetcherJob - fetcher throwable caught
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:586)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:13:35,500 INFO  fetcher.FetcherJob - -finishing thread FetcherThread3, activeThreads=9
2016-12-21 17:13:40,663 INFO  fetcher.FetcherJob - fetching http://jobs.51job.com/chengdu-wjq/82623598.html?s=02 (queue crawl delay=5000ms)
2016-12-21 17:13:41,004 ERROR fetcher.FetcherJob - Unexpected error for http://jobs.51job.com/chengdu-wjq/82623598.html?s=02
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:538)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:13:41,097 ERROR fetcher.FetcherJob - fetcher throwable caught
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:586)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:13:41,109 INFO  fetcher.FetcherJob - -finishing thread FetcherThread1, activeThreads=8
2016-12-21 17:13:41,457 INFO  crawl.SignatureFactory - Using Signature impl: org.apache.nutch.crawl.MD5Signature
2016-12-21 17:13:46,503 INFO  fetcher.FetcherJob - fetching http://jobs.51job.com/chengdu-slx/82146881.html?s=02 (queue crawl delay=5000ms)
2016-12-21 17:13:46,706 ERROR fetcher.FetcherJob - Unexpected error for http://jobs.51job.com/chengdu-slx/82146881.html?s=02
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:538)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:13:46,725 ERROR fetcher.FetcherJob - fetcher throwable caught
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:586)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:13:46,745 INFO  fetcher.FetcherJob - -finishing thread FetcherThread2, activeThreads=7
2016-12-21 17:13:52,015 INFO  fetcher.FetcherJob - fetching http://jobs.51job.com/chengdu-gxq/61915345.html?s=02 (queue crawl delay=5000ms)
2016-12-21 17:13:52,423 ERROR fetcher.FetcherJob - Unexpected error for http://jobs.51job.com/chengdu-gxq/61915345.html?s=02
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:538)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:13:52,461 ERROR fetcher.FetcherJob - fetcher throwable caught
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:586)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:13:52,475 INFO  fetcher.FetcherJob - -finishing thread FetcherThread0, activeThreads=6
2016-12-21 17:13:53,149 INFO  mapreduce.GoraRecordReader - gora.buffer.read.limit = 10000
2016-12-21 17:13:53,264 INFO  mapreduce.GoraRecordWriter - gora.buffer.write.limit = 10000
2016-12-21 17:13:53,392 INFO  crawl.SignatureFactory - Using Signature impl: org.apache.nutch.crawl.MD5Signature
2016-12-21 17:13:57,553 INFO  fetcher.FetcherJob - fetching http://jobs.51job.com/chengdu-jjq/84312636.html?s=02 (queue crawl delay=5000ms)
2016-12-21 17:13:57,852 ERROR fetcher.FetcherJob - Unexpected error for http://jobs.51job.com/chengdu-jjq/84312636.html?s=02
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:538)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:13:57,865 ERROR fetcher.FetcherJob - fetcher throwable caught
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:586)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:13:57,877 INFO  fetcher.FetcherJob - -finishing thread FetcherThread5, activeThreads=5
2016-12-21 17:14:03,041 INFO  fetcher.FetcherJob - fetching http://jobs.51job.com/chengdu-chq/78821570.html?s=02 (queue crawl delay=5000ms)
2016-12-21 17:14:03,208 ERROR fetcher.FetcherJob - Unexpected error for http://jobs.51job.com/chengdu-chq/78821570.html?s=02
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:538)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:14:03,223 ERROR fetcher.FetcherJob - fetcher throwable caught
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:586)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:14:03,237 INFO  fetcher.FetcherJob - -finishing thread FetcherThread6, activeThreads=4
2016-12-21 17:14:08,597 INFO  fetcher.FetcherJob - fetching http://jobs.51job.com/chengdu-dyx/80719630.html?s=02 (queue crawl delay=5000ms)
2016-12-21 17:14:08,880 ERROR fetcher.FetcherJob - Unexpected error for http://jobs.51job.com/chengdu-dyx/80719630.html?s=02
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:538)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:14:08,899 ERROR fetcher.FetcherJob - fetcher throwable caught
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:586)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:14:08,916 INFO  fetcher.FetcherJob - -finishing thread FetcherThread7, activeThreads=3
2016-12-21 17:15:19,350 INFO  fetcher.FetcherJob - fetching http://jobs.51job.com/chengdu-gxq/83466525.html?s=02 (queue crawl delay=5000ms)
2016-12-21 17:15:19,516 ERROR fetcher.FetcherJob - Unexpected error for http://jobs.51job.com/chengdu-gxq/83466525.html?s=02
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:538)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:15:19,539 ERROR fetcher.FetcherJob - fetcher throwable caught
java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:623)
at org.apache.gora.mapreduce.GoraRecordWriter.write(GoraRecordWriter.java:60)
at org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:586)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.output(FetcherReducer.java:667)
at org.apache.nutch.fetcher.FetcherReducer$FetcherThread.run(FetcherReducer.java:586)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1013)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:982)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:927)
at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1205)
at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1197)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4186)
at com.mysql.jdbc.ConnectionImpl.prepareStatement(ConnectionImpl.java:4152)
at org.apache.gora.sql.statement.MySqlInsertUpdateStatement.toStatement(MySqlInsertUpdateStatement.java:71)
at org.apache.gora.sql.store.SqlStore.put(SqlStore.java:616)
... 5 more
2016-12-21 17:15:19,545 INFO  fetcher.FetcherJob - -finishing thread FetcherThread8, activeThreads=2
2016-12-21 17:15:19,714 WARN  mapred.FileOutputCommitter - Output path is null in cleanup
2016-12-21 17:15:19,714 WARN  mapred.LocalJobRunner - job_local798005826_0008
java.lang.Exception: java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure


The last packet successfully received from the server was 54 milliseconds ago.  The last packet sent successfully to the server was 85,607 milliseconds ago.
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:354)
Caused by: java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure


The last packet successfully received from the server was 54 milliseconds ago.  The last packet sent successfully to the server was 85,607 milliseconds ago.
at org.apache.gora.sql.store.SqlStore.execute(SqlStore.java:427)
at org.apache.gora.query.impl.QueryBase.execute(QueryBase.java:71)
at org.apache.gora.mapreduce.GoraRecordReader.executeQuery(GoraRecordReader.java:66)
at org.apache.gora.mapreduce.GoraRecordReader.nextKeyValue(GoraRecordReader.java:102)
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:531)
at org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:223)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure


The last packet successfully received from the server was 54 milliseconds ago.  The last packet sent successfully to the server was 85,607 milliseconds ago.
at sun.reflect.GeneratedConstructorAccessor22.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116)
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3102)
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2991)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3532)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:943)
at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1441)
at com.mysql.jdbc.MysqlIO.readSingleRowSet(MysqlIO.java:2936)
at com.mysql.jdbc.MysqlIO.getResultSet(MysqlIO.java:477)
at com.mysql.jdbc.MysqlIO.readResultsForQueryOrUpdate(MysqlIO.java:2631)
at com.mysql.jdbc.MysqlIO.readAllResults(MysqlIO.java:1800)
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2221)
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2624)
at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2127)
at com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2293)
at org.apache.gora.sql.store.SqlStore.execute(SqlStore.java:423)
... 14 more
Caused by: java.io.EOFException: Can not read response from server. Expected to read 61,393 bytes, read 16,380 bytes before connection was unexpectedly lost.
at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:2552)
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3058)
... 27 more


加载中
返回顶部
顶部