刚把 nutch2.2 成功跑起来了,为什么没抓的有数据呢???

jack_peng 发布于 2013/09/24 01:26
阅读 2K+
收藏 0

nohup.out 文件内容 ,没有报错,往大神些随便指点下

InjectorJob: Using class org.apache.gora.memory.store.MemStore as the Gora storage class.

InjectorJob: total number of urls rejected by filters: 0
InjectorJob: total number of urls injected after normalization and filtering: 0
Fetcher: Your 'http.agent.name' value should be listed first in 'http.robots.agents' property.
FetcherJob: threads: 100
FetcherJob: parsing: false
FetcherJob: resuming: false
FetcherJob : timelimit set for : -1
Using queue mode : byHost
Fetcher: threads: 100
QueueFeeder finished: total 0 records. Hit by time limit :0
-finishing thread FetcherThread0, activeThreads=0
-finishing thread FetcherThread2, activeThreads=1
-finishing thread FetcherThread1, activeThreads=0
-finishing thread FetcherThread3, activeThreads=0
-finishing thread FetcherThread5, activeThreads=0
-finishing thread FetcherThread4, activeThreads=0
-finishing thread FetcherThread6, activeThreads=0
-finishing thread FetcherThread7, activeThreads=0
-finishing thread FetcherThread9, activeThreads=0
-finishing thread FetcherThread8, activeThreads=0
-finishing thread FetcherThread10, activeThreads=0
-finishing thread FetcherThread11, activeThreads=0
-finishing thread FetcherThread13, activeThreads=0
-finishing thread FetcherThread12, activeThreads=0
-finishing thread FetcherThread14, activeThreads=0
-finishing thread FetcherThread15, activeThreads=0
-finishing thread FetcherThread16, activeThreads=0
-finishing thread FetcherThread18, activeThreads=0
-finishing thread FetcherThread17, activeThreads=0
-finishing thread FetcherThread20, activeThreads=0
-finishing thread FetcherThread19, activeThreads=0
-finishing thread FetcherThread21, activeThreads=0
-finishing thread FetcherThread22, activeThreads=0
-finishing thread FetcherThread24, activeThreads=0
-finishing thread FetcherThread23, activeThreads=0
-finishing thread FetcherThread25, activeThreads=0
-finishing thread FetcherThread26, activeThreads=0
-finishing thread FetcherThread27, activeThreads=0
-finishing thread FetcherThread28, activeThreads=0
-finishing thread FetcherThread29, activeThreads=0
-finishing thread FetcherThread30, activeThreads=0
-finishing thread FetcherThread31, activeThreads=0
-finishing thread FetcherThread34, activeThreads=0
-finishing thread FetcherThread33, activeThreads=0
-finishing thread FetcherThread35, activeThreads=0
-finishing thread FetcherThread32, activeThreads=0
-finishing thread FetcherThread36, activeThreads=0
-finishing thread FetcherThread37, activeThreads=0
-finishing thread FetcherThread40, activeThreads=0
-finishing thread FetcherThread39, activeThreads=0
-finishing thread FetcherThread41, activeThreads=0
-finishing thread FetcherThread38, activeThreads=0
-finishing thread FetcherThread42, activeThreads=0
-finishing thread FetcherThread43, activeThreads=0
-finishing thread FetcherThread44, activeThreads=0
-finishing thread FetcherThread45, activeThreads=0
-finishing thread FetcherThread46, activeThreads=0
-finishing thread FetcherThread47, activeThreads=0
-finishing thread FetcherThread49, activeThreads=0
-finishing thread FetcherThread50, activeThreads=0
-finishing thread FetcherThread48, activeThreads=1
-finishing thread FetcherThread51, activeThreads=0
-finishing thread FetcherThread53, activeThreads=0
-finishing thread FetcherThread52, activeThreads=0
-finishing thread FetcherThread54, activeThreads=0
-finishing thread FetcherThread55, activeThreads=0
-finishing thread FetcherThread56, activeThreads=0
-finishing thread FetcherThread58, activeThreads=0
-finishing thread FetcherThread57, activeThreads=0
-finishing thread FetcherThread59, activeThreads=0
-finishing thread FetcherThread60, activeThreads=0
-finishing thread FetcherThread61, activeThreads=0
-finishing thread FetcherThread63, activeThreads=0
-finishing thread FetcherThread64, activeThreads=0
-finishing thread FetcherThread62, activeThreads=0
-finishing thread FetcherThread65, activeThreads=0
-finishing thread FetcherThread66, activeThreads=0
-finishing thread FetcherThread68, activeThreads=2
-finishing thread FetcherThread69, activeThreads=1
-finishing thread FetcherThread72, activeThreads=1
-finishing thread FetcherThread71, activeThreads=1
-finishing thread FetcherThread73, activeThreads=1
-finishing thread FetcherThread67, activeThreads=0
-finishing thread FetcherThread70, activeThreads=0
-finishing thread FetcherThread75, activeThreads=0
-finishing thread FetcherThread74, activeThreads=0
-finishing thread FetcherThread76, activeThreads=0
-finishing thread FetcherThread78, activeThreads=0
-finishing thread FetcherThread77, activeThreads=0
-finishing thread FetcherThread79, activeThreads=1
-finishing thread FetcherThread81, activeThreads=0
-finishing thread FetcherThread80, activeThreads=0
-finishing thread FetcherThread82, activeThreads=0
-finishing thread FetcherThread84, activeThreads=0
-finishing thread FetcherThread83, activeThreads=0
-finishing thread FetcherThread85, activeThreads=0
-finishing thread FetcherThread86, activeThreads=0
-finishing thread FetcherThread87, activeThreads=0
-finishing thread FetcherThread88, activeThreads=2
-finishing thread FetcherThread90, activeThreads=1
-finishing thread FetcherThread94, activeThreads=0
-finishing thread FetcherThread89, activeThreads=0
-finishing thread FetcherThread93, activeThreads=0
-finishing thread FetcherThread92, activeThreads=1
-finishing thread FetcherThread95, activeThreads=0
-finishing thread FetcherThread96, activeThreads=0
-finishing thread FetcherThread91, activeThreads=0
-finishing thread FetcherThread98, activeThreads=0
-finishing thread FetcherThread97, activeThreads=0
-finishing thread FetcherThread99, activeThreads=0
Fetcher: throughput threshold: -1
Fetcher: throughput threshold sequence: 5
0/0 spinwaiting/active, 0 pages, 0 errors, 0.0 0 pages/s, 0 0 kb/s, 0 URLs in 0 queues
-activeThreads=0
ParserJob: resuming:    false
ParserJob: forced reparse:    false
ParserJob: parsing all
Fetcher: Your 'http.agent.name' value should be listed first in 'http.robots.agents' property.
FetcherJob: threads: 100
FetcherJob: parsing: false
FetcherJob: resuming: false
FetcherJob : timelimit set for : -1
Using queue mode : byHost
Fetcher: threads: 100
QueueFeeder finished: total 0 records. Hit by time limit :0
-finishing thread FetcherThread0, activeThreads=0
-finishing thread FetcherThread1, activeThreads=78
-finishing thread FetcherThread2, activeThreads=77
-finishing thread FetcherThread3, activeThreads=76
-finishing thread FetcherThread4, activeThreads=75
-finishing thread FetcherThread5, activeThreads=74
-finishing thread FetcherThread6, activeThreads=73
-finishing thread FetcherThread7, activeThreads=72
-finishing thread FetcherThread8, activeThreads=71
-finishing thread FetcherThread9, activeThreads=70
-finishing thread FetcherThread10, activeThreads=69
-finishing thread FetcherThread11, activeThreads=68
-finishing thread FetcherThread12, activeThreads=67
-finishing thread FetcherThread13, activeThreads=66
-finishing thread FetcherThread14, activeThreads=65
-finishing thread FetcherThread15, activeThreads=64
-finishing thread FetcherThread16, activeThreads=63
-finishing thread FetcherThread17, activeThreads=62
-finishing thread FetcherThread18, activeThreads=61
-finishing thread FetcherThread19, activeThreads=60
-finishing thread FetcherThread20, activeThreads=59
-finishing thread FetcherThread21, activeThreads=58
-finishing thread FetcherThread22, activeThreads=57
-finishing thread FetcherThread23, activeThreads=56
-finishing thread FetcherThread24, activeThreads=55
-finishing thread FetcherThread25, activeThreads=54
-finishing thread FetcherThread26, activeThreads=53
-finishing thread FetcherThread27, activeThreads=52
-finishing thread FetcherThread28, activeThreads=51
-finishing thread FetcherThread29, activeThreads=50
-finishing thread FetcherThread30, activeThreads=49
-finishing thread FetcherThread31, activeThreads=48
-finishing thread FetcherThread32, activeThreads=47
-finishing thread FetcherThread33, activeThreads=46
-finishing thread FetcherThread34, activeThreads=45
-finishing thread FetcherThread35, activeThreads=44
-finishing thread FetcherThread36, activeThreads=43
-finishing thread FetcherThread37, activeThreads=42
-finishing thread FetcherThread38, activeThreads=50
-finishing thread FetcherThread80, activeThreads=49
-finishing thread FetcherThread85, activeThreads=48
-finishing thread FetcherThread84, activeThreads=47
-finishing thread FetcherThread83, activeThreads=46
-finishing thread FetcherThread82, activeThreads=45
-finishing thread FetcherThread81, activeThreads=44
-finishing thread FetcherThread79, activeThreads=43
-finishing thread FetcherThread78, activeThreads=42
-finishing thread FetcherThread77, activeThreads=41
-finishing thread FetcherThread86, activeThreads=40
-finishing thread FetcherThread76, activeThreads=39
-finishing thread FetcherThread88, activeThreads=38
-finishing thread FetcherThread75, activeThreads=37
-finishing thread FetcherThread87, activeThreads=36
-finishing thread FetcherThread74, activeThreads=35
-finishing thread FetcherThread73, activeThreads=34
-finishing thread FetcherThread72, activeThreads=33
-finishing thread FetcherThread71, activeThreads=36
-finishing thread FetcherThread70, activeThreads=37
-finishing thread FetcherThread69, activeThreads=36
-finishing thread FetcherThread68, activeThreads=35
-finishing thread FetcherThread67, activeThreads=34
-finishing thread FetcherThread66, activeThreads=33
-finishing thread FetcherThread96, activeThreads=33
-finishing thread FetcherThread65, activeThreads=32
-finishing thread FetcherThread64, activeThreads=31
-finishing thread FetcherThread63, activeThreads=30
-finishing thread FetcherThread97, activeThreads=30
-finishing thread FetcherThread62, activeThreads=29
-finishing thread FetcherThread61, activeThreads=28
-finishing thread FetcherThread60, activeThreads=27
-finishing thread FetcherThread59, activeThreads=26
-finishing thread FetcherThread58, activeThreads=25
-finishing thread FetcherThread98, activeThreads=25
-finishing thread FetcherThread57, activeThreads=24
Fetcher: throughput threshold: -1
-finishing thread FetcherThread56, activeThreads=23
Fetcher: throughput threshold sequence: 5
-finishing thread FetcherThread55, activeThreads=22
-finishing thread FetcherThread95, activeThreads=22
-finishing thread FetcherThread54, activeThreads=21
-finishing thread FetcherThread99, activeThreads=21
-finishing thread FetcherThread53, activeThreads=20
-finishing thread FetcherThread52, activeThreads=19
-finishing thread FetcherThread51, activeThreads=18
-finishing thread FetcherThread50, activeThreads=17
-finishing thread FetcherThread49, activeThreads=16
-finishing thread FetcherThread48, activeThreads=15
-finishing thread FetcherThread47, activeThreads=14
-finishing thread FetcherThread46, activeThreads=13
-finishing thread FetcherThread45, activeThreads=12
-finishing thread FetcherThread44, activeThreads=11
-finishing thread FetcherThread43, activeThreads=10
-finishing thread FetcherThread42, activeThreads=9
-finishing thread FetcherThread41, activeThreads=8
-finishing thread FetcherThread40, activeThreads=7
-finishing thread FetcherThread90, activeThreads=5
-finishing thread FetcherThread92, activeThreads=3
-finishing thread FetcherThread94, activeThreads=4
-finishing thread FetcherThread91, activeThreads=2
-finishing thread FetcherThread39, activeThreads=5
-finishing thread FetcherThread89, activeThreads=1
-finishing thread FetcherThread93, activeThreads=0
0/0 spinwaiting/active, 0 pages, 0 errors, 0.0 0 pages/s, 0 0 kb/s, 0 URLs in 0 queues
-activeThreads=0
ParserJob: resuming:    false
ParserJob: forced reparse:    false
ParserJob: parsing all
Fetcher: Your 'http.agent.name' value should be listed first in 'http.robots.agents' property.
FetcherJob: threads: 100
FetcherJob: parsing: false
FetcherJob: resuming: false
FetcherJob : timelimit set for : -1
Using queue mode : byHost
Fetcher: threads: 100
QueueFeeder finished: total 0 records. Hit by time limit :0
-finishing thread FetcherThread3, activeThreads=3
-finishing thread FetcherThread5, activeThreads=3
-finishing thread FetcherThread4, activeThreads=3
-finishing thread FetcherThread6, activeThreads=3
-finishing thread FetcherThread7, activeThreads=3
-finishing thread FetcherThread8, activeThreads=3
-finishing thread FetcherThread9, activeThreads=3
-finishing thread FetcherThread10, activeThreads=3
-finishing thread FetcherThread11, activeThreads=3
-finishing thread FetcherThread12, activeThreads=3
-finishing thread FetcherThread13, activeThreads=3
-finishing thread FetcherThread14, activeThreads=3
-finishing thread FetcherThread15, activeThreads=3
-finishing thread FetcherThread17, activeThreads=3
-finishing thread FetcherThread16, activeThreads=3
-finishing thread FetcherThread18, activeThreads=3
-finishing thread FetcherThread19, activeThreads=3
-finishing thread FetcherThread20, activeThreads=3
-finishing thread FetcherThread21, activeThreads=3
-finishing thread FetcherThread22, activeThreads=3
-finishing thread FetcherThread23, activeThreads=3
-finishing thread FetcherThread24, activeThreads=3
-finishing thread FetcherThread25, activeThreads=3
-finishing thread FetcherThread26, activeThreads=3
-finishing thread FetcherThread27, activeThreads=3
-finishing thread FetcherThread29, activeThreads=3
-finishing thread FetcherThread28, activeThreads=3
-finishing thread FetcherThread31, activeThreads=3
-finishing thread FetcherThread30, activeThreads=3
-finishing thread FetcherThread32, activeThreads=3
-finishing thread FetcherThread33, activeThreads=3
-finishing thread FetcherThread34, activeThreads=3
-finishing thread FetcherThread35, activeThreads=3
-finishing thread FetcherThread36, activeThreads=3
-finishing thread FetcherThread37, activeThreads=3
-finishing thread FetcherThread38, activeThreads=3
-finishing thread FetcherThread39, activeThreads=3
-finishing thread FetcherThread99, activeThreads=3
Fetcher: throughput threshold: -1
Fetcher: throughput threshold sequence: 5
-finishing thread FetcherThread98, activeThreads=3
-finishing thread FetcherThread97, activeThreads=3
-finishing thread FetcherThread96, activeThreads=3
-finishing thread FetcherThread95, activeThreads=3
-finishing thread FetcherThread94, activeThreads=3
-finishing thread FetcherThread93, activeThreads=3
-finishing thread FetcherThread92, activeThreads=3
-finishing thread FetcherThread91, activeThreads=3
-finishing thread FetcherThread90, activeThreads=3
-finishing thread FetcherThread89, activeThreads=3
-finishing thread FetcherThread88, activeThreads=3
-finishing thread FetcherThread87, activeThreads=3
-finishing thread FetcherThread86, activeThreads=3
-finishing thread FetcherThread85, activeThreads=3
-finishing thread FetcherThread84, activeThreads=3
-finishing thread FetcherThread83, activeThreads=3
-finishing thread FetcherThread82, activeThreads=3
-finishing thread FetcherThread81, activeThreads=3
-finishing thread FetcherThread80, activeThreads=3
-finishing thread FetcherThread79, activeThreads=3
-finishing thread FetcherThread78, activeThreads=3
-finishing thread FetcherThread77, activeThreads=3
-finishing thread FetcherThread76, activeThreads=3
-finishing thread FetcherThread75, activeThreads=3
-finishing thread FetcherThread74, activeThreads=3
-finishing thread FetcherThread73, activeThreads=3
-finishing thread FetcherThread72, activeThreads=3
-finishing thread FetcherThread71, activeThreads=3
-finishing thread FetcherThread70, activeThreads=3
-finishing thread FetcherThread69, activeThreads=3
-finishing thread FetcherThread68, activeThreads=3
-finishing thread FetcherThread67, activeThreads=3
-finishing thread FetcherThread66, activeThreads=3
-finishing thread FetcherThread65, activeThreads=3
-finishing thread FetcherThread64, activeThreads=3
-finishing thread FetcherThread63, activeThreads=3
-finishing thread FetcherThread62, activeThreads=3
-finishing thread FetcherThread61, activeThreads=3
-finishing thread FetcherThread60, activeThreads=3
-finishing thread FetcherThread59, activeThreads=3
-finishing thread FetcherThread58, activeThreads=3
-finishing thread FetcherThread57, activeThreads=3
-finishing thread FetcherThread56, activeThreads=3
-finishing thread FetcherThread55, activeThreads=3
-finishing thread FetcherThread54, activeThreads=3
-finishing thread FetcherThread53, activeThreads=3
-finishing thread FetcherThread52, activeThreads=3
-finishing thread FetcherThread51, activeThreads=3
-finishing thread FetcherThread50, activeThreads=3
-finishing thread FetcherThread49, activeThreads=3
-finishing thread FetcherThread48, activeThreads=3
-finishing thread FetcherThread47, activeThreads=3
-finishing thread FetcherThread46, activeThreads=3
-finishing thread FetcherThread45, activeThreads=3
-finishing thread FetcherThread44, activeThreads=3
-finishing thread FetcherThread43, activeThreads=3
-finishing thread FetcherThread42, activeThreads=3
-finishing thread FetcherThread41, activeThreads=3
-finishing thread FetcherThread40, activeThreads=3
-finishing thread FetcherThread0, activeThreads=2
-finishing thread FetcherThread2, activeThreads=1
-finishing thread FetcherThread1, activeThreads=0
0/0 spinwaiting/active, 0 pages, 0 errors, 0.0 0 pages/s, 0 0 kb/s, 0 URLs in 0 queues
-activeThreads=0
ParserJob: resuming:    false
ParserJob: forced reparse:    false
ParserJob: parsing all
加载中
返回顶部
顶部