web服务器崩溃,求大神解决

sp村长 发布于 2014/11/06 10:59
阅读 606
收藏 0

昨天晚上web服务器蹦了,三小时啊。估计今天要被老板KO了

情况是这样的(麻烦看这个帖子):http://www.oschina.net/question/152148_181366

然后这是服务器的一部分日志:


Nov  5 17:55:22 xxxxx kernel: nginx: page allocation failure. order:1, mode:0x20
Nov  5 17:55:22 xxxxx kernel: Pid: 2117, comm: nginx Not tainted 2.6.32-279.19.1.el6.x86_64 #1
Nov  5 17:55:22 xxxxx kernel: Call Trace:
Nov  5 17:55:22 xxxxx kernel: <IRQ>  [<ffffffff811231ff>] ? __alloc_pages_nodemask+0x77f/0x940
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81429d00>] ? dev_hard_start_xmit+0x240/0x3f0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8115d1a2>] ? kmem_getpages+0x62/0x170
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8115ddba>] ? fallback_alloc+0x1ba/0x270
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8115d80f>] ? cache_grow+0x2cf/0x320
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8115db39>] ? ____cache_alloc_node+0x99/0x160
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8115eabb>] ? kmem_cache_alloc+0x11b/0x190
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8141ae98>] ? sk_prot_alloc+0x48/0x1c0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8141bf72>] ? sk_clone+0x22/0x2e0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff814699d6>] ? inet_csk_clone+0x16/0xd0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81482853>] ? tcp_create_openreq_child+0x23/0x450
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8148004d>] ? tcp_v4_syn_recv_sock+0x4d/0x310
Nov  5 17:55:22 xxxxx kernel: [<ffffffff814825f6>] ? tcp_check_req+0x226/0x460
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8141e347>] ? __kfree_skb+0x47/0xa0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8147faeb>] ? tcp_v4_do_rcv+0x35b/0x430
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8142e15f>] ? netif_rx+0xaf/0x160
Nov  5 17:55:22 xxxxx kernel: [<ffffffff814812fe>] ? tcp_v4_rcv+0x4fe/0x8d0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81384925>] ? loopback_xmit+0x75/0xa0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8141e57d>] ? skb_release_head_state+0xcd/0x110
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8145f1ad>] ? ip_local_deliver_finish+0xdd/0x2d0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8145f438>] ? ip_local_deliver+0x98/0xa0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8145e8fd>] ? ip_rcv_finish+0x12d/0x440
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8147f95e>] ? tcp_v4_do_rcv+0x1ce/0x430
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8145ee85>] ? ip_rcv+0x275/0x350
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8142946b>] ? __netif_receive_skb+0x49b/0x6f0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8147e61a>] ? tcp4_gro_receive+0x5a/0xd0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8142b5e8>] ? netif_receive_skb+0x58/0x60
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8142b6f0>] ? napi_skb_finish+0x50/0x70
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8142d6a9>] ? napi_gro_receive+0x39/0x50
Nov  5 17:55:22 xxxxx kernel: [<ffffffffa013cd5f>] ? bnx2_poll_work+0xd4f/0x1280 [bnx2]
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8145ee85>] ? ip_rcv+0x275/0x350
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8127ddb0>] ? swiotlb_map_page+0x0/0x100
Nov  5 17:55:22 xxxxx kernel: [<ffffffffa013d2cd>] ? bnx2_poll_msix+0x3d/0xc0 [bnx2]
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8142d7c3>] ? net_rx_action+0x103/0x2f0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81072991>] ? __do_softirq+0xc1/0x1e0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff810d8b40>] ? handle_IRQ_event+0x60/0x170
Nov  5 17:55:22 xxxxx kernel: [<ffffffff810729ef>] ? __do_softirq+0x11f/0x1e0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8100c1cc>] ? call_softirq+0x1c/0x30
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8100de05>] ? do_softirq+0x65/0xa0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81072775>] ? irq_exit+0x85/0x90
Nov  5 17:55:22 xxxxx kernel: [<ffffffff814f1eb5>] ? do_IRQ+0x75/0xf0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8100b9d3>] ? ret_from_intr+0x0/0x11
Nov  5 17:55:22 xxxxx kernel: <EOI>  [<ffffffff814ec587>] ? _spin_unlock_irqrestore+0x17/0x20
Nov  5 17:55:22 xxxxx kernel: [<ffffffff811591ef>] ? compaction_alloc+0x39f/0x3e0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81163533>] ? migrate_pages+0xb3/0x4b0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff811270f7>] ? ____pagevec_lru_add+0x167/0x180
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81158e50>] ? compaction_alloc+0x0/0x3e0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81159747>] ? compact_zone+0x517/0x820
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81159cd1>] ? compact_zone_order+0xa1/0xe0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81159e2c>] ? try_to_compact_pages+0x11c/0x190
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81123075>] ? __alloc_pages_nodemask+0x5f5/0x940
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8115d1a2>] ? kmem_getpages+0x62/0x170
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8115ddba>] ? fallback_alloc+0x1ba/0x270
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8115d80f>] ? cache_grow+0x2cf/0x320
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8115db39>] ? ____cache_alloc_node+0x99/0x160
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8115eabb>] ? kmem_cache_alloc+0x11b/0x190
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8141ae98>] ? sk_prot_alloc+0x48/0x1c0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8141b04c>] ? sk_alloc+0x3c/0x130
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81490c9e>] ? inet_create+0x19e/0x380
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81191c52>] ? new_inode+0x72/0xb0
Nov  5 17:55:22 xxxxx kernel: [<ffffffff81416047>] ? __sock_create+0x117/0x240
Nov  5 17:55:22 xxxxx kernel: [<ffffffff814161d0>] ? sock_create+0x30/0x40
Nov  5 17:55:22 xxxxx kernel: [<ffffffff814163ec>] ? sys_socket+0x3c/0x80
Nov  5 17:55:22 xxxxx kernel: [<ffffffff8100b072>] ? system_call_fastpath+0x16/0x1b
Nov  5 17:55:23 xxxxx kernel: __ratelimit: 644 callbacks suppressed


下面有大量的:

__ratelimit: 1079 callbacks suppressed

加载中
返回顶部
顶部