[ale] nice - extracting a kernel panic from a tail -f maillog

[Jim Kinney]

BUG: unable to handle kernel NULL pointer dereferencelman-bounces at mai at 
virtual address 00000001
l. ale.org>, sizprinting eip:
=5c913, class=-60479801
, nrcpts=1, msgi*pde = 0b134067
d=<mailman.293.1Oops: 0002 [#1]
SMP
last sysfs file: /devices/pci0000:00/0000:00:00.0/irq
346106256.2045.aModules linked in: hidp l2cap bluetooth lockd sunrpc 
ipt_REJECT xt_state ip_conntrack nfnetlink xt_tcpudp iptable_filter 
ip_tables x_tables be2iscsi ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad 
ib_core ib_addr iscsi_tcp bnx2i cnic ipv6 xfrm_nalgo crypto_api uio 
cxgb3i libcxgbi cxgb3 8021q libiscsi_tcp libiscsi2 scsi_transport_iscsi2 
scsi_transport_iscsi dm_mirror dm_multipath scsi_dh parport_pc lp 
parport ide_cd serio_raw cdrom i2c_piix4 floppy e100 i2c_core mii pcspkr 
sg dm_raid45 dm_message dm_region_hash dm_log dm_mod dm_mem_cache 
aic7xxx scsi_transport_spi sd_mod scsi_mod raid1 ext3 jbd uhci_hcd 
ohci_hcd ehci_hcd
le at ale.org>, proCPU:    1
EIP:    0060:[<c0479801>]    Not tainted VLI
EFLAGS: 00010202   (2.6.18-274.7.1.el5 #1)
to=ESMTP, daemonEIP is at __find_get_block+0x9d/0x16c
=MTA, relay=locaeax: df74d518   ebx: 00000001   ecx: 00000001   edx: 
c13ef660
lhost.localdomaiesi: 00126816   edi: 00000000   ebp: c14ae620   esp: 
df8bbd74
ds: 007b   es: 007b   ss: 0068
n P[127.0.0.1]
rocess python (pid: 2048, ti=df8bb000 task=dff55aa0 task.ti=df8bb000)
Stack: 000fe01e 00000000 000fe01e 00000000 df61fafc df5573ac c8cf5bcc 
c80998c0
        c8cf5d6c c8cf4fa8 c8cf5dd4 dcde4aa0 00000000 c9810300 00000000 
c04798f7
        00001000 000fe01e 00000000 c14ae620 df74d518 00001000 e0844ad3 
0000000b
Call Trace:
ug 29 10:38:06 w [<c04798f7>] ww sendmail[4908__getblk+0x27/0x272
]: STARTTLS=clie [<e0844ad3>] nt, 
relay=mail.kdo_get_write_access+0x435/0x462 [jbd]
neuro.net., vers [<e087e4ba>] ion=TLSv1/SSLv3,ext3_getblk+0x7c/0x231 [ext3]
  v erify=FAIL, c[<e087e523>] pher=DHE-RSA-AESext3_getblk+0xe5/0x231 [ext3]
256-SHA, bits=25 [<c048d452>] 6/256
Aug 29 10dput+0x22/0xed
:38:06 www sendm [<e087f3c0>] ail[5330]: STARText3_bread+0x13/0x69 [ext3]
TLS=client, rela [<e0882904>] 
y=gmail-smtp-in.htree_dirblock_to_tree+0x22/0x113 [ext3]
l.google.com., v [<e0882a4d>] 
ersion=TLSv1/SSLext3_htree_fill_tree+0x58/0x1a0 [ext3]
v3 , verify=FAIL[<c04864dd>] do_path_lookup+0x231/0x297
  cipher=RC4-SHA, [<e088ab34>]  bits=128/128
Aext3_permission+0x0/0xa [ext3]
  [<c0483f92>] ug 29 10:38:06 wpermission+0xa2/0xb5
ww sendmail[5324 [<e087ba80>] ]: q7TEc58i00532ext3_readdir+0x1a6/0x5ae 
[ext3]
  [<c0487116>] 2: to=<jim.kinneopen_namei+0x26e/0x631
  [<c04787c3>] y at gmail.com>, defile_move+0x27/0x32
  [<c0488a78>] lay=00:00:01, xdfilldir64+0x0/0xc5
elay=00:00:01, m [<c0476329>] nameidata_to_filp+0x19/0x28
ailer=esmtp, pri [<c0476363>] do_filp_open+0x2b/0x31
=231894, relay=g [<c0488c59>] vfs_readdir+0x63/0x8d
mail-smtp-in.l.g [<c0488a78>] filldir64+0x0/0xc5
oogle.com. [IPv6 [<c0488ce6>] sys_getdents64+0x63/0xa5
:2001:4860:800a: [<c0404f4b>] :1a], dsn=2.0.0,syscall_call+0x7/0xb
  stat=Sent (OK 1 =======================
Code: f2 eb ef 89 19 f0 ff 43 30 eb 08 42 83 fa 08 75 b7 31 db fb 85 db 
0f 85 cc 00 00 00 8b 14 24 89 e8 8b 4c 24 04 e8 7d fc ff ff 43 <30> 31 
ed be 01 00 00 00 89 5c 24 0c c7 44 24 08 00 00 00 00 8b
EIP: [<c0479801>] __find_get_block+0x9d/0x16c346251086 q9si97 SS:ESP 
0068:df8bbd74
65296anp.164)
A ug 29 10:38:06 w<0>Kernel panic - not syncing: Fatal exception