Bug 42643

Summary: oops during resume from s2disk
Product: Power Management Reporter: Klaus Mueller (kmueller)
Component: Hibernation/SuspendAssignee: power-management_other
Status: CLOSED DUPLICATE    
Severity: normal CC: alan, lenb, rjw
Priority: P1    
Hardware: All   
OS: Linux   
Kernel Version: 3.2.1 Subsystem:
Regression: No Bisected commit-id:
Bug Depends on:    
Bug Blocks: 7216    

Description Klaus Mueller 2012-01-23 21:06:41 UTC
Machine (notebook MSI CR620, x86_64) was switched off using s2disk (via KDE). On resume. the following oops came up (complete s2disk / resume log):

Jan 23 19:49:42 nb dbus-daemon[1233]: **** /proc/self/mountinfo changed
Jan 23 19:49:42 nb kernel: [21282.812138] Syncing filesystems ... done.
Jan 23 19:49:43 nb kernel: [21283.145632] Freezing user space processes ... (elapsed 0.01 seconds) done.
Jan 23 19:49:43 nb kernel: [21283.157071] PM: Preallocating image memory... done (allocated 253842 pages)
Jan 23 19:49:43 nb kernel: [21283.479039] PM: Allocated 1015368 kbytes in 0.32 seconds (3173.02 MB/s)
Jan 23 19:49:43 nb kernel: [21283.479041] Freezing remaining freezable tasks ... (elapsed 0.01 seconds) done.
Jan 23 19:49:43 nb kernel: [21283.489852] Suspending console(s) (use no_console_suspend to debug)
Jan 23 19:49:43 nb kernel: [21283.490373] snd_hda_intel 0000:00:1b.0: PCI INT A disabled
Jan 23 19:49:43 nb kernel: [21283.690608] sd 5:0:0:0: [sda] Synchronizing SCSI cache
Jan 23 19:49:43 nb kernel: [21283.691704] PM: freeze of devices complete after 201.967 msecs
Jan 23 19:49:43 nb kernel: [21283.692325] PM: late freeze of devices complete after 0.618 msecs
Jan 23 19:49:43 nb kernel: [21283.692737] ACPI: Preparing to enter system sleep state S4
Jan 23 19:49:43 nb kernel: [21283.706728] PM: Saving platform NVS memory
Jan 23 19:49:43 nb kernel: [21283.707355] Disabling non-boot CPUs ...
Jan 23 19:49:43 nb kernel: [21283.709312] CPU 1 is now offline
Jan 23 19:49:43 nb kernel: [21283.712058] CPU 2 is now offline
Jan 23 19:49:43 nb kernel: [21283.714286] CPU 3 is now offline
Jan 23 19:49:43 nb kernel: [21283.714975] Extended CMOS year: 2000
Jan 23 19:49:43 nb kernel: [21283.715087] PM: Creating hibernation image:
Jan 23 19:49:43 nb kernel: [21283.737548] PM: Need to copy 192470 pages
Jan 23 19:49:43 nb kernel: [21283.737550] PM: Normal pages needed: 192470 + 1024, available pages: 294401
Jan 23 19:49:43 nb kernel: [21283.715133] PM: Restoring platform NVS memory
Jan 23 19:49:43 nb kernel: [21283.715602] CPU0: Thermal monitoring handled by SMI
Jan 23 19:49:43 nb kernel: [21283.715660] Extended CMOS year: 2000
Jan 23 19:49:43 nb kernel: [21283.715690] Enabling non-boot CPUs ...
Jan 23 19:49:43 nb kernel: [21283.718032] Booting Node 0 Processor 1 APIC 0x4
Jan 23 19:49:43 nb kernel: [21283.718035] smpboot cpu 1: start_ip = 96000
Jan 23 19:49:43 nb kernel: [21283.729153] Calibrating delay loop (skipped) already calibrated this CPU
Jan 23 19:49:43 nb kernel: [21283.729177] CPU1: Thermal monitoring handled by SMI
Jan 23 19:49:43 nb kernel: [21283.749573] NMI watchdog enabled, takes one hw-pmu counter.
Jan 23 19:49:43 nb kernel: [21283.750249] CPU1 is up
Jan 23 19:49:43 nb kernel: [21283.750621] Booting Node 0 Processor 2 APIC 0x1
Jan 23 19:49:43 nb kernel: [21283.750624] smpboot cpu 2: start_ip = 96000
Jan 23 19:49:43 nb kernel: [21283.761638] Calibrating delay loop (skipped) already calibrated this CPU
Jan 23 19:49:43 nb kernel: [21283.761662] CPU2: Thermal monitoring handled by SMI
Jan 23 19:49:43 nb kernel: [21283.782093] NMI watchdog enabled, takes one hw-pmu counter.
Jan 23 19:49:43 nb kernel: [21283.783452] CPU2 is up
Jan 23 19:49:43 nb kernel: [21283.783737] Booting Node 0 Processor 3 APIC 0x5
Jan 23 19:49:43 nb kernel: [21283.783739] smpboot cpu 3: start_ip = 96000
Jan 23 19:49:43 nb kernel: [21283.794753] Calibrating delay loop (skipped) already calibrated this CPU
Jan 23 19:49:43 nb kernel: [21283.794776] CPU3: Thermal monitoring handled by SMI
Jan 23 19:49:43 nb kernel: [21283.815334] NMI watchdog enabled, takes one hw-pmu counter.
Jan 23 19:49:43 nb kernel: [21283.815796] CPU3 is up
Jan 23 19:49:43 nb kernel: [21283.818408] ACPI: Waking up from system sleep state S4
Jan 23 19:49:43 nb kernel: [21283.818835] ACPI: \_SB_.PCI0.DOCK - undocking
Jan 23 19:49:43 nb kernel: [21283.819233] snd_hda_intel 0000:00:1b.0: restoring config space at offset 0x1 (was 0x100006, writing 0x100002)
Jan 23 19:49:43 nb kernel: [21283.819586] ahci 0000:00:1f.2: restoring config space at offset 0x1 (was 0x2b00403, writing 0x2b00407)
Jan 23 19:49:43 nb kernel: [21283.819723] pci 0000:05:00.0: restoring config space at offset 0x1 (was 0x100007, writing 0x100003)
Jan 23 19:49:43 nb kernel: [21283.819781] r8169 0000:06:00.0: restoring config space at offset 0x1 (was 0x100007, writing 0x100407)
Jan 23 19:49:43 nb kernel: [21283.819909] PM: early restore of devices complete after 0.902 msecs
Jan 23 19:49:43 nb kernel: [21283.847360] i915 0000:00:02.0: setting latency timer to 64
Jan 23 19:49:43 nb kernel: [21283.847366] ehci_hcd 0000:00:1a.0: setting latency timer to 64
Jan 23 19:49:43 nb kernel: [21283.847392] usb usb1: root hub lost power or was reset
Jan 23 19:49:43 nb kernel: [21283.851296] ehci_hcd 0000:00:1a.0: cache line size of 64 is not supported
Jan 23 19:49:43 nb kernel: [21283.851314] snd_hda_intel 0000:00:1b.0: PCI INT A -> GSI 22 (level, low) -> IRQ 22
Jan 23 19:49:43 nb kernel: [21283.851320] snd_hda_intel 0000:00:1b.0: setting latency timer to 64
Jan 23 19:49:43 nb kernel: [21283.851372] snd_hda_intel 0000:00:1b.0: irq 43 for MSI/MSI-X
Jan 23 19:49:43 nb kernel: [21283.851426] ehci_hcd 0000:00:1d.0: setting latency timer to 64
Jan 23 19:49:43 nb kernel: [21283.851437] usb usb2: root hub lost power or was reset
Jan 23 19:49:43 nb kernel: [21283.855316] ehci_hcd 0000:00:1d.0: cache line size of 64 is not supported
Jan 23 19:49:43 nb kernel: [21283.855324] pci 0000:00:1e.0: setting latency timer to 64
Jan 23 19:49:43 nb kernel: [21283.855335] ahci 0000:00:1f.2: setting latency timer to 64
Jan 23 19:49:43 nb kernel: [21283.855599] sd 5:0:0:0: [sda] Starting disk
Jan 23 19:49:43 nb kernel: [21284.160005] ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
Jan 23 19:49:43 nb kernel: [21284.162036] ata2: SATA link down (SStatus 0 SControl 300)
Jan 23 19:49:43 nb kernel: [21284.164034] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
Jan 23 19:49:43 nb kernel: [21284.165640] ata1.00: configured for UDMA/100
Jan 23 19:49:43 nb kernel: [21284.166005] ata5: SATA link down (SStatus 0 SControl 300)
Jan 23 19:49:43 nb kernel: [21284.166644] ata6.00: configured for UDMA/133
Jan 23 19:49:43 nb kernel: [21284.178972] usb 2-1: reset high-speed USB device number 2 using ehci_hcd
Jan 23 19:49:43 nb kernel: [21284.394874] usb 1-1: reset high-speed USB device number 2 using ehci_hcd
Jan 23 19:49:43 nb kernel: [21284.611524] PM: restore of devices complete after 764.729 msecs
Jan 23 19:49:43 nb kernel: [21284.616528] snapshot_ioctl: ioctl '4004330c' is deprecated and will be removed soon, update your suspend-to-disk utilities
Jan 23 19:49:43 nb kernel: [21284.616531] Restarting tasks ... 
Jan 23 19:49:43 nb kernel: [21284.617437] BUG: unable to handle kernel done.
Jan 23 19:49:43 nb kernel: [21284.617481] NULL pointer dereference at           (null)
Jan 23 19:49:43 nb kernel: [21284.617521] IP: [<ffffffff815c08ac>] _raw_spin_lock_irq+0x1c/0x40
Jan 23 19:49:43 nb kernel: [21284.617543] PGD 682b7067 PUD 6f315067 PMD 0 
Jan 23 19:49:43 nb kernel: [21284.617546] Oops: 0002 [#1] PREEMPT SMP 
Jan 23 19:49:43 nb kernel: [21284.617549] CPU 1 
Jan 23 19:49:43 nb kernel: [21284.617550] Modules linked in: bridge stp af_packet tun microcode cpufreq_conservative cpufreq_userspace cpufreq_powersave acpi_cpufreq mperf snd_usb_audio sg sr_mod cdrom snd_usbmidi_lib snd_rawmidi snd_seq_device arc4 snd_hda_codec_hdmi snd_hda_codec_realtek msi_laptop sparse_keymap snd_hda_intel iTCO_wdt snd_hda_codec snd_hwdep snd_pcm kvm_intel snd_timer kvm joydev pcspkr i2c_i801 intel_ips wmi rfkill r8169 iTCO_vendor_support ac snd battery soundcore snd_page_alloc autofs4 reiserfs sha256_generic cbc dm_crypt dm_mod linear i915 drm_kms_helper drm i2c_algo_bit thermal fan processor button video thermal_sys [last unloaded: cfg80211]
Jan 23 19:49:43 nb kernel: [21284.617584]
Jan 23 19:49:43 nb kernel: [21284.617587] Pid: 1146, comm: rsyslogd Not tainted 3.2.1-3-desktop #1 Micro-Star International CR620/CR620
Jan 23 19:49:43 nb kernel: [21284.617590] RIP: 0010:[<ffffffff815c08ac>]  [<ffffffff815c08ac>] _raw_spin_lock_irq+0x1c/0x40
Jan 23 19:49:43 nb kernel: [21284.617594] RSP: 0018:ffff88006f425de0  EFLAGS: 00010002
Jan 23 19:49:43 nb kernel: [21284.617596] RAX: 0000000000010000 RBX: ffff88006f425e88 RCX: 0000000000000000
Jan 23 19:49:43 nb kernel: [21284.617598] RDX: ffff88006f425fd8 RSI: ffff88006f616080 RDI: 0000000000000000
Jan 23 19:49:43 nb kernel: [21284.617599] RBP: 0000000000000000 R08: ffff88006f424000 R09: 0000000000000000
Jan 23 19:49:43 nb kernel: [21284.617601] R10: 0000000000000000 R11: 0000000000000001 R12: 000000000065f6a0
Jan 23 19:49:43 nb kernel: [21284.617602] R13: 00007f12533859c0 R14: 00007f12553ec000 R15: 0000000000000003
Jan 23 19:49:43 nb kernel: [21284.617605] FS:  00007f1253385700(0000) GS:ffff880076c40000(0000) knlGS:0000000000000000
Jan 23 19:49:43 nb kernel: [21284.617607] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 23 19:49:43 nb kernel: [21284.617609] CR2: 0000000000000000 CR3: 000000006fb86000 CR4: 00000000000006e0
Jan 23 19:49:43 nb kernel: [21284.617611] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 23 19:49:43 nb kernel: [21284.617612] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 23 19:49:43 nb kernel: [21284.617614] Process rsyslogd (pid: 1146, threadinfo ffff88006f424000, task ffff88006f616080)
Jan 23 19:49:43 nb kernel: [21284.617616] Stack:
Jan 23 19:49:43 nb kernel: [21284.617617]  ffffffff8106ab7d ffff880037beddb8 ffff88006f616080 0000000000000000
Jan 23 19:49:43 nb kernel: [21284.617620]  0000000000000000 0000000000000000 0000000000000000 0000000000000000
Jan 23 19:49:43 nb kernel: [21284.617623]  ffff880072cf2a80 ffff88006f616080 ffff88006f425f58 ffff88006f425f08
Jan 23 19:49:43 nb kernel: [21284.617626] Call Trace:
Jan 23 19:49:43 nb kernel: [21284.617640]  [<ffffffff8106ab7d>] get_signal_to_deliver+0xcd/0x480
Jan 23 19:49:43 nb kernel: [21284.617650]  [<ffffffff81002775>] do_signal+0x35/0x110
Jan 23 19:49:43 nb kernel: [21284.617656]  [<ffffffff81002a05>] do_notify_resume+0x65/0x90
Jan 23 19:49:43 nb kernel: [21284.617663]  [<ffffffff815c79a0>] int_signal+0x12/0x17
Jan 23 19:49:43 nb kernel: [21284.617672]  [<00007f12546cdd33>] 0x7f12546cdd32
Jan 23 19:49:43 nb kernel: [21284.617673] Code: f6 c3 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 fa 66 66 90 66 66 90 65 48 8b 04 25 48 b6 00 00 83 80 44 e0 ff ff 01 b8 00 00 01 00 <f0> 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 10 66 0f 1f 44 00 00 f3 
Jan 23 19:49:43 nb kernel: [21284.617694] RIP  [<ffffffff815c08ac>] _raw_spin_lock_irq+0x1c/0x40
Jan 23 19:49:43 nb kernel: [21284.617697]  RSP <ffff88006f425de0>
Jan 23 19:49:43 nb kernel: [21284.617698] CR2: 0000000000000000
Jan 23 19:49:43 nb kernel: [21284.617700] ---[ end trace d719bd166abcba7f ]---
Jan 23 19:49:43 nb kernel: [21284.617713] note: rsyslogd[1146] exited with preempt_count 1
Jan 23 19:49:43 nb kernel: [21284.623696] PM: Basic memory bitmaps freed
Jan 23 19:49:43 nb kernel: [21284.623701] video LNXVIDEO:00: Restoring backlight state


lspci -vv
00:00.0 Host bridge: Intel Corporation Core Processor DRAM Controller (rev 02)
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ >SERR- <PERR- INTx-
        Latency: 0
        Capabilities: [e0] Vendor Specific Information: Len=0c <?>
        Kernel driver in use: agpgart-intel

00:02.0 VGA compatible controller: Intel Corporation Core Processor Integrated Graphics Controller (rev 02) (prog-if 00 [VGA controller])
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Interrupt: pin A routed to IRQ 41
        Region 0: Memory at f0000000 (64-bit, non-prefetchable) [size=4M]
        Region 2: Memory at e0000000 (64-bit, prefetchable) [size=256M]
        Region 4: I/O ports at e080 [size=8]
        Expansion ROM at <unassigned> [disabled]
        Capabilities: [90] MSI: Enable+ Count=1/1 Maskable- 64bit-
                Address: fee0f00c  Data: 4161
        Capabilities: [d0] Power Management version 2
                Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [a4] PCI Advanced Features
                AFCap: TP+ FLR+
                AFCtrl: FLR-
                AFStatus: TP-
        Kernel driver in use: i915

00:16.0 Communication controller: Intel Corporation 5 Series/3400 Series Chipset HECI Controller (rev 06)
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Interrupt: pin A routed to IRQ 11
        Region 0: Memory at f680a000 (64-bit, non-prefetchable) [size=16]
        Capabilities: [50] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+
                Address: 0000000000000000  Data: 0000

00:1a.0 USB Controller: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller (rev 05) (prog-if 20 [EHCI])
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Interrupt: pin A routed to IRQ 16
        Region 0: Memory at f6808000 (32-bit, non-prefetchable) [size=1K]
        Capabilities: [50] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [58] Debug port: BAR=1 offset=00a0
        Capabilities: [98] PCI Advanced Features
                AFCap: TP+ FLR+
                AFCtrl: FLR-
                AFStatus: TP-
        Kernel driver in use: ehci_hcd

00:1b.0 Audio device: Intel Corporation 5 Series/3400 Series Chipset High Definition Audio (rev 05)
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 43
        Region 0: Memory at f6800000 (64-bit, non-prefetchable) [size=16K]
        Capabilities: [50] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [60] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 00000000fee0f00c  Data: 41a1
        Capabilities: [70] Express (v1) Root Complex Integrated Endpoint, MSI 00
                DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
                        ExtTag- RBE- FLReset+
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 128 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
                        ClockPM- Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; Disabled- Retrain- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
        Capabilities: [100 v1] Virtual Channel
                Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
                Arb:    Fixed- WRR32- WRR64- WRR128-
                Ctrl:   ArbSelect=Fixed
                Status: InProgress-
                VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=01
                        Status: NegoPending- InProgress-
                VC1:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable+ ID=1 ArbSelect=Fixed TC/VC=02
                        Status: NegoPending- InProgress-
        Capabilities: [130 v1] Root Complex Link
                Desc:   PortNumber=0f ComponentID=00 EltType=Config
                Link0:  Desc:   TargetPort=00 TargetComponent=00 AssocRCRB- LinkType=MemMapped LinkValid+
                        Addr:   00000000fed1c000
        Kernel driver in use: snd_hda_intel

00:1c.0 PCI bridge: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 1 (rev 05) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
        I/O behind bridge: 0000d000-0000dfff
        Memory behind bridge: f5400000-f67fffff
        Prefetchable memory behind bridge: 000000007c600000-000000007c7fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [40] Express (v2) Root Port (Slot+), MSI 00
                DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
                        ExtTag- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 128 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #1, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <1us, L1 <4us
                        ClockPM- Surprise- LLActRep+ BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x0, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+
                        Slot #0, PowerLimit 10.000W; Interlock- NoCompl+
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock-
                        Changed: MRL- PresDet- LinkState-
                RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible-
                RootCap: CRSVisible-
                RootSta: PME ReqID 0000, PMEStatus- PMEPending-
                DevCap2: Completion Timeout: Range BC, TimeoutDis+ ARIFwd-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd-
                LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
                Address: 00000000  Data: 0000
        Capabilities: [90] Subsystem: Micro-Star International Co., Ltd. Device 1033
        Capabilities: [a0] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: pcieport

00:1c.1 PCI bridge: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 2 (rev 05) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Bus: primary=00, secondary=02, subordinate=04, sec-latency=0
        I/O behind bridge: 0000c000-0000cfff
        Memory behind bridge: f0400000-f2bfffff
        Prefetchable memory behind bridge: 000000007c400000-000000007c5fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [40] Express (v2) Root Port (Slot+), MSI 00
                DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
                        ExtTag- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 128 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #2, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <1us, L1 <4us
                        ClockPM- Surprise- LLActRep+ BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x0, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+
                        Slot #1, PowerLimit 10.000W; Interlock- NoCompl+
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet+ CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock-
                        Changed: MRL- PresDet- LinkState-
                RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible-
                RootCap: CRSVisible-
                RootSta: PME ReqID 0000, PMEStatus- PMEPending-
                DevCap2: Completion Timeout: Range BC, TimeoutDis+ ARIFwd-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd-
                LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
                Address: 00000000  Data: 0000
        Capabilities: [90] Subsystem: Micro-Star International Co., Ltd. Device 1033
        Capabilities: [a0] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: pcieport

00:1c.3 PCI bridge: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 4 (rev 05) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Bus: primary=00, secondary=05, subordinate=05, sec-latency=0
        I/O behind bridge: 0000b000-0000bfff
        Memory behind bridge: f4000000-f53fffff
        Prefetchable memory behind bridge: 000000007c200000-000000007c3fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [40] Express (v2) Root Port (Slot+), MSI 00
                DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
                        ExtTag- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 128 bytes
                DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #4, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <256ns, L1 <4us
                        ClockPM- Surprise- LLActRep+ BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+
                        Slot #3, PowerLimit 10.000W; Interlock- NoCompl+
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
                        Changed: MRL- PresDet+ LinkState+
                RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible-
                RootCap: CRSVisible-
                RootSta: PME ReqID 0000, PMEStatus- PMEPending-
                DevCap2: Completion Timeout: Range BC, TimeoutDis+ ARIFwd-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd-
                LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
                Address: 00000000  Data: 0000
        Capabilities: [90] Subsystem: Gammagraphx, Inc. (or missing ID) Device 0000
        Capabilities: [a0] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: pcieport

00:1c.5 PCI bridge: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 6 (rev 05) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Bus: primary=00, secondary=06, subordinate=06, sec-latency=0
        I/O behind bridge: 0000a000-0000afff
        Memory behind bridge: f2c00000-f3ffffff
        Prefetchable memory behind bridge: 000000007c000000-000000007c1fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [40] Express (v2) Root Port (Slot+), MSI 00
                DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
                        ExtTag- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 128 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #6, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <256ns, L1 <4us
                        ClockPM- Surprise- LLActRep+ BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+
                        Slot #5, PowerLimit 10.000W; Interlock- NoCompl+
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
                        Changed: MRL- PresDet+ LinkState+
                RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible-
                RootCap: CRSVisible-
                RootSta: PME ReqID 0000, PMEStatus- PMEPending-
                DevCap2: Completion Timeout: Range BC, TimeoutDis+ ARIFwd-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- ARIFwd-
                LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
                Address: 00000000  Data: 0000
        Capabilities: [90] Subsystem: Micro-Star International Co., Ltd. Device 1033
        Capabilities: [a0] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Kernel driver in use: pcieport

00:1d.0 USB Controller: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller (rev 05) (prog-if 20 [EHCI])
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Interrupt: pin A routed to IRQ 23
        Region 0: Memory at f6807000 (32-bit, non-prefetchable) [size=1K]
        Capabilities: [50] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME+
        Capabilities: [58] Debug port: BAR=1 offset=00a0
        Capabilities: [98] PCI Advanced Features
                AFCap: TP+ FLR+
                AFCtrl: FLR-
                AFStatus: TP-
        Kernel driver in use: ehci_hcd

00:1e.0 PCI bridge: Intel Corporation 82801 Mobile PCI Bridge (rev a5) (prog-if 01 [Subtractive decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Bus: primary=00, secondary=07, subordinate=07, sec-latency=32
        Secondary status: 66MHz- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [50] Subsystem: Micro-Star International Co., Ltd. Device 1033

00:1f.0 ISA bridge: Intel Corporation Mobile 5 Series Chipset LPC Interface Controller (rev 05)
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Capabilities: [e0] Vendor Specific Information: Len=10 <?>

00:1f.2 SATA controller: Intel Corporation 5 Series/3400 Series Chipset 4 port SATA AHCI Controller (rev 05) (prog-if 01 [AHCI 1.0])
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Interrupt: pin B routed to IRQ 40
        Region 0: I/O ports at e070 [size=8]
        Region 1: I/O ports at e060 [size=4]
        Region 2: I/O ports at e050 [size=8]
        Region 3: I/O ports at e040 [size=4]
        Region 4: I/O ports at e020 [size=32]
        Region 5: Memory at f6806000 (32-bit, non-prefetchable) [size=2K]
        Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
                Address: fee0100c  Data: 4151
        Capabilities: [70] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot+,D3cold-)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [a8] SATA HBA v1.0 BAR4 Offset=00000004
        Capabilities: [b0] PCI Advanced Features
                AFCap: TP+ FLR+
                AFCtrl: FLR-
                AFStatus: TP-
        Kernel driver in use: ahci

00:1f.3 SMBus: Intel Corporation 5 Series/3400 Series Chipset SMBus Controller (rev 05)
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O+ Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Interrupt: pin C routed to IRQ 18
        Region 0: Memory at f6805000 (64-bit, non-prefetchable) [size=256]
        Region 4: I/O ports at e000 [size=32]
        Kernel driver in use: i801_smbus

00:1f.6 Signal processing controller: Intel Corporation 5 Series/3400 Series Chipset Thermal Subsystem (rev 05)
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Interrupt: pin C routed to IRQ 18
        Region 0: Memory at f6804000 (64-bit, non-prefetchable) [size=4K]
        Capabilities: [50] Power Management version 3
                Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
                Address: 00000000  Data: 0000
        Kernel driver in use: intel ips

05:00.0 Network controller: Atheros Communications Inc. AR9285 Wireless Network Adapter (PCI-Express) (rev 01)
        Subsystem: AzureWave AW-NE785 / AW-NE785H 802.11bgn Wireless Full or Half-size Mini PCIe Card
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 19
        Region 0: Memory at f4000000 (64-bit, non-prefetchable) [size=64K]
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1+ D2- AuxCurrent=375mA PME(D0+,D1+,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit-
                Address: 00000000  Data: 0000
        Capabilities: [60] Express (v2) Legacy Endpoint, MSI 00
                DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <512ns, L1 <64us
                        ClockPM- Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis+
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
                LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
        Capabilities: [140 v1] Virtual Channel
                Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
                Arb:    Fixed- WRR32- WRR64- WRR128-
                Ctrl:   ArbSelect=Fixed
                Status: InProgress-
                VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                        Status: NegoPending- InProgress-
        Capabilities: [160 v1] Device Serial Number 00-15-17-ff-ff-24-14-12
        Capabilities: [170 v1] Power Budgeting <?>
        Kernel driver in use: ath9k

06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8101E/RTL8102E PCI Express Fast Ethernet controller (rev 02)
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 42
        Region 0: I/O ports at a000 [size=256]
        Region 2: Memory at f2c30000 (64-bit, prefetchable) [size=4K]
        Region 4: Memory at f2c20000 (64-bit, prefetchable) [size=64K]
        Expansion ROM at f2c00000 [disabled] [size=128K]
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 00000000fee0f00c  Data: 4169
        Capabilities: [70] Express (v2) Endpoint, MSI 01
                DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 4096 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <512ns, L1 <64us
                        ClockPM+ Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis+
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
                LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB
        Capabilities: [ac] MSI-X: Enable- Count=2 Masked-
                Vector table: BAR=4 offset=00000000
                PBA: BAR=4 offset=00000800
        Capabilities: [cc] Vital Product Data
                Unknown small resource type 00, will not decode more.
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
        Capabilities: [140 v1] Virtual Channel
                Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
                Arb:    Fixed- WRR32- WRR64- WRR128-
                Ctrl:   ArbSelect=Fixed
                Status: InProgress-
                VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                        Status: NegoPending- InProgress-
        Capabilities: [160 v1] Device Serial Number 01-00-00-00-ff-ff-00-00
        Kernel driver in use: r8169

3f:00.0 Host bridge: Intel Corporation Core Processor QuickPath Architecture Generic Non-core Registers (rev 02)
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0

3f:00.1 Host bridge: Intel Corporation Core Processor QuickPath Architecture System Address Decoder (rev 02)
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0

3f:02.0 Host bridge: Intel Corporation Core Processor QPI Link 0 (rev 02)
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0

3f:02.1 Host bridge: Intel Corporation Core Processor QPI Physical 0 (rev 02)
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0

3f:02.2 Host bridge: Intel Corporation Core Processor Reserved (rev 02)
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0

3f:02.3 Host bridge: Intel Corporation Core Processor Reserved (rev 02)
        Subsystem: Micro-Star International Co., Ltd. Device 1033
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0


cat /proc/cpuinfo (processor 0..3)
processor       : 0
vendor_id       : GenuineIntel
cpu family      : 6
model           : 37
model name      : Intel(R) Core(TM) i5 CPU       M 460  @ 2.53GHz
stepping        : 5
microcode       : 0x2
cpu MHz         : 1199.000
cache size      : 3072 KB
physical id     : 0
siblings        : 4
core id         : 0
cpu cores       : 2
apicid          : 0
initial apicid  : 0
fpu             : yes
fpu_exception   : yes
cpuid level     : 11
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm pcid sse4_1 sse4_2 popcnt lahf_lm ida arat dts tpr_shadow vnmi flexpriority ept vpid
bogomips        : 5054.07
clflush size    : 64
cache_alignment : 64
address sizes   : 36 bits physical, 48 bits virtual
power management:

Do you need more information? Please ask and I'll try to provide it!
Comment 1 Rafael J. Wysocki 2012-01-23 21:13:19 UTC
This appears to be a memory corruption, but it's hard to tell where it happened, because there's not debug information in your kernel (i.e. I need to know function names instead of the addresses in the call trace).
Comment 2 Klaus Mueller 2012-01-23 22:18:03 UTC
This means, I have to install the debug-kernel? ksymoops was unable to resolve any address. Why is the kernel suddenly tainted???

I got another oops - a few minutes later, the machine was dead:


Jan 23 22:54:18 nb kernel: [30411.985876] Oops: 0000 [#2] PREEMPT SMP 
Jan 23 22:54:18 nb kernel: [30411.985907] CPU 1 
Jan 23 22:54:18 nb kernel: [30411.985918] Modules linked in: ath9k mac80211 ath9k_common ath9k_hw ath cfg80211 nfs lockd fscache auth_rpcgss nfs_acl sunrpc bridge stp af_packet tun microcode cpufreq_conservative cpufreq_userspace cpufreq_powersave acpi_cpufreq mperf snd_usb_audio sg sr_mod cdrom snd_usbmidi_lib snd_rawmidi snd_seq_device arc4 snd_hda_codec_hdmi snd_hda_codec_realtek msi_laptop sparse_keymap snd_hda_intel iTCO_wdt snd_hda_codec snd_hwdep snd_pcm kvm_intel snd_timer kvm joydev pcspkr i2c_i801 intel_ips wmi rfkill r8169 iTCO_vendor_support ac snd battery soundcore snd_page_alloc autofs4 reiserfs sha256_generic cbc dm_crypt dm_mod linear i915 drm_kms_helper drm i2c_algo_bit thermal fan processor button video thermal_sys [last unloaded: cfg80211]
Jan 23 22:54:18 nb kernel: [30411.986396] 
Jan 23 22:54:18 nb kernel: [30411.986406] Pid: 16283, comm: zypper Tainted: G      D      3.2.1-3-desktop #1 Micro-Star International CR620/CR620
Jan 23 22:54:18 nb kernel: [30411.986451] RIP: 0010:[<ffffffff812cdc42>]  [<ffffffff812cdc42>] strlen+0x2/0x20
Jan 23 22:54:18 nb kernel: [30411.986482] RSP: 0018:ffff880007537e90  EFLAGS: 00010246
Jan 23 22:54:18 nb kernel: [30411.986503] RAX: 0000000000000000 RBX: ffff88006f427370 RCX: ffff88006f4275b0
Jan 23 22:54:18 nb kernel: [30411.986529] RDX: 0000000000000000 RSI: ffff88006f427f40 RDI: 0000000000000000
Jan 23 22:54:18 nb kernel: [30411.986556] RBP: ffff88004f6c1240 R08: 0000000000002f55 R09: 0000000000000008
Jan 23 22:54:18 nb kernel: [30411.986582] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
Jan 23 22:54:18 nb kernel: [30411.986608] R13: 0000000000000000 R14: 0000000000000006 R15: ffff88006f427f40
Jan 23 22:54:18 nb kernel: [30411.986635] FS:  00007f84bc5477e0(0000) GS:ffff880076c40000(0000) knlGS:0000000000000000
Jan 23 22:54:18 nb kernel: [30411.986666] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 23 22:54:18 nb kernel: [30411.986687] CR2: 0000000000000000 CR3: 0000000065107000 CR4: 00000000000006e0
Jan 23 22:54:18 nb kernel: [30411.986714] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 23 22:54:18 nb kernel: [30411.986740] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 23 22:54:18 nb kernel: [30411.986767] Process zypper (pid: 16283, threadinfo ffff880007536000, task ffff880045ad6100)
Jan 23 22:54:18 nb kernel: [30411.986797] Stack:
Jan 23 22:54:18 nb kernel: [30411.986807]  ffffffff811ce0a5 ffff880000000008 0000000000002f55 ffff880007537f40
Jan 23 22:54:18 nb kernel: [30411.986844]  ffffffff8116cb70 ffff88004f6c1250 ffff88004f6c1240 ffff880007537f40
Jan 23 22:54:18 nb kernel: [30411.986880]  ffffffff8116cb70 ffff880074300358 ffff8800743002b8 00000000025f5ac0
Jan 23 22:54:18 nb kernel: [30411.986917] Call Trace:
Jan 23 22:54:18 nb kernel: [30411.986938]  [<ffffffff811ce0a5>] sysfs_readdir+0x95/0x250
Jan 23 22:54:18 nb kernel: [30411.986965]  [<ffffffff8116ce70>] vfs_readdir+0xc0/0xf0
Jan 23 22:54:18 nb kernel: [30411.986989]  [<ffffffff8116cf89>] sys_getdents+0x89/0x100
Jan 23 22:54:18 nb kernel: [30411.987014]  [<ffffffff815c76d2>] system_call_fastpath+0x16/0x1b
Jan 23 22:54:18 nb kernel: [30411.987042]  [<00007f84bab84225>] 0x7f84bab84224
Jan 23 22:54:18 nb kernel: [30411.987060] Code: 82 80 f5 63 81 20 74 11 90 48 83 c0 01 0f b6 10 f6 82 80 f5 63 81 20 75 f0 f3 c3 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 31 c0 <80> 3f 00 74 15 48 89 f8 66 0f 1f 44 00 00 48 83 c0 01 80 38 00 
Jan 23 22:54:18 nb kernel: [30411.987359] RIP  [<ffffffff812cdc42>] strlen+0x2/0x20
Jan 23 22:54:18 nb kernel: [30411.987383]  RSP <ffff880007537e90>
Jan 23 22:54:18 nb kernel: [30411.987398] CR2: 0000000000000000
Jan 23 22:54:18 nb kernel: [30412.047825] ---[ end trace d719bd166abcba80 ]---
Comment 3 Rafael J. Wysocki 2012-01-23 22:32:22 UTC
Is this a distro kernel?  If so, what distro and what kernel?
Comment 4 Klaus Mueller 2012-01-23 22:55:38 UTC
It's openSUSE 12.1 with this kernel:

rpm -qi kernel-debug
Name        : kernel-debug
Version     : 3.2.1
Release     : 3.1
Architecture: x86_64
Install Date: Mon Jan 23 23:19:17 2012
Group       : System/Kernel
Size        : 156665636
License     : GPL-2.0
Signature   : DSA/SHA1, Fri Jan 20 04:43:06 2012, Key ID 01a7de5aa840f92c
Source RPM  : kernel-debug-3.2.1-3.1.nosrc.rpm
Build Date  : Fri Jan 20 03:35:18 2012
Build Host  : build02
Relocations : (not relocatable)
Vendor      : obs://build.opensuse.org/openSUSE:Tumbleweed
URL         : http://www.kernel.org/
Summary     : A Debug Version of the Kernel
Description :
This kernel has several debug facilities enabled that hurt performance.
Only use this kernel when investigating problems.


Source Timestamp: 2012-01-13 11:38:45 +0100
GIT Revision: 2eca2bf29666a09cd407ec9ffe4120ebb0ca2e79
GIT Branch: stable
Distribution: openSUSE:Tumbleweed

Now, the next oops:

Jan 23 23:31:37 nb kernel: [  508.297484] BUG: unable to handle kernel NULL pointer dereference at           (null)
Jan 23 23:31:37 nb kernel: [  508.297532] IP: [<ffffffff8112a191>] unlink_anon_vmas+0x21/0x1b0
Jan 23 23:31:37 nb kernel: [  508.297563] PGD 70449067 PUD 7144e067 PMD 0 
Jan 23 23:31:37 nb kernel: [  508.297589] Oops: 0000 [#1] SMP 
Jan 23 23:31:37 nb kernel: [  508.297611] CPU 3 
Jan 23 23:31:37 nb kernel: [  508.297622] Modules linked in: af_packet cpufreq_conservative cpufreq_userspace cpufreq_powersave acpi_cpufreq mperf microcode arc4 iTCO_wdt snd_hda_codec
_hdmi sr_mod msi_laptop wmi iTCO_vendor_support intel_ips sg cdrom i2c_i801 snd_hda_codec_realtek snd_hda_intel r8169 sparse_keymap snd_hda_codec battery kvm_intel joydev snd_hwdep snd_pcm sn
d_timer snd soundcore snd_page_alloc kvm rfkill ac pcspkr autofs4 reiserfs sha256_generic cbc dm_crypt dm_mod linear rtc_cmos ehci_hcd i915 drm_kms_helper drm i2c_algo_bit usbcore fan usb_com
mon button i2c_core video thermal processor thermal_sys hwmon [last unloaded: cfg80211]
Jan 23 23:31:37 nb kernel: [  508.297990] 
Jan 23 23:31:37 nb kernel: [  508.297999] Pid: 2733, comm: kblankscrn.kss Not tainted 3.2.1-3-debug #1 Micro-Star International CR620/CR620
Jan 23 23:31:37 nb kernel: [  508.298039] RIP: 0010:[<ffffffff8112a191>]  [<ffffffff8112a191>] unlink_anon_vmas+0x21/0x1b0
Jan 23 23:31:37 nb kernel: [  508.298071] RSP: 0018:ffff880051df9d88  EFLAGS: 00010296
Jan 23 23:31:37 nb kernel: [  508.298090] RAX: 0000000000000000 RBX: ffff8800375b1790 RCX: 000000000000002d
Jan 23 23:31:37 nb kernel: [  508.298114] RDX: 0000000000607000 RSI: ffff88003dcd4bc8 RDI: ffff8800375b1790
Jan 23 23:31:37 nb kernel: [  508.298139] RBP: ffff88003dcd49e8 R08: 0000000000607000 R09: 2222222222222222
Jan 23 23:31:37 nb kernel: [  508.298163] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
Jan 23 23:31:37 nb kernel: [  508.298188] R13: ffff880051df9e18 R14: 0000000000000000 R15: ffff8800375b1800
Jan 23 23:31:37 nb kernel: [  508.298213] FS:  0000000000000000(0000) GS:ffff880076cc0000(0000) knlGS:0000000000000000
Jan 23 23:31:37 nb kernel: [  508.298241] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 23 23:31:37 nb kernel: [  508.298261] CR2: 0000000000000000 CR3: 0000000071c92000 CR4: 00000000000006e0
Jan 23 23:31:37 nb kernel: [  508.298285] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jan 23 23:31:37 nb kernel: [  508.298309] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jan 23 23:31:37 nb kernel: [  508.298335] Process kblankscrn.kss (pid: 2733, threadinfo ffff880051df8000, task ffff880051c02680)
Jan 23 23:31:37 nb kernel: [  508.298364] Stack:
Jan 23 23:31:37 nb kernel: [  508.298374]  ffff88003dcd4b78 ffff8800375b1790 ffff8800570e0cb8 ffff8800375b1790
Jan 23 23:31:37 nb kernel: [  508.298409]  ffff88003dcd49e8 0000000000000000 ffff880051df9e18 0000000000000000
Jan 23 23:31:37 nb kernel: [  508.298443]  0000000000400000 ffffffff8111d0d9 fffffffffffffbe0 ffff88003dcd4dd0
Jan 23 23:31:37 nb kernel: [  508.298477] Call Trace:
Jan 23 23:31:37 nb kernel: [  508.298498]  [<ffffffff8111d0d9>] free_pgtables+0x99/0x110
Jan 23 23:31:37 nb kernel: [  508.298521]  [<ffffffff811262f4>] exit_mmap+0xb4/0x120
Jan 23 23:31:37 nb kernel: [  508.298549]  [<ffffffff810524a5>] mmput.part.19+0x35/0x120
Jan 23 23:31:37 nb kernel: [  508.298573]  [<ffffffff81058bcc>] exit_mm+0x10c/0x130
Jan 23 23:31:37 nb kernel: [  508.298593]  [<ffffffff81058d3b>] do_exit+0x14b/0x400
Jan 23 23:31:37 nb kernel: [  508.298614]  [<ffffffff81059181>] do_group_exit+0x41/0xb0
Jan 23 23:31:37 nb kernel: [  508.298634]  [<ffffffff81059202>] sys_exit_group+0x12/0x20
Jan 23 23:31:37 nb kernel: [  508.298658]  [<ffffffff81570692>] system_call_fastpath+0x16/0x1b
Jan 23 23:31:37 nb kernel: [  508.298684]  [<00007f59ab6f41d8>] 0x7f59ab6f41d7
Jan 23 23:31:37 nb kernel: [  508.298701] Code: 66 2e 0f 1f 84 00 00 00 00 00 41 57 49 89 ff 49 83 c7 70 41 56 45 31 f6 41 55 41 54 55 53 48 83 ec 18 48 8b 47 70 48 89 7c 24 08 <4c> 8b
 20 48 8d 58 f0 49 83 ec 10 49 39 c7 75 15 e9 38 01 00 00 
Jan 23 23:31:37 nb kernel: [  508.298992] RIP  [<ffffffff8112a191>] unlink_anon_vmas+0x21/0x1b0
Jan 23 23:31:37 nb kernel: [  508.299017]  RSP <ffff880051df9d88>
Jan 23 23:31:37 nb kernel: [  508.299031] CR2: 0000000000000000
Jan 23 23:31:37 nb kernel: [  508.357991] ---[ end trace 19c5ef6fa472768f ]---

Unfortunately, ksymoops doesn't work:

ksymoops 2.4.11 on x86_64 3.2.1-3-debug.  Options used
     -V (default)
     -k /proc/kallsyms (default)
     -l /proc/modules (default)
     -o /lib/modules/3.2.1-3-debug/ (default)
     -m /boot/System.map-3.2.1-3-debug (default)

Warning: You did not tell me where to find symbol information.  I will
assume that the log matches the kernel and modules that are running
right now and I'll use the default options above for symbol resolution.
If the current kernel and/or modules do not match the log, you can get
more accurate output by telling me the kernel version and where to find
map, modules, ksyms etc.  ksymoops -h explains the options.

Warning (read_ksyms): no kernel symbols in ksyms, is /proc/kallsyms a valid ksyms file?
No modules in ksyms, skipping objects
No ksyms, skipping lsmod
Jan 23 23:31:37 nb kernel: [  508.297484] BUG: unable to handle kernel NULL pointer dereference at           (null)
Jan 23 23:31:37 nb kernel: [  508.297999] Pid: 2733, comm: kblankscrn.kss Not tainted 3.2.1-3-debug #1 Micro-Star International CR620/CR620

2 warnings issued.  Results may not be reliable.

I don't know how to get a usable output. What's the content of ksyms? /proc/kallsyms looks like this:

head /proc/kallsyms
0000000000000000 V irq_stack_union
0000000000000000 D __per_cpu_start
0000000000004000 V exception_stacks
000000000000a000 V gdt_page
000000000000b000 V tlb_vector_offset
000000000000b080 V cpu_loops_per_jiffy
000000000000b0c0 V is_idle
000000000000b0c8 V old_rsp
000000000000b0d0 V irq_regs
000000000000b0e0 V last_nmi_rip

head symvers-3.2.1-3-debug
0x46674bcd      cfg80211_send_rx_assoc  net/wireless/cfg80211   EXPORT_SYMBOL
0x5664c430      usb_serial_generic_submit_read_urb      drivers/usb/serial/usbserial    EXPORT_SYMBOL_GPL
0x99841375      iscsi_host_add  drivers/scsi/libiscsi   EXPORT_SYMBOL_GPL
0x009a8815      pcmcia_reset_card       drivers/pcmcia/pcmcia_core      EXPORT_SYMBOL
0xc47c22e8      mpt_deregister  drivers/message/fusion/mptbase  EXPORT_SYMBOL
0xbf32ec02      tm6000_set_reg_mask     drivers/media/video/tm6000/tm6000       EXPORT_SYMBOL_GPL
0xb07c4025      kvm_get_cs_db_l_bits    arch/x86/kvm/kvm        EXPORT_SYMBOL_GPL
0x5591ca36      sata_pmp_error_handler  vmlinux EXPORT_SYMBOL_GPL
0x9ba0501e      unregister_vt_notifier  vmlinux EXPORT_SYMBOL_GPL
0x0bbb5c3b      generic_file_splice_write       vmlinux EXPORT_SYMBOL

-> nothing worked!
Comment 5 Klaus Mueller 2012-08-30 15:19:44 UTC
https://bugzilla.kernel.org/attachment.cgi?id=72739

*** This bug has been marked as a duplicate of bug 37142 ***