Bug 11899 - sometime boot failed on T61 laptop
Summary: sometime boot failed on T61 laptop
Status: CLOSED CODE_FIX
Alias: None
Product: IO/Storage
Classification: Unclassified
Component: Serial ATA (show other bugs)
Hardware: All Linux
: P1 blocking
Assignee: Tejun Heo
URL:
Keywords:
Depends on:
Blocks: 11808
  Show dependency tree
 
Reported: 2008-10-30 02:04 UTC by Alex Shi
Modified: 2008-11-22 13:23 UTC (History)
3 users (show)

See Also:
Kernel Version: 2.6.28-rc1/rc2
Subsystem:
Regression: Yes
Bisected commit-id:


Attachments
kernel config file (82.51 KB, text/plain)
2008-10-31 01:28 UTC, Alex Shi
Details
new kernel config file (55.92 KB, text/plain)
2008-11-05 23:12 UTC, Yanmin Zhang
Details
Patch to fix (2.10 KB, patch)
2008-11-12 01:26 UTC, Yanmin Zhang
Details | Diff
register a blkext block device for MAJOR 259 (437 bytes, patch)
2008-11-12 19:29 UTC, Yanmin Zhang
Details | Diff
patch against nash to add blkext into table proc_dev_info (455 bytes, patch)
2008-11-12 19:31 UTC, Yanmin Zhang
Details | Diff
New patch against FC9's nash (2.10 KB, patch)
2008-11-13 21:00 UTC, Yanmin Zhang
Details | Diff
New patch against FC9's nash: against nash to add blkext into table proc_dev_info (455 bytes, patch)
2008-11-13 21:02 UTC, Yanmin Zhang
Details | Diff
New patch for kernel to register MAJOR 259 as a block device (457 bytes, patch)
2008-11-13 23:26 UTC, Yanmin Zhang
Details | Diff

Description Alex Shi 2008-10-30 02:04:59 UTC
Latest working kernel version:2.6.27
Earliest failing kernel version:2.6.28-rc1
Distribution:FC 8 
Hardware Environment: IBM T61
Software Environment:
Problem Description: most of time, the boot failed. but ocasionally boot works. 

Steps to reproduce: reboot 

lspci: 

00:00.0 Host bridge: Intel Corporation Mobile PM965/GM965/GL960 Memory Controller Hub (rev 0c)
	Subsystem: Lenovo Unknown device 20b3
	Flags: bus master, fast devsel, latency 0
	Capabilities: [e0] Vendor Specific Information

00:02.0 VGA compatible controller: Intel Corporation Mobile GM965/GL960 Integrated Graphics Controller (rev 0c) (prog-if 00 [VGA])
	Subsystem: Lenovo Unknown device 20b5
	Flags: bus master, fast devsel, latency 0, IRQ 10
	Memory at f8100000 (64-bit, non-prefetchable) [size=1M]
	Memory at e0000000 (64-bit, prefetchable) [size=256M]
	I/O ports at 1800 [size=8]
	Capabilities: [90] Message Signalled Interrupts: Mask- 64bit- Queue=0/0 Enable-
	Capabilities: [d0] Power Management version 3

00:02.1 Display controller: Intel Corporation Mobile GM965/GL960 Integrated Graphics Controller (rev 0c)
	Subsystem: Lenovo Unknown device 20b5
	Flags: bus master, fast devsel, latency 0
	Memory at f8200000 (64-bit, non-prefetchable) [size=1M]
	Capabilities: [d0] Power Management version 3

00:19.0 Ethernet controller: Intel Corporation 82566MM Gigabit Network Connection (rev 03)
	Subsystem: Lenovo Lenovo Thinkpad T61
	Flags: bus master, fast devsel, latency 0, IRQ 217
	Memory at fe000000 (32-bit, non-prefetchable) [size=128K]
	Memory at fe025000 (32-bit, non-prefetchable) [size=4K]
	I/O ports at 1840 [size=32]
	Capabilities: [c8] Power Management version 2
	Capabilities: [d0] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable+

00:1a.0 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Contoller #4 (rev 03) (prog-if 00 [UHCI])
	Subsystem: Lenovo Lenovo Thinkpad T61
	Flags: bus master, medium devsel, latency 0, IRQ 20
	I/O ports at 1860 [size=32]

00:1a.1 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #5 (rev 03) (prog-if 00 [UHCI])
	Subsystem: Lenovo Lenovo Thinkpad T60
	Flags: bus master, medium devsel, latency 0, IRQ 21
	I/O ports at 1880 [size=32]

00:1a.7 USB Controller: Intel Corporation 82801H (ICH8 Family) USB2 EHCI Controller #2 (rev 03) (prog-if 20 [EHCI])
	Subsystem: Lenovo Lenovo Thinkpad T61
	Flags: bus master, medium devsel, latency 0, IRQ 22
	Memory at fe226c00 (32-bit, non-prefetchable) [size=1K]
	Capabilities: [50] Power Management version 2

00:1b.0 Audio device: Intel Corporation 82801H (ICH8 Family) HD Audio Controller (rev 03)
	Subsystem: Lenovo Lenovo Thinkpad T61
	Flags: bus master, fast devsel, latency 0, IRQ 17
	Memory at fe020000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [50] Power Management version 2
	Capabilities: [60] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable-
	Capabilities: [70] Express Unknown type IRQ 0
	Capabilities: [100] Virtual Channel
	Capabilities: [130] Unknown (5)

00:1c.0 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 1 (rev 03) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0
	Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
	I/O behind bridge: 00002000-00002fff
	Memory behind bridge: fc000000-fdffffff
	Prefetchable memory behind bridge: 00000000f8000000-00000000f80fffff
	Capabilities: [40] Express Root Port (Slot+) IRQ 0
	Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=0/0 Enable+
	Capabilities: [90] Subsystem: Lenovo Unknown device 20ad
	Capabilities: [a0] Power Management version 2
	Capabilities: [100] Virtual Channel
	Capabilities: [180] Unknown (5)

00:1c.1 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 2 (rev 03) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0
	Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
	I/O behind bridge: 00003000-00003fff
	Memory behind bridge: dc000000-df3fffff
	Prefetchable memory behind bridge: 00000000dfe00000-00000000dfefffff
	Capabilities: [40] Express Root Port (Slot+) IRQ 0
	Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=0/0 Enable+
	Capabilities: [90] Subsystem: Lenovo Unknown device 20ad
	Capabilities: [a0] Power Management version 2
	Capabilities: [100] Virtual Channel
	Capabilities: [180] Unknown (5)

00:1c.2 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 3 (rev 03) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0
	Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
	I/O behind bridge: 00004000-00004fff
	Memory behind bridge: d8000000-d9ffffff
	Prefetchable memory behind bridge: 00000000dfb00000-00000000dfbfffff
	Capabilities: [40] Express Root Port (Slot+) IRQ 0
	Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=0/0 Enable+
	Capabilities: [90] Subsystem: Lenovo Unknown device 20ad
	Capabilities: [a0] Power Management version 2
	Capabilities: [100] Virtual Channel
	Capabilities: [180] Unknown (5)

00:1c.3 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 4 (rev 03) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0
	Bus: primary=00, secondary=05, subordinate=0c, sec-latency=0
	I/O behind bridge: 00005000-00005fff
	Memory behind bridge: d4000000-d5ffffff
	Prefetchable memory behind bridge: 00000000df800000-00000000df8fffff
	Capabilities: [40] Express Root Port (Slot+) IRQ 0
	Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=0/0 Enable+
	Capabilities: [90] Subsystem: Lenovo Unknown device 20ad
	Capabilities: [a0] Power Management version 2
	Capabilities: [100] Virtual Channel
	Capabilities: [180] Unknown (5)

00:1c.4 PCI bridge: Intel Corporation 82801H (ICH8 Family) PCI Express Port 5 (rev 03) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0
	Bus: primary=00, secondary=0d, subordinate=14, sec-latency=0
	I/O behind bridge: 00006000-00006fff
	Memory behind bridge: d0000000-d1ffffff
	Prefetchable memory behind bridge: 00000000df500000-00000000df5fffff
	Capabilities: [40] Express Root Port (Slot+) IRQ 0
	Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=0/0 Enable+
	Capabilities: [90] Subsystem: Lenovo Unknown device 20ad
	Capabilities: [a0] Power Management version 2
	Capabilities: [100] Virtual Channel
	Capabilities: [180] Unknown (5)

00:1d.0 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #1 (rev 03) (prog-if 00 [UHCI])
	Subsystem: Lenovo Unknown device 20aa
	Flags: bus master, medium devsel, latency 0, IRQ 16
	I/O ports at 18a0 [size=32]

00:1d.1 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #2 (rev 03) (prog-if 00 [UHCI])
	Subsystem: Lenovo Unknown device 20aa
	Flags: bus master, medium devsel, latency 0, IRQ 17
	I/O ports at 18c0 [size=32]

00:1d.2 USB Controller: Intel Corporation 82801H (ICH8 Family) USB UHCI Controller #3 (rev 03) (prog-if 00 [UHCI])
	Subsystem: Lenovo Unknown device 20aa
	Flags: bus master, medium devsel, latency 0, IRQ 18
	I/O ports at 18e0 [size=32]

00:1d.7 USB Controller: Intel Corporation 82801H (ICH8 Family) USB2 EHCI Controller #1 (rev 03) (prog-if 20 [EHCI])
	Subsystem: Lenovo Unknown device 20ab
	Flags: bus master, medium devsel, latency 0, IRQ 19
	Memory at fe227000 (32-bit, non-prefetchable) [size=1K]
	Capabilities: [50] Power Management version 2
	Capabilities: [58] Debug port

00:1e.0 PCI bridge: Intel Corporation 82801 Mobile PCI Bridge (rev f3) (prog-if 01 [Subtractive decode])
	Flags: bus master, fast devsel, latency 0
	Bus: primary=00, secondary=15, subordinate=18, sec-latency=32
	I/O behind bridge: 00007000-0000afff
	Memory behind bridge: f8300000-fbffffff
	Prefetchable memory behind bridge: 00000000f4000000-00000000f7ffffff
	Capabilities: [50] Subsystem: Lenovo Unknown device 20ae

00:1f.0 ISA bridge: Intel Corporation 82801HBM (ICH8M-E) LPC Interface Controller (rev 03)
	Subsystem: Lenovo Unknown device 20b6
	Flags: bus master, medium devsel, latency 0
	Capabilities: [e0] Vendor Specific Information

00:1f.1 IDE interface: Intel Corporation 82801HBM/HEM (ICH8M/ICH8M-E) IDE Controller (rev 03) (prog-if 8a [Master SecP PriP])
	Subsystem: Lenovo Unknown device 20a6
	Flags: bus master, medium devsel, latency 0, IRQ 16
	I/O ports at 01f0 [size=8]
	I/O ports at 03f4 [size=1]
	I/O ports at 0170 [size=8]
	I/O ports at 0374 [size=1]
	I/O ports at 1c00 [size=16]

00:1f.2 SATA controller: Intel Corporation 82801HBM/HEM (ICH8M/ICH8M-E) SATA AHCI Controller (rev 03) (prog-if 01 [AHCI 1.0])
	Subsystem: Lenovo Unknown device 20a7
	Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 218
	I/O ports at 1c50 [size=8]
	I/O ports at 1c44 [size=4]
	I/O ports at 1c48 [size=8]
	I/O ports at 1c40 [size=4]
	I/O ports at 1c20 [size=32]
	Memory at fe226000 (32-bit, non-prefetchable) [size=2K]
	Capabilities: [80] Message Signalled Interrupts: Mask- 64bit- Queue=0/2 Enable+
	Capabilities: [70] Power Management version 3
	Capabilities: [a8] #12 [0010]

00:1f.3 SMBus: Intel Corporation 82801H (ICH8 Family) SMBus Controller (rev 03)
	Subsystem: Lenovo Unknown device 20a9
	Flags: medium devsel, IRQ 23
	Memory at fe227400 (32-bit, non-prefetchable) [size=256]
	I/O ports at 1c60 [size=32]

03:00.0 Network controller: Intel Corporation PRO/Wireless 3945ABG Network Connection (rev 02)
	Subsystem: Intel Corporation Unknown device 1010
	Flags: fast devsel, IRQ 17
	Memory at df3ff000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [c8] Power Management version 2
	Capabilities: [d0] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable-
	Capabilities: [e0] Express Legacy Endpoint IRQ 0
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [140] Device Serial Number a3-90-06-ff-ff-77-1b-00

15:00.0 CardBus bridge: Ricoh Co Ltd RL5c476 II (rev ba)
	Subsystem: Lenovo Unknown device 20c6
	Flags: bus master, medium devsel, latency 168, IRQ 16
	Memory at f8300000 (32-bit, non-prefetchable) [size=4K]
	Bus: primary=15, secondary=16, subordinate=17, sec-latency=176
	Memory window 0: f4000000-f7fff000 (prefetchable)
	Memory window 1: 40000000-43fff000
	I/O window 0: 00007000-000070ff
	I/O window 1: 00007400-000074ff
	16-bit legacy interface ports at 0001

15:00.1 FireWire (IEEE 1394): Ricoh Co Ltd R5C832 IEEE 1394 Controller (rev 04) (prog-if 10 [OHCI])
	Subsystem: Lenovo Unknown device 20c7
	Flags: bus master, medium devsel, latency 64, IRQ 17
	Memory at f8301000 (32-bit, non-prefetchable) [size=2K]
	Capabilities: [dc] Power Management version 2

15:00.2 Generic system peripheral [0805]: Ricoh Co Ltd R5C822 SD/SDIO/MMC/MS/MSPro Host Adapter (rev 21)
	Subsystem: Lenovo Unknown device 20c8
	Flags: bus master, medium devsel, latency 0, IRQ 11
	Memory at f8301800 (32-bit, non-prefetchable) [size=256]
	Capabilities: [80] Power Management version 2

15:00.3 System peripheral: Ricoh Co Ltd Unknown device 0843 (rev 11)
	Subsystem: Lenovo Unknown device 20c9
	Flags: bus master, medium devsel, latency 0, IRQ 11
	Memory at f8301c00 (32-bit, non-prefetchable) [size=256]
	Capabilities: [80] Power Management version 2

15:00.4 System peripheral: Ricoh Co Ltd R5C592 Memory Stick Bus Host Adapter (rev 11)
	Subsystem: Lenovo Unknown device 20ca
	Flags: medium devsel, IRQ 11
	Memory at f8302000 (32-bit, non-prefetchable) [size=256]
	Capabilities: [80] Power Management version 2

15:00.5 System peripheral: Ricoh Co Ltd xD-Picture Card Controller (rev 11)
	Subsystem: Lenovo Unknown device 20cb
	Flags: medium devsel, IRQ 11
	Memory at f8302400 (32-bit, non-prefetchable) [size=256]
	Capabilities: [80] Power Management version 2



dmesg of 2.6.27 ( comments following '###' is compare to 2.6.28-rc2) :

Linux version 2.6.27 (alexs@lkp-t61) (gcc version 4.1.2 20070925 (Red Hat 4.1.2-33)) #1 SMP Tue Oct 14 18:02:00 CST 2008
BIOS-provided physical RAM map:
 BIOS-e820: 0000000000000000 - 000000000009d800 (usable)
 BIOS-e820: 000000000009d800 - 00000000000a0000 (reserved)
 BIOS-e820: 00000000000d2000 - 00000000000d4000 (reserved)
 BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)
 BIOS-e820: 0000000000100000 - 000000003e6b0000 (usable)
 BIOS-e820: 000000003e6b0000 - 000000003e6cc000 (ACPI data)
 BIOS-e820: 000000003e6cc000 - 000000003e700000 (ACPI NVS)
 BIOS-e820: 000000003e700000 - 000000003f000000 (reserved)
 BIOS-e820: 00000000f0000000 - 00000000f4000000 (reserved)
 BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
 BIOS-e820: 00000000fed00000 - 00000000fed00400 (reserved)
 BIOS-e820: 00000000fed14000 - 00000000fed1a000 (reserved)
 BIOS-e820: 00000000fed1c000 - 00000000fed90000 (reserved)
 BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
 BIOS-e820: 00000000ff000000 - 0000000100000000 (reserved)
last_pfn = 0x3e6b0 max_arch_pfn = 0x100000
kernel direct mapping tables up to 38000000 @ 7000-c000
RAMDISK: 37d0e000 - 37fef6bf
DMI present.
ACPI: RSDP 000F68D0, 0024 (r2 LENOVO)
ACPI: XSDT 3E6BB74B, 0094 (r1 LENOVO TP-7L        2090  LTP        0)
ACPI: FACP 3E6BB800, 00F4 (r3 LENOVO TP-7L        2090 LNVO        1)
ACPI Warning (tbfadt-0442): Optional field "Gpe1Block" has zero address or length: 000000000000102C/0 [20080609]
ACPI: DSDT 3E6BBC1D, FF05 (r1 LENOVO TP-7L        2090 MSFT  3000000)
ACPI: FACS 3E6E4000, 0040
ACPI: SSDT 3E6BB9B4, 0269 (r1 LENOVO TP-7L        2090 MSFT  3000000)
ACPI: ECDT 3E6CBB22, 0052 (r1 LENOVO TP-7L        2090 LNVO        1)
ACPI: TCPA 3E6CBB74, 0032 (r2 LENOVO TP-7L        2090 LNVO        1)
ACPI: APIC 3E6CBBA6, 0068 (r1 LENOVO TP-7L        2090 LNVO        1)
ACPI: MCFG 3E6CBC0E, 003C (r1 LENOVO TP-7L        2090 LNVO        1)
ACPI: HPET 3E6CBC4A, 0038 (r1 LENOVO TP-7L        2090 LNVO        1)
ACPI: SLIC 3E6CBDF0, 0176 (r1 LENOVO TP-7L        2090  LTP        0)
ACPI: BOOT 3E6CBF66, 0028 (r1 LENOVO TP-7L        2090  LTP        1)
ACPI: ASF! 3E6CBF8E, 0072 (r16 LENOVO TP-7L        2090 PTL         1)
ACPI: SSDT 3E6E2697, 025F (r1 LENOVO TP-7L        2090 INTL 20050513)
ACPI: SSDT 3E6E28F6, 00A6 (r1 LENOVO TP-7L        2090 INTL 20050513)
ACPI: SSDT 3E6E299C, 04F7 (r1 LENOVO TP-7L        2090 INTL 20050513)
ACPI: SSDT 3E6E2E93, 01D8 (r1 LENOVO TP-7L        2090 INTL 20050513)
ACPI: DMI detected: Lenovo ThinkPad T61
ACPI: Added _OSI(Linux)
102MB HIGHMEM available.
896MB LOWMEM available.
  mapped low ram: 0 - 38000000
  low ram: 00000000 - 38000000
  bootmap 00008000 - 0000f000
(9 early reservations) ==> bootmem [0000000000 - 0038000000]
  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
  #1 [0000001000 - 0000002000]    EX TRAMPOLINE ==> [0000001000 - 0000002000]
  #2 [0000006000 - 0000007000]       TRAMPOLINE ==> [0000006000 - 0000007000]
  #3 [0000400000 - 0000866680]    TEXT DATA BSS ==> [0000400000 - 0000866680]
  #4 [0037d0e000 - 0037fef6bf]          RAMDISK ==> [0037d0e000 - 0037fef6bf]
  #5 [0000867000 - 000086b000]    INIT_PG_TABLE ==> [0000867000 - 000086b000]
  #6 [000009d800 - 0000100000]    BIOS reserved ==> [000009d800 - 0000100000]
  #7 [0000007000 - 0000008000]          PGTABLE ==> [0000007000 - 0000008000]
  #8 [0000008000 - 000000f000]          BOOTMAP ==> [0000008000 - 000000f000]
found SMP MP-table at [c00f6900] 000f6900
Zone PFN ranges:
  DMA      0x00000000 -> 0x00001000
  Normal   0x00001000 -> 0x00038000
  HighMem  0x00038000 -> 0x0003e6b0
Movable zone start PFN for each node
early_node_map[2] active PFN ranges
    0: 0x00000000 -> 0x0000009d
    0: 0x00000100 -> 0x0003e6b0
On node 0 totalpages: 255565
free_area_init_node: node 0, pgdat c074ca80, node_mem_map c1000000
  DMA zone: 3965 pages, LIFO batch:0
  Normal zone: 223520 pages, LIFO batch:31
  HighMem zone: 26082 pages, LIFO batch:7
Using APIC driver default
ACPI: PM-Timer IO Port: 0x1008
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: IRQ0 used by override.
ACPI: IRQ2 used by override.
ACPI: IRQ9 used by override.
Enabling APIC mode:  Flat.  Using 1 I/O APICs
ACPI: HPET id: 0x8086a201 base: 0xfed00000
Using ACPI (MADT) for SMP configuration information
SMP: Allowing 2 CPUs, 0 hotplug CPUs
mapped APIC to ffffb000 (fee00000)
mapped IOAPIC to ffffa000 (fec00000)
PM: Registered nosave memory: 000000000009d000 - 000000000009e000
PM: Registered nosave memory: 000000000009e000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000d2000
PM: Registered nosave memory: 00000000000d2000 - 00000000000d4000
PM: Registered nosave memory: 00000000000d4000 - 00000000000e0000
PM: Registered nosave memory: 00000000000e0000 - 0000000000100000
Allocating PCI resources starting at 40000000 (gap: 3f000000:b1000000)
PERCPU: Allocating 40476 bytes of per cpu data
NR_CPUS: 32, nr_cpu_ids: 2, nr_node_ids 1
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 253567
Kernel command line: ro root=/dev/sda2 selinux=0 
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Initializing CPU#0
CPU 0 irqstacks, hard=c07cf000 soft=c07af000
PID hash table entries: 4096 (order: 12, 16384 bytes)
Extended CMOS year: 2000
TSC: PIT calibration confirmed by PMTIMER.
TSC: using PIT calibration value
Detected 1795.464 MHz processor.
Console: colour VGA+ 80x25
console [tty0] enabled
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Memory: 1005516k/1022656k available (2199k kernel code, 16464k reserved, 1271k data, 264k init, 105152k highmem)
virtual kernel memory layout:
    fixmap  : 0xffc58000 - 0xfffff000   (3740 kB)
    pkmap   : 0xff400000 - 0xff800000   (4096 kB)
    vmalloc : 0xf8800000 - 0xff3fe000   ( 107 MB)
    lowmem  : 0xc0000000 - 0xf8000000   ( 896 MB)
      .init : 0xc076a000 - 0xc07ac000   ( 264 kB)
      .data : 0xc0625eb5 - 0xc0763b00   (1271 kB)
      .text : 0xc0400000 - 0xc0625eb5   (2199 kB)
Checking if this processor honours the WP bit even in supervisor mode...Ok.
CPA: page pool initialized 1 of 1 pages preallocated
SLUB: Genslabs=12, HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
hpet clockevent registered
Calibrating delay loop (skipped), value calculated using timer frequency.. 3590.92 BogoMIPS (lpj=7181856)
Security Framework initialized
SELinux:  Disabled at boot.
Mount-cache hash table entries: 512
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 2048K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#0.
using mwait in idle threads.
Checking 'hlt' instruction... OK.
ACPI: Core revision 20080609
ENABLING IO-APIC IRQs
..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1
CPU0: Intel(R) Core(TM)2 Duo CPU     T7100  @ 1.80GHz stepping 0d
CPU 1 irqstacks, hard=c07d0000 soft=c07b0000
Booting processor 1/1 ip 6000
Initializing CPU#1
Calibrating delay using timer specific routine.. 3590.98 BogoMIPS (lpj=7181979)
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 2048K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 1
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#1.
CPU1: Intel(R) Core(TM)2 Duo CPU     T7100  @ 1.80GHz stepping 0d
checking TSC synchronization [CPU#0 -> CPU#1]:
Measured 326988 cycles TSC warp between CPUs, turning off TSC clock.
Marking TSC unstable due to check_tsc_sync_source failed
Brought up 2 CPUs
Total of 2 processors activated (7181.91 BogoMIPS).
CPU0 attaching sched-domain:
 domain 0: span 0-1 level MC
  groups: 0 1
CPU1 attaching sched-domain:
 domain 0: span 0-1 level MC
  groups: 1 0
net_namespace: 840 bytes
NET: Registered protocol family 16
ACPI: ACPI Dock Station Driver
ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
ACPI: bus type pci registered
PCI: MCFG configuration 0: base f0000000 segment 0 buses 0 - 63
PCI: MCFG area at f0000000 reserved in E820
PCI: Using MMCONFIG for extended config space
PCI: Using configuration type 1 for base access
ACPI: EC: EC description table is found, configuring boot EC
ACPI: BIOS _OSI(Linux) query honored via DMI
ACPI: EC: non-query interrupt received, switching to interrupt mode
ACPI: Interpreter enabled
ACPI: (supports S0 S3 S4 S5)
ACPI: Using IOAPIC for interrupt routing
ACPI: EC: GPE = 0x12, I/O: command/status = 0x66, data = 0x62
ACPI: EC: driver started in interrupt mode
ACPI: PCI Root Bridge [PCI0] (0000:00)
PCI: 0000:00:02.0 reg 10 64bit mmio: [f8100000, f81fffff]
PCI: 0000:00:02.0 reg 18 32bit mmio: [e0000000, efffffff]
PCI: 0000:00:02.0 reg 20 io port: [1800, 1807]
PCI: 0000:00:02.1 reg 10 64bit mmio: [f8200000, f82fffff]
PCI: 0000:00:19.0 reg 10 32bit mmio: [fe000000, fe01ffff]
PCI: 0000:00:19.0 reg 14 32bit mmio: [fe025000, fe025fff]
PCI: 0000:00:19.0 reg 18 io port: [1840, 185f]
pci 0000:00:19.0: PME# supported from D0 D3hot D3cold
pci 0000:00:19.0: PME# disabled
PCI: 0000:00:1a.0 reg 20 io port: [1860, 187f]
PCI: 0000:00:1a.1 reg 20 io port: [1880, 189f]
PCI: 0000:00:1a.7 reg 10 32bit mmio: [fe226c00, fe226fff]
pci 0000:00:1a.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1a.7: PME# disabled
PCI: 0000:00:1b.0 reg 10 64bit mmio: [fe020000, fe023fff]
pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1b.0: PME# disabled
pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.0: PME# disabled
pci 0000:00:1c.1: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.1: PME# disabled
pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.2: PME# disabled
pci 0000:00:1c.3: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.3: PME# disabled
pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
pci 0000:00:1c.4: PME# disabled
PCI: 0000:00:1d.0 reg 20 io port: [18a0, 18bf]
PCI: 0000:00:1d.1 reg 20 io port: [18c0, 18df]
PCI: 0000:00:1d.2 reg 20 io port: [18e0, 18ff]
PCI: 0000:00:1d.7 reg 10 32bit mmio: [fe227000, fe2273ff]
pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
pci 0000:00:1d.7: PME# disabled
pci 0000:00:1f.0: quirk: region 1000-107f claimed by ICH6 ACPI/GPIO/TCO
pci 0000:00:1f.0: quirk: region 1180-11bf claimed by ICH6 GPIO
PCI: 0000:00:1f.1 reg 10 io port: [0, 7]
PCI: 0000:00:1f.1 reg 14 io port: [0, 3]
PCI: 0000:00:1f.1 reg 18 io port: [0, 7]
PCI: 0000:00:1f.1 reg 1c io port: [0, 3]
PCI: 0000:00:1f.1 reg 20 io port: [1c00, 1c0f]
PCI: 0000:00:1f.2 reg 10 io port: [1c50, 1c57]
PCI: 0000:00:1f.2 reg 14 io port: [1c44, 1c47]
PCI: 0000:00:1f.2 reg 18 io port: [1c48, 1c4f]
PCI: 0000:00:1f.2 reg 1c io port: [1c40, 1c43]
PCI: 0000:00:1f.2 reg 20 io port: [1c20, 1c3f]
PCI: 0000:00:1f.2 reg 24 32bit mmio: [fe226000, fe2267ff]
pci 0000:00:1f.2: PME# supported from D3hot
pci 0000:00:1f.2: PME# disabled
PCI: 0000:00:1f.3 reg 10 32bit mmio: [fe227400, fe2274ff]
PCI: 0000:00:1f.3 reg 20 io port: [1c60, 1c7f]
PCI: bridge 0000:00:1c.0 io port: [2000, 2fff]
PCI: bridge 0000:00:1c.0 32bit mmio: [fc000000, fdffffff]
PCI: bridge 0000:00:1c.0 64bit mmio pref: [f8000000, f80fffff]
PCI: 0000:03:00.0 reg 10 32bit mmio: [df3ff000, df3fffff]
pci 0000:03:00.0: PME# supported from D0 D3hot
pci 0000:03:00.0: PME# disabled
PCI: bridge 0000:00:1c.1 io port: [3000, 3fff]
PCI: bridge 0000:00:1c.1 32bit mmio: [dc000000, df3fffff]
PCI: bridge 0000:00:1c.1 64bit mmio pref: [dfe00000, dfefffff]
PCI: bridge 0000:00:1c.2 io port: [4000, 4fff]
PCI: bridge 0000:00:1c.2 32bit mmio: [d8000000, d9ffffff]
PCI: bridge 0000:00:1c.2 64bit mmio pref: [dfb00000, dfbfffff]
PCI: bridge 0000:00:1c.3 io port: [5000, 5fff]
PCI: bridge 0000:00:1c.3 32bit mmio: [d4000000, d5ffffff]
PCI: bridge 0000:00:1c.3 64bit mmio pref: [df800000, df8fffff]
PCI: bridge 0000:00:1c.4 io port: [6000, 6fff]
PCI: bridge 0000:00:1c.4 32bit mmio: [d0000000, d1ffffff]
PCI: bridge 0000:00:1c.4 64bit mmio pref: [df500000, df5fffff]
PCI: 0000:15:00.0 reg 10 32bit mmio: [f8300000, f8300fff]
pci 0000:15:00.0: supports D1
pci 0000:15:00.0: supports D2
pci 0000:15:00.0: PME# supported from D0 D1 D2 D3hot D3cold
pci 0000:15:00.0: PME# disabled
PCI: 0000:15:00.1 reg 10 32bit mmio: [f8301000, f83017ff]
pci 0000:15:00.1: supports D1
pci 0000:15:00.1: supports D2
pci 0000:15:00.1: PME# supported from D0 D1 D2 D3hot D3cold
pci 0000:15:00.1: PME# disabled
PCI: 0000:15:00.2 reg 10 32bit mmio: [f8301800, f83018ff]
pci 0000:15:00.2: supports D1
pci 0000:15:00.2: supports D2
pci 0000:15:00.2: PME# supported from D0 D1 D2 D3hot D3cold
pci 0000:15:00.2: PME# disabled
PCI: 0000:15:00.3 reg 10 32bit mmio: [f8301c00, f8301cff]
pci 0000:15:00.3: supports D1
pci 0000:15:00.3: supports D2
pci 0000:15:00.3: PME# supported from D0 D1 D2 D3hot D3cold
pci 0000:15:00.3: PME# disabled
PCI: 0000:15:00.4 reg 10 32bit mmio: [f8302000, f83020ff]
pci 0000:15:00.4: supports D1
pci 0000:15:00.4: supports D2
pci 0000:15:00.4: PME# supported from D0 D1 D2 D3hot D3cold
pci 0000:15:00.4: PME# disabled
PCI: 0000:15:00.5 reg 10 32bit mmio: [f8302400, f83024ff]
pci 0000:15:00.5: supports D1
pci 0000:15:00.5: supports D2
pci 0000:15:00.5: PME# supported from D0 D1 D2 D3hot D3cold
pci 0000:15:00.5: PME# disabled
pci 0000:00:1e.0: transparent bridge
PCI: bridge 0000:00:1e.0 io port: [7000, afff]
PCI: bridge 0000:00:1e.0 32bit mmio: [f8300000, fbffffff]
PCI: bridge 0000:00:1e.0 64bit mmio pref: [f4000000, f7ffffff]
bus 00 -> node 0
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP1._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP2._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP3._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP4._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCI1._PRT]
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 *10 11)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 *11)
ACPI: Power Resource [PUBS] (on)
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI init
ACPI: bus type pnp registered
pnp: PnP ACPI: found 11 devices
ACPI: ACPI bus type pnp unregistered
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: Using ACPI for IRQ routing
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
hpet0: 3 64-bit timers, 14318180 Hz
Switched to high resolution mode on CPU 0
Switched to high resolution mode on CPU 1
system 00:00: iomem range 0x0-0x9ffff could not be reserved
system 00:00: iomem range 0xc0000-0xc3fff could not be reserved
system 00:00: iomem range 0xc4000-0xc7fff could not be reserved
system 00:00: iomem range 0xc8000-0xcbfff has been reserved
system 00:00: iomem range 0xcc000-0xcffff has been reserved
system 00:00: iomem range 0xd0000-0xd3fff could not be reserved
system 00:00: iomem range 0xe0000-0xe3fff could not be reserved
system 00:00: iomem range 0xe4000-0xe7fff could not be reserved
system 00:00: iomem range 0xe8000-0xebfff could not be reserved
system 00:00: iomem range 0xec000-0xeffff could not be reserved
system 00:00: iomem range 0xf0000-0xfffff could not be reserved
system 00:00: iomem range 0x100000-0x3effffff could not be reserved
system 00:00: iomem range 0xfec00000-0xfed3ffff could not be reserved
system 00:00: iomem range 0xfed4c000-0xffffffff could not be reserved
system 00:02: ioport range 0x164e-0x164f has been reserved
system 00:02: ioport range 0x1000-0x107f has been reserved
system 00:02: ioport range 0x1180-0x11bf has been reserved
system 00:02: ioport range 0x800-0x80f has been reserved
system 00:02: ioport range 0x15e0-0x15ef has been reserved
system 00:02: ioport range 0x1600-0x165f could not be reserved
system 00:02: iomem range 0xf0000000-0xf3ffffff could not be reserved
system 00:02: iomem range 0xfed1c000-0xfed1ffff could not be reserved
system 00:02: iomem range 0xfed14000-0xfed17fff could not be reserved
system 00:02: iomem range 0xfed18000-0xfed18fff could not be reserved
system 00:02: iomem range 0xfed19000-0xfed19fff could not be reserved
system 00:02: iomem range 0xfed45000-0xfed4bfff could not be reserved
pci 0000:00:1c.0: PCI bridge, secondary bus 0000:02
pci 0000:00:1c.0:   IO window: 0x2000-0x2fff
pci 0000:00:1c.0:   MEM window: 0xfc000000-0xfdffffff
pci 0000:00:1c.0:   PREFETCH window: 0x000000f8000000-0x000000f80fffff
pci 0000:00:1c.1: PCI bridge, secondary bus 0000:03
pci 0000:00:1c.1:   IO window: 0x3000-0x3fff
pci 0000:00:1c.1:   MEM window: 0xdc000000-0xdf3fffff
pci 0000:00:1c.1:   PREFETCH window: 0x000000dfe00000-0x000000dfefffff
pci 0000:00:1c.2: PCI bridge, secondary bus 0000:04
pci 0000:00:1c.2:   IO window: 0x4000-0x4fff
pci 0000:00:1c.2:   MEM window: 0xd8000000-0xd9ffffff
pci 0000:00:1c.2:   PREFETCH window: 0x000000dfb00000-0x000000dfbfffff
pci 0000:00:1c.3: PCI bridge, secondary bus 0000:05
pci 0000:00:1c.3:   IO window: 0x5000-0x5fff
pci 0000:00:1c.3:   MEM window: 0xd4000000-0xd5ffffff
pci 0000:00:1c.3:   PREFETCH window: 0x000000df800000-0x000000df8fffff
pci 0000:00:1c.4: PCI bridge, secondary bus 0000:0d
pci 0000:00:1c.4:   IO window: 0x6000-0x6fff
pci 0000:00:1c.4:   MEM window: 0xd0000000-0xd1ffffff
pci 0000:00:1c.4:   PREFETCH window: 0x000000df500000-0x000000df5fffff
pci 0000:15:00.0: CardBus bridge, secondary bus 0000:16
pci 0000:15:00.0:   IO window: 0x007000-0x0070ff
pci 0000:15:00.0:   IO window: 0x007400-0x0074ff
pci 0000:15:00.0:   PREFETCH window: 0xf4000000-0xf7ffffff
pci 0000:15:00.0:   MEM window: 0x40000000-0x43ffffff
pci 0000:00:1e.0: PCI bridge, secondary bus 0000:15
pci 0000:00:1e.0:   IO window: 0x7000-0xafff
pci 0000:00:1e.0:   MEM window: 0xf8300000-0xfbffffff
pci 0000:00:1e.0:   PREFETCH window: 0x000000f4000000-0x000000f7ffffff
pci 0000:00:1c.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
pci 0000:00:1c.0: setting latency timer to 64
pci 0000:00:1c.1: PCI INT B -> GSI 21 (level, low) -> IRQ 21
pci 0000:00:1c.1: setting latency timer to 64
pci 0000:00:1c.2: PCI INT C -> GSI 22 (level, low) -> IRQ 22
pci 0000:00:1c.2: setting latency timer to 64
pci 0000:00:1c.3: PCI INT D -> GSI 23 (level, low) -> IRQ 23
pci 0000:00:1c.3: setting latency timer to 64
pci 0000:00:1c.4: PCI INT A -> GSI 20 (level, low) -> IRQ 20
pci 0000:00:1c.4: setting latency timer to 64
pci 0000:00:1e.0: enabling device (0005 -> 0007)
pci 0000:00:1e.0: setting latency timer to 64
pci 0000:15:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
pci 0000:15:00.0: setting latency timer to 64
bus: 00 index 0 io port: [0, ffff]
bus: 00 index 1 mmio: [0, ffffffffffffffff]
bus: 02 index 0 io port: [2000, 2fff]
bus: 02 index 1 mmio: [fc000000, fdffffff]
bus: 02 index 2 mmio: [f8000000, f80fffff]
bus: 02 index 3 mmio: [0, 0]
bus: 03 index 0 io port: [3000, 3fff]
bus: 03 index 1 mmio: [dc000000, df3fffff]
bus: 03 index 2 mmio: [dfe00000, dfefffff]
bus: 03 index 3 mmio: [0, 0]
bus: 04 index 0 io port: [4000, 4fff]
bus: 04 index 1 mmio: [d8000000, d9ffffff]
bus: 04 index 2 mmio: [dfb00000, dfbfffff]
bus: 04 index 3 mmio: [0, 0]
bus: 05 index 0 io port: [5000, 5fff]
bus: 05 index 1 mmio: [d4000000, d5ffffff]
bus: 05 index 2 mmio: [df800000, df8fffff]
bus: 05 index 3 mmio: [0, 0]
bus: 0d index 0 io port: [6000, 6fff]
bus: 0d index 1 mmio: [d0000000, d1ffffff]
bus: 0d index 2 mmio: [df500000, df5fffff]
bus: 0d index 3 mmio: [0, 0]
bus: 15 index 0 io port: [7000, afff]
bus: 15 index 1 mmio: [f8300000, fbffffff]
bus: 15 index 2 mmio: [f4000000, f7ffffff]
bus: 15 index 3 io port: [0, ffff]
bus: 15 index 4 mmio: [0, ffffffffffffffff]
bus: 16 index 0 io port: [7000, 70ff]
bus: 16 index 1 io port: [7400, 74ff]
bus: 16 index 2 mmio: [f4000000, f7ffffff]
bus: 16 index 3 mmio: [40000000, 43ffffff]
NET: Registered protocol family 2
IP route cache hash table entries: 32768 (order: 5, 131072 bytes)
TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
NET: Registered protocol family 1
checking if image is initramfs... it is
Freeing initrd memory: 2949k freed
Simple Boot Flag at 0x35 set to 0x1
apm: BIOS not found.
audit: initializing netlink socket (disabled)
type=2000 audit(1225269530.588:1): initialized
highmem bounce pool size: 64 pages
HugeTLB registered 4 MB page size, pre-allocated 0 pages
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
msgmni has been set to 1764
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
pci 0000:00:02.0: Boot video device
pcieport-driver 0000:00:1c.0: setting latency timer to 64
pcieport-driver 0000:00:1c.0: found MSI capability
pci_express 0000:00:1c.0:pcie00: allocate port service
pci_express 0000:00:1c.0:pcie02: allocate port service
pci_express 0000:00:1c.0:pcie03: allocate port service
pcieport-driver 0000:00:1c.1: setting latency timer to 64
pcieport-driver 0000:00:1c.1: found MSI capability
pci_express 0000:00:1c.1:pcie00: allocate port service
pci_express 0000:00:1c.1:pcie02: allocate port service
pci_express 0000:00:1c.1:pcie03: allocate port service
pcieport-driver 0000:00:1c.2: setting latency timer to 64
pcieport-driver 0000:00:1c.2: found MSI capability
pci_express 0000:00:1c.2:pcie00: allocate port service
pci_express 0000:00:1c.2:pcie02: allocate port service
pci_express 0000:00:1c.2:pcie03: allocate port service
pcieport-driver 0000:00:1c.3: setting latency timer to 64
pcieport-driver 0000:00:1c.3: found MSI capability
pci_express 0000:00:1c.3:pcie00: allocate port service
pci_express 0000:00:1c.3:pcie02: allocate port service
pci_express 0000:00:1c.3:pcie03: allocate port service
pcieport-driver 0000:00:1c.4: setting latency timer to 64
pcieport-driver 0000:00:1c.4: found MSI capability
pci_express 0000:00:1c.4:pcie00: allocate port service
pci_express 0000:00:1c.4:pcie02: allocate port service
pci_express 0000:00:1c.4:pcie03: allocate port service
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
cyblafb: CyblaFB version 0.62 initializing
ACPI: SSDT 3E6E1B32, 0282 (r1  PmRef  Cpu0Ist      100 INTL 20050513)
ACPI: SSDT 3E6E1E39, 085E (r1  PmRef  Cpu0Cst      100 INTL 20050513)
Monitor-Mwait will be used to enter C-1 state
Monitor-Mwait will be used to enter C-2 state
Monitor-Mwait will be used to enter C-3 state
ACPI: CPU0 (power states: C1[C1] C2[C2] C3[C3])
processor ACPI0007:00: registered as cooling_device0
ACPI: Processor [CPU0] (supports 8 throttling states)
ACPI: SSDT 3E6E1A6A, 00C8 (r1  PmRef  Cpu1Ist      100 INTL 20050513)
ACPI: SSDT 3E6E1DB4, 0085 (r1  PmRef  Cpu1Cst      100 INTL 20050513)
ACPI: CPU1 (power states: C1[C1] C2[C2] C3[C3])
processor ACPI0007:01: registered as cooling_device1
ACPI: Processor [CPU1] (supports 8 throttling states)
thermal LNXTHERM:01: registered as thermal_zone0
ACPI: Thermal Zone [THM0] (46 C)
thermal LNXTHERM:02: registered as thermal_zone1
ACPI: Thermal Zone [THM1] (45 C)
isapnp: Scanning for PnP cards...
isapnp: No Plug & Play device found
Real Time Clock Driver v1.12ac
hpet_resources: 0xfed00000 is busy
Non-volatile memory driver v1.2
Linux agpgart interface v0.103
agpgart-intel 0000:00:00.0: Intel 965GM Chipset
agpgart-intel 0000:00:00.0: detected 7676K stolen memory
agpgart-intel 0000:00:00.0: AGP aperture is 256M @ 0xe0000000
Serial: 8250/16550 driver4 ports, IRQ sharing enabled
brd: module loaded
input: Macintosh mouse button emulation as /class/input/input0
Yenta: CardBus bridge found at 0000:15:00.0 [17aa:20c6]
Yenta: ISA IRQ mask 0x0cb8, PCI irq 16
Socket status: 30000006
pcmcia: parent PCI bridge I/O window: 0x7000 - 0xafff
cs: IO port probe 0x7000-0xafff: clean.
pcmcia: parent PCI bridge Memory window: 0xf8300000 - 0xfbffffff
pcmcia: parent PCI bridge Memory window: 0xf4000000 - 0xf7ffffff
PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
serio: i8042 KBD port at 0x60,0x64 irq 1
serio: i8042 AUX port at 0x60,0x64 irq 12
mice: PS/2 mouse device common for all mice
input: AT Translated Set 2 keyboard as /class/input/input1
md: multipath personality registered for level -4
md: faulty personality registered for level -5
cpuidle: using governor ladder
cpuidle: using governor menu
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid
usbhid: v2.6:USB HID core driver
TCP cubic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
Using IPI No-Shortcut mode
registered taskstats version 1
Freeing unused kernel memory: 264k freed
Write protecting the kernel text: 2200k
Write protecting the kernel read-only data: 1052k
ehci_hcd 0000:00:1a.7: power state changed by ACPI to D0
ehci_hcd 0000:00:1a.7: PCI INT C -> GSI 22 (level, low) -> IRQ 22
ehci_hcd 0000:00:1a.7: setting latency timer to 64
ehci_hcd 0000:00:1a.7: EHCI Host Controller
ehci_hcd 0000:00:1a.7: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1a.7: cache line size of 32 is not supported
ehci_hcd 0000:00:1a.7: irq 22, io mem 0xfe226c00
ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 4 ports detected
ehci_hcd 0000:00:1d.7: power state changed by ACPI to D0
ehci_hcd 0000:00:1d.7: PCI INT D -> GSI 19 (level, low) -> IRQ 19
ehci_hcd 0000:00:1d.7: setting latency timer to 64
ehci_hcd 0000:00:1d.7: EHCI Host Controller
ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 2
ehci_hcd 0000:00:1d.7: debug port 1
ehci_hcd 0000:00:1d.7: cache line size of 32 is not supported
ehci_hcd 0000:00:1d.7: irq 19, io mem 0xfe227000
Synaptics Touchpad, model: 1, fw: 6.2, id: 0x81a0b1, caps: 0xa04793/0x300000
serio: Synaptics pass-through port at isa0060/serio1/input0
ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 6 ports detected
input: SynPS/2 Synaptics TouchPad as /class/input/input2
ohci_hcd: 2006 August 04 USB 1.1 'Open' Host Controller (OHCI) Driver
USB Universal Host Controller Interface driver v3.0
uhci_hcd 0000:00:1a.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
uhci_hcd 0000:00:1a.0: setting latency timer to 64
uhci_hcd 0000:00:1a.0: UHCI Host Controller
uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 3
uhci_hcd 0000:00:1a.0: irq 20, io base 0x00001860
usb usb3: configuration #1 chosen from 1 choice
hub 3-0:1.0: USB hub found
hub 3-0:1.0: 2 ports detected
uhci_hcd 0000:00:1a.1: power state changed by ACPI to D0
uhci_hcd 0000:00:1a.1: PCI INT B -> GSI 21 (level, low) -> IRQ 21
uhci_hcd 0000:00:1a.1: setting latency timer to 64
uhci_hcd 0000:00:1a.1: UHCI Host Controller
uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4
uhci_hcd 0000:00:1a.1: irq 21, io base 0x00001880
usb usb4: configuration #1 chosen from 1 choice
hub 4-0:1.0: USB hub found
hub 4-0:1.0: 2 ports detected
uhci_hcd 0000:00:1d.0: power state changed by ACPI to D0
uhci_hcd 0000:00:1d.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
uhci_hcd 0000:00:1d.0: setting latency timer to 64
uhci_hcd 0000:00:1d.0: UHCI Host Controller
uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 5
uhci_hcd 0000:00:1d.0: irq 16, io base 0x000018a0
usb usb5: configuration #1 chosen from 1 choice
hub 5-0:1.0: USB hub found
hub 5-0:1.0: 2 ports detected
usb 3-2: new full speed USB device using uhci_hcd and address 2
uhci_hcd 0000:00:1d.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
uhci_hcd 0000:00:1d.1: setting latency timer to 64
uhci_hcd 0000:00:1d.1: UHCI Host Controller
uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 6
uhci_hcd 0000:00:1d.1: irq 17, io base 0x000018c0
usb usb6: configuration #1 chosen from 1 choice
hub 6-0:1.0: USB hub found
hub 6-0:1.0: 2 ports detected
usb 3-2: configuration #1 chosen from 1 choice
uhci_hcd 0000:00:1d.2: power state changed by ACPI to D0
uhci_hcd 0000:00:1d.2: PCI INT C -> GSI 18 (level, low) -> IRQ 18
uhci_hcd 0000:00:1d.2: setting latency timer to 64
uhci_hcd 0000:00:1d.2: UHCI Host Controller
uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 7
uhci_hcd 0000:00:1d.2: irq 18, io base 0x000018e0
usb usb7: configuration #1 chosen from 1 choice
hub 7-0:1.0: USB hub found
hub 7-0:1.0: 2 ports detected
SCSI subsystem initialized
Driver 'sd' needs updating - please use bus_type methods
libata version 3.00 loaded.
ahci 0000:00:1f.2: version 3.0
ahci 0000:00:1f.2: PCI INT B -> GSI 16 (level, low) -> IRQ 16
ahci 0000:00:1f.2: AHCI 0001.0100 32 slots 3 ports 1.5 Gbps 0x1 impl SATA mode
ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part 
ahci 0000:00:1f.2: setting latency timer to 64 ### 28-rc2 no this line
scsi0 : ahci
scsi1 : ahci
scsi2 : ahci
ata1: SATA max UDMA/133 abar m2048@0xfe226000 port 0xfe226100 irq 218 ## irq is 42 on bad. 
ata2: DUMMY
ata3: DUMMY
ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300) 
ata1.00: ACPI cmd ef/02:00:00:00:00:a0 succeeded           ### no this line 
ata1.00: ACPI cmd f5/00:00:00:00:00:a0 filtered out
ata1.00: ACPI cmd ef/5f:00:00:00:00:a0 succeeded
ata1.00: ACPI cmd ef/10:03:00:00:00:a0 filtered out	   ### no this line
ata1.00: ATA-7: ST9120822AS, 3.CLF, max UDMA/100
ata1.00: 234441648 sectors, multi 16: LBA48 NCQ (depth 31/32)
ata1.00: ACPI cmd ef/02:00:00:00:00:a0 succeeded	  ### no this line	
ata1.00: ACPI cmd f5/00:00:00:00:00:a0 filtered out
ata1.00: ACPI cmd ef/5f:00:00:00:00:a0 succeeded		### no this line
ata1.00: ACPI cmd ef/10:03:00:00:00:a0 filtered out
ata1.00: configured for UDMA/100		
ata1.00: configured for UDMA/100
ata1: EH complete
scsi 0:0:0:0: Direct-Access     ATA      ST9120822AS      3.CL PQ: 0 ANSI: 5  
sd 0:0:0:0: [sda] 234441648 512-byte hardware sectors (120034 MB) ### no 120034MB but (120GB/111GiB)
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00			  ### no this line
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
sd 0:0:0:0: [sda] 234441648 512-byte hardware sectors (120034 MB) ### same to last comments
sd 0:0:0:0: [sda] Write Protect is off
sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00			 ### no this line
sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
 sda: sda1 sda2 sda3 sda4 < sda5 >
sd 0:0:0:0: [sda] Attached SCSI disk
ata_piix 0000:00:1f.1: version 2.12 #no this line 
ata_piix 0000:00:1f.1: PCI INT C -> GSI 16 (level, low) -> IRQ 16
ata_piix 0000:00:1f.1: setting latency timer to 64	# no this line
scsi3 : ata_piix
scsi4 : ata_piix
ata4: PATA max UDMA/100 cmd 0x1f0 ctl 0x3f6 bmdma 0x1c00 irq 14
ata5: PATA max UDMA/100 cmd 0x170 ctl 0x376 bmdma 0x1c08 irq 15
ata4.00: ATAPI: MATSHITADVD-RAM UJ-852, RB01, max UDMA/33
ata4.00: configured for UDMA/33
ata5: port disabled. ignoring.					### no this line
scsi 3:0:0:0: CD-ROM            MATSHITA DVD-RAM UJ-852   RB01 PQ: 0 ANSI: 5
IBM TrackPoint firmware: 0x0e, buttons: 3/3
input: TPPS/2 IBM TrackPoint as /class/input/input3
kjournald starting.  Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
Clocksource tsc unstable (delta = -183085068 ns)
input: Power Button (FF) as /class/input/input4
cs: IO port probe 0x100-0x3af: clean.
cs: IO port probe 0x3e0-0x4ff: excluding 0x4d0-0x4d7
cs: IO port probe 0x820-0x8ff: clean.
cs: IO port probe 0xc00-0xcf7: clean.
cs: IO port probe 0xa00-0xaff: clean.
ACPI: Power Button (FF) [PWRF]
input: Lid Switch as /class/input/input5
ACPI: Lid Switch [LID]
input: Sleep Button (CM) as /class/input/input6
ACPI: Sleep Button (CM) [SLPB]
sd 0:0:0:0: Attached scsi generic sg0 type 0
scsi 3:0:0:0: Attached scsi generic sg1 type 5
ACPI: AC Adapter [AC] (on-line)
ACPI: Battery Slot [BAT0] (battery absent)
ACPI: \_SB_.PCI0.IDE0.PRIM.MSTR: found ejectable bay
ACPI: \_SB_.PCI0.IDE0.PRIM.MSTR: Adding notify handler
ACPI: Error installing bay notify handler
thinkpad_acpi: ThinkPad ACPI Extras v0.21
thinkpad_acpi: http://ibm-acpi.sf.net/
thinkpad_acpi: ThinkPad BIOS 7LETA9WW (2.09 ), EC 7KHT24WW-1.08
thinkpad_acpi: Lenovo ThinkPad T61, model 646557U
thinkpad_acpi: radio switch found; radios are disabled
thinkpad_acpi: This ThinkPad has standard ACPI backlight brightness control, supported by the ACPI video driver
thinkpad_acpi: Disabling thinkpad-acpi brightness events by default...
Registered led device: tpacpi::thinklight
Registered led device: tpacpi::power
Registered led device: tpacpi:orange:batt
Registered led device: tpacpi:green:batt
Registered led device: tpacpi::dock_active
Registered led device: tpacpi::bay_active
Registered led device: tpacpi::dock_batt
Registered led device: tpacpi::unknown_led
Registered led device: tpacpi::standby
thinkpad_acpi: Lenovo BIOS switched to ACPI backlight control mode
thinkpad_acpi: standard ACPI backlight interface available, not loading native one...
input: ThinkPad Extra Buttons as /class/input/input7
e1000e: Intel(R) PRO/1000 Network Driver - 0.3.3.3-k6
e1000e: Copyright (c) 1999-2008 Intel Corporation.
e1000e 0000:00:19.0: PCI INT A -> GSI 20 (level, low) -> IRQ 20
e1000e 0000:00:19.0: setting latency timer to 64
iTCO_vendor_support: vendor-support=0
0000:00:19.0: eth0: (PCI Express:2.5GB/s:Width x1) 00:1a:6b:36:0b:73
0000:00:19.0: eth0: Intel(R) PRO/1000 Network Connection
0000:00:19.0: eth0: MAC: 4, PHY: 6, PBA No: ffffff-0ff
iTCO_wdt: Intel TCO WatchDog Timer Driver v1.03 (30-Apr-2008)
iTCO_wdt: Found a ICH8M-E TCO device (Version=2, TCOBASE=0x1060)
iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
Driver 'sr' needs updating - please use bus_type methods
sr0: scsi3-mmc drive: 19x/62x writer dvd-ram cd/rw xa/form2 cdda tray
Uniform CD-ROM driver Revision: 3.20
sr 3:0:0:0: Attached scsi CD-ROM sr0
input: PC Speaker as /class/input/input8
acpi device:03: registered as cooling_device2
input: Video Bus as /class/input/input9
i801_smbus 0000:00:1f.3: PCI INT A -> GSI 23 (level, low) -> IRQ 23
ACPI: Video Device [VID] (multi-head: yes  rom: no  post: no)
acpi device:08: registered as cooling_device3
input: Video Bus as /class/input/input10
ACPI: Video Device [VID1] (multi-head: yes  rom: no  post: no)
firewire_ohci 0000:15:00.1: PCI INT B -> GSI 17 (level, low) -> IRQ 17
firewire_ohci 0000:15:00.1: setting latency timer to 64
firewire_ohci: Added fw-ohci device 0000:15:00.1, OHCI version 1.10
firewire_core: created device fw0: GUID 00061b032a1006c5, S400
iwl3945: Intel(R) PRO/Wireless 3945ABG/BG Network Connection driver for Linux, 1.2.26k
iwl3945: Copyright(c) 2003-2008 Intel Corporation
iwl3945 0000:03:00.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
iwl3945 0000:03:00.0: setting latency timer to 64
iwl3945: Detected Intel Wireless WiFi Link 3945ABG
iwl3945: Tunable channels: 11 802.11bg, 13 802.11a channels
phy0: Selected rate control algorithm 'iwl-3945-rs'
iwl3945 0000:03:00.0: PCI INT A disabled
HDA Intel 0000:00:1b.0: PCI INT B -> GSI 17 (level, low) -> IRQ 17
hda_intel: probe_mask set to 0x1 for device 17aa:20ac
HDA Intel 0000:00:1b.0: setting latency timer to 64
device-mapper: ioctl: 4.14.0-ioctl (2008-04-23) initialised: dm-devel@redhat.com
device-mapper: multipath: version 1.0.5 loaded
EXT3 FS on sda2, internal journal
Adding 3689240k swap on /dev/sda5.  Priority:-1 extents:1 across:3689240k
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
ADDRCONF(NETDEV_UP): eth0: link is not ready
0000:00:19.0: eth0: Link is Up 100 Mbps Full Duplex, Flow Control: None
0000:00:19.0: eth0: 10/100 speed: disabling TSO
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
thinkpad_acpi: ThinkPad ACPI Extras v0.21
thinkpad_acpi: http://ibm-acpi.sf.net/
thinkpad_acpi: ThinkPad BIOS 7LETA9WW (2.09 ), EC 7KHT24WW-1.08
thinkpad_acpi: Lenovo ThinkPad T61, model 646557U
thinkpad_acpi: radio switch found; radios are disabled
thinkpad_acpi: This ThinkPad has standard ACPI backlight brightness control, supported by the ACPI video driver
thinkpad_acpi: Disabling thinkpad-acpi brightness events by default...
Registered led device: tpacpi::thinklight
Registered led device: tpacpi::power
Registered led device: tpacpi:orange:batt
Registered led device: tpacpi:green:batt
Registered led device: tpacpi::dock_active
Registered led device: tpacpi::bay_active
Registered led device: tpacpi::dock_batt
Registered led device: tpacpi::unknown_led
Registered led device: tpacpi::standby
thinkpad_acpi: Lenovo BIOS switched to ACPI backlight control mode
thinkpad_acpi: standard ACPI backlight interface available, not loading native one...
input: ThinkPad Extra Buttons as /class/input/input11
eth0: no IPv6 routers present
Comment 1 Alex Shi 2008-10-31 01:28:06 UTC
Created attachment 18547 [details]
kernel config file 

kernel configure file for this bug.
Comment 2 Alex Shi 2008-11-03 00:02:45 UTC
still exists in rc3 
Comment 3 Tejun Heo 2008-11-03 06:38:41 UTC
How does it fail? and is this a regression?
Comment 4 Tejun Heo 2008-11-03 06:40:40 UTC
Ah.. okay, missed the first few lines.  2.6.27 worked.  Strange, 2.6.28-rc1 doesn't change much although slave link change might be causing the problem.  Can you please set up a net or serial console and capture failing log?  Thanks.
Comment 5 Alex Shi 2008-11-03 07:20:42 UTC
the problem machine is a product laptop. So, it is so hard to adding a serial line to capture the booting log. Even, the failure message have nothing useful info, anyting is fine in kernel booting and then move to initrd;In initrd.img, inserting relative modules are all fine. and then the system try to do switchroot failed and report "boot failed" . the console can show disk info till "sda1 sda2 sda3 sda4 <sda5>". I also compile in all relative modules but bug still exists. 

The booting message in console of 2.6.27, is quite similar with problem kernel. I mean the previous comments following by "###" also do not appear in console for 2.6.27 kernel in fact. but pop up in dmesg.  In one time 2.6.28-rc2 succeed booting, the sonsole and dmesg is quite similar with 2.6.27. 

oh, in booting somewhere it will print "resume from /dev/sda5 ..." in console of the 2.6.27 kernel, resume report find sda5. but in problem kernel, it report find sda5 failed. 
Comment 6 Tejun Heo 2008-11-03 07:51:44 UTC
The only thing I can think about is HPA but there's no reset or HPA related changes between 2.6.27 and 2.6.28-rc for ahci.  Does libata.ignore_hpa=1 do any good?
Comment 7 Alex Shi 2008-11-05 01:25:20 UTC
I modified the "init" file in initrd.img to add this parameter: 

insmod /lib/libata.ko ignore_hpa=1

but seems no help for this issue. we found several machine was affected, like think pad R52 etc.  
Comment 8 Tejun Heo 2008-11-05 01:42:06 UTC
Can you post .config?
Comment 9 Alex Shi 2008-11-05 16:53:22 UTC
it was posted as "kernel config file" as below. the Creator is "alexs", Do not you find it? 
Comment 10 Tejun Heo 2008-11-05 19:06:51 UTC
Heh, yeah, I missed that.  I was suspecting whether block extended devt was turned on.  I don't have much experience with fc initrd.  Can you drop into emergency shell from initrd and see whether you can mount filesystems manually?  I'm not sure where the problem is.  I have another bug report which is caused by recent block change (along with the extended block devt changes) where md returns garbage values and what you're seeing could be related.  If you can't mount manually and you see error message from filesystem code, it's likely to be the same problem.  I'll investigate the problem and let you know when I know more.  Thanks.
Comment 11 Alex Shi 2008-11-05 21:23:40 UTC
I have added CONFIG_DEBUG_BLOCK_EXT_DEVT in kernel. but no more message print out. 
Comment 12 Tejun Heo 2008-11-05 23:05:27 UTC
CONFIG_DEBUG_BLOCK_EXT_DEVT doesn't add any messages, it only changes device number allocation.

Ah.. strange.  Can you please build the kernel w/ all the necessary things built-in and skip initrd altogether?  Does the kernel still fail to mount root?
Comment 13 Yanmin Zhang 2008-11-05 23:12:41 UTC
Created attachment 18699 [details]
new kernel config file

I rebuilt kernel 2.6.28-rc3 and configure disk driver (AHCI) and some other drivers as built-in. Then, kernel could boot without hang. I booted for 4 times.
Comment 14 Alex Shi 2008-11-05 23:17:11 UTC
I also had built in these driver. and sometime it still hang. 
Another time, I write "reboot" in /etc/rc.local, the system keep reboot for 1.5 hours but still hang finally. 
Comment 15 Tejun Heo 2008-11-05 23:19:39 UTC
Thanks for testing.  Hmm.. Where does the kernel hang?  What are the final words w/o initrd?
Comment 16 Yanmin Zhang 2008-11-05 23:55:52 UTC
Then, I built ahci (root disk driver) as module and reboot for 5 times. No hang.

I will switch to the first kernel config file.
Comment 17 Alex Shi 2008-11-06 00:15:16 UTC
sorry for laptop is not in my hand. 
In my memory, in initrd, the first failure is that can not find /dev/root. and then setup root, switchroot all failed. 
Comment 18 Yanmin Zhang 2008-11-06 01:26:23 UTC
I add some debug in script init in initrd. mkrootdev doesn't create /dev/root
while the root partition /dev/sda5 does exists. I will download nash source
codes to add some debugging codes to track command mkrootdev tomorrow.
Comment 19 Tejun Heo 2008-11-06 18:27:46 UTC
Thanks, Yanmin.  It probably is a good idea to cross post to rh bugzilla?
Comment 20 Yanmin Zhang 2008-11-06 19:10:37 UTC
The grub.conf configures the root partition as LABEL=/1. nash debug shows it
fails to get the root device from the LABEL(name convertion failed). If I
change the root partition to /dev/sda1 in the kernel boot parameter line,
system could always boot (I tried for 5 times). 
Comment 21 Yanmin Zhang 2008-11-06 19:13:37 UTC
(In reply to comment #19)
> Thanks, Yanmin.  It probably is a good idea to cross post to rh bugzilla?
> 
Because of comment #20, Perhaps we need stick to kernel and nash before posting to rh bugzilla.
Comment 22 Tejun Heo 2008-11-06 19:58:55 UTC
Well, it's more about who knows rh initrd better rather than who's fault it is.  We could be spending hours here trying to find out why nash has trouble reading label off the disk when rh's initrd might already know it.
Comment 23 Yanmin Zhang 2008-11-06 20:24:09 UTC
Yes, you are right. The key is system could boot with old kernel. I suspect the new kernel doesn't prepare data for /etc/blkid/blkid.tab well before initrd reads it, or kernel and initrd doen't cooperate well sometimes. I'm checking who initiate /etc/blkid/blkid.tab and how to initiate it.
Comment 24 Yanmin Zhang 2008-11-06 21:51:22 UTC
Well, more debugging shows block layer adds /sys/block/sda, but forgets add it to /proc/devices. nash use /proc/devices to find the __type__(here should be disk for sda) of the device. When nash can't find the type, it just omits it. So kernel block layer might doesn't add the device to /proc/devices in time.
Comment 25 Tejun Heo 2008-11-06 22:03:02 UTC
/proc/devices?  That file only lists major -> driver relationship.  If you have DEBUG_BLOCK_EXT_DEVT off, it shouldn't behave any differently.  Does nash still fail at the same point with DEBUG_BLOCK_EXT_DEVT off?
Comment 26 Yanmin Zhang 2008-11-06 22:38:39 UTC
(In reply to comment #25)
> /proc/devices?  That file only lists major -> driver relationship.
I instrumented nash and it gets device type from /proc/devices.


  If you have
> DEBUG_BLOCK_EXT_DEVT off, it shouldn't behave any differently.  Does nash
> still
> fail at the same point with DEBUG_BLOCK_EXT_DEVT off?
My initial failed kernel set DEBUG_BLOCK_EXT_DEVT off. The current debugging kernel enables it. Both kernels fails randomly.

I found now that sometimes kernel also fails when root=/dev/sda1 in boot prarameter line.


I think it's related to BLOCK_EXT feature. when it fails, kernel allocates 259 as the major number for the disk. This is just BLOCK_EXT_MAJOR. If I set root=/dev/sda1, sometimes it can boot and 259 is added to /proc/devices. With my another kernel, the root device major number is 8.
Comment 27 Tejun Heo 2008-11-06 22:49:49 UTC
I don't know how nash handles block device discovery but the behavior being indeterministic is confusing.  If DEBUG_BLOCK_EXT_DEVT is set, all ide and scsi devices will populate major 259, if it's not turned on, nothing should change as long as the number of partitions don't go over the current limits.

How does the kernel fail when root=/dev/sda1 is specified?  Does it fail less frequently than the initrd case?  Do the failures have correlation with DEBUG_BLOCK_EXT_DEVT enabledness?

Thanks.
Comment 28 Yanmin Zhang 2008-11-06 23:15:50 UTC
(In reply to comment #27)
> I don't know how nash handles block device discovery
I just go through the codes of nash today. nash colects device under /sys/block and find the device type from /proc/devices. If not, its subcommand mkblkdevs won't create /dev/root, so later switchroot fails. 

I got a headache and need take a rest. Then, I will double-check it. 

 but the behavior being
> indeterministic is confusing.  If DEBUG_BLOCK_EXT_DEVT is set, all ide and
> scsi
> devices will populate major 259, if it's not turned on, nothing should change
> as long as the number of partitions don't go over the current limits.
> 
> How does the kernel fail when root=/dev/sda1 is specified?
It fails rarely. Mostly, it could boot. But I did hit a boot failure. 

  Does it fail less
> frequently than the initrd case?  Do the failures have correlation with
> DEBUG_BLOCK_EXT_DEVT enabledness?
I don't think so.
Comment 29 Rafael J. Wysocki 2008-11-09 09:55:52 UTC
Notify-Also : Yanmin Zhang <yanmin_zhang@linux.intel.com>

Handled-By : Tejun Heo <tj@kernel.org>
Comment 30 Yanmin Zhang 2008-11-10 17:47:58 UTC
Just some update in case you guys might lose patience.

It looks the issue consists of at least 2 problems:
1) nash doesn't create device node for later devices sometimes;
2) If devices are created before nash searches /sys/block/XXX, and the major device number is 259, nash reports failure to check the device type from /proc/devices. nash has a table definition to probe disk devices for filesystem label (if we define root=LABEL=XXX).

I am busy in a couple of tasks. Pls. let me arrange them. I might communicate with Peter Jones <pjones@redhat.com>, the nash developer.
Comment 31 Tejun Heo 2008-11-10 17:57:16 UTC
Hello,

(In reply to comment #30)
> 1) nash doesn't create device node for later devices sometimes;

Hmm...

> 2) If devices are created before nash searches /sys/block/XXX, and the major
> device number is 259, nash reports failure to check the device type from
> /proc/devices. nash has a table definition to probe disk devices for
> filesystem
> label (if we define root=LABEL=XXX).

If CONFIG_DEBUG_BLOCK_EXT_DEVT is not set, maj 259 is used iff the device has more than 15 partitions.  I don't think nash makes any difference which major number a device gets.

> I am busy in a couple of tasks. Pls. let me arrange them. I might communicate
> with Peter Jones <pjones@redhat.com>, the nash developer.

Thanks.
Comment 32 Yanmin Zhang 2008-11-10 18:25:50 UTC
(In reply to comment #31)
> Hello,
> 
> (In reply to comment #30)
> > 1) nash doesn't create device node for later devices sometimes;
> 
> Hmm...
> 
> > 2) If devices are created before nash searches /sys/block/XXX, and the
> major
> > device number is 259, nash reports failure to check the device type from
> > /proc/devices. nash has a table definition to probe disk devices for
> filesystem
> > label (if we define root=LABEL=XXX).
> 
> If CONFIG_DEBUG_BLOCK_EXT_DEVT is not set, maj 259 is used iff the device has
> more than 15 partitions.  I don't think nash makes any difference which major
> number a device gets.
Here is an executation branch:
1) nash read /sys/block/sda/dev; Assume major is 8 (on my desktop)
2) nash query /proc/devices with the major number; It found line  "8 sd";
3) nash use 'sd' to search its own probe table to find DISK type for the device and add it to its own list;
4) Later on, it probes all devices in its list to get filesystem labels;

scsi register "8 sd" always.

When major is 259, nash fails to find the DISK type.

Let me do more instruments.
Comment 33 Jike Song 2008-11-11 22:05:54 UTC
(In reply to comment #20)
> The grub.conf configures the root partition as LABEL=/1. nash debug shows it
> fails to get the root device from the LABEL(name convertion failed). If I
> change the root partition to /dev/sda1 in the kernel boot parameter line,
> system could always boot (I tried for 5 times). 
> 

Hi Yanmin,

 I have the very problem with vanilla 2.6.28-rc4, Fedora 8 x86-64, HPC NX6325 laptop.  I replaced `LABEL=/1' with `/dev/sda8' in grub.conf, and then Linux boots.  But sometimes resuming from disk still fails, even after replacing `LABEL=SWAP-sda6' with `/dev/sda6' as well as replacing `LABEL=/1' with `/dev/sda8' in /etc/fstab.  

 Any clues?
Comment 34 Yanmin Zhang 2008-11-11 22:26:10 UTC
(In reply to comment #33)
> (In reply to comment #20)
> > The grub.conf configures the root partition as LABEL=/1. nash debug shows
> it
> > fails to get the root device from the LABEL(name convertion failed). If I
> > change the root partition to /dev/sda1 in the kernel boot parameter line,
> > system could always boot (I tried for 5 times). 
> > 
> 
> Hi Yanmin,
> 
>  I have the very problem with vanilla 2.6.28-rc4, Fedora 8 x86-64, HPC NX6325
> laptop.  I replaced `LABEL=/1' with `/dev/sda8' in grub.conf, and then Linux
> boots.
Can you try to boot for many times with root=/dev/sda8?

With root=LABEL=/1, my T61 can't boot. After replacing with root=/dev/sda1, sometimes it can boot, sometimes it can't. Mostly try 5 times and hit once.

I instrumented kernel and nash. The sda1 uevent was sent to the socket queue, but laster on, nash just gets some other uevent and can't get the sda1 ADD uevent. I don't know who stole the sda1 uevent in kernel.


  But sometimes resuming from disk still fails, even after replacing
> `LABEL=SWAP-sda6' with `/dev/sda6' as well as replacing `LABEL=/1' with
> `/dev/sda8' in /etc/fstab.  
> 
>  Any clues?
> 
Comment 35 Jike Song 2008-11-11 22:32:27 UTC
On Wed, Nov 12, 2008 at 2:26 PM,  <bugme-daemon@bugzilla.kernel.org> wrote:
> http://bugzilla.kernel.org/show_bug.cgi?id=11899
>
>
>
>
>
> ------- Comment #34 from yanmin_zhang@linux.intel.com  2008-11-11 22:26
> -------
> (In reply to comment #33)
>> (In reply to comment #20)
>> > The grub.conf configures the root partition as LABEL=/1. nash debug shows
>> it
>> > fails to get the root device from the LABEL(name convertion failed). If I
>> > change the root partition to /dev/sda1 in the kernel boot parameter line,
>> > system could always boot (I tried for 5 times).
>> >
>>
>> Hi Yanmin,
>>
>>  I have the very problem with vanilla 2.6.28-rc4, Fedora 8 x86-64, HPC
>>  NX6325
>> laptop.  I replaced `LABEL=/1' with `/dev/sda8' in grub.conf, and then Linux
>> boots.
> Can you try to boot for many times with root=/dev/sda8?
>
> With root=LABEL=/1, my T61 can't boot. After replacing with root=/dev/sda1,
> sometimes it can boot, sometimes it can't. Mostly try 5 times and hit once.
>

Yes, I did boot with root=/dev/sda8, still gets random failures. The
same as you;-)

> I instrumented kernel and nash. The sda1 uevent was sent to the socket queue,
> but laster on, nash just gets some other uevent and can't get the sda1 ADD
> uevent. I don't know who stole the sda1 uevent in kernel.
>
>
>  But sometimes resuming from disk still fails, even after replacing
>> `LABEL=SWAP-sda6' with `/dev/sda6' as well as replacing `LABEL=/1' with
>> `/dev/sda8' in /etc/fstab.
>>
>>  Any clues?
>>
>
>
> --
> Configure bugmail: http://bugzilla.kernel.org/userprefs.cgi?tab=email
> ------- You are receiving this mail because: -------
> You are on the CC list for the bug, or are watching someone who is.
>
Comment 36 Yanmin Zhang 2008-11-12 01:20:13 UTC
Well, I think I find the root cause why system randomly fails to boot when root/dev/sda1. It's a bug of nash and latest kernel triggers it.

Below statements are about nash source.

In function nashBdevIterNext, 

            case POLLING:
                timeout = iter->timeout;
                if (block_process_one_uevent(iter->nc, &timeout, &node) > 0
                        && node) {
                    *dev = node->bdev;
                    return 1;
                }
                if (speczero(&timeout))
                    iter->state = DONE;
                continue;

block_process_one_uevent might process an event which is not block device, but timeout is also reset to 0, so the loop (bot inner and the caller) will stop and all other uevent are left in kernel queues.
Comment 37 Yanmin Zhang 2008-11-12 01:24:55 UTC
As for why timeout becomes 0 when uevent isn't block device, I think current scheduler in 2.6.28-rc did a process schedule of nash process. When nash is scheduled back, timeout is used up (15usec when mkblkdevs is executed).
Comment 38 Yanmin Zhang 2008-11-12 01:26:31 UTC
Created attachment 18816 [details]
Patch to fix

Here is the patch against mkinitrd-6.0.19 to fix it.
Comment 39 Yanmin Zhang 2008-11-12 01:28:29 UTC
I will fix another issue that when root=LABEL=/1.
Comment 40 Jike Song 2008-11-12 18:48:19 UTC
(In reply to comment #38)
> Created an attachment (id=18816) [details]
> Patch to fix
> 
> Here is the patch against mkinitrd-6.0.19 to fix it.
> 

Yanmin, 

I'm afraid that this fix doesn't work for me.  I downloaded mkinitrd-6.0.19-4.fc8.src.rpm, install and patch it with your fix(as well as 3 patches along with the .src rpm),  and call mkinitrd again:

# mkinitrd -v --preload libata /boot/initrd-2.6.28-rc4.img 2.6.28

After that, booting always fails whether with `root=/dev/sda8' or `root=LABEL=/1'.
Comment 41 Yanmin Zhang 2008-11-12 19:21:55 UTC
(In reply to comment #40)
> (In reply to comment #38)
> > Created an attachment (id=18816) [details] [details]
> > Patch to fix
> > 
> > Here is the patch against mkinitrd-6.0.19 to fix it.
> > 
> 
> Yanmin, 
> 
> I'm afraid that this fix doesn't work for me.  I downloaded
> mkinitrd-6.0.19-4.fc8.src.rpm, install and patch it with your fix(as well as
> 3
> patches along with the .src rpm),  and call mkinitrd again:
> 
> # mkinitrd -v --preload libata /boot/initrd-2.6.28-rc4.img 2.6.28
It seems the commandline isn't correct. You should use 2.6.28-rc4 as kernel version number.

#mkinitrd -v --preload libata /boot/initrd-2.6.28-rc4.img 2.6.28-rc4

> 
> After that, booting always fails whether with `root=/dev/sda8' or
> `root=LABEL=/1'.
Pls. don't use root=LABEL=/1 now. I have a kernel patch and nash patch to fix it.
Comment 42 Jike Song 2008-11-12 19:26:09 UTC
Sure, it's a typo of my post.  In fact '2.6.28' is  'nonexistent' now ;-)

I'm sure I call mkinitrd correctly.

On Thu, Nov 13, 2008 at 11:21 AM,  <bugme-daemon@bugzilla.kernel.org> wrote:
> http://bugzilla.kernel.org/show_bug.cgi?id=11899
>
>
>
>
>
> ------- Comment #41 from yanmin_zhang@linux.intel.com  2008-11-12 19:21
> -------
> (In reply to comment #40)
>> (In reply to comment #38)
>> > Created an attachment (id=18816)
>  --> (http://bugzilla.kernel.org/attachment.cgi?id=18816&action=view)
>  [details] [details]
>> > Patch to fix
>> >
>> > Here is the patch against mkinitrd-6.0.19 to fix it.
>> >
>>
>> Yanmin,
>>
>> I'm afraid that this fix doesn't work for me.  I downloaded
>> mkinitrd-6.0.19-4.fc8.src.rpm, install and patch it with your fix(as well as
>> 3
>> patches along with the .src rpm),  and call mkinitrd again:
>>
>> # mkinitrd -v --preload libata /boot/initrd-2.6.28-rc4.img 2.6.28
> It seems the commandline isn't correct. You should use 2.6.28-rc4 as kernel
> version number.
>
> #mkinitrd -v --preload libata /boot/initrd-2.6.28-rc4.img 2.6.28-rc4
>
>>
>> After that, booting always fails whether with `root=/dev/sda8' or
>> `root=LABEL=/1'.
> Pls. don't use root=LABEL=/1 now. I have a kernel patch and nash patch to fix
> it.
>
>
> --
> Configure bugmail: http://bugzilla.kernel.org/userprefs.cgi?tab=email
> ------- You are receiving this mail because: -------
> You are on the CC list for the bug, or are watching someone who is.
>
Comment 43 Yanmin Zhang 2008-11-12 19:29:32 UTC
Created attachment 18837 [details]
register a blkext block device for MAJOR 259

As for boot failure with root=LABEL=/1, I work out 2 patch.
Here is the first patch for kernel to just register blkext block device for
major 259.

next patch is against nash to add blkext into table proc_dev_info.
Comment 44 Yanmin Zhang 2008-11-12 19:31:20 UTC
Created attachment 18838 [details]
patch against nash to add blkext into table proc_dev_info

The patch shold be applied to nash.
Comment 45 Yanmin Zhang 2008-11-12 19:46:16 UTC
(In reply to comment #42)
> Sure, it's a typo of my post.  In fact '2.6.28' is  'nonexistent' now ;-)
> 
> I'm sure I call mkinitrd correctly.
> 
> On Thu, Nov 13, 2008 at 11:21 AM,  <bugme-daemon@bugzilla.kernel.org> wrote:
> > http://bugzilla.kernel.org/show_bug.cgi?id=11899
> > ------- Comment #41 from yanmin_zhang@linux.intel.com  2008-11-12 19:21
> -------
> > (In reply to comment #40)
> >> (In reply to comment #38)
> >> > Created an attachment (id=18816) [details]
> >  --> (http://bugzilla.kernel.org/attachment.cgi?id=18816&action=view)
> [details] [details]
> >> > Patch to fix
> >> >
> >> > Here is the patch against mkinitrd-6.0.19 to fix it.
> >> >
> >>
> >> Yanmin,
> >>
> >> I'm afraid that this fix doesn't work for me.  I downloaded
> >> mkinitrd-6.0.19-4.fc8.src.rpm, install and patch it with your fix(as well
> as 3

I tried both maunal cpio and command mkinitrd. They all work well to boot my T61.

What's your os version? FedoraCore 8? I have a coulple of patches of both kernel and nash to debug it. I might send you if you want to debug it.

> >> patches along with the .src rpm),  and call mkinitrd again:
> >>
> >> # mkinitrd -v --preload libata /boot/initrd-2.6.28-rc4.img 2.6.28
> > It seems the commandline isn't correct. You should use 2.6.28-rc4 as kernel
> > version number.
> >
> > #mkinitrd -v --preload libata /boot/initrd-2.6.28-rc4.img 2.6.28-rc4
> >
> >>
> >> After that, booting always fails whether with `root=/dev/sda8' or
> >> `root=LABEL=/1'.
> > Pls. don't use root=LABEL=/1 now. I have a kernel patch and nash patch to
> fix
> > it.
> >
>
Comment 46 Jike Song 2008-11-13 18:32:33 UTC
(In reply to comment #45)
> 
> What's your os version? FedoraCore 8? I have a coulple of patches of both
> kernel and nash to debug it. I might send you if you want to debug it.
> 

Aha, with Yanmin's patch applied, I can always boot 2.6.28-rc4 with root=/dev/sda8.  Will check the patch for kernel shortly.
Comment 47 Yanmin Zhang 2008-11-13 19:39:17 UTC
(In reply to comment #46)
> (In reply to comment #45)
> > 
> > What's your os version? FedoraCore 8? I have a coulple of patches of both
> > kernel and nash to debug it. I might send you if you want to debug it.
> > 
> 
> Aha, with Yanmin's patch applied, I can always boot 2.6.28-rc4 with
> root=/dev/sda8.  Will check the patch for kernel shortly.
Thanks Jike.

I created a bug report at https://bugzilla.redhat.com/show_bug.cgi?id=471517.
I ported 2 nash patches to FC9's nash version and posted to redhat bugzilla.
Comment 48 Yanmin Zhang 2008-11-13 19:40:49 UTC
I reproduced the issue on another nehalem machine with FC9. My patches do fix it.

Tejun Heo,

What's your opinion on these patches?

Yanmin
Comment 49 Tejun Heo 2008-11-13 19:57:32 UTC
The kernel part looks fine to me.  Please send it to Jens Axboe <jens.axboe@oracle.com> and cc lkml and me.  For the nash part, I don't have the slightest idea.  Thanks.
Comment 50 Yanmin Zhang 2008-11-13 21:00:21 UTC
Created attachment 18858 [details]
New patch against FC9's nash
Comment 51 Yanmin Zhang 2008-11-13 21:02:34 UTC
Created attachment 18859 [details]
New patch against FC9's nash: against nash to add blkext into table proc_dev_info
Comment 52 Yanmin Zhang 2008-11-13 23:26:57 UTC
Created attachment 18860 [details]
New patch for kernel to register MAJOR 259 as a block device

Thank Tejun Heo and Alexey Dobriyan for their good comments. The new patch moves 
the registration to genhd_device_init.
Comment 53 Rafael J. Wysocki 2008-11-15 15:08:22 UTC
References : http://marc.info/?l=linux-kernel&m=122663989015147&w=4
Comment 54 Rafael J. Wysocki 2008-11-15 15:12:56 UTC
Handled-By : Yanmin Zhang <yanmin_zhang@linux.intel.com>
Patch : http://bugzilla.kernel.org/attachment.cgi?id=18860&action=view

Notify-Also : Tejun Heo <tj@kernel.org>
Notify-Also : Jens Axboe <jens.axboe@oracle.com>
Comment 55 Rafael J. Wysocki 2008-11-22 13:23:24 UTC
Fixed by commit 561ec68e4de7947167937c49c451728e6b19e63b .

Note You need to log in before you can comment on or make changes to this bug.