Bug 6516

Summary: (sata_svw) wrong value for avgqu-sz
Product: IO/Storage Reporter: Vladimir Nicolici (vladnc)
Component: Serial ATAAssignee: Jeff Garzik (jgarzik)
Status: REJECTED UNREPRODUCIBLE    
Severity: normal CC: htejun, protasnb
Priority: P2    
Hardware: i386   
OS: Linux   
Kernel Version: 2.6.16-gentoo-r6 Subsystem:
Regression: --- Bisected commit-id:

Description Vladimir Nicolici 2006-05-08 06:20:43 UTC
[1.] One line summary of the problem:    

	wrong value for avgqu-sz

[2.] Full description of the problem/report:

	I have a linux server with 2 disk controllers: a serverworks sata 
controler, with 2 disks, and a LSI Logic SCSI controller, with 16 disks. 

	The iostat statisics work fine for the 16 disks on the scsi 
controller, but the avgqu-sz keeps growing with each request for the 2 disks 
on the sata controller. Also, for those two disks the %util is always 100%, 
even when the machine is completely idle. This generates false alarms from 
Oracle Enterprise Manager that is monitoring those disks.

	The 2 sata disks are in a md raid1 volume with 2 partitions: the root 
partition and the boot partition;

	The 16 disks on the SCSI controller are used by Oracle ASM, through 
raw devices;

	Except for the broken statistics, the system doesn't seem to have any 
other problems, but I am afraid that it will crash once it's deployed in 
production, and avgqu-sz will reach a very large value.

	See [7.7.] for a sample iostat output.

[3.] Keywords (i.e., modules, networking, kernel):

	sata_svw 2.6.16

[4.] Kernel version (from /proc/version):

	Linux version 2.6.16-gentoo-r6-dio-patch (root@infocost2) (gcc version 
3.4.4 (Gentoo 3.4.4-r1, ssp-3.4.4-1.0, pie-8.7.8)) #1 SMP Sun May 7 10:25:15 
EEST 2006

[5.] Output of Oops.. message (if applicable) with symbolic information 
resolved (see Documentation/oops-tracing.txt)

	N/A

[6.] A small shell script or example program which triggers the problem (if 
possible)

	iostat -x 1

[7.] Environment

infocost2 scripts # env
MANPATH=/usr/local/share/man:/usr/share/man:/usr/share/binutils-data/x86_64-pc-
linux-gnu/2.16.1/man:/usr/share/gcc-data/x86_64-pc-linux-gnu/3.4.4/man
HOSTNAME=infocost2
TERM=xterm
SHELL=/bin/bash
SSH_CLIENT=10.103.3.70 3363 22
SSH_TTY=/dev/pts/1
USER=root
PAGER=/usr/bin/less
CONFIG_PROTECT_MASK=/etc/terminfo
MAIL=/var/mail/root
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/bin:/usr
/x86_64-pc-linux-gnu/gcc-bin/3.4.4
PWD=/usr/src/linux/scripts
EDITOR=/bin/nano
SHLVL=1
HOME=/root
LESS=-R -M --shift 5
PYTHONPATH=/usr/lib/portage/pym
LOGNAME=root
CVS_RSH=ssh
GCC_SPECS=
SSH_CONNECTION=10.103.3.70 3363 172.16.253.28 22
LESSOPEN=|lesspipe.sh %s
INFOPATH=/usr/share/info:/usr/share/binutils-data/x86_64-pc-linux-
gnu/2.16.1/info:/usr/share/gcc-data/x86_64-pc-linux-gnu/3.4.4/info
G_BROKEN_FILENAMES=1
_=/usr/bin/env
OLDPWD=/root
infocost2 scripts # set
BASH=/bin/bash
BASH_ARGC=()
BASH_ARGV=()
BASH_LINENO=()
BASH_SOURCE=()
BASH_VERSINFO=([0]="3" [1]="00" [2]="16" [3]="1" [4]="release" [5]="x86_64-pc-
linux-gnu")
BASH_VERSION='3.00.16(1)-release'
COLUMNS=157
CONFIG_PROTECT_MASK=/etc/terminfo
CVS_RSH=ssh
DIRSTACK=()
EDITOR=/bin/nano
EUID=0
GCC_SPECS=
GROUPS=()
G_BROKEN_FILENAMES=1
HISTFILE=/root/.bash_history
HISTFILESIZE=500
HISTSIZE=500
HOME=/root
HOSTNAME=infocost2
HOSTTYPE=x86_64
IFS=$' \t\n'
INFOPATH=/usr/share/info:/usr/share/binutils-data/x86_64-pc-linux-
gnu/2.16.1/info:/usr/share/gcc-data/x86_64-pc-linux-gnu/3.4.4/info
LESS='-R -M --shift 5'
LESSOPEN='|lesspipe.sh %s'
LINES=58
LOGNAME=root
MACHTYPE=x86_64-pc-linux-gnu
MAIL=/var/mail/root
MAILCHECK=60
MANPATH=/usr/local/share/man:/usr/share/man:/usr/share/binutils-data/x86_64-pc-
linux-gnu/2.16.1/man:/usr/share/gcc-data/x86_64-pc-linux-gnu/3.4.4/man
MC_ENV=/usr/share/mc/bin/mc.sh
OLDPWD=/root
OPTERR=1
OPTIND=1
OSTYPE=linux-gnu
PAGER=/usr/bin/less
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/bin:/usr
/x86_64-pc-linux-gnu/gcc-bin/3.4.4
PIPESTATUS=([0]="0")
PPID=12089
PS1='\[\033[01;31m\]\h\[\033[01;34m\] \W \$\[\033[00m\] '
PS2='> '
PS4='+ '
PWD=/usr/src/linux/scripts
PYTHONPATH=/usr/lib/portage/pym
SHELL=/bin/bash
SHELLOPTS=braceexpand:emacs:hashall:histexpand:history:interactive-
comments:monitor
SHLVL=1
SSH_CLIENT='10.103.3.70 3363 22'
SSH_CONNECTION='10.103.3.70 3363 172.16.253.28 22'
SSH_TTY=/dev/pts/1
TERM=xterm
UID=0
USER=root
_=env
i=/usr/share/mc/bin/mc.sh
infocost2 scripts #

[7.1.] Software (add the output of the ver_linux script here)

If some fields are empty or look unusual you may have an old version.
Compare to the current minimal requirements in Documentation/Changes.

Linux infocost2 2.6.16-gentoo-r6-dio-patch #1 SMP Sun May 7 10:25:15 EEST 2006 
x86_64 Dual Core AMD Opteron(tm) Processor 270 AuthenticAMD GNU/Linux

Gnu C                  3.4.4
Gnu make               3.80
binutils               2.16.1
util-linux             2.12r
mount                  2.12r
module-init-tools      3.0
e2fsprogs              1.38
reiserfsprogs          line
reiser4progs           line
xfsprogs               2.7.3
Linux C Library        2.3.5
Dynamic linker (ldd)   2.3.5
Procps                 3.2.5
Net-tools              1.60
Kbd                    1.12
Sh-utils               5.2.1
udev                   079
Modules Loaded         raw tg3 mptspi mptscsih mptbase serverworks sata_svw 
libata

[7.2.] Processor information (from /proc/cpuinfo):

processor       : 0
vendor_id       : AuthenticAMD
cpu family      : 15
model           : 33
model name      : Dual Core AMD Opteron(tm) Processor 270
stepping        : 2
cpu MHz         : 1995.070
cache size      : 1024 KB
physical id     : 0
siblings        : 2
core id         : 0
cpu cores       : 2
fpu             : yes
fpu_exception   : yes
cpuid level     : 1
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca 
cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt lm 
3dnowext 3dnow pni lahf_lm cmp_legacy
bogomips        : 3998.81
TLB size        : 1024 4K pages
clflush size    : 64
cache_alignment : 64
address sizes   : 40 bits physical, 48 bits virtual
power management: ts fid vid ttp

processor       : 1
vendor_id       : AuthenticAMD
cpu family      : 15
model           : 33
model name      : Dual Core AMD Opteron(tm) Processor 270
stepping        : 2
cpu MHz         : 1995.070
cache size      : 1024 KB
physical id     : 0
siblings        : 2
core id         : 1
cpu cores       : 2
fpu             : yes
fpu_exception   : yes
cpuid level     : 1
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca 
cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt lm 
3dnowext 3dnow pni lahf_lm cmp_legacy
bogomips        : 3990.37
TLB size        : 1024 4K pages
clflush size    : 64
cache_alignment : 64
address sizes   : 40 bits physical, 48 bits virtual
power management: ts fid vid ttp

processor       : 2
vendor_id       : AuthenticAMD
cpu family      : 15
model           : 33
model name      : Dual Core AMD Opteron(tm) Processor 270
stepping        : 2
cpu MHz         : 1995.070
cache size      : 1024 KB
physical id     : 1
siblings        : 2
core id         : 0
cpu cores       : 2
fpu             : yes
fpu_exception   : yes
cpuid level     : 1
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca 
cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt lm 
3dnowext 3dnow pni lahf_lm cmp_legacy
bogomips        : 3990.34
TLB size        : 1024 4K pages
clflush size    : 64
cache_alignment : 64
address sizes   : 40 bits physical, 48 bits virtual
power management: ts fid vid ttp

processor       : 3
vendor_id       : AuthenticAMD
cpu family      : 15
model           : 33
model name      : Dual Core AMD Opteron(tm) Processor 270
stepping        : 2
cpu MHz         : 1995.070
cache size      : 1024 KB
physical id     : 1
siblings        : 2
core id         : 1
cpu cores       : 2
fpu             : yes
fpu_exception   : yes
cpuid level     : 1
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca 
cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt lm 
3dnowext 3dnow pni lahf_lm cmp_legacy
bogomips        : 3990.33
TLB size        : 1024 4K pages
clflush size    : 64
cache_alignment : 64
address sizes   : 40 bits physical, 48 bits virtual
power management: ts fid vid ttp

[7.3.] Module information (from /proc/modules):

raw 12256 199 - Live 0xffffffff88053000
tg3 102724 0 - Live 0xffffffff88038000
mptspi 11080 16 - Live 0xffffffff88034000
mptscsih 40384 1 mptspi, Live 0xffffffff88029000
mptbase 55456 2 mptspi,mptscsih, Live 0xffffffff8801a000
serverworks 10064 0 [permanent], Live 0xffffffff88016000
sata_svw 9604 4 - Live 0xffffffff88012000
libata 65944 1 sata_svw, Live 0xffffffff88000000

[7.4.] Loaded driver and hardware information (/proc/ioports, /proc/iomem)

infocost2 scripts # cat /proc/ioports
0000-001f : dma1
0020-0021 : pic1
0040-0043 : timer0
0050-0053 : timer1
0060-006f : keyboard
0070-0077 : rtc
0080-008f : dma page reg
00a0-00a1 : pic2
00c0-00df : dma2
00f0-00ff : fpu
01f0-01f7 : ide0
03c0-03df : vga+
03f6-03f6 : ide0
03f8-03ff : serial
0500-0503 : PM1a_EVT_BLK
0504-0505 : PM1a_CNT_BLK
0508-050b : PM_TMR
0514-051b : GPE0_BLK
0540-0543 : PM1b_EVT_BLK
0544-0545 : PM1b_CNT_BLK
0550-0557 : GPE1_BLK
0cf8-0cff : PCI conf1
5010-5015 : ACPI CPU throttle
7000-8fff : PCI Bus #01
  7800-780f : 0000:01:0e.1
  7880-7883 : 0000:01:0e.1
  7c00-7c07 : 0000:01:0e.1
  8000-8003 : 0000:01:0e.1
  8080-8087 : 0000:01:0e.1
  8400-840f : 0000:01:0e.0
    8400-840f : sata_svw
  8480-8483 : 0000:01:0e.0
    8480-8483 : sata_svw
  8800-8807 : 0000:01:0e.0
    8800-8807 : sata_svw
  8880-8883 : 0000:01:0e.0
    8880-8883 : sata_svw
  8c00-8c07 : 0000:01:0e.0
    8c00-8c07 : sata_svw
9000-bfff : PCI Bus #03
  b000-b0ff : 0000:03:06.0
d400-d4ff : 0000:00:03.2
d800-d8ff : 0000:00:03.1
e000-e0ff : 0000:00:05.0
e800-e8ff : 0000:00:03.0
ffa0-ffaf : 0000:00:02.1

infocost2 scripts # cat /proc/iomem
00000000-0009fbff : System RAM
0009fc00-0009ffff : reserved
000a0000-000bffff : Video RAM area
000c0000-000c7fff : Video ROM
000ca000-000cdfff : Adapter ROM
000f0000-000fffff : System ROM
00100000-fbfeffff : System RAM
  00100000-003d1353 : Kernel code
  003d1354-004d4877 : Kernel data
fbff0000-fbffdfff : ACPI Tables
fbffe000-fbffffff : ACPI Non-volatile Storage
fc000000-fc0fffff : PCI Bus #01
  fc0c0000-fc0dffff : 0000:01:0e.0
  fc0fe000-fc0fffff : 0000:01:0e.0
    fc0fe000-fc0fffff : sata_svw
fc100000-fc9fffff : PCI Bus #03
  fc400000-fc7fffff : 0000:03:06.0
  fc9c0000-fc9dffff : 0000:03:06.0
  fc9e0000-fc9fffff : 0000:03:06.0
fca00000-fcafffff : PCI Bus #04
  fcac0000-fcacffff : 0000:04:04.1
    fcac0000-fcacffff : tg3
  fcad0000-fcadffff : 0000:04:04.1
    fcad0000-fcadffff : tg3
  fcae0000-fcaeffff : 0000:04:04.0
    fcae0000-fcaeffff : tg3
  fcaf0000-fcafffff : 0000:04:04.0
    fcaf0000-fcafffff : tg3
fd000000-fdffffff : 0000:00:05.0
febc0000-febdffff : 0000:00:05.0
febfb000-febfbfff : 0000:00:03.2
febfc000-febfcfff : 0000:00:03.1
febfd000-febfdfff : 0000:00:03.0
febff000-febfffff : 0000:00:05.0
fec00000-fec02fff : reserved
fee00000-fee00fff : reserved
ff400000-ff4fffff : PCI Bus #03
ff500000-ff5fffff : PCI Bus #04
ff700000-ffffffff : reserved


[7.5.] PCI information ('lspci -vvv' as root)

00:01.0 PCI bridge: Broadcom HT1000 PCI/PCI-X bridge (prog-if 00 [Normal 
decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-
        Latency: 64
        Bus: primary=00, secondary=01, subordinate=02, sec-latency=64
        I/O behind bridge: 00007000-00008fff
        Memory behind bridge: fc000000-fc0fffff
        Prefetchable memory behind bridge: 00000000fff00000-0000000000000000
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=slow >TAbort- <TAbort-
 <MAbort+ <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA+ VGA- MAbort- >Reset- FastB2B-
        Capabilities: [90] PCI-X bridge device
                Secondary Status: 64bit+ 133MHz+ SCD- USC- SCO- SRD- 
Freq=133MHz
                Status: Dev=00:01.0 64bit- 133MHz- SCD- USC- SCO- SRD-
                Upstream: Capacity=0 CommitmentLimit=0
                Downstream: Capacity=0 CommitmentLimit=0
        Capabilities: [a0] HyperTransport: MSI Mapping
        Capabilities: [b0] HyperTransport: Slave or Primary Interface
                Command: BaseUnitID=1 UnitCnt=3 MastHost- DefDir-
                Link Control 0: CFlE- CST- CFE- <LkFail- Init+ EOC- TXO- 
<CRCErr=0
                Link Config 0: MLWI=8bit MLWO=8bit LWI=8bit LWO=8bit
                Link Control 1: CFlE- CST- CFE- <LkFail- Init- EOC+ TXO+ 
<CRCErr=0
                Link Config 1: MLWI=8bit MLWO=8bit LWI=N/C LWO=N/C
                Revision ID: 0.00

00:02.0 Host bridge: Broadcom HT1000 Legacy South Bridge
        Subsystem: Broadcom Unknown device 0201
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR+ FastB2B-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR-
        Latency: 64

00:02.1 IDE interface: Broadcom HT1000 Legacy IDE controller (prog-if 8a 
[Master SecP PriP])
        Subsystem: Broadcom HT1000 Legacy IDE controller
        Control: I/O+ Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR-
        Latency: 64, Cache Line Size 10
        Region 0: I/O ports at <ignored>
        Region 1: I/O ports at <ignored>
        Region 2: I/O ports at <ignored>
        Region 3: I/O ports at <ignored>
        Region 4: I/O ports at ffa0 [size=16]

00:02.2 ISA bridge: Broadcom HT1000 LPC Bridge
        Subsystem: Broadcom Unknown device 0230
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR+ FastB2B-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR-
        Latency: 0

00:03.0 USB Controller: Broadcom HT1000 USB Controller (rev 01) (prog-if 10 
[OHCI])
        Subsystem: Broadcom HT1000 USB Controller
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- 
Stepping- SERR+ FastB2B-
        Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR-
        Latency: 64, Cache Line Size 10
        Interrupt: pin A routed to IRQ 10
        Region 0: Memory at febfd000 (32-bit, non-prefetchable) [size=4K]
        Region 1: I/O ports at e800 [size=256]
        Capabilities: [dc] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-
,D3hot-,D3cold-)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-
                Bridge: PM- B3+

00:03.1 USB Controller: Broadcom HT1000 USB Controller (rev 01) (prog-if 10 
[OHCI])
        Subsystem: Broadcom HT1000 USB Controller
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- 
Stepping- SERR+ FastB2B-
        Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR-
        Latency: 64, Cache Line Size 10
        Interrupt: pin A routed to IRQ 10
        Region 0: Memory at febfc000 (32-bit, non-prefetchable) [size=4K]
        Region 1: I/O ports at d800 [size=256]
        Capabilities: [dc] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-
,D3hot-,D3cold-)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-
                Bridge: PM- B3+

00:03.2 USB Controller: Broadcom HT1000 USB Controller (rev 01) (prog-if 20 
[EHCI])
        Subsystem: Broadcom HT1000 USB Controller
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- 
Stepping- SERR+ FastB2B-
        Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR-
        Latency: 64, Cache Line Size 10
        Interrupt: pin A routed to IRQ 10
        Region 0: Memory at febfb000 (32-bit, non-prefetchable) [size=4K]
        Region 1: I/O ports at d400 [size=256]
        Capabilities: [dc] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME
(D0+,D1+,D2+,D3hot+,D3cold-)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-
                Bridge: PM- B3+

00:05.0 VGA compatible controller: ATI Technologies Inc Rage XL (rev 27) (prog-
if 00 [VGA])
        Subsystem: ATI Technologies Inc Rage XL
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping+ SERR- FastB2B-
        Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR-
        Latency: 64 (2000ns min), Cache Line Size 10
        Interrupt: pin A routed to IRQ 0
        Region 0: Memory at fd000000 (32-bit, non-prefetchable) [size=16M]
        Region 1: I/O ports at e000 [size=256]
        Region 2: Memory at febff000 (32-bit, non-prefetchable) [size=4K]
        Expansion ROM at febc0000 [disabled] [size=128K]
        Capabilities: [5c] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-
,D3hot-,D3cold-)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-

00:08.0 PCI bridge: Broadcom HT1000 PCI-X bridge (rev a3) (prog-if 00 [Normal 
decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-
        Latency: 64
        Bus: primary=00, secondary=03, subordinate=03, sec-latency=64
        I/O behind bridge: 00009000-0000bfff
        Memory behind bridge: fc100000-fc9fffff
        Prefetchable memory behind bridge: 00000000ff400000-00000000ff400000
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA+ VGA- MAbort- >Reset- FastB2B-
        Capabilities: [90] PCI-X bridge device
                Secondary Status: 64bit+ 133MHz+ SCD- USC- SCO- SRD- 
Freq=133MHz
                Status: Dev=00:08.0 64bit- 133MHz- SCD- USC- SCO- SRD-
                Upstream: Capacity=0 CommitmentLimit=0
                Downstream: Capacity=0 CommitmentLimit=0
        Capabilities: [a0] HyperTransport: MSI Mapping
        Capabilities: [b0] HyperTransport: Slave or Primary Interface
                Command: BaseUnitID=8 UnitCnt=6 MastHost- DefDir-
                Link Control 0: CFlE- CST- CFE- <LkFail- Init+ EOC- TXO- 
<CRCErr=0
                Link Config 0: MLWI=16bit MLWO=16bit LWI=16bit LWO=16bit
                Link Control 1: CFlE- CST- CFE- <LkFail- Init+ EOC- TXO- 
<CRCErr=0
                Link Config 1: MLWI=8bit MLWO=8bit LWI=8bit LWO=8bit
                Revision ID: 0.00

00:09.0 PCI bridge: Broadcom HT1000 PCI-X bridge (rev a3) (prog-if 00 [Normal 
decode])
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-
        Latency: 64
        Bus: primary=00, secondary=04, subordinate=04, sec-latency=64
        I/O behind bridge: 0000f000-00000fff
        Memory behind bridge: fca00000-fcafffff
        Prefetchable memory behind bridge: 00000000ff500000-00000000ff500000
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=slow >TAbort- <TAbort-
 <MAbort+ <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA+ VGA- MAbort- >Reset- FastB2B-
        Capabilities: [90] PCI-X bridge device
                Secondary Status: 64bit+ 133MHz+ SCD- USC- SCO- SRD- 
Freq=133MHz
                Status: Dev=00:09.0 64bit- 133MHz- SCD- USC- SCO- SRD-
                Upstream: Capacity=0 CommitmentLimit=0
                Downstream: Capacity=0 CommitmentLimit=0
        Capabilities: [a0] HyperTransport: MSI Mapping

00:0a.0 PCI bridge: Broadcom HT1000 PCI-Express bridge (rev a3) (prog-if 00 
[Normal decode])
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-
        Latency: 0
        Bus: primary=00, secondary=05, subordinate=05, sec-latency=64
        I/O behind bridge: 0000f000-00000fff
        Memory behind bridge: fff00000-000fffff
        Prefetchable memory behind bridge: 00000000fff00000-0000000000000000
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA+ VGA- MAbort- >Reset- FastB2B-
        Capabilities: [a0] HyperTransport: MSI Mapping
        Capabilities: [b0] Express Root Port (Slot-) IRQ 0
                Device: Supported: MaxPayload 512 bytes, PhantFunc 0, ExtTag-
                Device: Latency L0s <4us, L1 <16us
                Device: Errors: Correctable- Non-Fatal- Fatal- Unsupported-
                Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                Device: MaxPayload 128 bytes, MaxReadReq 128 bytes
                Link: Supported Speed 2.5Gb/s, Width x8, ASPM L0s L1, Port 1
                Link: Latency L0s <4us, L1 <16us
                Link: ASPM Disabled RCB 128 bytes CommClk- ExtSynch-
                Link: Speed 2.5Gb/s, Width x8
                Root: Correctable- Non-Fatal- Fatal- PME-

00:0b.0 PCI bridge: Broadcom HT1000 PCI-Express bridge (rev a3) (prog-if 00 
[Normal decode])
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-
        Latency: 0
        Bus: primary=00, secondary=06, subordinate=06, sec-latency=64
        I/O behind bridge: 0000f000-00000fff
        Memory behind bridge: fff00000-000fffff
        Prefetchable memory behind bridge: 00000000fff00000-0000000000000000
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA+ VGA- MAbort- >Reset- FastB2B-
        Capabilities: [a0] HyperTransport: MSI Mapping
        Capabilities: [b0] Express Root Port (Slot-) IRQ 0
                Device: Supported: MaxPayload 512 bytes, PhantFunc 0, ExtTag-
                Device: Latency L0s <4us, L1 <16us
                Device: Errors: Correctable- Non-Fatal- Fatal- Unsupported-
                Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                Device: MaxPayload 128 bytes, MaxReadReq 128 bytes
                Link: Supported Speed 2.5Gb/s, Width x4, ASPM L0s L1, Port 2
                Link: Latency L0s <4us, L1 <16us
                Link: ASPM Disabled RCB 128 bytes CommClk- ExtSynch-
                Link: Speed 2.5Gb/s, Width x4
                Root: Correctable- Non-Fatal- Fatal- PME-

00:0c.0 PCI bridge: Broadcom HT1000 PCI-Express bridge (rev a3) (prog-if 00 
[Normal decode])
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-
        Latency: 0
        Bus: primary=00, secondary=07, subordinate=07, sec-latency=64
        I/O behind bridge: 0000f000-00000fff
        Memory behind bridge: fff00000-000fffff
        Prefetchable memory behind bridge: 00000000fff00000-0000000000000000
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA+ VGA- MAbort- >Reset- FastB2B-
        Capabilities: [a0] HyperTransport: MSI Mapping
        Capabilities: [b0] Express Root Port (Slot-) IRQ 0
                Device: Supported: MaxPayload 512 bytes, PhantFunc 0, ExtTag-
                Device: Latency L0s <4us, L1 <16us
                Device: Errors: Correctable- Non-Fatal- Fatal- Unsupported-
                Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                Device: MaxPayload 128 bytes, MaxReadReq 128 bytes
                Link: Supported Speed 2.5Gb/s, Width x8, ASPM L0s L1, Port 3
                Link: Latency L0s <4us, L1 <16us
                Link: ASPM Disabled RCB 128 bytes CommClk- ExtSynch-
                Link: Speed 2.5Gb/s, Width x8
                Root: Correctable- Non-Fatal- Fatal- PME-

00:0d.0 PCI bridge: Broadcom HT1000 PCI-Express bridge (rev a3) (prog-if 00 
[Normal decode])
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-
        Latency: 0
        Bus: primary=00, secondary=08, subordinate=08, sec-latency=64
        I/O behind bridge: 0000f000-00000fff
        Memory behind bridge: fff00000-000fffff
        Prefetchable memory behind bridge: 00000000fff00000-0000000000000000
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA+ VGA- MAbort- >Reset- FastB2B-
        Capabilities: [a0] HyperTransport: MSI Mapping
        Capabilities: [b0] Express Root Port (Slot-) IRQ 0
                Device: Supported: MaxPayload 512 bytes, PhantFunc 0, ExtTag-
                Device: Latency L0s <4us, L1 <16us
                Device: Errors: Correctable- Non-Fatal- Fatal- Unsupported-
                Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                Device: MaxPayload 128 bytes, MaxReadReq 128 bytes
                Link: Supported Speed 2.5Gb/s, Width x4, ASPM L0s L1, Port 4
                Link: Latency L0s <4us, L1 <16us
                Link: ASPM Disabled RCB 128 bytes CommClk- ExtSynch-
                Link: Speed 2.5Gb/s, Width x4
                Root: Correctable- Non-Fatal- Fatal- PME-

00:18.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] 
HyperTransport Technology Configuration
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-
        Capabilities: [80] HyperTransport: Host or Secondary Interface
                !!! Possibly incomplete decoding
                Command: WarmRst+ DblEnd-
                Link Control: CFlE- CST- CFE- <LkFail- Init+ EOC- TXO- 
<CRCErr=0
                Link Config: MLWI=16bit MLWO=16bit LWI=16bit LWO=16bit
                Revision ID: 1.02
        Capabilities: [a0] HyperTransport: Host or Secondary Interface
                !!! Possibly incomplete decoding
                Command: WarmRst+ DblEnd-
                Link Control: CFlE- CST- CFE- <LkFail- Init+ EOC- TXO- 
<CRCErr=0
                Link Config: MLWI=16bit MLWO=16bit LWI=16bit LWO=16bit
                Revision ID: 1.02
        Capabilities: [c0] HyperTransport: Host or Secondary Interface
                !!! Possibly incomplete decoding
                Command: WarmRst+ DblEnd-
                Link Control: CFlE- CST- CFE- <LkFail- Init+ EOC- TXO- 
<CRCErr=0
                Link Config: MLWI=16bit MLWO=16bit LWI=16bit LWO=16bit
                Revision ID: 1.02

00:18.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] 
Address Map
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-

00:18.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM 
Controller
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-

00:18.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] 
Miscellaneous Control
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-

00:19.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] 
HyperTransport Technology Configuration
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-
        Capabilities: [80] HyperTransport: Host or Secondary Interface
                !!! Possibly incomplete decoding
                Command: WarmRst+ DblEnd-
                Link Control: CFlE- CST- CFE- <LkFail- Init+ EOC- TXO- 
<CRCErr=0
                Link Config: MLWI=16bit MLWO=16bit LWI=16bit LWO=16bit
                Revision ID: 1.02
        Capabilities: [a0] HyperTransport: Host or Secondary Interface
                !!! Possibly incomplete decoding
                Command: WarmRst+ DblEnd-
                Link Control: CFlE- CST- CFE- <LkFail+ Init- EOC+ TXO+ 
<CRCErr=0
                Link Config: MLWI=16bit MLWO=16bit LWI=N/C LWO=N/C
                Revision ID: 1.02
        Capabilities: [c0] HyperTransport: Host or Secondary Interface
                !!! Possibly incomplete decoding
                Command: WarmRst+ DblEnd-
                Link Control: CFlE- CST- CFE- <LkFail- Init+ EOC- TXO- 
<CRCErr=0
                Link Config: MLWI=16bit MLWO=16bit LWI=16bit LWO=16bit
                Revision ID: 1.02

00:19.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] 
Address Map
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-

00:19.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM 
Controller
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-

00:19.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] 
Miscellaneous Control
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort-
 <MAbort- >SERR- <PERR-

01:0d.0 PCI bridge: Broadcom HT1000 PCI/PCI-X bridge (rev b2) (prog-if 00 
[Normal decode])
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- 
Stepping- SERR- FastB2B-
        Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR-
        Latency: 64, Cache Line Size 10
        Bus: primary=01, secondary=02, subordinate=02, sec-latency=64
        I/O behind bridge: 0000f000-00000fff
        Memory behind bridge: fff00000-000fffff
        Prefetchable memory behind bridge: 00000000fff00000-0000000000000000
        Secondary status: 66MHz+ FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort+ <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA+ VGA- MAbort- >Reset- FastB2B-
        Capabilities: [90] PCI-X bridge device
                Secondary Status: 64bit+ 133MHz+ SCD- USC- SCO- SRD- Freq=conv
                Status: Dev=01:0d.0 64bit+ 133MHz+ SCD- USC- SCO- SRD-
                Upstream: Capacity=8 CommitmentLimit=8
                Downstream: Capacity=8 CommitmentLimit=8

01:0e.0 IDE interface: Broadcom Unknown device 024b (prog-if 8f [Master SecP 
SecO PriP PriO])
        Subsystem: Broadcom Unknown device 024b
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR+ FastB2B-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR-
        Latency: 64
        Interrupt: pin A routed to IRQ 11
        Region 0: I/O ports at 8c00 [size=8]
        Region 1: I/O ports at 8880 [size=4]
        Region 2: I/O ports at 8800 [size=8]
        Region 3: I/O ports at 8480 [size=4]
        Region 4: I/O ports at 8400 [size=16]
        Region 5: Memory at fc0fe000 (32-bit, non-prefetchable) [size=8K]
        Expansion ROM at fc0c0000 [disabled] [size=128K]
        Capabilities: [60] PCI-X non-bridge device
                Command: DPERE- ERO- RBC=512 OST=8
                Status: Dev=01:0e.0 64bit+ 133MHz+ SCD- USC- DC=simple 
DMMRBC=512 DMOST=8 DMCRS=32 RSCEM- 266MHz- 533MHz-
        Capabilities: [90] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-
,D3hot-,D3cold-)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [a0] Message Signalled Interrupts: 64bit- Queue=0/0 
Enable-
                Address: 00000000  Data: 0000

01:0e.1 IDE interface: Broadcom Unknown device 024b (prog-if 8f [Master SecP 
SecO PriP PriO])
        Subsystem: Broadcom Unknown device 024b
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR+ FastB2B-
        Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR-
        Latency: 64
        Interrupt: pin A routed to IRQ 11
        Region 0: I/O ports at 8080 [size=8]
        Region 1: I/O ports at 8000 [size=4]
        Region 2: I/O ports at 7c00 [size=8]
        Region 3: I/O ports at 7880 [size=4]
        Region 4: I/O ports at 7800 [size=16]
        Capabilities: [60] PCI-X non-bridge device
                Command: DPERE- ERO- RBC=512 OST=8
                Status: Dev=01:0e.0 64bit+ 133MHz+ SCD- USC- DC=simple 
DMMRBC=512 DMOST=8 DMCRS=32 RSCEM- 266MHz- 533MHz-
        Capabilities: [90] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-
,D3hot-,D3cold-)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [a0] Message Signalled Interrupts: 64bit- Queue=0/0 
Enable-
                Address: 00000000  Data: 0000

03:06.0 SCSI storage controller: LSI Logic / Symbios Logic 53c1030 PCI-X 
Fusion-MPT Dual Ultra320 SCSI (rev 08)
        Subsystem: LSI Logic / Symbios Logic Unknown device 1060
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- 
Stepping- SERR+ FastB2B-
        Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR-
        Latency: 72 (4000ns min, 1500ns max), Cache Line Size 10
        Interrupt: pin A routed to IRQ 16
        Region 0: I/O ports at b000 [size=256]
        Region 1: Memory at fc9e0000 (64-bit, non-prefetchable) [size=128K]
        Region 3: Memory at fc9c0000 (64-bit, non-prefetchable) [size=128K]
        Expansion ROM at fc400000 [disabled] [size=4M]
        Capabilities: [50] Power Management version 2
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-
,D3hot-,D3cold-)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [58] Message Signalled Interrupts: 64bit+ Queue=0/0 
Enable-
                Address: 0000000000000000  Data: 0000
        Capabilities: [68] PCI-X non-bridge device
                Command: DPERE- ERO- RBC=512 OST=8
                Status: Dev=03:06.0 64bit+ 133MHz+ SCD- USC- DC=simple 
DMMRBC=2048 DMOST=8 DMCRS=16 RSCEM- 266MHz- 533MHz-

04:04.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5780 Gigabit 
Ethernet (rev 03)
        Subsystem: Super Micro Computer Inc Unknown device 166a
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR+ FastB2B-
        Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR-
        Latency: 64 (16000ns min), Cache Line Size 10
        Interrupt: pin A routed to IRQ 17
        Region 0: Memory at fcaf0000 (64-bit, non-prefetchable) [size=64K]
        Region 2: Memory at fcae0000 (64-bit, non-prefetchable) [size=64K]
        Capabilities: [40] PCI-X non-bridge device
                Command: DPERE- ERO- RBC=512 OST=1
                Status: Dev=04:04.0 64bit+ 133MHz+ SCD- USC- DC=simple 
DMMRBC=2048 DMOST=1 DMCRS=16 RSCEM- 266MHz- 533MHz-
        Capabilities: [48] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-
,D3hot+,D3cold+)
                Status: D0 PME-Enable+ DSel=0 DScale=1 PME-
        Capabilities: [50] Vital Product Data
        Capabilities: [58] Message Signalled Interrupts: 64bit+ Queue=0/3 
Enable-
                Address: 0000000802010020  Data: 0000

04:04.1 Ethernet controller: Broadcom Corporation NetXtreme BCM5780 Gigabit 
Ethernet (rev 03)
        Subsystem: Super Micro Computer Inc Unknown device 166a
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- 
Stepping- SERR+ FastB2B-
        Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- 
<TAbort- <MAbort- >SERR- <PERR-
        Latency: 64 (16000ns min), Cache Line Size 10
        Interrupt: pin B routed to IRQ 18
        Region 0: Memory at fcad0000 (64-bit, non-prefetchable) [size=64K]
        Region 2: Memory at fcac0000 (64-bit, non-prefetchable) [size=64K]
        Capabilities: [40] PCI-X non-bridge device
                Command: DPERE- ERO+ RBC=512 OST=1
                Status: Dev=04:04.1 64bit+ 133MHz+ SCD- USC- DC=simple 
DMMRBC=2048 DMOST=1 DMCRS=16 RSCEM- 266MHz- 533MHz-
        Capabilities: [48] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-
,D3hot+,D3cold+)
                Status: D0 PME-Enable- DSel=0 DScale=1 PME-
        Capabilities: [50] Vital Product Data
        Capabilities: [58] Message Signalled Interrupts: 64bit+ Queue=0/3 
Enable-
                Address: 0000000080000050  Data: 0080

[7.6.] SCSI information (from /proc/scsi/scsi)

Attached devices:
Host: scsi0 Channel: 00 Id: 00 Lun: 00
  Vendor: ATA      Model: WDC WD740GD-00FL Rev: 33.0
  Type:   Direct-Access                    ANSI SCSI revision: 05
Host: scsi1 Channel: 00 Id: 00 Lun: 00
  Vendor: ATA      Model: WDC WD740GD-00FL Rev: 33.0
  Type:   Direct-Access                    ANSI SCSI revision: 05
Host: scsi4 Channel: 00 Id: 00 Lun: 00
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 01
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 02
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 03
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 04
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 05
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 06
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 07
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 08
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 09
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 10
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 11
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 12
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 13
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 14
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03
Host: scsi4 Channel: 00 Id: 00 Lun: 15
  Vendor: WDC WD25 Model: 00JS-60MHB1      Rev: R0.0
  Type:   Direct-Access                    ANSI SCSI revision: 03

[7.7.] Other information that might be relevant to the problem (please look 
in /proc and include all information that you think to be relevant):

IOStat Output:

infocost2 scripts # iostat -x 1
Linux 2.6.16-gentoo-r6-dio-patch (infocost2)    05/08/06

avg-cpu:  %user   %nice    %sys %iowait   %idle
           0.33    0.00    0.22    0.44   99.02

Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-
sz avgqu-sz   await  svctm  %util
sda          0.15   1.50  2.37  1.82   76.20  487.86    38.10   243.93   
134.60   530.56  103.29 238.20  99.82
sdb          0.15   1.52  2.36  1.80   80.40  487.86    40.20   243.93   
136.45   530.55  102.44 239.68  99.82
md1          0.00   0.00  5.01  2.70  156.46  482.88    78.23   241.44    
82.96     0.00    0.00   0.00   0.00
md0          0.00   0.00  0.01  0.00    0.10    0.00     0.05     0.00     
7.17     0.00    0.00   0.00   0.00
sdc          0.29   0.00  1.07  0.58  635.72  148.77   317.86    74.39   
476.07     0.04   25.70  12.17   2.01
sdd          0.29   0.00  1.05  0.82  636.40  157.32   318.20    78.66   
424.66     0.05   24.89  10.54   1.97
sde          0.29   0.00  1.03  0.36  635.03  154.47   317.52    77.23   
569.20     0.04   31.20  12.91   1.79
sdf          0.29   0.00  1.03  0.35  632.90  153.52   316.45    76.76   
572.71     0.04   32.21  14.46   1.99
sdg          0.29   0.00  2.10  0.43  671.25  155.90   335.63    77.95   
327.21     0.04   16.96   8.01   2.03
sdh          0.29   0.00  1.04  0.64  635.57  153.84   317.79    76.92   
469.57     0.04   26.52  11.80   1.98
sdi          0.29   0.00  1.15  0.61  643.65  153.13   321.83    76.56   
451.65     0.05   25.87  10.17   1.79
sdj          0.29   0.00  1.36  0.40  647.80  147.29   323.90    73.64   
453.03     0.05   25.74  11.21   1.97
sdk          0.28   0.00  1.72  0.63  651.79  163.52   325.90    81.76   
347.27     0.04   19.15   8.56   2.01
sdl          0.28   0.00  1.11  0.69  629.87  151.75   314.93    75.88   
434.37     0.04   21.81  10.43   1.88
sdm          0.28   0.00  1.05  0.79  630.57  154.35   315.29    77.17   
427.16     0.04   22.84  10.30   1.89
sdn          0.28   0.00  1.12  0.39  633.47  147.78   316.74    73.89   
517.08     0.04   26.98  12.56   1.90
sdo          0.28   0.00  1.18  0.71  626.65  156.12   313.32    78.06   
413.77     0.04   22.92  10.35   1.96
sdp          0.28   0.00  1.02  0.48  620.91  147.63   310.45    73.81   
514.42     0.04   26.97  12.60   1.88
sdq          0.29   0.00  1.02  0.34  634.92  145.21   317.46    72.61   
573.07     0.04   30.21  13.42   1.83
sdr          0.29   0.00  1.04  0.71  638.53  155.17   319.27    77.58   
453.60     0.04   24.18  10.73   1.88

avg-cpu:  %user   %nice    %sys %iowait   %idle
           0.00    0.00    0.00    0.00  100.00

Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-
sz avgqu-sz   await  svctm  %util
sda          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00  1226.67    0.00   0.00  99.41
sdb          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00  1226.67    0.00   0.00  99.41
md1          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
md0          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdc          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdd          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sde          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdf          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdg          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdh          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdi          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdj          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdk          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdl          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdm          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdn          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdo          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdp          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdq          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdr          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice    %sys %iowait   %idle
           0.00    0.00    0.00    0.00  100.00

Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-
sz avgqu-sz   await  svctm  %util
sda          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00  1234.00    0.00   0.00 100.00
sdb          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00  1234.00    0.00   0.00 100.00
md1          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
md0          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdc          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdd          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sde          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdf          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdg          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdh          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdi          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdj          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdk          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdl          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdm          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdn          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdo          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdp          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdq          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdr          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice    %sys %iowait   %idle
           0.00    0.00    0.00    0.00  100.00

Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-
sz avgqu-sz   await  svctm  %util
sda          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00  1234.00    0.00   0.00 100.00
sdb          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00  1234.00    0.00   0.00 100.00
md1          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
md0          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdc          0.00   0.00  0.00  1.00    0.00    8.00     0.00     4.00     
8.00     0.00    0.00   0.00   0.00
sdd          0.00   0.00  0.00  1.00    0.00   32.00     0.00    16.00    
32.00     0.00    0.00   0.00   0.00
sde          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdf          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdg          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdh          0.00   0.00  0.00  1.00    0.00   32.00     0.00    16.00    
32.00     0.00    0.00   0.00   0.00
sdi          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdj          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdk          0.00   0.00  0.00  1.00    0.00   32.00     0.00    16.00    
32.00     0.00    0.00   0.00   0.00
sdl          0.00   0.00  0.00  1.00    0.00    8.00     0.00     4.00     
8.00     0.00    0.00   0.00   0.00
sdm          0.00   0.00  0.00  2.00    0.00   40.00     0.00    20.00    
20.00     0.00    0.00   0.00   0.00
sdn          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdo          0.00   0.00  0.00  1.00    0.00   32.00     0.00    16.00    
32.00     0.00    4.00   4.00   0.40
sdp          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdq          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdr          0.00   0.00  0.00  1.00    0.00   32.00     0.00    16.00    
32.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice    %sys %iowait   %idle
           0.00    0.00    0.00    0.00  100.00

Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-
sz avgqu-sz   await  svctm  %util
sda          0.00   0.00  0.00  5.00    0.00   35.00     0.00    17.50     
7.00  1234.66    5.60 200.00 100.00
sdb          0.00   0.00  0.00  5.00    0.00   35.00     0.00    17.50     
7.00  1234.64    8.00 200.00 100.00
md1          0.00   0.00  0.00  1.00    0.00    3.00     0.00     1.50     
3.00     0.00    0.00   0.00   0.00
md0          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdc          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdd          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sde          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdf          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdg          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdh          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdi          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdj          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdk          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdl          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdm          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdn          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdo          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdp          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdq          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdr          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice    %sys %iowait   %idle
           0.00    0.00    0.00    0.00  100.00

Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-
sz avgqu-sz   await  svctm  %util
sda          0.00   0.00  0.00  5.00    0.00   33.00     0.00    16.50     
6.60  1237.72    6.40 200.00 100.00
sdb          0.00   0.00  0.00  5.00    0.00   33.00     0.00    16.50     
6.60  1237.72    6.40 200.00 100.00
md1          0.00   0.00  0.00  1.00    0.00    1.00     0.00     0.50     
1.00     0.00    0.00   0.00   0.00
md0          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdc          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdd          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sde          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdf          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdg          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdh          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdi          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdj          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdk          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdl          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdm          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdn          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdo          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdp          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdq          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdr          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice    %sys %iowait   %idle
           0.00    0.00    0.00    0.00  100.00

Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-
sz avgqu-sz   await  svctm  %util
sda          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00  1238.00    0.00   0.00 100.00
sdb          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00  1238.00    0.00   0.00 100.00
md1          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
md0          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdc          0.00   0.00  0.00  1.00    0.00    8.00     0.00     4.00     
8.00     0.00    0.00   0.00   0.00
sdd          0.00   0.00  0.00  1.00    0.00   32.00     0.00    16.00    
32.00     0.00    0.00   0.00   0.00
sde          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdf          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdg          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdh          0.00   0.00  0.00  1.00    0.00   32.00     0.00    16.00    
32.00     0.00    0.00   0.00   0.00
sdi          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdj          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdk          0.00   0.00  0.00  1.00    0.00   32.00     0.00    16.00    
32.00     0.00    0.00   0.00   0.00
sdl          0.00   0.00  0.00  1.00    0.00    8.00     0.00     4.00     
8.00     0.00    0.00   0.00   0.00
sdm          0.00   0.00  0.00  2.00    0.00   40.00     0.00    20.00    
20.00     0.00    0.00   0.00   0.00
sdn          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdo          0.00   0.00  0.00  1.00    0.00   32.00     0.00    16.00    
32.00     0.00    4.00   4.00   0.40
sdp          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdq          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdr          0.00   0.00  0.00  1.00    0.00   32.00     0.00    16.00    
32.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice    %sys %iowait   %idle
           0.00    0.00    0.00    0.00  100.00

Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-
sz avgqu-sz   await  svctm  %util
sda          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00  1238.00    0.00   0.00 100.00
sdb          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00  1238.00    0.00   0.00 100.00
md1          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
md0          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdc          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdd          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sde          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdf          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdg          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdh          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdi          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdj          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdk          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdl          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdm          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdn          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdo          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdp          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdq          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdr          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice    %sys %iowait   %idle
           0.00    0.00    0.00    0.00  100.00

Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-
sz avgqu-sz   await  svctm  %util
sda          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00  1238.00    0.00   0.00 100.00
sdb          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00  1238.00    0.00   0.00 100.00
md1          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
md0          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdc          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdd          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sde          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdf          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdg          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdh          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdi          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdj          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdk          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdl          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdm          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdn          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdo          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdp          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdq          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00
sdr          0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     
0.00     0.00    0.00   0.00   0.00

[X.] Other notes, patches, fixes, workarounds:

The kernel has this patch applied: http://lkml.org/lkml/2006/3/21/42 , because 
without this patch Oracle freezes when any disk used by ASM has problems. 
However, the iostat behaviour is the same with or without this patch.

I tried installing a vanilla kernel on the system to reproduce the problem, 
but I gave up after 6 hours of frustating errors. (it was on of those "Windows 
Rules / Linux Sucks" moments).
Comment 1 Natalie Protasevich 2007-07-08 17:24:29 UTC
Vladimir,
Have you tried latest kernels since then?
Thanks.
Comment 2 Vladimir Nicolici 2007-07-09 00:15:26 UTC
I will ask the administration team to attempt a kernel update this week, and I will return with details.
Comment 3 Tejun Heo 2007-08-08 20:48:08 UTC
Ping.
Comment 4 Natalie Protasevich 2008-03-22 23:23:17 UTC
Vladimir, were you able to do some testing with new kernel lately?