54741 – Filesystem dataloss after writing to bad blocks

Bug 54741 - Filesystem dataloss after writing to bad blocks

Summary: Filesystem dataloss after writing to bad blocks

Status:	RESOLVED INVALID

Alias:	None

Product:	File System
Classification:	Unclassified
Component:	XFS (show other bugs)
Hardware:	All Linux

Importance:	P1 normal
Assignee:	Dave Chinner

URL:
Keywords:

Depends on:
Blocks:

Reported:	2013-03-04 12:53 UTC by Dennis Jakobsen
Modified:	2013-03-04 20:30 UTC (History)
CC List:	1 user (show)

See Also:
Kernel Version:	2.6.32-5-amd64 SMP
Tree:	Mainline
Regression:	No

Attachments
Add an attachment (proposed patch, testcase, etc.)

Description Dennis Jakobsen 2013-03-04 12:53:07 UTC

I was copying a big file from my workstation to my linux server and in the middle it just stopped and lost access to the drive (mapped samba share to drive letter in windows).

It's an LVM stripe set with two 1TB Western Digital 'Green' drives.

Can't mount. Can't use any xfs_ utils without getting "i/o error, segmentation fault".

Did a 'badblocks' scan and found these on /dev/sdb:
244190976
244190977
244190978
244190979
971538424
971538425
971542384

According to FAQ on xfs.org these are important info when submitting bugs:

uname -a
Linux idefix 2.6.32-5-amd64 #1 SMP Mon Feb 25 00:26:11 UTC 2013 x86_64 GNU/Linux

xfs_repair -V
xfs_repair version 3.1.4

cat /proc/meminfo
MemTotal:        2060964 kB
MemFree:         1714764 kB
Buffers:            7904 kB
Cached:           227388 kB
SwapCached:            0 kB
Active:           183672 kB
Inactive:         117220 kB
Active(anon):      65612 kB
Inactive(anon):      184 kB
Active(file):     118060 kB
Inactive(file):   117036 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:        724984 kB
SwapFree:         724984 kB
Dirty:                 0 kB
Writeback:             0 kB
AnonPages:         65632 kB
Mapped:            25588 kB
Shmem:               196 kB
Slab:              17716 kB
SReclaimable:       8464 kB
SUnreclaim:         9252 kB
KernelStack:        1200 kB
PageTables:         7220 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:     1755464 kB
Committed_AS:     470896 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      275536 kB
VmallocChunk:   34359432512 kB
HardwareCorrupted:     0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:       10240 kB
DirectMap2M:     2086912 kB

cat /proc/mounts
rootfs / rootfs rw 0 0
none /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /proc proc rw,nosuid,nodev,noexec,relatime 0 0
none /dev devtmpfs rw,relatime,size=1025132k,nr_inodes=256283,mode=755 0 0
none /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/dev/mapper/idefix-root / ext3 rw,noatime,errors=remount-ro,data=ordered 0 0
tmpfs /lib/init/rw tmpfs rw,nosuid,relatime,mode=755 0 0
tmpfs /dev/shm tmpfs rw,nosuid,nodev,relatime 0 0
/dev/sda1 /boot ext2 rw,noatime,errors=continue 0 0
binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
nfsd /proc/fs/nfsd nfsd rw,relatime 0 0

cat /proc/partitions
major minor  #blocks  name

   8        0   16777216 sda
   8        1     248832 sda1
   8        2          1 sda2
   8        5   16525312 sda5
   8       16  976762584 sdb
   8       32  976762584 sdc
 254        0   15798272 dm-0
 254        1     724992 dm-1
 254        2 1953521664 dm-2

lvmdiskscan
  /dev/root [      15.07 GiB]
  /dev/sda1 [     243.00 MiB]
  /dev/dm-1 [     708.00 MiB]
  /dev/dm-2 [       1.82 TiB]
  /dev/sda5 [      15.76 GiB] LVM physical volume
  /dev/sdb  [     931.51 GiB] LVM physical volume
  /dev/sdc  [     931.51 GiB] LVM physical volume
  1 disk
  3 partitions
  2 LVM physical volume whole disks
  1 LVM physical volume

pvdisplay
  --- Physical volume ---
  PV Name               /dev/sdb
  VG Name               stripeset
  PV Size               931.51 GiB / not usable 1.71 MiB
  Allocatable           yes (but full)
  PE Size               4.00 MiB
  Total PE              238467
  Free PE               0
  Allocated PE          238467
  PV UUID               kejyiP-i8hs-0l3L-10K3-Wbnt-Ue2w-Zr6nLc

  --- Physical volume ---
  PV Name               /dev/sdc
  VG Name               stripeset
  PV Size               931.51 GiB / not usable 1.71 MiB
  Allocatable           yes (but full)
  PE Size               4.00 MiB
  Total PE              238467
  Free PE               0
  Allocated PE          238467
  PV UUID               I8Z43V-kPHp-JZdB-TqYB-oeYY-e9ZT-1EINjZ

  --- Physical volume ---
  PV Name               /dev/sda5
  VG Name               idefix
  PV Size               15.76 GiB / not usable 2.00 MiB
  Allocatable           yes (but full)
  PE Size               4.00 MiB
  Total PE              4034
  Free PE               0
  Allocated PE          4034
  PV UUID               rsltRt-Arno-8Mn9-DNNd-zLBw-ohT7-idreI4

xfs_info
none, can't mount.

dmesg  (relevant output):
[    1.913952] sd 0:0:1:0: [sdb] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB)
[    1.913975] sd 0:0:1:0: [sdb] Write Protect is off
[    1.913976] sd 0:0:1:0: [sdb] Mode Sense: 31 00 00 00
[    1.914000] sd 0:0:1:0: [sdb] Cache data unavailable
[    1.914002] sd 0:0:1:0: [sdb] Assuming drive cache: write through
[    1.914257] sd 0:0:1:0: [sdb] Cache data unavailable
[    1.914259] sd 0:0:1:0: [sdb] Assuming drive cache: write through
[    1.915356]  sdb: unknown partition table
[    1.916470] sd 0:0:1:0: [sdb] Cache data unavailable
[    1.916471] sd 0:0:1:0: [sdb] Assuming drive cache: write through
[    1.916571] sd 0:0:1:0: [sdb] Attached SCSI disk

[    7.110449] sd 0:0:1:0: [sdb] Unhandled sense code
[    7.110455] sd 0:0:1:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[    7.110460] sd 0:0:1:0: [sdb] Sense Key : Medium Error [current]
[    7.110464] sd 0:0:1:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[    7.110470] sd 0:0:1:0: [sdb] CDB: Read(10): 28 00 1d 1c 1e 00 00 00 08 00
[    7.110476] end_request: I/O error, dev sdb, sector 488381952

[  151.608957] sd 0:0:1:0: [sdb] Unhandled sense code
[  151.608960] sd 0:0:1:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[  151.608962] sd 0:0:1:0: [sdb] Sense Key : Medium Error [current]
[  151.608965] sd 0:0:1:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[  151.608968] sd 0:0:1:0: [sdb] CDB: Read(10): 28 00 1d 1c 1e 00 00 00 08 00
[  151.608974] end_request: I/O error, dev sdb, sector 488381952

[ 3199.474123] sd 0:0:1:0: [sdb] Unhandled sense code
[ 3199.474127] sd 0:0:1:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[ 3199.474130] sd 0:0:1:0: [sdb] Sense Key : Medium Error [current]
[ 3199.474134] sd 0:0:1:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[ 3199.474138] sd 0:0:1:0: [sdb] CDB: Read(10): 28 00 1d 1c 1e 00 00 00 08 00
[ 3199.474146] end_request: I/O error, dev sdb, sector 488381952
[ 3199.474248] Buffer I/O error on device sdb, logical block 61047744

[12031.855211] sd 0:0:1:0: [sdb] Unhandled sense code
[12031.855214] sd 0:0:1:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[12031.855216] sd 0:0:1:0: [sdb] Sense Key : Medium Error [current]
[12031.855219] sd 0:0:1:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[12031.855222] sd 0:0:1:0: [sdb] CDB: Read(10): 28 00 1d 1c 1e 00 00 00 08 00
[12031.855228] end_request: I/O error, dev sdb, sector 488381952

mount yields:
mount: /dev/mapper/stripeset-stripe: can't read superblock

/var/log/messages states:
Mar  4 13:25:10 idefix kernel: [13708.127009] XFS mounting filesystem dm-2
Mar  4 13:25:11 idefix kernel: [13708.828065] Starting XFS recovery on filesystem: dm-2 (logdev: internal)
Mar  4 13:25:14 idefix kernel: [13711.652102] sd 0:0:1:0: [sdb] Unhandled sense code
Mar  4 13:25:14 idefix kernel: [13711.652105] sd 0:0:1:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Mar  4 13:25:14 idefix kernel: [13711.652109] sd 0:0:1:0: [sdb] Sense Key : Medium Error [current]
Mar  4 13:25:14 idefix kernel: [13711.652113] sd 0:0:1:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
Mar  4 13:25:14 idefix kernel: [13711.652125] sd 0:0:1:0: [sdb] CDB: Read(10): 28 00 1d 1c 1e 00 00 00 08 00

Comment 1 Dave Chinner 2013-03-04 20:28:54 UTC

Your disk is dead and getting unrecoverable errors. It needs tobe replaced.

-Dave.

Comment 2 Dave Chinner 2013-03-04 20:30:16 UTC

Closing - hardware broken, not a filesystem bug.

Note You need to log in before you can comment on or make changes to this bug.