114011 – XFS crash and destroyed metadata during heavy disk operations

Bug 114011 - XFS crash and destroyed metadata during heavy disk operations

Summary: XFS crash and destroyed metadata during heavy disk operations

Status:	NEW

Alias:	None

Product:	File System
Classification:	Unclassified
Component:	XFS (show other bugs)
Hardware:	All Linux

Importance:	P1 high
Assignee:	XFS Guru

URL:
Keywords:

Depends on:
Blocks:

Reported:	2016-03-08 11:56 UTC by René Krell
Modified:	2016-03-20 09:51 UTC (History)
CC List:	1 user (show)

See Also:
Kernel Version:	4.4.3
Subsystem:
Regression:	No
Bisected commit-id:

Attachments
/var/log/messages - full log (1.88 MB, text/plain) 2016-03-08 12:00 UTC, René Krell	Details
Add an attachment (proposed patch, testcase, etc.)

Description René Krell 2016-03-08 11:56:07 UTC

After updating from kernel 4.4.2 to 4.4.3 I got an XFS crash during doing extensive disk operations (compiling, Java IDE):

2016-03-04T10:27:17.775528+01:00 rkrell kernel: [ 1111.720047] SGI XFS with ACLs, security attributes, realtime, no debug enabled
2016-03-04T10:27:17.779497+01:00 rkrell kernel: [ 1111.721029] XFS (sdb2): Mounting V5 Filesystem
2016-03-04T10:27:17.927503+01:00 rkrell kernel: [ 1111.870749] XFS (sdb2): Starting recovery (logdev: internal)
2016-03-04T10:27:21.745815+01:00 rkrell kernel: [ 1115.687157] XFS (sdb2): Internal error XFS_WANT_CORRUPTED_GOTO at line 3156 of file ../fs/xfs/libxfs/xfs_btree.c.  Caller xfs_free_ag_extent+0x3f5/0x770 [xfs]
2016-03-04T10:27:21.745833+01:00 rkrell kernel: [ 1115.687164] CPU: 0 PID: 11002 Comm: mount Tainted: G           O    4.4.3-2.gedb49cc-default #1
2016-03-04T10:27:21.745835+01:00 rkrell kernel: [ 1115.687166] Hardware name: Hewlett-Packard HP ZBook 15/1909, BIOS L70 Ver. 01.34 10/28/2015
2016-03-04T10:27:21.745836+01:00 rkrell kernel: [ 1115.687169]  0000000000000000 ffff8808426739e8 ffffffff813828b1 ffff88086d7b10e8
2016-03-04T10:27:21.745836+01:00 rkrell kernel: [ 1115.687173]  ffff88086d7b10e8 ffff880842673a00 ffffffffa09f4e2c ffffffffa09b1b25
2016-03-04T10:27:21.745837+01:00 rkrell kernel: [ 1115.687176]  ffff880842673a70 ffffffffa09ce16a ffff88087c3cb7c0 0000000000000001
2016-03-04T10:27:21.745838+01:00 rkrell kernel: [ 1115.687179] Call Trace:
2016-03-04T10:27:21.745839+01:00 rkrell kernel: [ 1115.687191]  [<ffffffff8101b0e5>] try_stack_unwind+0x175/0x190
2016-03-04T10:27:21.745840+01:00 rkrell kernel: [ 1115.687199]  [<ffffffff8101a039>] dump_trace+0x69/0x3a0
2016-03-04T10:27:21.745841+01:00 rkrell kernel: [ 1115.687204]  [<ffffffff8101b14b>] show_trace_log_lvl+0x4b/0x60
2016-03-04T10:27:21.745841+01:00 rkrell kernel: [ 1115.687208]  [<ffffffff8101a47c>] show_stack_log_lvl+0x10c/0x180
2016-03-04T10:27:21.745842+01:00 rkrell kernel: [ 1115.687212]  [<ffffffff8101b1e5>] show_stack+0x25/0x50
2016-03-04T10:27:21.745843+01:00 rkrell kernel: [ 1115.687217]  [<ffffffff813828b1>] dump_stack+0x63/0x82
2016-03-04T10:27:21.745844+01:00 rkrell kernel: [ 1115.687258]  [<ffffffffa09f4e2c>] xfs_error_report+0x3c/0x40 [xfs]
2016-03-04T10:27:21.745845+01:00 rkrell kernel: [ 1115.687308]  [<ffffffffa09ce16a>] xfs_btree_insert+0x14a/0x1a0 [xfs]
2016-03-04T10:27:21.745846+01:00 rkrell kernel: [ 1115.687337]  [<ffffffffa09b1b25>] xfs_free_ag_extent+0x3f5/0x770 [xfs]
2016-03-04T10:27:21.745846+01:00 rkrell kernel: [ 1115.687366]  [<ffffffffa09b2fca>] xfs_free_extent+0xda/0x110 [xfs]
2016-03-04T10:27:21.745847+01:00 rkrell kernel: [ 1115.687406]  [<ffffffffa0a20a46>] xfs_trans_free_extent+0x26/0x60 [xfs]
2016-03-04T10:27:21.745848+01:00 rkrell kernel: [ 1115.687444]  [<ffffffffa0a19a62>] xlog_recover_process_efi+0x152/0x190 [xfs]
2016-03-04T10:27:21.745849+01:00 rkrell kernel: [ 1115.687480]  [<ffffffffa0a1b9de>] xlog_recover_process_efis.isra.29+0x6e/0xb0 [xfs]
2016-03-04T10:27:21.745850+01:00 rkrell kernel: [ 1115.687514]  [<ffffffffa0a1e921>] xlog_recover_finish+0x21/0xa0 [xfs]
2016-03-04T10:27:21.745851+01:00 rkrell kernel: [ 1115.687550]  [<ffffffffa0a12b09>] xfs_log_mount_finish+0x29/0x50 [xfs]
2016-03-04T10:27:21.745851+01:00 rkrell kernel: [ 1115.687587]  [<ffffffffa0a0988e>] xfs_mountfs+0x58e/0x850 [xfs]
2016-03-04T10:27:21.745852+01:00 rkrell kernel: [ 1115.687623]  [<ffffffffa0a0ca60>] xfs_fs_fill_super+0x3b0/0x4d0 [xfs]
2016-03-04T10:27:21.745853+01:00 rkrell kernel: [ 1115.687634]  [<ffffffff81200516>] mount_bdev+0x1a6/0x1e0
2016-03-04T10:27:21.745854+01:00 rkrell kernel: [ 1115.687666]  [<ffffffffa0a0ade5>] xfs_fs_mount+0x15/0x20 [xfs]
2016-03-04T10:27:21.745855+01:00 rkrell kernel: [ 1115.687674]  [<ffffffff81200df8>] mount_fs+0x38/0x160
2016-03-04T10:27:21.745855+01:00 rkrell kernel: [ 1115.687682]  [<ffffffff8121be67>] vfs_kern_mount+0x67/0x110
2016-03-04T10:27:21.745856+01:00 rkrell kernel: [ 1115.687687]  [<ffffffff8121e68d>] do_mount+0x21d/0xd90
2016-03-04T10:27:21.745857+01:00 rkrell kernel: [ 1115.687691]  [<ffffffff8121f51c>] SyS_mount+0x8c/0xd0
2016-03-04T10:27:21.745858+01:00 rkrell kernel: [ 1115.687700]  [<ffffffff816aec36>] entry_SYSCALL_64_fastpath+0x16/0x75
2016-03-04T10:27:21.745859+01:00 rkrell kernel: [ 1115.690131] DWARF2 unwinder stuck at entry_SYSCALL_64_fastpath+0x16/0x75
2016-03-04T10:27:21.745859+01:00 rkrell kernel: [ 1115.690132] 
2016-03-04T10:27:21.745860+01:00 rkrell kernel: [ 1115.690133] Leftover inexact backtrace:
2016-03-04T10:27:21.745876+01:00 rkrell kernel: [ 1115.690133] 
2016-03-04T10:27:21.745877+01:00 rkrell kernel: [ 1115.690205] XFS (sdb2): Internal error xfs_trans_cancel at line 990 of file ../fs/xfs/xfs_trans.c.  Caller xlog_recover_process_efi+0x161/0x190 [xfs]
2016-03-04T10:27:21.745878+01:00 rkrell kernel: [ 1115.690217] CPU: 0 PID: 11002 Comm: mount Tainted: G           O    4.4.3-2.gedb49cc-default #1
2016-03-04T10:27:21.745879+01:00 rkrell kernel: [ 1115.690222] Hardware name: Hewlett-Packard HP ZBook 15/1909, BIOS L70 Ver. 01.34 10/28/2015
2016-03-04T10:27:21.745880+01:00 rkrell kernel: [ 1115.690230]  0000000000000000 ffff880842673ba0 ffffffff813828b1 ffff8808793f7928
2016-03-04T10:27:21.745880+01:00 rkrell kernel: [ 1115.690245]  0000000000000001 ffff880842673bb8 ffffffffa09f4e2c ffffffffa0a19a71
2016-03-04T10:27:21.745949+01:00 rkrell kernel: [ 1115.690263]  ffff880842673be0 ffffffffa0a0fdd6 ffff8808692bde20 ffff8808692bdc90
2016-03-04T10:27:21.745950+01:00 rkrell kernel: [ 1115.690270] Call Trace:
2016-03-04T10:27:21.745951+01:00 rkrell kernel: [ 1115.690276]  [<ffffffff8101b0e5>] try_stack_unwind+0x175/0x190
2016-03-04T10:27:21.745952+01:00 rkrell kernel: [ 1115.690282]  [<ffffffff8101a039>] dump_trace+0x69/0x3a0
2016-03-04T10:27:21.745953+01:00 rkrell kernel: [ 1115.690287]  [<ffffffff8101b14b>] show_trace_log_lvl+0x4b/0x60
2016-03-04T10:27:21.745954+01:00 rkrell kernel: [ 1115.690291]  [<ffffffff8101a47c>] show_stack_log_lvl+0x10c/0x180
2016-03-04T10:27:21.745955+01:00 rkrell kernel: [ 1115.690294]  [<ffffffff8101b1e5>] show_stack+0x25/0x50
2016-03-04T10:27:21.745956+01:00 rkrell kernel: [ 1115.690298]  [<ffffffff813828b1>] dump_stack+0x63/0x82
2016-03-04T10:27:21.745957+01:00 rkrell kernel: [ 1115.690331]  [<ffffffffa09f4e2c>] xfs_error_report+0x3c/0x40 [xfs]
2016-03-04T10:27:21.745958+01:00 rkrell kernel: [ 1115.690369]  [<ffffffffa0a0fdd6>] xfs_trans_cancel+0xb6/0xe0 [xfs]
2016-03-04T10:27:21.745959+01:00 rkrell kernel: [ 1115.690409]  [<ffffffffa0a19a71>] xlog_recover_process_efi+0x161/0x190 [xfs]
2016-03-04T10:27:21.747521+01:00 rkrell kernel: [ 1115.690446]  [<ffffffffa0a1b9de>] xlog_recover_process_efis.isra.29+0x6e/0xb0 [xfs]
2016-03-04T10:27:21.747530+01:00 rkrell kernel: [ 1115.690479]  [<ffffffffa0a1e921>] xlog_recover_finish+0x21/0xa0 [xfs]
2016-03-04T10:27:21.747531+01:00 rkrell kernel: [ 1115.690515]  [<ffffffffa0a12b09>] xfs_log_mount_finish+0x29/0x50 [xfs]
2016-03-04T10:27:21.747532+01:00 rkrell kernel: [ 1115.690550]  [<ffffffffa0a0988e>] xfs_mountfs+0x58e/0x850 [xfs]
2016-03-04T10:27:21.747533+01:00 rkrell kernel: [ 1115.690585]  [<ffffffffa0a0ca60>] xfs_fs_fill_super+0x3b0/0x4d0 [xfs]
2016-03-04T10:27:21.747534+01:00 rkrell kernel: [ 1115.690593]  [<ffffffff81200516>] mount_bdev+0x1a6/0x1e0
2016-03-04T10:27:21.747536+01:00 rkrell kernel: [ 1115.690624]  [<ffffffffa0a0ade5>] xfs_fs_mount+0x15/0x20 [xfs]
2016-03-04T10:27:21.747548+01:00 rkrell kernel: [ 1115.690631]  [<ffffffff81200df8>] mount_fs+0x38/0x160
2016-03-04T10:27:21.747549+01:00 rkrell kernel: [ 1115.690636]  [<ffffffff8121be67>] vfs_kern_mount+0x67/0x110
2016-03-04T10:27:21.747550+01:00 rkrell kernel: [ 1115.690639]  [<ffffffff8121e68d>] do_mount+0x21d/0xd90
2016-03-04T10:27:21.747551+01:00 rkrell kernel: [ 1115.690643]  [<ffffffff8121f51c>] SyS_mount+0x8c/0xd0
2016-03-04T10:27:21.747552+01:00 rkrell kernel: [ 1115.690648]  [<ffffffff816aec36>] entry_SYSCALL_64_fastpath+0x16/0x75
2016-03-04T10:27:21.748600+01:00 rkrell kernel: [ 1115.693014] DWARF2 unwinder stuck at entry_SYSCALL_64_fastpath+0x16/0x75
2016-03-04T10:27:21.748610+01:00 rkrell kernel: [ 1115.693016] 
2016-03-04T10:27:21.748612+01:00 rkrell kernel: [ 1115.693017] Leftover inexact backtrace:
2016-03-04T10:27:21.748615+01:00 rkrell kernel: [ 1115.693017] 
2016-03-04T10:27:21.748616+01:00 rkrell kernel: [ 1115.693029] XFS (sdb2): xfs_do_force_shutdown(0x8) called from line 991 of file ../fs/xfs/xfs_trans.c.  Return address = 0xffffffffa0a0fdef
2016-03-04T10:27:21.748617+01:00 rkrell kernel: [ 1115.693037] XFS (sdb2): Corruption of in-memory data detected.  Shutting down filesystem
2016-03-04T10:27:21.748619+01:00 rkrell kernel: [ 1115.693038] XFS (sdb2): Please umount the filesystem and rectify the problem(s)
2016-03-04T10:27:21.748620+01:00 rkrell kernel: [ 1115.693047] XFS (sdb2): Failed to recover EFIs
2016-03-04T10:27:21.748621+01:00 rkrell kernel: [ 1115.693054] XFS (sdb2): log mount finish failed
2016-03-04T10:27:21.748625+01:00 rkrell kernel: [ 1115.693074] XFS (sdb2): xfs_log_force: error -5 returned.
2016-03-04T10:30:34.223539+01:00 rkrell kernel: [ 1308.151528] XFS (sdb2): Mounting V5 Filesystem
2016-03-04T10:30:34.271513+01:00 rkrell kernel: [ 1308.201333] XFS (sdb2): Starting recovery (logdev: internal)
2016-03-04T10:30:37.997629+01:00 rkrell kernel: [ 1311.925866] XFS (sdb2): Internal error XFS_WANT_CORRUPTED_GOTO at line 3156 of file ../fs/xfs/libxfs/xfs_btree.c.  Caller xfs_free_ag_extent+0x3f5/0x770 [xfs]
2016-03-04T10:30:37.997649+01:00 rkrell kernel: [ 1311.925873] CPU: 0 PID: 11157 Comm: mount Tainted: G           O    4.4.3-2.gedb49cc-default #1
2016-03-04T10:30:37.997651+01:00 rkrell kernel: [ 1311.925875] Hardware name: Hewlett-Packard HP ZBook 15/1909, BIOS L70 Ver. 01.34 10/28/2015
2016-03-04T10:30:37.997652+01:00 rkrell kernel: [ 1311.925877]  0000000000000000 ffff880840b5b9e8 ffffffff813828b1 ffff88087bdd9698
2016-03-04T10:30:37.997654+01:00 rkrell kernel: [ 1311.925881]  ffff88087bdd9698 ffff880840b5ba00 ffffffffa09f4e2c ffffffffa09b1b25
2016-03-04T10:30:37.997655+01:00 rkrell kernel: [ 1311.925884]  ffff880840b5ba70 ffffffffa09ce16a ffff88085d693dc0 0000000000000001
2016-03-04T10:30:37.997656+01:00 rkrell kernel: [ 1311.925887] Call Trace:
2016-03-04T10:30:37.997657+01:00 rkrell kernel: [ 1311.925898]  [<ffffffff8101b0e5>] try_stack_unwind+0x175/0x190
2016-03-04T10:30:37.997659+01:00 rkrell kernel: [ 1311.925906]  [<ffffffff8101a039>] dump_trace+0x69/0x3a0
2016-03-04T10:30:37.997660+01:00 rkrell kernel: [ 1311.925911]  [<ffffffff8101b14b>] show_trace_log_lvl+0x4b/0x60
2016-03-04T10:30:37.997661+01:00 rkrell kernel: [ 1311.925914]  [<ffffffff8101a47c>] show_stack_log_lvl+0x10c/0x180
2016-03-04T10:30:37.997662+01:00 rkrell kernel: [ 1311.925919]  [<ffffffff8101b1e5>] show_stack+0x25/0x50
2016-03-04T10:30:37.997664+01:00 rkrell kernel: [ 1311.925923]  [<ffffffff813828b1>] dump_stack+0x63/0x82
2016-03-04T10:30:37.997665+01:00 rkrell kernel: [ 1311.925960]  [<ffffffffa09f4e2c>] xfs_error_report+0x3c/0x40 [xfs]
2016-03-04T10:30:37.997666+01:00 rkrell kernel: [ 1311.926007]  [<ffffffffa09ce16a>] xfs_btree_insert+0x14a/0x1a0 [xfs]
2016-03-04T10:30:37.997667+01:00 rkrell kernel: [ 1311.926034]  [<ffffffffa09b1b25>] xfs_free_ag_extent+0x3f5/0x770 [xfs]
2016-03-04T10:30:37.997669+01:00 rkrell kernel: [ 1311.926061]  [<ffffffffa09b2fca>] xfs_free_extent+0xda/0x110 [xfs]
2016-03-04T10:30:37.997670+01:00 rkrell kernel: [ 1311.926098]  [<ffffffffa0a20a46>] xfs_trans_free_extent+0x26/0x60 [xfs]
2016-03-04T10:30:37.997671+01:00 rkrell kernel: [ 1311.926135]  [<ffffffffa0a19a62>] xlog_recover_process_efi+0x152/0x190 [xfs]
2016-03-04T10:30:37.997672+01:00 rkrell kernel: [ 1311.926168]  [<ffffffffa0a1b9de>] xlog_recover_process_efis.isra.29+0x6e/0xb0 [xfs]
2016-03-04T10:30:37.997673+01:00 rkrell kernel: [ 1311.926200]  [<ffffffffa0a1e921>] xlog_recover_finish+0x21/0xa0 [xfs]
2016-03-04T10:30:37.997686+01:00 rkrell kernel: [ 1311.926234]  [<ffffffffa0a12b09>] xfs_log_mount_finish+0x29/0x50 [xfs]
2016-03-04T10:30:37.997687+01:00 rkrell kernel: [ 1311.926269]  [<ffffffffa0a0988e>] xfs_mountfs+0x58e/0x850 [xfs]
2016-03-04T10:30:37.997688+01:00 rkrell kernel: [ 1311.926302]  [<ffffffffa0a0ca60>] xfs_fs_fill_super+0x3b0/0x4d0 [xfs]
2016-03-04T10:30:37.997690+01:00 rkrell kernel: [ 1311.926313]  [<ffffffff81200516>] mount_bdev+0x1a6/0x1e0
2016-03-04T10:30:37.997691+01:00 rkrell kernel: [ 1311.926342]  [<ffffffffa0a0ade5>] xfs_fs_mount+0x15/0x20 [xfs]
2016-03-04T10:30:37.997692+01:00 rkrell kernel: [ 1311.926350]  [<ffffffff81200df8>] mount_fs+0x38/0x160
2016-03-04T10:30:37.997693+01:00 rkrell kernel: [ 1311.926358]  [<ffffffff8121be67>] vfs_kern_mount+0x67/0x110
2016-03-04T10:30:37.997694+01:00 rkrell kernel: [ 1311.926362]  [<ffffffff8121e68d>] do_mount+0x21d/0xd90
2016-03-04T10:30:37.997695+01:00 rkrell kernel: [ 1311.926367]  [<ffffffff8121f51c>] SyS_mount+0x8c/0xd0
2016-03-04T10:30:37.997697+01:00 rkrell kernel: [ 1311.926374]  [<ffffffff816aec36>] entry_SYSCALL_64_fastpath+0x16/0x75
2016-03-04T10:30:37.997698+01:00 rkrell kernel: [ 1311.928660] DWARF2 unwinder stuck at entry_SYSCALL_64_fastpath+0x16/0x75
2016-03-04T10:30:37.997699+01:00 rkrell kernel: [ 1311.928661] 
2016-03-04T10:30:37.997700+01:00 rkrell kernel: [ 1311.928662] Leftover inexact backtrace:
2016-03-04T10:30:37.997701+01:00 rkrell kernel: [ 1311.928662] 
2016-03-04T10:30:37.997702+01:00 rkrell kernel: [ 1311.928731] XFS (sdb2): Internal error xfs_trans_cancel at line 990 of file ../fs/xfs/xfs_trans.c.  Caller xlog_recover_process_efi+0x161/0x190 [xfs]
2016-03-04T10:30:37.997704+01:00 rkrell kernel: [ 1311.928741] CPU: 0 PID: 11157 Comm: mount Tainted: G           O    4.4.3-2.gedb49cc-default #1
2016-03-04T10:30:37.997705+01:00 rkrell kernel: [ 1311.928746] Hardware name: Hewlett-Packard HP ZBook 15/1909, BIOS L70 Ver. 01.34 10/28/2015
2016-03-04T10:30:37.997706+01:00 rkrell kernel: [ 1311.928756]  0000000000000000 ffff880840b5bba0 ffffffff813828b1 ffff8808793f7a10
2016-03-04T10:30:37.997707+01:00 rkrell kernel: [ 1311.928778]  0000000000000001 ffff880840b5bbb8 ffffffffa09f4e2c ffffffffa0a19a71
2016-03-04T10:30:37.997762+01:00 rkrell kernel: [ 1311.928797]  ffff880840b5bbe0 ffffffffa0a0fdd6 ffff88086be14e20 ffff88086be14c90
2016-03-04T10:30:37.997764+01:00 rkrell kernel: [ 1311.928810] Call Trace:
2016-03-04T10:30:37.997765+01:00 rkrell kernel: [ 1311.928815]  [<ffffffff8101b0e5>] try_stack_unwind+0x175/0x190
2016-03-04T10:30:37.997767+01:00 rkrell kernel: [ 1311.928821]  [<ffffffff8101a039>] dump_trace+0x69/0x3a0
2016-03-04T10:30:37.997768+01:00 rkrell kernel: [ 1311.928825]  [<ffffffff8101b14b>] show_trace_log_lvl+0x4b/0x60
2016-03-04T10:30:37.997769+01:00 rkrell kernel: [ 1311.928829]  [<ffffffff8101a47c>] show_stack_log_lvl+0x10c/0x180
2016-03-04T10:30:37.997770+01:00 rkrell kernel: [ 1311.928833]  [<ffffffff8101b1e5>] show_stack+0x25/0x50
2016-03-04T10:30:37.997771+01:00 rkrell kernel: [ 1311.928836]  [<ffffffff813828b1>] dump_stack+0x63/0x82
2016-03-04T10:30:37.997780+01:00 rkrell kernel: [ 1311.928867]  [<ffffffffa09f4e2c>] xfs_error_report+0x3c/0x40 [xfs]
2016-03-04T10:30:37.997781+01:00 rkrell kernel: [ 1311.928902]  [<ffffffffa0a0fdd6>] xfs_trans_cancel+0xb6/0xe0 [xfs]
2016-03-04T10:30:37.997782+01:00 rkrell kernel: [ 1311.928942]  [<ffffffffa0a19a71>] xlog_recover_process_efi+0x161/0x190 [xfs]
2016-03-04T10:30:37.999531+01:00 rkrell kernel: [ 1311.928978]  [<ffffffffa0a1b9de>] xlog_recover_process_efis.isra.29+0x6e/0xb0 [xfs]
2016-03-04T10:30:37.999536+01:00 rkrell kernel: [ 1311.929009]  [<ffffffffa0a1e921>] xlog_recover_finish+0x21/0xa0 [xfs]
2016-03-04T10:30:37.999537+01:00 rkrell kernel: [ 1311.929041]  [<ffffffffa0a12b09>] xfs_log_mount_finish+0x29/0x50 [xfs]
2016-03-04T10:30:37.999538+01:00 rkrell kernel: [ 1311.929074]  [<ffffffffa0a0988e>] xfs_mountfs+0x58e/0x850 [xfs]
2016-03-04T10:30:37.999538+01:00 rkrell kernel: [ 1311.929111]  [<ffffffffa0a0ca60>] xfs_fs_fill_super+0x3b0/0x4d0 [xfs]
2016-03-04T10:30:37.999539+01:00 rkrell kernel: [ 1311.929119]  [<ffffffff81200516>] mount_bdev+0x1a6/0x1e0
2016-03-04T10:30:37.999539+01:00 rkrell kernel: [ 1311.929147]  [<ffffffffa0a0ade5>] xfs_fs_mount+0x15/0x20 [xfs]
2016-03-04T10:30:37.999540+01:00 rkrell kernel: [ 1311.929154]  [<ffffffff81200df8>] mount_fs+0x38/0x160
2016-03-04T10:30:37.999541+01:00 rkrell kernel: [ 1311.929162]  [<ffffffff8121be67>] vfs_kern_mount+0x67/0x110
2016-03-04T10:30:37.999541+01:00 rkrell kernel: [ 1311.929165]  [<ffffffff8121e68d>] do_mount+0x21d/0xd90
2016-03-04T10:30:37.999541+01:00 rkrell kernel: [ 1311.929168]  [<ffffffff8121f51c>] SyS_mount+0x8c/0xd0
2016-03-04T10:30:37.999542+01:00 rkrell kernel: [ 1311.929173]  [<ffffffff816aec36>] entry_SYSCALL_64_fastpath+0x16/0x75
2016-03-04T10:30:38.000013+01:00 rkrell kernel: [ 1311.931170] DWARF2 unwinder stuck at entry_SYSCALL_64_fastpath+0x16/0x75
2016-03-04T10:30:38.000020+01:00 rkrell kernel: [ 1311.931171] 
2016-03-04T10:30:38.000020+01:00 rkrell kernel: [ 1311.931172] Leftover inexact backtrace:
2016-03-04T10:30:38.000021+01:00 rkrell kernel: [ 1311.931172] 
2016-03-04T10:30:38.000022+01:00 rkrell kernel: [ 1311.931179] XFS (sdb2): xfs_do_force_shutdown(0x8) called from line 991 of file ../fs/xfs/xfs_trans.c.  Return address = 0xffffffffa0a0fdef
2016-03-04T10:30:38.000022+01:00 rkrell kernel: [ 1311.931185] XFS (sdb2): Corruption of in-memory data detected.  Shutting down filesystem
2016-03-04T10:30:38.000023+01:00 rkrell kernel: [ 1311.931186] XFS (sdb2): Please umount the filesystem and rectify the problem(s)
2016-03-04T10:30:38.000023+01:00 rkrell kernel: [ 1311.931191] XFS (sdb2): Failed to recover EFIs
2016-03-04T10:30:38.000024+01:00 rkrell kernel: [ 1311.931192] XFS (sdb2): log mount finish failed
2016-03-04T10:30:38.000027+01:00 rkrell kernel: [ 1311.931207] XFS (sdb2): xfs_log_force: error -5 returned.
2016-03-04T10:31:44.787512+01:00 rkrell kernel: [ 1378.712943] XFS (sdb2): Mounting V5 Filesystem
2016-03-04T10:31:44.923513+01:00 rkrell kernel: [ 1378.847109] XFS (sdb2): Starting recovery (logdev: internal)
2016-03-04T10:31:48.559007+01:00 rkrell kernel: [ 1382.480239] XFS (sdb2): Internal error XFS_WANT_CORRUPTED_GOTO at line 3156 of file ../fs/xfs/libxfs/xfs_btree.c.  Caller xfs_free_ag_extent+0x3f5/0x770 [xfs]
2016-03-04T10:31:48.559034+01:00 rkrell kernel: [ 1382.480250] CPU: 0 PID: 11195 Comm: mount Tainted: G           O    4.4.3-2.gedb49cc-default #1
2016-03-04T10:31:48.559037+01:00 rkrell kernel: [ 1382.480253] Hardware name: Hewlett-Packard HP ZBook 15/1909, BIOS L70 Ver. 01.34 10/28/2015
2016-03-04T10:31:48.559038+01:00 rkrell kernel: [ 1382.480257]  0000000000000000 ffff88084079f9e8 ffffffff813828b1 ffff880876bfb288
2016-03-04T10:31:48.559040+01:00 rkrell kernel: [ 1382.480264]  ffff880876bfb288 ffff88084079fa00 ffffffffa09f4e2c ffffffffa09b1b25
2016-03-04T10:31:48.559041+01:00 rkrell kernel: [ 1382.480269]  ffff88084079fa70 ffffffffa09ce16a ffff880879226500 0000000000000001
2016-03-04T10:31:48.559042+01:00 rkrell kernel: [ 1382.480274] Call Trace:
2016-03-04T10:31:48.559044+01:00 rkrell kernel: [ 1382.480292]  [<ffffffff8101b0e5>] try_stack_unwind+0x175/0x190
2016-03-04T10:31:48.559045+01:00 rkrell kernel: [ 1382.480305]  [<ffffffff8101a039>] dump_trace+0x69/0x3a0
2016-03-04T10:31:48.559047+01:00 rkrell kernel: [ 1382.480313]  [<ffffffff8101b14b>] show_trace_log_lvl+0x4b/0x60
2016-03-04T10:31:48.559048+01:00 rkrell kernel: [ 1382.480320]  [<ffffffff8101a47c>] show_stack_log_lvl+0x10c/0x180
2016-03-04T10:31:48.559049+01:00 rkrell kernel: [ 1382.480327]  [<ffffffff8101b1e5>] show_stack+0x25/0x50
2016-03-04T10:31:48.559051+01:00 rkrell kernel: [ 1382.480335]  [<ffffffff813828b1>] dump_stack+0x63/0x82
2016-03-04T10:31:48.559052+01:00 rkrell kernel: [ 1382.480398]  [<ffffffffa09f4e2c>] xfs_error_report+0x3c/0x40 [xfs]
2016-03-04T10:31:48.559054+01:00 rkrell kernel: [ 1382.480474]  [<ffffffffa09ce16a>] xfs_btree_insert+0x14a/0x1a0 [xfs]
2016-03-04T10:31:48.559055+01:00 rkrell kernel: [ 1382.480529]  [<ffffffffa09b1b25>] xfs_free_ag_extent+0x3f5/0x770 [xfs]
2016-03-04T10:31:48.559056+01:00 rkrell kernel: [ 1382.480583]  [<ffffffffa09b2fca>] xfs_free_extent+0xda/0x110 [xfs]
2016-03-04T10:31:48.559058+01:00 rkrell kernel: [ 1382.480656]  [<ffffffffa0a20a46>] xfs_trans_free_extent+0x26/0x60 [xfs]
2016-03-04T10:31:48.559059+01:00 rkrell kernel: [ 1382.480727]  [<ffffffffa0a19a62>] xlog_recover_process_efi+0x152/0x190 [xfs]
2016-03-04T10:31:48.559060+01:00 rkrell kernel: [ 1382.480795]  [<ffffffffa0a1b9de>] xlog_recover_process_efis.isra.29+0x6e/0xb0 [xfs]
2016-03-04T10:31:48.559062+01:00 rkrell kernel: [ 1382.480859]  [<ffffffffa0a1e921>] xlog_recover_finish+0x21/0xa0 [xfs]
2016-03-04T10:31:48.559063+01:00 rkrell kernel: [ 1382.480923]  [<ffffffffa0a12b09>] xfs_log_mount_finish+0x29/0x50 [xfs]
2016-03-04T10:31:48.559064+01:00 rkrell kernel: [ 1382.480983]  [<ffffffffa0a0988e>] xfs_mountfs+0x58e/0x850 [xfs]
2016-03-04T10:31:48.559066+01:00 rkrell kernel: [ 1382.481044]  [<ffffffffa0a0ca60>] xfs_fs_fill_super+0x3b0/0x4d0 [xfs]
2016-03-04T10:31:48.559067+01:00 rkrell kernel: [ 1382.481061]  [<ffffffff81200516>] mount_bdev+0x1a6/0x1e0
2016-03-04T10:31:48.559068+01:00 rkrell kernel: [ 1382.481113]  [<ffffffffa0a0ade5>] xfs_fs_mount+0x15/0x20 [xfs]
2016-03-04T10:31:48.559070+01:00 rkrell kernel: [ 1382.481126]  [<ffffffff81200df8>] mount_fs+0x38/0x160
2016-03-04T10:31:48.559071+01:00 rkrell kernel: [ 1382.481139]  [<ffffffff8121be67>] vfs_kern_mount+0x67/0x110
2016-03-04T10:31:48.559074+01:00 rkrell kernel: [ 1382.481146]  [<ffffffff8121e68d>] do_mount+0x21d/0xd90
2016-03-04T10:31:48.559093+01:00 rkrell kernel: [ 1382.481153]  [<ffffffff8121f51c>] SyS_mount+0x8c/0xd0
2016-03-04T10:31:48.559095+01:00 rkrell kernel: [ 1382.481166]  [<ffffffff816aec36>] entry_SYSCALL_64_fastpath+0x16/0x75
2016-03-04T10:31:48.559096+01:00 rkrell kernel: [ 1382.485183] DWARF2 unwinder stuck at entry_SYSCALL_64_fastpath+0x16/0x75
2016-03-04T10:31:48.559097+01:00 rkrell kernel: [ 1382.485185] 
2016-03-04T10:31:48.559099+01:00 rkrell kernel: [ 1382.485188] Leftover inexact backtrace:
2016-03-04T10:31:48.559100+01:00 rkrell kernel: [ 1382.485188] 
2016-03-04T10:31:48.559102+01:00 rkrell kernel: [ 1382.485301] XFS (sdb2): Internal error xfs_trans_cancel at line 990 of file ../fs/xfs/xfs_trans.c.  Caller xlog_recover_process_efi+0x161/0x190 [xfs]
2016-03-04T10:31:48.559103+01:00 rkrell kernel: [ 1382.485317] CPU: 0 PID: 11195 Comm: mount Tainted: G           O    4.4.3-2.gedb49cc-default #1
2016-03-04T10:31:48.559105+01:00 rkrell kernel: [ 1382.485326] Hardware name: Hewlett-Packard HP ZBook 15/1909, BIOS L70 Ver. 01.34 10/28/2015
2016-03-04T10:31:48.559106+01:00 rkrell kernel: [ 1382.485342]  0000000000000000 ffff88084079fba0 ffffffff813828b1 ffff88017c6aa4a0
2016-03-04T10:31:48.559107+01:00 rkrell kernel: [ 1382.485370]  0000000000000001 ffff88084079fbb8 ffffffffa09f4e2c ffffffffa0a19a71
2016-03-04T10:31:48.559232+01:00 rkrell kernel: [ 1382.485397]  ffff88084079fbe0 ffffffffa0a0fdd6 ffff88087434ee20 ffff88087434ec90
2016-03-04T10:31:48.559233+01:00 rkrell kernel: [ 1382.485412] Call Trace:
2016-03-04T10:31:48.559235+01:00 rkrell kernel: [ 1382.485421]  [<ffffffff8101b0e5>] try_stack_unwind+0x175/0x190
2016-03-04T10:31:48.559237+01:00 rkrell kernel: [ 1382.485432]  [<ffffffff8101a039>] dump_trace+0x69/0x3a0
2016-03-04T10:31:48.559238+01:00 rkrell kernel: [ 1382.485439]  [<ffffffff8101b14b>] show_trace_log_lvl+0x4b/0x60
2016-03-04T10:31:48.559240+01:00 rkrell kernel: [ 1382.485445]  [<ffffffff8101a47c>] show_stack_log_lvl+0x10c/0x180
2016-03-04T10:31:48.559242+01:00 rkrell kernel: [ 1382.485452]  [<ffffffff8101b1e5>] show_stack+0x25/0x50
2016-03-04T10:31:48.559243+01:00 rkrell kernel: [ 1382.485458]  [<ffffffff813828b1>] dump_stack+0x63/0x82
2016-03-04T10:31:48.559245+01:00 rkrell kernel: [ 1382.485512]  [<ffffffffa09f4e2c>] xfs_error_report+0x3c/0x40 [xfs]
2016-03-04T10:31:48.559247+01:00 rkrell kernel: [ 1382.485575]  [<ffffffffa0a0fdd6>] xfs_trans_cancel+0xb6/0xe0 [xfs]
2016-03-04T10:31:48.559248+01:00 rkrell kernel: [ 1382.485642]  [<ffffffffa0a19a71>] xlog_recover_process_efi+0x161/0x190 [xfs]
2016-03-04T10:31:48.559636+01:00 rkrell kernel: [ 1382.485702]  [<ffffffffa0a1b9de>] xlog_recover_process_efis.isra.29+0x6e/0xb0 [xfs]
2016-03-04T10:31:48.559645+01:00 rkrell kernel: [ 1382.485758]  [<ffffffffa0a1e921>] xlog_recover_finish+0x21/0xa0 [xfs]
2016-03-04T10:31:48.559647+01:00 rkrell kernel: [ 1382.485815]  [<ffffffffa0a12b09>] xfs_log_mount_finish+0x29/0x50 [xfs]
2016-03-04T10:31:48.559649+01:00 rkrell kernel: [ 1382.485873]  [<ffffffffa0a0988e>] xfs_mountfs+0x58e/0x850 [xfs]
2016-03-04T10:31:48.559650+01:00 rkrell kernel: [ 1382.485930]  [<ffffffffa0a0ca60>] xfs_fs_fill_super+0x3b0/0x4d0 [xfs]
2016-03-04T10:31:48.559651+01:00 rkrell kernel: [ 1382.485943]  [<ffffffff81200516>] mount_bdev+0x1a6/0x1e0
2016-03-04T10:31:48.559653+01:00 rkrell kernel: [ 1382.485993]  [<ffffffffa0a0ade5>] xfs_fs_mount+0x15/0x20 [xfs]
2016-03-04T10:31:48.559654+01:00 rkrell kernel: [ 1382.486009]  [<ffffffff81200df8>] mount_fs+0x38/0x160
2016-03-04T10:31:48.559655+01:00 rkrell kernel: [ 1382.486020]  [<ffffffff8121be67>] vfs_kern_mount+0x67/0x110
2016-03-04T10:31:48.559657+01:00 rkrell kernel: [ 1382.486027]  [<ffffffff8121e68d>] do_mount+0x21d/0xd90
2016-03-04T10:31:48.559658+01:00 rkrell kernel: [ 1382.486035]  [<ffffffff8121f51c>] SyS_mount+0x8c/0xd0
2016-03-04T10:31:48.559666+01:00 rkrell kernel: [ 1382.486054]  [<ffffffff816aec36>] entry_SYSCALL_64_fastpath+0x16/0x75
2016-03-04T10:31:48.563693+01:00 rkrell kernel: [ 1382.490028] DWARF2 unwinder stuck at entry_SYSCALL_64_fastpath+0x16/0x75
2016-03-04T10:31:48.563711+01:00 rkrell kernel: [ 1382.490030] 
2016-03-04T10:31:48.563713+01:00 rkrell kernel: [ 1382.490032] Leftover inexact backtrace:
2016-03-04T10:31:48.563715+01:00 rkrell kernel: [ 1382.490032] 
2016-03-04T10:31:48.563716+01:00 rkrell kernel: [ 1382.490052] XFS (sdb2): xfs_do_force_shutdown(0x8) called from line 991 of file ../fs/xfs/xfs_trans.c.  Return address = 0xffffffffa0a0fdef
2016-03-04T10:31:48.563718+01:00 rkrell kernel: [ 1382.490061] XFS (sdb2): Corruption of in-memory data detected.  Shutting down filesystem
2016-03-04T10:31:48.563720+01:00 rkrell kernel: [ 1382.490064] XFS (sdb2): Please umount the filesystem and rectify the problem(s)
2016-03-04T10:31:48.563721+01:00 rkrell kernel: [ 1382.490080] XFS (sdb2): Failed to recover EFIs
2016-03-04T10:31:48.563723+01:00 rkrell kernel: [ 1382.490091] XFS (sdb2): log mount finish failed
2016-03-04T10:31:48.563729+01:00 rkrell kernel: [ 1382.490122] XFS (sdb2): xfs_log_force: error -5 returned.
2016-03-04T10:46:53.603508+01:00 rkrell kernel: [ 2287.466856] st: Version 20101219, fixed bufsize 32768, s/g segs 256
2016-03-04T10:46:53.639530+01:00 rkrell kernel: [ 2287.501174] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
2016-03-04T10:46:53.639542+01:00 rkrell kernel: [ 2287.501177] EDD information not available.
2016-03-04T10:47:23.859525+01:00 rkrell kernel: [ 2317.720544] XFS (sdb2): Mounting V5 Filesystem
2016-03-04T10:47:24.079472+01:00 rkrell kernel: [ 2317.939675] XFS (sdb2): Ending clean mount
---

After this I was not able to mount the according partition cleany.
I was forced to remove it from /etc/fstab and, run xfs_repair -L
(removing the log containing changed metadata).

I'm using the according this HDD about half a year without problems and frequently update the kernel on an OpenSUSE Tumbleweed distribution. Haven't seen any other problems before until kernel 4.4.2.

I'm still running kernel 4.4.3, this has been occurred one single time to this time although using this disk as home partition quite intensively for read and write operations.

Comment 1 René Krell 2016-03-08 11:59:41 UTC

Hardware:
- HP ZBook G2
- additional disk in the DVD slot - WDC WD7500BPKX-00HPJT0

No other I/O error noticed in /var/log/messages before this, just this one:

2016-03-04T10:08:54.401666+01:00 rkrell kernel: [    4.147242] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
2016-03-04T10:08:54.401667+01:00 rkrell kernel: [    4.152053] ata2.00: ATA-8: WDC WD7500BPKX-00HPJT0, 01.01A01, max UDMA/133
2016-03-04T10:08:54.401668+01:00 rkrell kernel: [    4.152057] ata2.00: 1465149168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
2016-03-04T10:08:54.401668+01:00 rkrell kernel: [    4.157063] ata2.00: configured for UDMA/133
2016-03-04T10:08:54.401668+01:00 rkrell kernel: [    4.157384] scsi 1:0:0:0: Direct-Access     ATA      WDC WD7500BPKX-0 1A01 PQ: 0 ANSI: 5
2016-03-04T10:08:54.401669+01:00 rkrell kernel: [    4.157799] sd 1:0:0:0: [sdb] 1465149168 512-byte logical blocks: (750 GB/699 GiB)
2016-03-04T10:08:54.401669+01:00 rkrell kernel: [    4.157803] sd 1:0:0:0: [sdb] 4096-byte physical blocks
2016-03-04T10:08:54.401670+01:00 rkrell kernel: [    4.158070] sd 1:0:0:0: [sdb] Write Protect is off
2016-03-04T10:08:54.401672+01:00 rkrell kernel: [    4.158073] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00
2016-03-04T10:08:54.401672+01:00 rkrell kernel: [    4.158195] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
2016-03-04T10:08:54.401672+01:00 rkrell kernel: [    4.169389]  sdb: sdb1 sdb2
2016-03-04T10:08:54.401673+01:00 rkrell kernel: [    4.170208] sd 1:0:0:0: [sdb] Attached SCSI disk

Comment 2 René Krell 2016-03-08 12:00:41 UTC

Created attachment 208211 [details]
/var/log/messages - full log

Comment 3 René Krell 2016-03-08 12:05:21 UTC

I'm not a kernel expert, but I tried to find a relation and I suspect this commit to be related:

https://git.kernel.org/cgit/linux/kernel/git/stable/linux-stable.git/commit/?id=7530e6fdd9f207a6ebcf669490656def4f7cf73e

The committer added:
xfs_buf_ioerror(bp, -EIO);

and in my trace there is:
XFS (sdb2): xfs_log_force: error -5 returned.

I assume EIO is still defined as:
#define EIO              5      /* I/O error */

Note You need to log in before you can comment on or make changes to this bug.