Bug 29162

Summary: Reiserfs hang with dataloss sometimes
Product: File System Reporter: roucaries.bastien+kernel
Component: ReiserFSAssignee: ReiseFS developers team (reiserfs-devel)
Status: NEW ---    
Severity: high CC: amg1127, ansla80, burbon04, c880562, dkowis+kbt, dkozlowski, fweisbec, hhamdi, jeffm, matwey.kornilov, n.milovanov, rasasi78, stephan.diestelhorst, szg00000, thkoch2001
Priority: P1    
Hardware: All   
OS: Linux   
Kernel Version: 2.6.36,2.6.37,2.6.39,3.0 Subsystem:
Regression: Yes Bisected commit-id:
Attachments: log with debug enable (see patch debug)
Debug patch
log with lockdep enable
New trace of this bug under kernel 2.6.37 No kmail
dmesg for the oops
[PATCHSET] reiserfs locking fixes
Program to deadlock reiserfs
dmesg for the oops (3.12.6)
Output of LOCKDEP on a locked system
All Blocked processes when system locked up

Description roucaries.bastien+kernel 2011-02-15 09:36:39 UTC
Reiserfs hang and it is a regression compared to 2.6.33

System trace is here:
Nov 18 15:25:08 portablebastien kernel: [19920.664304] kalarm        D 00000001004a5de3     0  2995      1 0x00000000
Nov 18 15:25:08 portablebastien kernel: [19920.664312]  ffff88011cfced00 0000000000000082 ffff880000000000 ffffffff81632020
Nov 18 15:25:08 portablebastien kernel: [19920.664319]  0000000000014940 0000000000014940 ffff8800cabfffd8 0000000000014940
Nov 18 15:25:08 portablebastien kernel: [19920.664325]  0000000000014940 ffff88011cfcefd8 ffff88011cfcefe0 ffff88011cfced00
Nov 18 15:25:08 portablebastien kernel: [19920.664331] Call Trace:
Nov 18 15:25:08 portablebastien kernel: [19920.664364]  [<ffffffffa01aab69>] ? queue_log_writer+0x7e/0xac [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664373]  [<ffffffff8103f7c9>] ? default_wake_function+0x0/0xf
Nov 18 15:25:08 portablebastien kernel: [19920.664386]  [<ffffffffa01ae70a>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664399]  [<ffffffffa01b1c65>] ? xattr_lookup+0x17/0xef [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664412]  [<ffffffffa01ae8b4>] ? journal_begin+0xbd/0xfa [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664425]  [<ffffffffa01a0516>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664431]  [<ffffffff81048a76>] ? current_fs_time+0x1e/0x24
Nov 18 15:25:08 portablebastien kernel: [19920.664438]  [<ffffffff81107d03>] ? __mark_inode_dirty+0x27/0x1ac
Nov 18 15:25:08 portablebastien kernel: [19920.664444]  [<ffffffff810fdcf4>] ? file_update_time+0xf6/0x121
Nov 18 15:25:08 portablebastien kernel: [19920.664450]  [<ffffffff810b0703>] ? __generic_file_aio_write+0x164/0x280
Nov 18 15:25:08 portablebastien kernel: [19920.664457]  [<ffffffff8124e41e>] ? sock_aio_read+0xb6/0xc5
Nov 18 15:25:08 portablebastien kernel: [19920.664462]  [<ffffffff810b0874>] ? generic_file_aio_write+0x55/0x9f
Nov 18 15:25:08 portablebastien kernel: [19920.664469]  [<ffffffff810ec718>] ? do_sync_write+0xb1/0xea
Nov 18 15:25:08 portablebastien kernel: [19920.664476]  [<ffffffff811533f3>] ? security_file_permission+0x18/0x2e
Nov 18 15:25:08 portablebastien kernel: [19920.664482]  [<ffffffff810ecc4b>] ? vfs_write+0xa4/0x100
Nov 18 15:25:08 portablebastien kernel: [19920.664488]  [<ffffffff810ecd5a>] ? sys_write+0x45/0x6b
Nov 18 15:25:08 portablebastien kernel: [19920.664493]  [<ffffffff81008a02>] ? system_call_fastpath+0x16/0x1b
Nov 18 15:25:08 portablebastien kernel: [19920.664505] akregator     D ffffc900054360e0     0  2996      1 0x00000000
Nov 18 15:25:08 portablebastien kernel: [19920.664511]  ffff880037bf2210 0000000000000082 ffff8800cab77aa8 ffff88011f6d6630
Nov 18 15:25:08 portablebastien kernel: [19920.664517]  0000000000014940 0000000000014940 ffff8800cab77fd8 0000000000014940
Nov 18 15:25:08 portablebastien kernel: [19920.664523]  0000000000014940 ffff880037bf24e8 ffff880037bf24f0 ffff880037bf2210
Nov 18 15:25:08 portablebastien kernel: [19920.664529] Call Trace:
Nov 18 15:25:08 portablebastien kernel: [19920.664535]  [<ffffffff8130e223>] ? schedule_hrtimeout_range_clock+0xc4/0x125
Nov 18 15:25:08 portablebastien kernel: [19920.664549]  [<ffffffffa01aab69>] ? queue_log_writer+0x7e/0xac [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664555]  [<ffffffff8103f7c9>] ? default_wake_function+0x0/0xf
Nov 18 15:25:08 portablebastien kernel: [19920.664568]  [<ffffffffa01ae70a>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664580]  [<ffffffffa01b1c65>] ? xattr_lookup+0x17/0xef [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664593]  [<ffffffffa01ae8b4>] ? journal_begin+0xbd/0xfa [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664606]  [<ffffffffa01a0516>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664611]  [<ffffffff81048a76>] ? current_fs_time+0x1e/0x24
Nov 18 15:25:08 portablebastien kernel: [19920.664617]  [<ffffffff81107d03>] ? __mark_inode_dirty+0x27/0x1ac
Nov 18 15:25:08 portablebastien kernel: [19920.664622]  [<ffffffff810fdcf4>] ? file_update_time+0xf6/0x121
Nov 18 15:25:08 portablebastien kernel: [19920.664628]  [<ffffffff810b0703>] ? __generic_file_aio_write+0x164/0x280
Nov 18 15:25:08 portablebastien kernel: [19920.664633]  [<ffffffff810b16f0>] ? generic_file_aio_read+0x51e/0x576
Nov 18 15:25:08 portablebastien kernel: [19920.664638]  [<ffffffff810b0874>] ? generic_file_aio_write+0x55/0x9f
Nov 18 15:25:08 portablebastien kernel: [19920.664644]  [<ffffffff810ec718>] ? do_sync_write+0xb1/0xea
Nov 18 15:25:08 portablebastien kernel: [19920.664650]  [<ffffffff811533f3>] ? security_file_permission+0x18/0x2e
Nov 18 15:25:08 portablebastien kernel: [19920.664656]  [<ffffffff810ecc4b>] ? vfs_write+0xa4/0x100
Nov 18 15:25:08 portablebastien kernel: [19920.664661]  [<ffffffff810ecd5a>] ? sys_write+0x45/0x6b
Nov 18 15:25:08 portablebastien kernel: [19920.664493]  [<ffffffff81008a02>] ? system_call_fastpath+0x16/0x1b
Nov 18 15:25:08 portablebastien kernel: [19920.664505] akregator     D ffffc900054360e0     0  2996      1 0x00000000
Nov 18 15:25:08 portablebastien kernel: [19920.664511]  ffff880037bf2210 0000000000000082 ffff8800cab77aa8 ffff88011f6d6630
Nov 18 15:25:08 portablebastien kernel: [19920.664517]  0000000000014940 0000000000014940 ffff8800cab77fd8 0000000000014940
Nov 18 15:25:08 portablebastien kernel: [19920.664523]  0000000000014940 ffff880037bf24e8 ffff880037bf24f0 ffff880037bf2210
Nov 18 15:25:08 portablebastien kernel: [19920.664529] Call Trace:
Nov 18 15:25:08 portablebastien kernel: [19920.664535]  [<ffffffff8130e223>] ? schedule_hrtimeout_range_clock+0xc4/0x125
Nov 18 15:25:08 portablebastien kernel: [19920.664549]  [<ffffffffa01aab69>] ? queue_log_writer+0x7e/0xac [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664555]  [<ffffffff8103f7c9>] ? default_wake_function+0x0/0xf
Nov 18 15:25:08 portablebastien kernel: [19920.664568]  [<ffffffffa01ae70a>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664580]  [<ffffffffa01b1c65>] ? xattr_lookup+0x17/0xef [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664593]  [<ffffffffa01ae8b4>] ? journal_begin+0xbd/0xfa [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664606]  [<ffffffffa01a0516>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
Nov 18 15:25:08 portablebastien kernel: [19920.664611]  [<ffffffff81048a76>] ? current_fs_time+0x1e/0x24
Nov 18 15:25:08 portablebastien kernel: [19920.664617]  [<ffffffff81107d03>] ? __mark_inode_dirty+0x27/0x1ac
Nov 18 15:25:08 portablebastien kernel: [19920.664622]  [<ffffffff810fdcf4>] ? file_update_time+0xf6/0x121
Nov 18 15:25:08 portablebastien kernel: [19920.664628]  [<ffffffff810b0703>] ? __generic_file_aio_write+0x164/0x280
Nov 18 15:25:08 portablebastien kernel: [19920.664633]  [<ffffffff810b16f0>] ? generic_file_aio_read+0x51e/0x576
Nov 18 15:25:08 portablebastien kernel: [19920.664638]  [<ffffffff810b0874>] ? generic_file_aio_write+0x55/0x9f
Nov 18 15:25:08 portablebastien kernel: [19920.664644]  [<ffffffff810ec718>] ? do_sync_write+0xb1/0xea
Nov 18 15:25:08 portablebastien kernel: [19920.664650]  [<ffffffff811533f3>] ? security_file_permission+0x18/0x2e
Nov 18 15:25:08 portablebastien kernel: [19920.664656]  [<ffffffff810ecc4b>] ? vfs_write+0xa4/0x100
Nov 18 15:25:08 portablebastien kernel: [19920.664661]  [<ffffffff810ecd5a>] ? sys_write+0x45/0x6b
Nov 18 15:25:08 portablebastien kernel: [19920.664666]  [<ffffffff81008a02>] ? system_call_fastpath+0x16/0x1b
ov 18 15:27:08 portablebastien kernel: [20040.668744] kded4         D 00000001004a8412     0  2869      1 0x00000000
Nov 18 15:27:08 portablebastien kernel: [20040.668752]  ffff8801114adf60 0000000000000086 ffff880100000000 ffffffff81632020
Nov 18 15:27:08 portablebastien kernel: [20040.668760]  0000000000014940 0000000000014940 ffff880037ad7fd8 0000000000014940
Nov 18 15:27:08 portablebastien kernel: [20040.668770]  0000000000014940 ffff8801114ae238 ffff8801114ae240 ffff8801114adf60
Nov 18 15:27:08 portablebastien kernel: [20040.668780] Call Trace:
Nov 18 15:27:08 portablebastien kernel: [20040.668815]  [<ffffffffa01aab69>] ? queue_log_writer+0x7e/0xac [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.668825]  [<ffffffff8103f7c9>] ? default_wake_function+0x0/0xf
Nov 18 15:27:08 portablebastien kernel: [20040.668840]  [<ffffffffa01ae70a>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.668848]  [<ffffffff8112c164>] ? __dquot_initialize+0x20/0x16d
Nov 18 15:27:08 portablebastien kernel: [20040.668862]  [<ffffffffa01ae8b4>] ? journal_begin+0xbd/0xfa [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.668875]  [<ffffffffa0196bff>] ? reiserfs_create+0xe6/0x205 [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.668883]  [<ffffffff810f4712>] ? generic_permission+0xe/0x8a
Nov 18 15:27:08 portablebastien kernel: [20040.668892]  [<ffffffff810f54b7>] ? vfs_create+0x66/0x88
Nov 18 15:27:08 portablebastien kernel: [20040.668898]  [<ffffffff810f49c5>] ? d_alloc_and_lookup+0x4a/0x67
Nov 18 15:27:08 portablebastien kernel: [20040.668904]  [<ffffffff810f5e6a>] ? do_last+0x268/0x536
Nov 18 15:27:08 portablebastien kernel: [20040.668911]  [<ffffffff810f7aa9>] ? do_filp_open+0x1e4/0x53b
Nov 18 15:27:08 portablebastien kernel: [20040.668919]  [<ffffffff810eb2e0>] ? do_sys_open+0x56/0xe4
Nov 18 15:27:08 portablebastien kernel: [20040.668926]  [<ffffffff81008a02>] ? system_call_fastpath+0x16/0x1b
Nov 18 15:27:08 portablebastien kernel: [20040.673550] kalarm        D 00000001004a5de3     0  2995      1 0x00000000
Nov 18 15:27:08 portablebastien kernel: [20040.673557]  ffff88011cfced00 0000000000000082 ffff880000000000 ffffffff81632020
Nov 18 15:27:08 portablebastien kernel: [20040.673563]  0000000000014940 0000000000014940 ffff8800cabfffd8 0000000000014940
Nov 18 15:27:08 portablebastien kernel: [20040.673571]  0000000000014940 ffff88011cfcefd8 ffff88011cfcefe0 ffff88011cfced00
Nov 18 15:27:08 portablebastien kernel: [20040.673580] Call Trace:
Nov 18 15:27:08 portablebastien kernel: [20040.673598]  [<ffffffffa01aab69>] ? queue_log_writer+0x7e/0xac [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.673606]  [<ffffffff8103f7c9>] ? default_wake_function+0x0/0xf
Nov 18 15:27:08 portablebastien kernel: [20040.673620]  [<ffffffffa01ae70a>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.673633]  [<ffffffffa01b1c65>] ? xattr_lookup+0x17/0xef [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.673647]  [<ffffffffa01ae8b4>] ? journal_begin+0xbd/0xfa [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.673661]  [<ffffffffa01a0516>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.673668]  [<ffffffff81048a76>] ? current_fs_time+0x1e/0x24
Nov 18 15:27:08 portablebastien kernel: [20040.673676]  [<ffffffff81107d03>] ? __mark_inode_dirty+0x27/0x1ac
Nov 18 15:27:08 portablebastien kernel: [20040.673683]  [<ffffffff810fdcf4>] ? file_update_time+0xf6/0x121
Nov 18 15:27:08 portablebastien kernel: [20040.673690]  [<ffffffff810b0703>] ? __generic_file_aio_write+0x164/0x280
Nov 18 15:27:08 portablebastien kernel: [20040.673698]  [<ffffffff8124e41e>] ? sock_aio_read+0xb6/0xc5
Nov 18 15:27:08 portablebastien kernel: [20040.673704]  [<ffffffff810b0874>] ? generic_file_aio_write+0x55/0x9f
Nov 18 15:27:08 portablebastien kernel: [20040.673711]  [<ffffffff810ec718>] ? do_sync_write+0xb1/0xea
Nov 18 15:27:08 portablebastien kernel: [20040.673719]  [<ffffffff811533f3>] ? security_file_permission+0x18/0x2e
Nov 18 15:27:08 portablebastien kernel: [20040.673726]  [<ffffffff810ecc4b>] ? vfs_write+0xa4/0x100
Nov 18 15:27:08 portablebastien kernel: [20040.673732]  [<ffffffff810ecd5a>] ? sys_write+0x45/0x6b
Nov 18 15:27:08 portablebastien kernel: [20040.673738]  [<ffffffff81008a02>] ? system_call_fastpath+0x16/0x1b
Nov 18 15:27:08 portablebastien kernel: [20040.678435] akregator     D ffffc900054360e0     0  2996      1 0x00000000
Nov 18 15:27:08 portablebastien kernel: [20040.678441]  ffff880037bf2210 0000000000000082 ffff8800cab77aa8 ffff88011f6d6630
Nov 18 15:27:08 portablebastien kernel: [20040.678448]  0000000000014940 0000000000014940 ffff8800cab77fd8 0000000000014940
Nov 18 15:27:08 portablebastien kernel: [20040.678454]  0000000000014940 ffff880037bf24e8 ffff880037bf24f0 ffff880037bf2210
Nov 18 15:27:08 portablebastien kernel: [20040.678460] Call Trace:
Nov 18 15:27:08 portablebastien kernel: [20040.678467]  [<ffffffff8130e223>] ? schedule_hrtimeout_range_clock+0xc4/0x125
Nov 18 15:27:08 portablebastien kernel: [20040.678482]  [<ffffffffa01aab69>] ? queue_log_writer+0x7e/0xac [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.678488]  [<ffffffff8103f7c9>] ? default_wake_function+0x0/0xf
Nov 18 15:27:08 portablebastien kernel: [20040.678501]  [<ffffffffa01ae70a>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.678514]  [<ffffffffa01b1c65>] ? xattr_lookup+0x17/0xef [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.678526]  [<ffffffffa01ae8b4>] ? journal_begin+0xbd/0xfa [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.678539]  [<ffffffffa01a0516>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.678544]  [<ffffffff81048a76>] ? current_fs_time+0x1e/0x24
Nov 18 15:27:08 portablebastien kernel: [20040.678550]  [<ffffffff81107d03>] ? __mark_inode_dirty+0x27/0x1ac
Nov 18 15:27:08 portablebastien kernel: [20040.678555]  [<ffffffff810fdcf4>] ? file_update_time+0xf6/0x121
Nov 18 15:27:08 portablebastien kernel: [20040.678560]  [<ffffffff810b0703>] ? __generic_file_aio_write+0x164/0x280
Nov 18 15:27:08 portablebastien kernel: [20040.678566]  [<ffffffff810b16f0>] ? generic_file_aio_read+0x51e/0x576
Nov 18 15:27:08 portablebastien kernel: [20040.678571]  [<ffffffff810b0874>] ? generic_file_aio_write+0x55/0x9f
Nov 18 15:27:08 portablebastien kernel: [20040.678577]  [<ffffffff810ec718>] ? do_sync_write+0xb1/0xea
Nov 18 15:27:08 portablebastien kernel: [20040.678583]  [<ffffffff811533f3>] ? security_file_permission+0x18/0x2e
Nov 18 15:27:08 portablebastien kernel: [20040.678588]  [<ffffffff810ecc4b>] ? vfs_write+0xa4/0x100
Nov 18 15:27:08 portablebastien kernel: [20040.678593]  [<ffffffff810ecd5a>] ? sys_write+0x45/0x6b
Nov 18 15:27:08 portablebastien kernel: [20040.678598]  [<ffffffff81008a02>] ? system_call_fastpath+0x16/0x1b
Nov 18 15:27:08 portablebastien kernel: [20040.683411] pidgin        D 00000001004abe7c     0  7472   2942 0x00000000
Nov 18 15:27:08 portablebastien kernel: [20040.683417]  ffff8800b83cc420 0000000000000082 0000000000000000 ffffffff81632020
Nov 18 15:27:08 portablebastien kernel: [20040.683424]  0000000000014940 0000000000014940 ffff88003d1d7fd8 0000000000014940
Nov 18 15:27:08 portablebastien kernel: [20040.683430]  0000000000014940 ffff8800b83cc6f8 ffff8800b83cc700 ffff8800b83cc420
Nov 18 15:27:08 portablebastien kernel: [20040.683436] Call Trace:
Nov 18 15:27:08 portablebastien kernel: [20040.683451]  [<ffffffffa01aab69>] ? queue_log_writer+0x7e/0xac [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.683457]  [<ffffffff8103f7c9>] ? default_wake_function+0x0/0xf
Nov 18 15:27:08 portablebastien kernel: [20040.683470]  [<ffffffffa01ae70a>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.683476]  [<ffffffff8112c164>] ? __dquot_initialize+0x20/0x16d
Nov 18 15:27:08 portablebastien kernel: [20040.683489]  [<ffffffffa01ae8b4>] ? journal_begin+0xbd/0xfa [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.683500]  [<ffffffffa0196bff>] ? reiserfs_create+0xe6/0x205 [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.683506]  [<ffffffff810f4712>] ? generic_permission+0xe/0x8a
Nov 18 15:27:08 portablebastien kernel: [20040.683512]  [<ffffffff810f54b7>] ? vfs_create+0x66/0x88
Nov 18 15:27:08 portablebastien kernel: [20040.683517]  [<ffffffff810f5e6a>] ? do_last+0x268/0x536
Nov 18 15:27:08 portablebastien kernel: [20040.683523]  [<ffffffff810f7aa9>] ? do_filp_open+0x1e4/0x53b
Nov 18 15:27:08 portablebastien kernel: [20040.683529]  [<ffffffff810eb2e0>] ? do_sys_open+0x56/0xe4
Nov 18 15:27:08 portablebastien kernel: [20040.683534]  [<ffffffff81008a02>] ? system_call_fastpath+0x16/0x1b
Nov 18 15:27:08 portablebastien kernel: [20040.688478] okular        D 00000001004a9d20     0 19668  19569 0x00000000
Nov 18 15:27:08 portablebastien kernel: [20040.688485]  ffff8800b813caf0 0000000000000082 0000000000000000 ffff88011f65caf0
Nov 18 15:27:08 portablebastien kernel: [20040.688491]  0000000000014940 0000000000014940 ffff8800b82f9fd8 0000000000014940
Nov 18 15:27:08 portablebastien kernel: [20040.688497]  0000000000014940 ffff8800b813cdc8 ffff8800b813cdd0 ffff8800b813caf0
Nov 18 15:27:08 portablebastien kernel: [20040.688506] Call Trace:
Nov 18 15:27:08 portablebastien kernel: [20040.688522]  [<ffffffffa01aab69>] ? queue_log_writer+0x7e/0xac [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.688530]  [<ffffffff8103f7c9>] ? default_wake_function+0x0/0xf
Nov 18 15:27:08 portablebastien kernel: [20040.688543]  [<ffffffffa01ae70a>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.688558]  [<ffffffffa01ae8b4>] ? journal_begin+0xbd/0xfa [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.688571]  [<ffffffffa01997a4>] ? reiserfs_truncate_file+0x175/0x279 [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.688579]  [<ffffffff810c728f>] ? unmap_mapping_range+0x59/0xf5
Nov 18 15:27:08 portablebastien kernel: [20040.688592]  [<ffffffffa019b6ae>] ? reiserfs_vfs_truncate_file+0x22/0x2d [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.688599]  [<ffffffff810b9269>] ? vmtruncate+0x36/0x41
Nov 18 15:27:08 portablebastien kernel: [20040.688612]  [<ffffffffa0197c20>] ? reiserfs_setattr+0x26f/0x2f4 [reiserfs]
Nov 18 15:27:08 portablebastien kernel: [20040.688619]  [<ffffffff81048a76>] ? current_fs_time+0x1e/0x24
Nov 18 15:27:08 portablebastien kernel: [20040.688626]  [<ffffffff810ff2e1>] ? notify_change+0x195/0x27e
Nov 18 15:27:08 portablebastien kernel: [20040.688633]  [<ffffffff810ec0ac>] ? do_truncate+0x68/0x86
Nov 18 15:27:08 portablebastien kernel: [20040.688639]  [<ffffffff810eb531>] ? __dentry_open+0x186/0x291
Nov 18 15:27:08 portablebastien kernel: [20040.688645]  [<ffffffff810f45e8>] ? get_write_access+0x10/0x3a
Nov 18 15:27:08 portablebastien kernel: [20040.688652]  [<ffffffff810f605f>] ? do_last+0x45d/0x536
Nov 18 15:27:08 portablebastien kernel: [20040.688658]  [<ffffffff810f7aa9>] ? do_filp_open+0x1e4/0x53b
Nov 18 15:27:08 portablebastien kernel: [20040.688665]  [<ffffffff810ec802>] ? do_sync_read+0xb1/0xea
Nov 18 15:27:08 portablebastien kernel: [20040.688672]  [<ffffffff810eb2e0>] ? do_sys_open+0x56/0xe4
Nov 18 15:27:08 portablebastien kernel: [20040.688678]  [<ffffffff81008a02>] ? system_call_fastpath+0x16/0x1b
Comment 1 roucaries.bastien+kernel 2011-02-15 09:38:27 UTC
Add a new log with lockdep
Comment 2 roucaries.bastien+kernel 2011-02-15 09:39:14 UTC
Created attachment 47832 [details]
log with debug enable (see patch debug)

log with lockdep
Comment 3 roucaries.bastien+kernel 2011-02-15 09:41:28 UTC
Created attachment 47842 [details]
Debug patch
Comment 4 roucaries.bastien+kernel 2011-02-15 09:44:35 UTC
Created attachment 47852 [details]
log with lockdep enable
Comment 5 roucaries.bastien+kernel 2011-02-15 09:45:44 UTC
I get also this

[20404.979618] =================================
[20404.979659] [ INFO: inconsistent lock state ]
[20404.979683] 2.6.36reiser #6
[20404.979698] ---------------------------------
[20404.979722] inconsistent {IN-RECLAIM_FS-R} -> {RECLAIM_FS-ON-W} usage.
[20404.979759] khubd/268 [HC0[0]:SC0[0]:HE1:SE1] takes:
[20404.979789]  (iprune_sem){+++++-}, at: [<ffffffff811175b9>] invalidate_inodes+0x39/0x142
[20404.979849] {IN-RECLAIM_FS-R} state was registered at:
[20404.979880]   [<ffffffff81076053>] __lock_acquire+0x385/0xd1a
[20404.979921]   [<ffffffff81076abf>] lock_acquire+0xd7/0x104
[20404.979957]   [<ffffffff8134b9de>] down_read+0x47/0x5c
[20404.979993]   [<ffffffff8111794e>] shrink_icache_memory+0x48/0x224
[20404.980025]   [<ffffffff810d0256>] shrink_slab+0xdb/0x15f
[20404.980025]   [<ffffffff810d1a21>] balance_pgdat+0x2ff/0x525
[20404.980025]   [<ffffffff810d1f24>] kswapd+0x2dd/0x31a
[20404.980025]   [<ffffffff810642ae>] kthread+0x8c/0x94
[20404.980025]   [<ffffffff8100a964>] kernel_thread_helper+0x4/0x10
[20404.980025] irq event stamp: 18699
[20404.980025] hardirqs last  enabled at (18699): [<ffffffff810a1d98>] __call_rcu+0x136/0x149
[20404.980025] hardirqs last disabled at (18698): [<ffffffff810a1c97>] __call_rcu+0x35/0x149
[20404.980025] softirqs last  enabled at (17986): [<ffffffff81121369>] bdi_queue_work+0xcb/0xd4
[20404.980025] softirqs last disabled at (17982): [<ffffffff8134c655>] _raw_spin_lock_bh+0x11/0x40
[20404.980025]
[20404.980025] other info that might help us debug this:
[20404.980025] 8 locks held by khubd/268:
[20404.980025]  #0:  (&__lockdep_no_validate__){+.+.+.}, at: [<ffffffffa014d759>] hub_thread+0x11f/0xe77 [usbcore]
[20404.980025]  #1:  (&__lockdep_no_validate__){+.+.+.}, at: [<ffffffffa014c702>] usb_disconnect+0x58/0x11e [usbcore]
[20404.980025]  #2:  (&__lockdep_no_validate__){+.+.+.}, at: [<ffffffff812580bc>] device_release_driver+0x18/0x2d
[20404.980025]  #3:  (&shost->scan_mutex){+.+.+.}, at: [<ffffffffa0026059>] scsi_remove_host+0x21/0x110 [scsi_mod]
[20404.980025]  #4:  (&__lockdep_no_validate__){+.+.+.}, at: [<ffffffff812580bc>] device_release_driver+0x18/0x2d
[20404.980025]  #5:  (&type->s_umount_key#38){.+.+.+}, at: [<ffffffff81105900>] get_super+0x67/0xb7
[20404.980025]  #6:  (iprune_sem){+++++-}, at: [<ffffffff811175b9>] invalidate_inodes+0x39/0x142
[20404.980025]  #7:  (&fsnotify_mark_srcu){.+.+.+}, at: [<ffffffff8113060a>] fsnotify+0x79/0x449
[20404.980025]
[20404.980025] stack backtrace:
[20404.980025] Pid: 268, comm: khubd Not tainted 2.6.36reiser #6
[20404.980025] Call Trace:
[20404.980025]  [<ffffffff81074afa>] valid_state+0x17f/0x192
[20404.980025]  [<ffffffff8107546e>] ? check_usage_backwards+0x0/0x81
[20404.980025]  [<ffffffff81074c66>] mark_lock+0x159/0x235
[20404.980025]  [<ffffffff81130c99>] ? fsnotify_create_event+0x39/0x162
[20404.980025]  [<ffffffff81074d94>] mark_held_locks+0x52/0x70
[20404.980025]  [<ffffffff81074e4b>] lockdep_trace_alloc+0x99/0xbb
[20404.980025]  [<ffffffff810fb7d0>] kmem_cache_alloc+0x2d/0x141
[20404.980025]  [<ffffffff81130c99>] fsnotify_create_event+0x39/0x162
[20404.980025]  [<ffffffff81130553>] send_to_group+0x10f/0x14d
[20404.980025]  [<ffffffff81130859>] fsnotify+0x2c8/0x449
[20404.980025]  [<ffffffff811315ac>] fsnotify_unmount_inodes+0xb8/0xf9
[20404.980025]  [<ffffffff811175cd>] invalidate_inodes+0x4d/0x142
[20404.980025]  [<ffffffff8112b98f>] __invalidate_device+0x30/0x4e
[20404.980025]  [<ffffffff811a731b>] invalidate_partition+0x28/0x3d
[20404.980025]  [<ffffffff811565e7>] del_gendisk+0x36/0xf1
[20404.980025]  [<ffffffff81255760>] ? device_del+0x19e/0x1a6
[20404.980025]  [<ffffffffa00f1f45>] sd_remove+0x61/0x9f [sd_mod]
[20404.980025]  [<ffffffff81257f9a>] __device_release_driver+0x76/0xcc
[20404.991845]  [<ffffffff812580c4>] device_release_driver+0x20/0x2d
[20404.991845]  [<ffffffff812573cc>] bus_remove_device+0xb1/0xc6
[20404.993852]  [<ffffffff812556fc>] device_del+0x13a/0x1a6
[20404.993852]  [<ffffffffa002f830>] __scsi_remove_device+0x4d/0x98 [scsi_mod]
[20404.993852]  [<ffffffffa002c77d>] scsi_forget_host+0x47/0x6c [scsi_mod]
[20404.993852]  [<ffffffffa00260c5>] scsi_remove_host+0x8d/0x110 [scsi_mod]
[20404.993852]  [<ffffffffa0066c70>] quiesce_and_remove_host+0x60/0x9c [usb_storage]
[20404.993852]  [<ffffffffa0066d69>] usb_stor_disconnect+0x1d/0x29 [usb_storage]
[20404.993852]  [<ffffffffa0154480>] usb_unbind_interface+0x6c/0x13f [usbcore]
[20404.993852]  [<ffffffff81257f9a>] __device_release_driver+0x76/0xcc
[20405.003718]  [<ffffffff812580c4>] device_release_driver+0x20/0x2d
[20405.003718]  [<ffffffff812573cc>] bus_remove_device+0xb1/0xc6
[20405.006684]  [<ffffffff812556fc>] device_del+0x13a/0x1a6
[20405.006684]  [<ffffffffa01519ee>] usb_disable_device+0x80/0xf7 [usbcore]
[20405.006684]  [<ffffffffa014c738>] usb_disconnect+0x8e/0x11e [usbcore]
[20405.010204]  [<ffffffffa014db04>] hub_thread+0x4ca/0xe77 [usbcore]
[20405.010204]  [<ffffffff81075014>] ? trace_hardirqs_on_caller+0x111/0x135
[20405.010204]  [<ffffffff81064747>] ? autoremove_wake_function+0x0/0x34
[20405.010204]  [<ffffffffa014d63a>] ? hub_thread+0x0/0xe77 [usbcore]
[20405.010204]  [<ffffffff810642ae>] kthread+0x8c/0x94
[20405.010204]  [<ffffffff8100a964>] kernel_thread_helper+0x4/0x10
[20405.010204]  [<ffffffff8134cf10>] ? restore_args+0x0/0x30
[20405.010204]  [<ffffffff81064222>] ? kthread+0x0/0x94
[20405.010204]  [<ffffffff8100a960>] ? kernel_thread_helper+0x0/0x10
Comment 6 roucaries.bastien+kernel 2011-02-15 09:47:13 UTC
Very hard to reproduce. Take between 30 to 6 hours to get it.

using git pull in parallel increase the chance to hit.

I suffer dataloss at reboot and I rebuild twice my / partition using reiserfsck and restore using a backup once.
Comment 7 Thomas Koch 2011-03-08 20:44:43 UTC
Reported also for Debian unstable: 
http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=616334
Comment 8 Jeff Mahoney 2011-03-15 22:03:12 UTC
Bastien, are you using ACLs or security xattrs (e.g. selinux) on your file system?

If you're not, I'll have to keep looking, but it seems as though Frederic's BKL replacement patches got the nested behavior of the BKL right but not the drop-over-schedule part completely right.

The BKL can do nesting but drops the lock entirely over schedule. The reiserfs write lock can do nesting but only drops one reference to the lock over schedule. So if the lock is nested and a schedule occurs, the lock isn't truly dropped.

The most obvious case of nesting the write lock like this is when using extended attributes since it will nest journal transactions. There are others, though.

I'll work up a patch to test this theory and post it shortly.
Comment 9 roucaries.bastien+kernel 2011-03-28 09:33:30 UTC
Dear Jeff,

Yes I have acl enable.

If your theory is right why lockdep does not detect this kind of scenario ? Do you need a virtual lock in order to lockdep to automatically detect this ?

Sorry for the delay, real life suck

Bastien
Comment 10 Maximilian Decker 2011-05-02 16:11:07 UTC
hi there,

I'm just curious if there are any news on this ?
I ran into the very same problem (well, at least same symptoms, but nothing specific in the logs) after upgrading openSuSE 11.3 to 11.4 (kernel 2.6.37.1+suse), running rootfs on ext4, dm-crypted /home with reiserfs (rw,relatime) and a non-encrypted reiserfs data volume on top of LVM (rw,noatime,acl).

In my case the system was running for some hours and suddenly after trying to start "kwrite" (I'm running KDE 4 btw.) the /home - Partition was dead, but without dataloss after SysRq-reboot. 
As that specific system is kind of support and development system for me, I immediately reverted back to kernel 2.6.34 (i.e. openSuSE 11.3 kernel) as a workaround, no freezes since then (several weeks).

I recently also tried to reproduce that issue with Ubuntu and openSuSE on top of a 2.6.38 kernel, using ramdisks and hard disk partitions, but no luck so far, test cases ran for hours without a single glitch.

Well, today I switched my openSuSE (the one that crashed the reiserfs once) to 2.6.38. I have made backups, so let's see what happens. 

I wonder if either hardly anyone suffers from this bug or if it is only caused in some very special combinations, or if it is just gone with 2.6.38.

Reiserfs IMHO has been a rock solid, fast and reliable file system over the last years, and I would hate to be forced to drop it just because of that silly weird bug .... :-/


cheers,

- Maximilian
Comment 11 Frederic Weisbecker 2011-05-11 14:54:46 UTC
I'm still investigating on this.

I had tested concurrent loops of git-reset/git-merge for 2 days few weeks ago but couldn't reproduce. I think it was on 2.6.38 though.

I've tested the same this night with 2.6.37.1 as in your latest report, but couldn't manage to trigger the issue either.

So now I'm going to test kmail as it seems to often happen as a good trigger for this bug.

I'll give you more news soon.
Comment 12 Frederic Weisbecker 2011-05-13 13:09:03 UTC
Ah I think I finally got something. I've run those git-reset/git-merge parallel loops for one night. No result. I retried with kmail in parallel fetching hundreds thousands emails. Still no result.

Then I let the machine this night doing nothing, there was just kmail in the background.

And today it seems frozen. I can't login, the screen is shutdown and typing on the keyboard doesn't shed it as usual. So I think I finally succeded to get a crash :-D

Now whether it's that reiserfs crash or not, I don't know.

So I'm going to try some more things, this time with a serial console to get the messages.

If you are aware of something more mechanical to reproduce, I'm really interested.

Thanks.
Comment 13 Maximilian Decker 2011-05-17 07:16:24 UTC
well my openSuSE box running on 2.6.38.4 is up for 14 days now, usage is everything between idle and stressed under quite different workloads. 
No crash so far. 

Suspicion arises that somehow the problem is either gone or at least much more harder to reproduce on 2.6.38. It would be interesting why, though.

@Bastien - did you ever get to test on 2.6.38 ?
Comment 14 Maximilian Decker 2011-05-17 09:19:42 UTC
oh no, it just happened again - I should not have commended the 2.6.38.4 kernel for being fine again with reiserfs :-/

The dm-crypted /home reiserfs - Partition is dead again, whereas the other non-encrypted reiserfs partition on top of LVM2 is still accessible. Every process trying to access /home gets stuck now. All the other mounted filesystems (based on ext4, cifs) are ok.

There is nothing unusual in the logs oder dmesg (no debug patches or config options were set in this kernel, however).

The crash happend while trying to save a screenshot, the "save as" dialog opened but did not manage to show the folder contents. At that time the system was quite loaded running several applications and virtual machines (but no out-of-memory condition or whatsoever occured).

So, looks like there still is a serious issue with reiserfs on 2.6.38.
Comment 15 Frederic Weisbecker 2011-05-17 13:15:51 UTC
Ok, good to know.

Well it's fairly possible that 2.6.38 got some patch that lowered the likeliness
of this to happen. In any case I still need to find a way to reproduce that.

I've been unable to trigger the issue again. I'm going to use some stress test tools like xfstools or so and see if that can trigger the thing faster.
Comment 16 roucaries.bastien+kernel 2011-05-21 14:36:59 UTC
I achieved to reproduce on 2.6.37,
new trace:
May 21 14:18:00 portablebastien kernel: [63360.729426] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 14:18:00 portablebastien kernel: [63360.730680] kglobalaccel  D ffff8800dd9136c0     0 16193      1 0x00000000
May 21 14:18:00 portablebastien kernel: [63360.730689]  ffff88002f2ba1c0 0000000000000086 0000000000000000 ffff88007ddeb600
May 21 14:18:00 portablebastien kernel: [63360.730696]  00000000000136c0 ffff880036c95fd8 00000000000136c0 00000000000136c0
May 21 14:18:00 portablebastien kernel: [63360.730703]  ffff88002f2ba498 ffff88002f2ba4a0 ffff88002f2ba1c0 00000000000136c0
May 21 14:18:00 portablebastien kernel: [63360.730710] Call Trace:
May 21 14:18:00 portablebastien kernel: [63360.730724]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 14:18:00 portablebastien kernel: [63360.730764]  [<ffffffffa02d7b83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 21 14:18:00 portablebastien kernel: [63360.730771]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 14:18:00 portablebastien kernel: [63360.730785]  [<ffffffffa02db57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 21 14:18:00 portablebastien kernel: [63360.730799]  [<ffffffffa02deaed>] ? xattr_lookup+0x17/0xef [reiserfs]
May 21 14:18:00 portablebastien kernel: [63360.730813]  [<ffffffffa02db726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 21 14:18:00 portablebastien kernel: [63360.730826]  [<ffffffffa02cd52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
May 21 14:18:00 portablebastien kernel: [63360.730833]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 21 14:18:00 portablebastien kernel: [63360.730839]  [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac
May 21 14:18:00 portablebastien kernel: [63360.730846]  [<ffffffff81104c94>] ? file_update_time+0xf6/0x121
May 21 14:18:00 portablebastien kernel: [63360.730853]  [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280
May 21 14:18:00 portablebastien kernel: [63360.730860]  [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5
May 21 14:18:00 portablebastien kernel: [63360.730866]  [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f
May 21 14:18:00 portablebastien kernel: [63360.730872]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 21 14:18:00 portablebastien kernel: [63360.730878]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 21 14:18:00 portablebastien kernel: [63360.730883]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 21 14:18:00 portablebastien kernel: [63360.730888]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 21 14:18:00 portablebastien kernel: [63360.730894]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 14:18:00 portablebastien kernel: [63360.730901] INFO: task krunner:16219 blocked for more than 120 seconds.
May 21 14:18:00 portablebastien kernel: [63360.732085] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 14:18:00 portablebastien kernel: [63360.733226] krunner       D ffff8800dd8136c0     0 16219      1 0x00000000
May 21 14:18:00 portablebastien kernel: [63360.733233]  ffff880095dbde80 0000000000000086 0000004000000000 ffff88007ddef2c0
May 21 14:18:00 portablebastien kernel: [63360.733240]  00000000000136c0 ffff880076453fd8 00000000000136c0 00000000000136c0
May 21 14:18:00 portablebastien kernel: [63360.733246]  ffff880095dbe158 ffff880095dbe160 ffff880095dbde80 00000000000136c0
May 21 14:18:00 portablebastien kernel: [63360.733252] Call Trace:
May 21 14:18:00 portablebastien kernel: [63360.733259]  [<ffffffff81100bc8>] ? pollwake+0x0/0x4e
May 21 14:18:00 portablebastien kernel: [63360.733265]  [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193
May 21 14:18:00 portablebastien kernel: [63360.733271]  [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5
May 21 14:18:00 portablebastien kernel: [63360.733276]  [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33
May 21 14:18:00 portablebastien kernel: [63360.733282]  [<ffffffff810b631d>] ? generic_file_aio_write+0x40/0x9f
May 21 14:18:00 portablebastien kernel: [63360.733288]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 21 14:18:00 portablebastien kernel: [63360.733293]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 21 14:18:00 portablebastien kernel: [63360.733298]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 21 14:18:00 portablebastien kernel: [63360.733303]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 21 14:18:00 portablebastien kernel: [63360.733308]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 14:18:00 portablebastien kernel: [63360.733318] INFO: task konsole:16274 blocked for more than 120 seconds.
May 21 14:18:00 portablebastien kernel: [63360.734470] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 14:18:00 portablebastien kernel: [63360.735647] konsole       D ffff8800d04e1440     0 16274      1 0x00000000
May 21 14:18:00 portablebastien kernel: [63360.735653]  ffff8800d04e1440 0000000000000082 ffff880000000000 ffffffff8160b020
May 21 14:18:00 portablebastien kernel: [63360.735660]  00000000000136c0 ffff880044c5dfd8 00000000000136c0 00000000000136c0
May 21 14:18:00 portablebastien kernel: [63360.735666]  ffff8800d04e1718 ffff8800d04e1720 ffff8800d04e1440 00000000000136c0
May 21 14:18:00 portablebastien kernel: [63360.735673] Call Trace:
May 21 14:18:00 portablebastien kernel: [63360.735689]  [<ffffffffa02d7b83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 21 14:18:00 portablebastien kernel: [63360.735696]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 14:18:00 portablebastien kernel: [63360.735710]  [<ffffffffa02db57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 21 14:18:00 portablebastien kernel: [63360.735716]  [<ffffffff811035c5>] ? d_instantiate+0x31/0x46
May 21 14:18:00 portablebastien kernel: [63360.735723]  [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172
May 21 14:18:00 portablebastien kernel: [63360.735737]  [<ffffffffa02db726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 21 14:18:00 portablebastien kernel: [63360.735749]  [<ffffffffa02c3c03>] ? reiserfs_create+0xe6/0x205 [reiserfs]
May 21 14:18:00 portablebastien kernel: [63360.735755]  [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a
May 21 14:18:00 portablebastien kernel: [63360.735760]  [<ffffffff810fc470>] ? vfs_create+0x66/0x88
May 21 14:18:00 portablebastien kernel: [63360.735765]  [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67
May 21 14:18:00 portablebastien kernel: [63360.735770]  [<ffffffff810fce1a>] ? do_last+0x25f/0x526
May 21 14:18:00 portablebastien kernel: [63360.735775]  [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538
May 21 14:18:00 portablebastien kernel: [63360.735781]  [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde
May 21 14:18:00 portablebastien kernel: [63360.735786]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 14:18:00 portablebastien kernel: [63360.735792] INFO: task firefox-bin:16275 blocked for more than 120 seconds.
May 21 14:18:00 portablebastien kernel: [63360.736992] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 14:18:00 portablebastien kernel: [63360.738217] firefox-bin   D ffff8800d04e57c0     0 16275  16158 0x00000004
May 21 14:18:00 portablebastien kernel: [63360.738223]  ffff8800d04e57c0 0000000000000082 0000000000000041 ffffffff8160b020
May 21 14:18:00 portablebastien kernel: [63360.738230]  00000000000136c0 ffff8800d0473fd8 00000000000136c0 00000000000136c0
May 21 14:18:00 portablebastien kernel: [63360.738236]  ffff8800d04e5a98 ffff8800d04e5aa0 ffff8800d04e57c0 00000000000136c0
May 21 14:18:00 portablebastien kernel: [63360.738243] Call Trace:
May 21 14:18:00 portablebastien kernel: [63360.738250]  [<ffffffff810bb2e4>] ? get_page_from_freelist+0x538/0x733
May 21 14:18:00 portablebastien kernel: [63360.738265]  [<ffffffffa02d7b83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 21 14:18:00 portablebastien kernel: [63360.738272]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 14:18:00 portablebastien kernel: [63360.738286]  [<ffffffffa02db57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 21 14:18:00 portablebastien kernel: [63360.738292]  [<ffffffff811035c5>] ? d_instantiate+0x31/0x46
May 21 14:18:00 portablebastien kernel: [63360.738298]  [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172
May 21 14:18:00 portablebastien kernel: [63360.738311]  [<ffffffffa02db726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 21 14:18:00 portablebastien kernel: [63360.738324]  [<ffffffffa02c3c03>] ? reiserfs_create+0xe6/0x205 [reiserfs]
May 21 14:18:00 portablebastien kernel: [63360.738329]  [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a
May 21 14:18:00 portablebastien kernel: [63360.738334]  [<ffffffff810fc470>] ? vfs_create+0x66/0x88
May 21 14:18:00 portablebastien kernel: [63360.738339]  [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67
May 21 14:18:00 portablebastien kernel: [63360.738344]  [<ffffffff810fce1a>] ? do_last+0x25f/0x526
May 21 14:18:00 portablebastien kernel: [63360.738349]  [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538
May 21 14:18:00 portablebastien kernel: [63360.738355]  [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde
May 21 14:18:00 portablebastien kernel: [63360.738360]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 14:18:00 portablebastien kernel: [63360.738365] INFO: task firefox-bin:16343 blocked for more than 120 seconds.
May 21 14:18:00 portablebastien kernel: [63360.739632] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 14:18:00 portablebastien kernel: [63360.740973] firefox-bin   D ffff8800dd9136c0     0 16343  16158 0x00000000
May 21 14:18:00 portablebastien kernel: [63360.740980]  ffff8800b93dca40 0000000000000082 0000000000000010 ffff88010fb5f2c0
May 21 14:18:00 portablebastien kernel: [63360.740986]  00000000000136c0 ffff88006d03ffd8 00000000000136c0 00000000000136c0
May 21 14:18:00 portablebastien kernel: [63360.740994]  ffff8800b93dcd18 ffff8800b93dcd20 ffff8800b93dca40 00000000000136c0
May 21 14:18:00 portablebastien kernel: [63360.741004] Call Trace:
May 21 14:18:00 portablebastien kernel: [63360.741011]  [<ffffffff8110333c>] ? dput+0x2c/0x12f
May 21 14:18:00 portablebastien kernel: [63360.741018]  [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193
May 21 14:18:00 portablebastien kernel: [63360.741024]  [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33
May 21 14:18:00 portablebastien kernel: [63360.741030]  [<ffffffff810fe073>] ? do_unlinkat+0x52/0x157
May 21 14:18:00 portablebastien kernel: [63360.741038]  [<ffffffff8131fa95>] ? page_fault+0x25/0x30
May 21 14:18:00 portablebastien kernel: [63360.741043]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 14:20:00 portablebastien kernel: [63480.740134] INFO: task kdeinit4:16158 blocked for more than 120 seconds.
May 21 14:20:00 portablebastien kernel: [63480.744377] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 14:20:00 portablebastien kernel: [63480.746337] kdeinit4      D ffff8800dd9136c0     0 16158      1 0x00000000
May 21 14:20:00 portablebastien kernel: [63480.746344]  ffff8800c208b600 0000000000000082 ffff8800a164ba80 ffff8800c208d7c0
May 21 14:20:00 portablebastien kernel: [63480.746352]  00000000000136c0 ffff880119a65fd8 00000000000136c0 00000000000136c0
May 21 14:20:00 portablebastien kernel: [63480.746359]  ffff8800c208b8d8 ffff8800c208b8e0 ffff8800c208b600 00000000000136c0
May 21 14:20:00 portablebastien kernel: [63480.746366] Call Trace:
May 21 14:20:00 portablebastien kernel: [63480.746380]  [<ffffffff810d79c6>] ? page_move_anon_rmap+0x1e/0x29
May 21 14:20:00 portablebastien kernel: [63480.746388]  [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193
May 21 14:20:00 portablebastien kernel: [63480.746393]  [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33
May 21 14:20:00 portablebastien kernel: [63480.746400]  [<ffffffff810b631d>] ? generic_file_aio_write+0x40/0x9f
May 21 14:20:00 portablebastien kernel: [63480.746406]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 21 14:20:00 portablebastien kernel: [63480.746412]  [<ffffffff8103bcd1>] ? enqueue_task_fair+0x21/0x62
May 21 14:20:00 portablebastien kernel: [63480.746419]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 21 14:20:00 portablebastien kernel: [63480.746424]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 21 14:20:00 portablebastien kernel: [63480.746429]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 21 14:20:00 portablebastien kernel: [63480.746435]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 14:20:00 portablebastien kernel: [63480.746440] INFO: task kded4:16161 blocked for more than 120 seconds.
May 21 14:20:00 portablebastien kernel: [63480.748399] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 14:20:00 portablebastien kernel: [63480.750368] kded4         D ffff8800c208d7c0     0 16161      1 0x00000000
May 21 14:20:00 portablebastien kernel: [63480.750374]  ffff8800c208d7c0 0000000000000082 0000004000000000 ffff88011b65ca40
May 21 14:20:00 portablebastien kernel: [63480.750381]  00000000000136c0 ffff880112c6ffd8 00000000000136c0 00000000000136c0
May 21 14:20:00 portablebastien kernel: [63480.750387]  ffff8800c208da98 ffff8800c208daa0 ffff8800c208d7c0 00000000000136c0
May 21 14:20:00 portablebastien kernel: [63480.750394] Call Trace:
May 21 14:20:00 portablebastien kernel: [63480.750400]  [<ffffffff81100bc8>] ? pollwake+0x0/0x4e
May 21 14:20:00 portablebastien kernel: [63480.750406]  [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193
May 21 14:20:00 portablebastien kernel: [63480.750413]  [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5
May 21 14:20:00 portablebastien kernel: [63480.750418]  [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33
May 21 14:20:00 portablebastien kernel: [63480.750424]  [<ffffffff810b631d>] ? generic_file_aio_write+0x40/0x9f
May 21 14:20:00 portablebastien kernel: [63480.750429]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 21 14:20:00 portablebastien kernel: [63480.750434]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 21 14:20:00 portablebastien kernel: [63480.750440]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 21 14:20:00 portablebastien kernel: [63480.750444]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 21 14:20:00 portablebastien kernel: [63480.750449]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 14:20:00 portablebastien kernel: [63480.750454] INFO: task kwalletd:16175 blocked for more than 120 seconds.
May 21 14:20:00 portablebastien kernel: [63480.752480] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 14:20:00 portablebastien kernel: [63480.754493] kwalletd      D ffff8800c2089440     0 16175      1 0x00000000
May 21 14:20:00 portablebastien kernel: [63480.754499]  ffff8800c2089440 0000000000000086 ffff880000000000 ffffffff8160b020
May 21 14:20:00 portablebastien kernel: [63480.754506]  00000000000136c0 ffff8801114cbfd8 00000000000136c0 00000000000136c0
May 21 14:20:00 portablebastien kernel: [63480.754512]  ffff8800c2089718 ffff8800c2089720 ffff8800c2089440 00000000000136c0
May 21 14:20:00 portablebastien kernel: [63480.754519] Call Trace:
May 21 14:20:00 portablebastien kernel: [63480.754525]  [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193
May 21 14:20:00 portablebastien kernel: [63480.754531]  [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33
May 21 14:20:00 portablebastien kernel: [63480.754536]  [<ffffffff810b631d>] ? generic_file_aio_write+0x40/0x9f
May 21 14:20:00 portablebastien kernel: [63480.754541]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 21 14:20:00 portablebastien kernel: [63480.754547]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 21 14:20:00 portablebastien kernel: [63480.754552]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 21 14:20:00 portablebastien kernel: [63480.754557]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 21 14:20:00 portablebastien kernel: [63480.754562]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 14:20:00 portablebastien kernel: [63480.754567] INFO: task ksmserver:16179 blocked for more than 120 seconds.
May 21 14:20:00 portablebastien kernel: [63480.756617] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 14:20:00 portablebastien kernel: [63480.758707] ksmserver     D ffff88007ddeb600     0 16179  16158 0x00000004
May 21 14:20:00 portablebastien kernel: [63480.758713]  ffff88007ddeb600 0000000000000082 ffff880000000000 ffff88011b65ca40
May 21 14:20:00 portablebastien kernel: [63480.758720]  00000000000136c0 ffff8800c6513fd8 00000000000136c0 00000000000136c0
May 21 14:20:00 portablebastien kernel: [63480.758726]  ffff88007ddeb8d8 ffff88007ddeb8e0 ffff88007ddeb600 00000000000136c0
May 21 14:20:00 portablebastien kernel: [63480.758732] Call Trace:
May 21 14:20:00 portablebastien kernel: [63480.758739]  [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193
May 21 14:20:00 portablebastien kernel: [63480.758745]  [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33
May 21 14:20:00 portablebastien kernel: [63480.758750]  [<ffffffff810b631d>] ? generic_file_aio_write+0x40/0x9f
May 21 14:20:00 portablebastien kernel: [63480.758755]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 21 14:20:00 portablebastien kernel: [63480.758761]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 21 14:20:00 portablebastien kernel: [63480.758766]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 21 14:20:00 portablebastien kernel: [63480.758771]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 21 14:20:00 portablebastien kernel: [63480.758776]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 14:20:00 portablebastien kernel: [63480.758781] INFO: task kwin:16181 blocked for more than 120 seconds.
May 21 14:20:00 portablebastien kernel: [63480.760891] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 14:20:00 portablebastien kernel: [63480.763018] kwin          D ffff88007ddef2c0     0 16181  16179 0x00000000
May 21 14:20:00 portablebastien kernel: [63480.763024]  ffff88007ddef2c0 0000000000000082 0000004000000000 ffff88011b65ca40
May 21 14:20:00 portablebastien kernel: [63480.763031]  00000000000136c0 ffff8800b924dfd8 00000000000136c0 00000000000136c0
May 21 14:20:00 portablebastien kernel: [63480.763038]  ffff88007ddef598 ffff88007ddef5a0 ffff88007ddef2c0 00000000000136c0
May 21 14:20:00 portablebastien kernel: [63480.763044] Call Trace:
May 21 14:20:00 portablebastien kernel: [63480.763050]  [<ffffffff81100bc8>] ? pollwake+0x0/0x4e
May 21 14:20:00 portablebastien kernel: [63480.763056]  [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193
May 21 14:20:00 portablebastien kernel: [63480.763062]  [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5
May 21 14:20:00 portablebastien kernel: [63480.763067]  [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33
May 21 14:20:00 portablebastien kernel: [63480.763073]  [<ffffffff810b631d>] ? generic_file_aio_write+0x40/0x9f
May 21 14:20:00 portablebastien kernel: [63480.763078]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 21 14:20:00 portablebastien kernel: [63480.763083]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 21 14:20:00 portablebastien kernel: [63480.763089]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 21 14:20:00 portablebastien kernel: [63480.763093]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 21 14:20:00 portablebastien kernel: [63480.763099]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
Comment 17 roucaries.bastien+kernel 2011-05-21 14:38:28 UTC
Created attachment 58912 [details]
New trace of this bug under kernel 2.6.37 No kmail
Comment 18 Maximilian Decker 2011-05-22 11:06:19 UTC
Bastien,

could you please provide some additional information about your system ?
Maybe it helps finding some appropriate setup for Frederic to reproduce.

Here some specs about my openSuSE that crashed reiserfs twice
(2.6.37.1 after about 6 hours, 2.6.38.4 after about 14 days, now back on 2.6.34)

CPU: Dual-Code AMD running at 800MHz - 3 GHz
GPU: Radeon HD 4200 (shared mem)
RAM: 7 GB
Kernel: Desktop-Kernel (i.e. PREEMPT) 64bits

reiserfs-Partitions:
 /dev/sda7 61GB, dm-crypted, 74% usage, mounted "rw,relatime" (home-partition)
 LVM2-pooled 160G volume (PV /dev/sdb1), ~90% usage, mounted "rw,noatime,acl" (data-partition)

I tried to create some proof-of-concept setup with VMWare and direct mapped old
(i.e. intentionally slow) USB-harddrive (2,5G), using 96MB RAM for the guest OS 
(to force more hdd activity and less cache), using 8 parallel tests and 2 
reiserfs partitions, running on 2.6.37.1 for 2 days without problems.

Another test setup running on native Intel hardware with same kernel and 2 reiserfs partitions on one fast local SATA drive also did not crash within 1,5 days.
Comment 19 roucaries.bastien+kernel 2011-05-23 13:06:36 UTC
Do you mount reiserfs with acl,relatime option ? I believe it is related to acl option.
Comment 20 roucaries.bastien+kernel 2011-05-23 13:11:26 UTC
New trace also

May 21 17:03:28 portablebastien kernel: [ 9720.730560] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 17:03:28 portablebastien kernel: [ 9720.732965] krunner       D ffff8800dd8136c0     0  3838      1 0x00000000
May 21 17:03:28 portablebastien kernel: [ 9720.732973]  ffff880119784a40 0000000000000082 0000000000000000 ffff880117dc21c0
May 21 17:03:28 portablebastien kernel: [ 9720.732983]  00000000000136c0 ffff8800c948bfd8 00000000000136c0 00000000000136c0
May 21 17:03:28 portablebastien kernel: [ 9720.732992]  ffff880119784d18 ffff880119784d20 ffff880119784a40 00000000000136c0
May 21 17:03:28 portablebastien kernel: [ 9720.733009] Call Trace:
May 21 17:03:28 portablebastien kernel: [ 9720.733048]  [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 21 17:03:28 portablebastien kernel: [ 9720.733058]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 17:03:28 portablebastien kernel: [ 9720.733073]  [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 21 17:03:28 portablebastien kernel: [ 9720.733087]  [<ffffffffa02b3aed>] ? xattr_lookup+0x17/0xef [reiserfs]
May 21 17:03:28 portablebastien kernel: [ 9720.733102]  [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 21 17:03:28 portablebastien kernel: [ 9720.733116]  [<ffffffffa02a252f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
May 21 17:03:28 portablebastien kernel: [ 9720.733123]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 21 17:03:28 portablebastien kernel: [ 9720.733130]  [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac
May 21 17:03:28 portablebastien kernel: [ 9720.733138]  [<ffffffff81104c94>] ? file_update_time+0xf6/0x121
May 21 17:03:28 portablebastien kernel: [ 9720.733146]  [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280
May 21 17:03:28 portablebastien kernel: [ 9720.733154]  [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5
May 21 17:03:28 portablebastien kernel: [ 9720.733160]  [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f
May 21 17:03:28 portablebastien kernel: [ 9720.733167]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 21 17:03:28 portablebastien kernel: [ 9720.733175]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 21 17:03:28 portablebastien kernel: [ 9720.733181]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 21 17:03:28 portablebastien kernel: [ 9720.733186]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 21 17:03:28 portablebastien kernel: [ 9720.733193]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 17:03:28 portablebastien kernel: [ 9720.733204] INFO: task firefox-bin:3884 blocked for more than 120 seconds.
May 21 17:03:28 portablebastien kernel: [ 9720.735623] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 17:03:28 portablebastien kernel: [ 9720.738074] firefox-bin   D ffff8800c2d721c0     0  3884   3544 0x00000000
May 21 17:03:28 portablebastien kernel: [ 9720.738081]  ffff8800c2d721c0 0000000000000086 0000000000000000 ffffffff8160b020
May 21 17:03:28 portablebastien kernel: [ 9720.738088]  00000000000136c0 ffff8800c2fcdfd8 00000000000136c0 00000000000136c0
May 21 17:03:28 portablebastien kernel: [ 9720.738097]  ffff8800c2d72498 ffff8800c2d724a0 ffff8800c2d721c0 00000000000136c0
May 21 17:03:28 portablebastien kernel: [ 9720.738106] Call Trace:
May 21 17:03:28 portablebastien kernel: [ 9720.738124]  [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 21 17:03:28 portablebastien kernel: [ 9720.738132]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 17:03:28 portablebastien kernel: [ 9720.738147]  [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 21 17:03:28 portablebastien kernel: [ 9720.738154]  [<ffffffff811035c5>] ? d_instantiate+0x31/0x46
May 21 17:03:28 portablebastien kernel: [ 9720.738162]  [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172
May 21 17:03:28 portablebastien kernel: [ 9720.738176]  [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 21 17:03:28 portablebastien kernel: [ 9720.738189]  [<ffffffffa0298c03>] ? reiserfs_create+0xe6/0x205 [reiserfs]
May 21 17:03:28 portablebastien kernel: [ 9720.738196]  [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a
May 21 17:03:28 portablebastien kernel: [ 9720.738202]  [<ffffffff810fc470>] ? vfs_create+0x66/0x88
May 21 17:03:28 portablebastien kernel: [ 9720.738208]  [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67
May 21 17:03:28 portablebastien kernel: [ 9720.738213]  [<ffffffff810fce1a>] ? do_last+0x25f/0x526
May 21 17:03:28 portablebastien kernel: [ 9720.738219]  [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538
May 21 17:03:28 portablebastien kernel: [ 9720.738226]  [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde
May 21 17:03:28 portablebastien kernel: [ 9720.738232]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 17:05:28 portablebastien kernel: [ 9840.736224] INFO: task krunner:3838 blocked for more than 120 seconds.
May 21 17:05:28 portablebastien kernel: [ 9840.738576] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 17:05:28 portablebastien kernel: [ 9840.740930] krunner       D ffff8800dd8136c0     0  3838      1 0x00000000
May 21 17:05:28 portablebastien kernel: [ 9840.740938]  ffff880119784a40 0000000000000082 0000000000000000 ffff880117dc21c0
May 21 17:05:28 portablebastien kernel: [ 9840.740948]  00000000000136c0 ffff8800c948bfd8 00000000000136c0 00000000000136c0
May 21 17:05:28 portablebastien kernel: [ 9840.740958]  ffff880119784d18 ffff880119784d20 ffff880119784a40 00000000000136c0
May 21 17:05:28 portablebastien kernel: [ 9840.740967] Call Trace:
May 21 17:05:28 portablebastien kernel: [ 9840.741006]  [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 21 17:05:28 portablebastien kernel: [ 9840.741016]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 17:05:28 portablebastien kernel: [ 9840.741032]  [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 21 17:05:28 portablebastien kernel: [ 9840.741046]  [<ffffffffa02b3aed>] ? xattr_lookup+0x17/0xef [reiserfs]
May 21 17:05:28 portablebastien kernel: [ 9840.741064]  [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 21 17:05:28 portablebastien kernel: [ 9840.741078]  [<ffffffffa02a252f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
May 21 17:05:28 portablebastien kernel: [ 9840.741085]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 21 17:05:28 portablebastien kernel: [ 9840.741092]  [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac
May 21 17:05:28 portablebastien kernel: [ 9840.741100]  [<ffffffff81104c94>] ? file_update_time+0xf6/0x121
May 21 17:05:28 portablebastien kernel: [ 9840.741108]  [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280
May 21 17:05:28 portablebastien kernel: [ 9840.741116]  [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5
May 21 17:05:28 portablebastien kernel: [ 9840.741122]  [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f
May 21 17:05:28 portablebastien kernel: [ 9840.741129]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 21 17:05:28 portablebastien kernel: [ 9840.741137]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 21 17:05:28 portablebastien kernel: [ 9840.741143]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 21 17:05:28 portablebastien kernel: [ 9840.741148]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 21 17:05:28 portablebastien kernel: [ 9840.741155]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 17:05:28 portablebastien kernel: [ 9840.741167] INFO: task firefox-bin:3884 blocked for more than 120 seconds.
May 21 17:05:28 portablebastien kernel: [ 9840.743488] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 17:05:28 portablebastien kernel: [ 9840.745866] firefox-bin   D ffff8800c2d721c0     0  3884   3544 0x00000000
May 21 17:05:28 portablebastien kernel: [ 9840.745872]  ffff8800c2d721c0 0000000000000086 0000000000000000 ffffffff8160b020
May 21 17:05:28 portablebastien kernel: [ 9840.745879]  00000000000136c0 ffff8800c2fcdfd8 00000000000136c0 00000000000136c0
May 21 17:05:28 portablebastien kernel: [ 9840.745889]  ffff8800c2d72498 ffff8800c2d724a0 ffff8800c2d721c0 00000000000136c0
May 21 17:05:28 portablebastien kernel: [ 9840.745898] Call Trace:
May 21 17:05:28 portablebastien kernel: [ 9840.745916]  [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 21 17:05:28 portablebastien kernel: [ 9840.745924]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 17:05:28 portablebastien kernel: [ 9840.745939]  [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 21 17:05:28 portablebastien kernel: [ 9840.745946]  [<ffffffff811035c5>] ? d_instantiate+0x31/0x46
May 21 17:05:28 portablebastien kernel: [ 9840.745954]  [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172
May 21 17:05:28 portablebastien kernel: [ 9840.745968]  [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 21 17:05:28 portablebastien kernel: [ 9840.745981]  [<ffffffffa0298c03>] ? reiserfs_create+0xe6/0x205 [reiserfs]
May 21 17:05:28 portablebastien kernel: [ 9840.745988]  [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a
May 21 17:05:28 portablebastien kernel: [ 9840.745994]  [<ffffffff810fc470>] ? vfs_create+0x66/0x88
May 21 17:05:28 portablebastien kernel: [ 9840.746000]  [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67
May 21 17:05:28 portablebastien kernel: [ 9840.746006]  [<ffffffff810fce1a>] ? do_last+0x25f/0x526
May 21 17:05:28 portablebastien kernel: [ 9840.746012]  [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538
May 21 17:05:28 portablebastien kernel: [ 9840.746019]  [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde
May 21 17:05:28 portablebastien kernel: [ 9840.746025]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 17:07:28 portablebastien kernel: [ 9960.744122] INFO: task krunner:3838 blocked for more than 120 seconds.
May 21 17:07:28 portablebastien kernel: [ 9960.746505] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 17:07:28 portablebastien kernel: [ 9960.748918] krunner       D ffff8800dd8136c0     0  3838      1 0x00000000
May 21 17:07:28 portablebastien kernel: [ 9960.748927]  ffff880119784a40 0000000000000082 0000000000000000 ffff880117dc21c0
May 21 17:07:28 portablebastien kernel: [ 9960.748936]  00000000000136c0 ffff8800c948bfd8 00000000000136c0 00000000000136c0
May 21 17:07:28 portablebastien kernel: [ 9960.748946]  ffff880119784d18 ffff880119784d20 ffff880119784a40 00000000000136c0
May 21 17:07:28 portablebastien kernel: [ 9960.748955] Call Trace:
May 21 17:07:28 portablebastien kernel: [ 9960.748994]  [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 21 17:07:28 portablebastien kernel: [ 9960.749005]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 17:07:28 portablebastien kernel: [ 9960.749020]  [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 21 17:07:28 portablebastien kernel: [ 9960.749034]  [<ffffffffa02b3aed>] ? xattr_lookup+0x17/0xef [reiserfs]
May 21 17:07:28 portablebastien kernel: [ 9960.749049]  [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 21 17:07:28 portablebastien kernel: [ 9960.749063]  [<ffffffffa02a252f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
May 21 17:07:28 portablebastien kernel: [ 9960.749070]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 21 17:07:28 portablebastien kernel: [ 9960.749077]  [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac
May 21 17:07:28 portablebastien kernel: [ 9960.749085]  [<ffffffff81104c94>] ? file_update_time+0xf6/0x121
May 21 17:07:28 portablebastien kernel: [ 9960.749093]  [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280
May 21 17:07:28 portablebastien kernel: [ 9960.749101]  [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5
May 21 17:07:28 portablebastien kernel: [ 9960.749107]  [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f
May 21 17:07:28 portablebastien kernel: [ 9960.749114]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 21 17:07:28 portablebastien kernel: [ 9960.749121]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 21 17:07:28 portablebastien kernel: [ 9960.749128]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 21 17:07:28 portablebastien kernel: [ 9960.749133]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 21 17:07:28 portablebastien kernel: [ 9960.749140]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 17:07:28 portablebastien kernel: [ 9960.749151] INFO: task firefox-bin:3884 blocked for more than 120 seconds.
May 21 17:07:28 portablebastien kernel: [ 9960.751556] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 17:07:28 portablebastien kernel: [ 9960.754002] firefox-bin   D ffff8800c2d721c0     0  3884   3544 0x00000000
May 21 17:07:28 portablebastien kernel: [ 9960.754008]  ffff8800c2d721c0 0000000000000086 0000000000000000 ffffffff8160b020
May 21 17:07:28 portablebastien kernel: [ 9960.754015]  00000000000136c0 ffff8800c2fcdfd8 00000000000136c0 00000000000136c0
May 21 17:07:28 portablebastien kernel: [ 9960.754024]  ffff8800c2d72498 ffff8800c2d724a0 ffff8800c2d721c0 00000000000136c0
May 21 17:07:28 portablebastien kernel: [ 9960.754033] Call Trace:
May 21 17:07:28 portablebastien kernel: [ 9960.754051]  [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 21 17:07:28 portablebastien kernel: [ 9960.754058]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 17:07:28 portablebastien kernel: [ 9960.754073]  [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 21 17:07:28 portablebastien kernel: [ 9960.754081]  [<ffffffff811035c5>] ? d_instantiate+0x31/0x46
May 21 17:07:28 portablebastien kernel: [ 9960.754088]  [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172
May 21 17:07:28 portablebastien kernel: [ 9960.754103]  [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 21 17:07:28 portablebastien kernel: [ 9960.754116]  [<ffffffffa0298c03>] ? reiserfs_create+0xe6/0x205 [reiserfs]
May 21 17:07:28 portablebastien kernel: [ 9960.754123]  [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a
May 21 17:07:28 portablebastien kernel: [ 9960.754129]  [<ffffffff810fc470>] ? vfs_create+0x66/0x88
May 21 17:07:28 portablebastien kernel: [ 9960.754134]  [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67
May 21 17:07:28 portablebastien kernel: [ 9960.754140]  [<ffffffff810fce1a>] ? do_last+0x25f/0x526
May 21 17:07:28 portablebastien kernel: [ 9960.754146]  [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538
May 21 17:07:28 portablebastien kernel: [ 9960.754153]  [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde
May 21 17:07:28 portablebastien kernel: [ 9960.754159]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 17:09:28 portablebastien kernel: [10080.752184] INFO: task krunner:3838 blocked for more than 120 seconds.
May 21 17:09:28 portablebastien kernel: [10080.754639] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 17:09:28 portablebastien kernel: [10080.757099] krunner       D ffff8800dd8136c0     0  3838      1 0x00000000
May 21 17:09:28 portablebastien kernel: [10080.757107]  ffff880119784a40 0000000000000082 0000000000000000 ffff880117dc21c0
May 21 17:09:28 portablebastien kernel: [10080.757116]  00000000000136c0 ffff8800c948bfd8 00000000000136c0 00000000000136c0
May 21 17:09:28 portablebastien kernel: [10080.757126]  ffff880119784d18 ffff880119784d20 ffff880119784a40 00000000000136c0
May 21 17:09:28 portablebastien kernel: [10080.757135] Call Trace:
May 21 17:09:28 portablebastien kernel: [10080.757175]  [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 21 17:09:28 portablebastien kernel: [10080.757185]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 17:09:28 portablebastien kernel: [10080.757200]  [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 21 17:09:28 portablebastien kernel: [10080.757215]  [<ffffffffa02b3aed>] ? xattr_lookup+0x17/0xef [reiserfs]
May 21 17:09:28 portablebastien kernel: [10080.757229]  [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 21 17:09:28 portablebastien kernel: [10080.757243]  [<ffffffffa02a252f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
May 21 17:09:28 portablebastien kernel: [10080.757251]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 21 17:09:28 portablebastien kernel: [10080.757258]  [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac
May 21 17:09:28 portablebastien kernel: [10080.757266]  [<ffffffff81104c94>] ? file_update_time+0xf6/0x121
May 21 17:09:28 portablebastien kernel: [10080.757273]  [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280
May 21 17:09:28 portablebastien kernel: [10080.757281]  [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5
May 21 17:09:28 portablebastien kernel: [10080.757288]  [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f
May 21 17:09:28 portablebastien kernel: [10080.757295]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 21 17:09:28 portablebastien kernel: [10080.757302]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 21 17:09:28 portablebastien kernel: [10080.757308]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 21 17:09:28 portablebastien kernel: [10080.757314]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 21 17:09:28 portablebastien kernel: [10080.757321]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 17:09:28 portablebastien kernel: [10080.757332] INFO: task firefox-bin:3884 blocked for more than 120 seconds.
May 21 17:09:28 portablebastien kernel: [10080.759822] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 17:09:28 portablebastien kernel: [10080.762417] firefox-bin   D ffff8800c2d721c0     0  3884   3544 0x00000000
May 21 17:09:28 portablebastien kernel: [10080.762424]  ffff8800c2d721c0 0000000000000086 0000000000000000 ffffffff8160b020
May 21 17:09:28 portablebastien kernel: [10080.762434]  00000000000136c0 ffff8800c2fcdfd8 00000000000136c0 00000000000136c0
May 21 17:09:28 portablebastien kernel: [10080.762443]  ffff8800c2d72498 ffff8800c2d724a0 ffff8800c2d721c0 00000000000136c0
May 21 17:09:28 portablebastien kernel: [10080.762453] Call Trace:
May 21 17:09:28 portablebastien kernel: [10080.762473]  [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 21 17:09:28 portablebastien kernel: [10080.762481]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 17:09:28 portablebastien kernel: [10080.762496]  [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 21 17:09:28 portablebastien kernel: [10080.762503]  [<ffffffff811035c5>] ? d_instantiate+0x31/0x46
May 21 17:09:28 portablebastien kernel: [10080.762511]  [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172
May 21 17:09:28 portablebastien kernel: [10080.762525]  [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 21 17:09:28 portablebastien kernel: [10080.762538]  [<ffffffffa0298c03>] ? reiserfs_create+0xe6/0x205 [reiserfs]
May 21 17:09:28 portablebastien kernel: [10080.762545]  [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a
May 21 17:09:28 portablebastien kernel: [10080.762551]  [<ffffffff810fc470>] ? vfs_create+0x66/0x88
May 21 17:09:28 portablebastien kernel: [10080.762557]  [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67
May 21 17:09:28 portablebastien kernel: [10080.762563]  [<ffffffff810fce1a>] ? do_last+0x25f/0x526
May 21 17:09:28 portablebastien kernel: [10080.762568]  [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538
May 21 17:09:28 portablebastien kernel: [10080.762576]  [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde
May 21 17:09:28 portablebastien kernel: [10080.762582]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 17:11:28 portablebastien kernel: [10200.760197] INFO: task krunner:3838 blocked for more than 120 seconds.
May 21 17:11:28 portablebastien kernel: [10200.762733] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 17:11:28 portablebastien kernel: [10200.765324] krunner       D ffff8800dd8136c0     0  3838      1 0x00000000
May 21 17:11:28 portablebastien kernel: [10200.765333]  ffff880119784a40 0000000000000082 0000000000000000 ffff880117dc21c0
May 21 17:11:28 portablebastien kernel: [10200.765344]  00000000000136c0 ffff8800c948bfd8 00000000000136c0 00000000000136c0
May 21 17:11:28 portablebastien kernel: [10200.765353]  ffff880119784d18 ffff880119784d20 ffff880119784a40 00000000000136c0
May 21 17:11:28 portablebastien kernel: [10200.765363] Call Trace:
May 21 17:11:28 portablebastien kernel: [10200.765404]  [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 21 17:11:28 portablebastien kernel: [10200.765414]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 17:11:28 portablebastien kernel: [10200.765429]  [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 21 17:11:28 portablebastien kernel: [10200.765444]  [<ffffffffa02b3aed>] ? xattr_lookup+0x17/0xef [reiserfs]
May 21 17:11:28 portablebastien kernel: [10200.765458]  [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 21 17:11:28 portablebastien kernel: [10200.765473]  [<ffffffffa02a252f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
May 21 17:11:28 portablebastien kernel: [10200.765482]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 21 17:11:28 portablebastien kernel: [10200.765489]  [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac
May 21 17:11:28 portablebastien kernel: [10200.765497]  [<ffffffff81104c94>] ? file_update_time+0xf6/0x121
May 21 17:11:28 portablebastien kernel: [10200.765505]  [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280
May 21 17:11:28 portablebastien kernel: [10200.765513]  [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5
May 21 17:11:28 portablebastien kernel: [10200.765519]  [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f
May 21 17:11:28 portablebastien kernel: [10200.765526]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 21 17:11:28 portablebastien kernel: [10200.765534]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 21 17:11:28 portablebastien kernel: [10200.765540]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 21 17:11:28 portablebastien kernel: [10200.765546]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 21 17:11:28 portablebastien kernel: [10200.765552]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 21 17:11:28 portablebastien kernel: [10200.765564] INFO: task firefox-bin:3884 blocked for more than 120 seconds.
May 21 17:11:28 portablebastien kernel: [10200.768165] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 21 17:11:28 portablebastien kernel: [10200.770750] firefox-bin   D ffff8800c2d721c0     0  3884   3544 0x00000000
May 21 17:11:28 portablebastien kernel: [10200.770757]  ffff8800c2d721c0 0000000000000086 0000000000000000 ffffffff8160b020
May 21 17:11:28 portablebastien kernel: [10200.770764]  00000000000136c0 ffff8800c2fcdfd8 00000000000136c0 00000000000136c0
May 21 17:11:28 portablebastien kernel: [10200.770770]  ffff8800c2d72498 ffff8800c2d724a0 ffff8800c2d721c0 00000000000136c0
May 21 17:11:28 portablebastien kernel: [10200.770777] Call Trace:
May 21 17:11:28 portablebastien kernel: [10200.770795]  [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 21 17:11:28 portablebastien kernel: [10200.770801]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 21 17:11:28 portablebastien kernel: [10200.770815]  [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 21 17:11:28 portablebastien kernel: [10200.770821]  [<ffffffff811035c5>] ? d_instantiate+0x31/0x46
May 21 17:11:28 portablebastien kernel: [10200.770829]  [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172
May 21 17:11:28 portablebastien kernel: [10200.770842]  [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 21 17:11:28 portablebastien kernel: [10200.770855]  [<ffffffffa0298c03>] ? reiserfs_create+0xe6/0x205 [reiserfs]
May 21 17:11:28 portablebastien kernel: [10200.770860]  [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a
May 21 17:11:28 portablebastien kernel: [10200.770866]  [<ffffffff810fc470>] ? vfs_create+0x66/0x88
May 21 17:11:28 portablebastien kernel: [10200.770871]  [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67
May 21 17:11:28 portablebastien kernel: [10200.770875]  [<ffffffff810fce1a>] ? do_last+0x25f/0x526
May 21 17:11:28 portablebastien kernel: [10200.770880]  [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538
May 21 17:11:28 portablebastien kernel: [10200.770887]  [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde
May 21 17:11:28 portablebastien kernel: [10200.770892]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
Comment 21 roucaries.bastien+kernel 2011-05-23 16:33:39 UTC
New trace

May 23 14:32:11 portablebastien kernel: [43800.728142] INFO: task firefox-bin:14948 blocked for more than 120 seconds.
May 23 14:32:11 portablebastien kernel: [43800.728147] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 23 14:32:11 portablebastien kernel: [43800.728151] firefox-bin   D ffff8800c3168000     0 14948   3917 0x00000000
May 23 14:32:11 portablebastien kernel: [43800.728159]  ffff8800c3168000 0000000000000086 0000000000000000 ffffffff8160b020
May 23 14:32:11 portablebastien kernel: [43800.728168]  00000000000136c0 ffff88004f5f5fd8 00000000000136c0 00000000000136c0
May 23 14:32:11 portablebastien kernel: [43800.728174]  ffff8800c31682d8 ffff8800c31682e0 ffff8800c3168000 00000000000136c0
May 23 14:32:11 portablebastien kernel: [43800.728181] Call Trace:
May 23 14:32:11 portablebastien kernel: [43800.728219]  [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 23 14:32:11 portablebastien kernel: [43800.728227]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 23 14:32:11 portablebastien kernel: [43800.728242]  [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 23 14:32:11 portablebastien kernel: [43800.728255]  [<ffffffffa02d0aed>] ? xattr_lookup+0x17/0xef [reiserfs]
May 23 14:32:11 portablebastien kernel: [43800.728269]  [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 23 14:32:11 portablebastien kernel: [43800.728283]  [<ffffffffa02bf52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
May 23 14:32:11 portablebastien kernel: [43800.728289]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 23 14:32:11 portablebastien kernel: [43800.728295]  [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac
May 23 14:32:11 portablebastien kernel: [43800.728302]  [<ffffffff81104c94>] ? file_update_time+0xf6/0x121
May 23 14:32:11 portablebastien kernel: [43800.728309]  [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280
May 23 14:32:11 portablebastien kernel: [43800.728315]  [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f
May 23 14:32:11 portablebastien kernel: [43800.728321]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 23 14:32:11 portablebastien kernel: [43800.728327]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 23 14:32:11 portablebastien kernel: [43800.728332]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 23 14:32:11 portablebastien kernel: [43800.728337]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 23 14:32:11 portablebastien kernel: [43800.728342]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 23 14:34:11 portablebastien kernel: [43920.728239] INFO: task firefox-bin:14948 blocked for more than 120 seconds.
May 23 14:34:11 portablebastien kernel: [43920.728247] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 23 14:34:11 portablebastien kernel: [43920.728251] firefox-bin   D ffff8800c3168000     0 14948   3917 0x00000000
May 23 14:34:11 portablebastien kernel: [43920.728258]  ffff8800c3168000 0000000000000086 0000000000000000 ffffffff8160b020
May 23 14:34:11 portablebastien kernel: [43920.728266]  00000000000136c0 ffff88004f5f5fd8 00000000000136c0 00000000000136c0
May 23 14:34:11 portablebastien kernel: [43920.728273]  ffff8800c31682d8 ffff8800c31682e0 ffff8800c3168000 00000000000136c0
May 23 14:34:11 portablebastien kernel: [43920.728279] Call Trace:
May 23 14:34:11 portablebastien kernel: [43920.728317]  [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 23 14:34:11 portablebastien kernel: [43920.728326]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 23 14:34:11 portablebastien kernel: [43920.728340]  [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 23 14:34:11 portablebastien kernel: [43920.728354]  [<ffffffffa02d0aed>] ? xattr_lookup+0x17/0xef [reiserfs]
May 23 14:34:11 portablebastien kernel: [43920.728368]  [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 23 14:34:11 portablebastien kernel: [43920.728381]  [<ffffffffa02bf52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
May 23 14:34:11 portablebastien kernel: [43920.728388]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 23 14:34:11 portablebastien kernel: [43920.728394]  [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac
May 23 14:34:11 portablebastien kernel: [43920.728401]  [<ffffffff81104c94>] ? file_update_time+0xf6/0x121
May 23 14:34:11 portablebastien kernel: [43920.728408]  [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280
May 23 14:34:11 portablebastien kernel: [43920.728414]  [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f
May 23 14:34:11 portablebastien kernel: [43920.728420]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 23 14:34:11 portablebastien kernel: [43920.728426]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 23 14:34:11 portablebastien kernel: [43920.728431]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 23 14:34:11 portablebastien kernel: [43920.728436]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 23 14:34:11 portablebastien kernel: [43920.728442]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 23 14:34:11 portablebastien kernel: [43920.728456] INFO: task okular:16181 blocked for more than 120 seconds.
May 23 14:34:11 portablebastien kernel: [43920.728459] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 23 14:34:11 portablebastien kernel: [43920.728462] okular        D ffff8800bdc18d80     0 16181   3586 0x00000000
May 23 14:34:11 portablebastien kernel: [43920.728468]  ffff8800bdc18d80 0000000000000086 0000000000000000 ffff88011b65ca40
May 23 14:34:11 portablebastien kernel: [43920.728475]  00000000000136c0 ffff88011a73bfd8 00000000000136c0 00000000000136c0
May 23 14:34:11 portablebastien kernel: [43920.728481]  ffff8800bdc19058 ffff8800bdc19060 ffff8800bdc18d80 00000000000136c0
May 23 14:34:11 portablebastien kernel: [43920.728488] Call Trace:
May 23 14:34:11 portablebastien kernel: [43920.728502]  [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 23 14:34:11 portablebastien kernel: [43920.728509]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 23 14:34:11 portablebastien kernel: [43920.728522]  [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 23 14:34:11 portablebastien kernel: [43920.728536]  [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 23 14:34:11 portablebastien kernel: [43920.728549]  [<ffffffffa02b87cb>] ? reiserfs_truncate_file+0x17a/0x27f [reiserfs]
May 23 14:34:11 portablebastien kernel: [43920.728558]  [<ffffffff810ceeaa>] ? unmap_mapping_range+0x59/0xf5
May 23 14:34:11 portablebastien kernel: [43920.728571]  [<ffffffffa02ba6d2>] ? reiserfs_vfs_truncate_file+0x22/0x2d [reiserfs]
May 23 14:34:11 portablebastien kernel: [43920.728577]  [<ffffffff810bef87>] ? vmtruncate+0x36/0x3f
May 23 14:34:11 portablebastien kernel: [43920.728590]  [<ffffffffa02b6d45>] ? reiserfs_setattr+0x26f/0x2f4 [reiserfs]
May 23 14:34:11 portablebastien kernel: [43920.728596]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 23 14:34:11 portablebastien kernel: [43920.728601]  [<ffffffff81106439>] ? notify_change+0x195/0x27e
May 23 14:34:11 portablebastien kernel: [43920.728606]  [<ffffffff810f2d4f>] ? do_truncate+0x68/0x86
May 23 14:34:11 portablebastien kernel: [43920.728611]  [<ffffffff810f21bb>] ? __dentry_open+0x186/0x291
May 23 14:34:11 portablebastien kernel: [43920.728616]  [<ffffffff810fb5c4>] ? get_write_access+0x10/0x3a
May 23 14:34:11 portablebastien kernel: [43920.728621]  [<ffffffff810fd00e>] ? do_last+0x453/0x526
May 23 14:34:11 portablebastien kernel: [43920.728626]  [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538
May 23 14:34:11 portablebastien kernel: [43920.728631]  [<ffffffff810f34a5>] ? do_sync_read+0xb1/0xea
May 23 14:34:11 portablebastien kernel: [43920.728637]  [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde
May 23 14:34:11 portablebastien kernel: [43920.728642]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 23 14:36:11 portablebastien kernel: [44040.728162] INFO: task firefox-bin:14948 blocked for more than 120 seconds.
May 23 14:36:11 portablebastien kernel: [44040.728168] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 23 14:36:11 portablebastien kernel: [44040.728172] firefox-bin   D ffff8800c3168000     0 14948   3917 0x00000000
May 23 14:36:11 portablebastien kernel: [44040.728179]  ffff8800c3168000 0000000000000086 0000000000000000 ffffffff8160b020
May 23 14:36:11 portablebastien kernel: [44040.728187]  00000000000136c0 ffff88004f5f5fd8 00000000000136c0 00000000000136c0
May 23 14:36:11 portablebastien kernel: [44040.728193]  ffff8800c31682d8 ffff8800c31682e0 ffff8800c3168000 00000000000136c0
May 23 14:36:11 portablebastien kernel: [44040.728200] Call Trace:
May 23 14:36:11 portablebastien kernel: [44040.728239]  [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 23 14:36:11 portablebastien kernel: [44040.728248]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 23 14:36:11 portablebastien kernel: [44040.728262]  [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 23 14:36:11 portablebastien kernel: [44040.728276]  [<ffffffffa02d0aed>] ? xattr_lookup+0x17/0xef [reiserfs]
May 23 14:36:11 portablebastien kernel: [44040.728290]  [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 23 14:36:11 portablebastien kernel: [44040.728303]  [<ffffffffa02bf52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
May 23 14:36:11 portablebastien kernel: [44040.728309]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 23 14:36:11 portablebastien kernel: [44040.728316]  [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac
May 23 14:36:11 portablebastien kernel: [44040.728322]  [<ffffffff81104c94>] ? file_update_time+0xf6/0x121
May 23 14:36:11 portablebastien kernel: [44040.728329]  [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280
May 23 14:36:11 portablebastien kernel: [44040.728335]  [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f
May 23 14:36:11 portablebastien kernel: [44040.728341]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 23 14:36:11 portablebastien kernel: [44040.728347]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 23 14:36:11 portablebastien kernel: [44040.728352]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 23 14:36:11 portablebastien kernel: [44040.728357]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 23 14:36:11 portablebastien kernel: [44040.728362]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 23 14:36:11 portablebastien kernel: [44040.728373] INFO: task okular:16181 blocked for more than 120 seconds.
May 23 14:36:11 portablebastien kernel: [44040.728377] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 23 14:36:11 portablebastien kernel: [44040.728380] okular        D ffff8800bdc18d80     0 16181   3586 0x00000000
May 23 14:36:11 portablebastien kernel: [44040.728386]  ffff8800bdc18d80 0000000000000086 0000000000000000 ffff88011b65ca40
May 23 14:36:11 portablebastien kernel: [44040.728393]  00000000000136c0 ffff88011a73bfd8 00000000000136c0 00000000000136c0
May 23 14:36:11 portablebastien kernel: [44040.728399]  ffff8800bdc19058 ffff8800bdc19060 ffff8800bdc18d80 00000000000136c0
May 23 14:36:11 portablebastien kernel: [44040.728405] Call Trace:
May 23 14:36:11 portablebastien kernel: [44040.728420]  [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 23 14:36:11 portablebastien kernel: [44040.728426]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 23 14:36:11 portablebastien kernel: [44040.728440]  [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 23 14:36:11 portablebastien kernel: [44040.728453]  [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 23 14:36:11 portablebastien kernel: [44040.728467]  [<ffffffffa02b87cb>] ? reiserfs_truncate_file+0x17a/0x27f [reiserfs]
May 23 14:36:11 portablebastien kernel: [44040.728473]  [<ffffffff810ceeaa>] ? unmap_mapping_range+0x59/0xf5
May 23 14:36:11 portablebastien kernel: [44040.728486]  [<ffffffffa02ba6d2>] ? reiserfs_vfs_truncate_file+0x22/0x2d [reiserfs]
May 23 14:36:11 portablebastien kernel: [44040.728493]  [<ffffffff810bef87>] ? vmtruncate+0x36/0x3f
May 23 14:36:11 portablebastien kernel: [44040.728505]  [<ffffffffa02b6d45>] ? reiserfs_setattr+0x26f/0x2f4 [reiserfs]
May 23 14:36:11 portablebastien kernel: [44040.728511]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 23 14:36:11 portablebastien kernel: [44040.728516]  [<ffffffff81106439>] ? notify_change+0x195/0x27e
May 23 14:36:11 portablebastien kernel: [44040.728522]  [<ffffffff810f2d4f>] ? do_truncate+0x68/0x86
May 23 14:36:11 portablebastien kernel: [44040.728526]  [<ffffffff810f21bb>] ? __dentry_open+0x186/0x291
May 23 14:36:11 portablebastien kernel: [44040.728532]  [<ffffffff810fb5c4>] ? get_write_access+0x10/0x3a
May 23 14:36:11 portablebastien kernel: [44040.728537]  [<ffffffff810fd00e>] ? do_last+0x453/0x526
May 23 14:36:11 portablebastien kernel: [44040.728542]  [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538
May 23 14:36:11 portablebastien kernel: [44040.728547]  [<ffffffff810f34a5>] ? do_sync_read+0xb1/0xea
May 23 14:36:11 portablebastien kernel: [44040.728552]  [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde
May 23 14:36:11 portablebastien kernel: [44040.728557]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 23 14:38:11 portablebastien kernel: [44160.728166] INFO: task firefox-bin:14948 blocked for more than 120 seconds.
May 23 14:38:11 portablebastien kernel: [44160.728182] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 23 14:38:11 portablebastien kernel: [44160.728186] firefox-bin   D ffff8800c3168000     0 14948   3917 0x00000000
May 23 14:38:11 portablebastien kernel: [44160.728193]  ffff8800c3168000 0000000000000086 0000000000000000 ffffffff8160b020
May 23 14:38:11 portablebastien kernel: [44160.728201]  00000000000136c0 ffff88004f5f5fd8 00000000000136c0 00000000000136c0
May 23 14:38:11 portablebastien kernel: [44160.728208]  ffff8800c31682d8 ffff8800c31682e0 ffff8800c3168000 00000000000136c0
May 23 14:38:11 portablebastien kernel: [44160.728215] Call Trace:
May 23 14:38:11 portablebastien kernel: [44160.728255]  [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 23 14:38:11 portablebastien kernel: [44160.728264]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 23 14:38:11 portablebastien kernel: [44160.728279]  [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 23 14:38:11 portablebastien kernel: [44160.728293]  [<ffffffffa02d0aed>] ? xattr_lookup+0x17/0xef [reiserfs]
May 23 14:38:11 portablebastien kernel: [44160.728307]  [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 23 14:38:11 portablebastien kernel: [44160.728321]  [<ffffffffa02bf52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
May 23 14:38:11 portablebastien kernel: [44160.728327]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 23 14:38:11 portablebastien kernel: [44160.728333]  [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac
May 23 14:38:11 portablebastien kernel: [44160.728340]  [<ffffffff81104c94>] ? file_update_time+0xf6/0x121
May 23 14:38:11 portablebastien kernel: [44160.728347]  [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280
May 23 14:38:11 portablebastien kernel: [44160.728353]  [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f
May 23 14:38:11 portablebastien kernel: [44160.728359]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 23 14:38:11 portablebastien kernel: [44160.728365]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 23 14:38:11 portablebastien kernel: [44160.728370]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 23 14:38:11 portablebastien kernel: [44160.728375]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 23 14:38:11 portablebastien kernel: [44160.728381]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 23 14:38:11 portablebastien kernel: [44160.728393] INFO: task okular:16181 blocked for more than 120 seconds.
May 23 14:38:11 portablebastien kernel: [44160.728397] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 23 14:38:11 portablebastien kernel: [44160.728400] okular        D ffff8800bdc18d80     0 16181   3586 0x00000000
May 23 14:38:11 portablebastien kernel: [44160.728406]  ffff8800bdc18d80 0000000000000086 0000000000000000 ffff88011b65ca40
May 23 14:38:11 portablebastien kernel: [44160.728413]  00000000000136c0 ffff88011a73bfd8 00000000000136c0 00000000000136c0
May 23 14:38:11 portablebastien kernel: [44160.728419]  ffff8800bdc19058 ffff8800bdc19060 ffff8800bdc18d80 00000000000136c0
May 23 14:38:11 portablebastien kernel: [44160.728425] Call Trace:
May 23 14:38:11 portablebastien kernel: [44160.728440]  [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 23 14:38:11 portablebastien kernel: [44160.728446]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 23 14:38:11 portablebastien kernel: [44160.728460]  [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 23 14:38:11 portablebastien kernel: [44160.728473]  [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 23 14:38:11 portablebastien kernel: [44160.728487]  [<ffffffffa02b87cb>] ? reiserfs_truncate_file+0x17a/0x27f [reiserfs]
May 23 14:38:11 portablebastien kernel: [44160.728493]  [<ffffffff810ceeaa>] ? unmap_mapping_range+0x59/0xf5
May 23 14:38:11 portablebastien kernel: [44160.728506]  [<ffffffffa02ba6d2>] ? reiserfs_vfs_truncate_file+0x22/0x2d [reiserfs]
May 23 14:38:11 portablebastien kernel: [44160.728513]  [<ffffffff810bef87>] ? vmtruncate+0x36/0x3f
May 23 14:38:11 portablebastien kernel: [44160.728525]  [<ffffffffa02b6d45>] ? reiserfs_setattr+0x26f/0x2f4 [reiserfs]
May 23 14:38:11 portablebastien kernel: [44160.728531]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 23 14:38:11 portablebastien kernel: [44160.728536]  [<ffffffff81106439>] ? notify_change+0x195/0x27e
May 23 14:38:11 portablebastien kernel: [44160.728541]  [<ffffffff810f2d4f>] ? do_truncate+0x68/0x86
May 23 14:38:11 portablebastien kernel: [44160.728546]  [<ffffffff810f21bb>] ? __dentry_open+0x186/0x291
May 23 14:38:11 portablebastien kernel: [44160.728551]  [<ffffffff810fb5c4>] ? get_write_access+0x10/0x3a
May 23 14:38:11 portablebastien kernel: [44160.728556]  [<ffffffff810fd00e>] ? do_last+0x453/0x526
May 23 14:38:11 portablebastien kernel: [44160.728561]  [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538
May 23 14:38:11 portablebastien kernel: [44160.728566]  [<ffffffff810f34a5>] ? do_sync_read+0xb1/0xea
May 23 14:38:11 portablebastien kernel: [44160.728572]  [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde
May 23 14:38:11 portablebastien kernel: [44160.728577]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 23 14:40:11 portablebastien kernel: [44280.728140] INFO: task firefox-bin:14948 blocked for more than 120 seconds.
May 23 14:40:11 portablebastien kernel: [44280.728145] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 23 14:40:11 portablebastien kernel: [44280.728150] firefox-bin   D ffff8800c3168000     0 14948   3917 0x00000000
May 23 14:40:11 portablebastien kernel: [44280.728157]  ffff8800c3168000 0000000000000086 0000000000000000 ffffffff8160b020
May 23 14:40:11 portablebastien kernel: [44280.728165]  00000000000136c0 ffff88004f5f5fd8 00000000000136c0 00000000000136c0
May 23 14:40:11 portablebastien kernel: [44280.728171]  ffff8800c31682d8 ffff8800c31682e0 ffff8800c3168000 00000000000136c0
May 23 14:40:11 portablebastien kernel: [44280.728178] Call Trace:
May 23 14:40:11 portablebastien kernel: [44280.728215]  [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 23 14:40:11 portablebastien kernel: [44280.728224]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 23 14:40:11 portablebastien kernel: [44280.728238]  [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 23 14:40:11 portablebastien kernel: [44280.728252]  [<ffffffffa02d0aed>] ? xattr_lookup+0x17/0xef [reiserfs]
May 23 14:40:11 portablebastien kernel: [44280.728266]  [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 23 14:40:11 portablebastien kernel: [44280.728279]  [<ffffffffa02bf52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
May 23 14:40:11 portablebastien kernel: [44280.728285]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 23 14:40:11 portablebastien kernel: [44280.728291]  [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac
May 23 14:40:11 portablebastien kernel: [44280.728298]  [<ffffffff81104c94>] ? file_update_time+0xf6/0x121
May 23 14:40:11 portablebastien kernel: [44280.728305]  [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280
May 23 14:40:11 portablebastien kernel: [44280.728311]  [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f
May 23 14:40:11 portablebastien kernel: [44280.728316]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 23 14:40:11 portablebastien kernel: [44280.728323]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 23 14:40:11 portablebastien kernel: [44280.728328]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 23 14:40:11 portablebastien kernel: [44280.728333]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 23 14:40:11 portablebastien kernel: [44280.728338]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 23 14:40:11 portablebastien kernel: [44280.728349] INFO: task okular:16181 blocked for more than 120 seconds.
May 23 14:40:11 portablebastien kernel: [44280.728352] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 23 14:40:11 portablebastien kernel: [44280.728356] okular        D ffff8800bdc18d80     0 16181   3586 0x00000000
May 23 14:40:11 portablebastien kernel: [44280.728362]  ffff8800bdc18d80 0000000000000086 0000000000000000 ffff88011b65ca40
May 23 14:40:11 portablebastien kernel: [44280.728368]  00000000000136c0 ffff88011a73bfd8 00000000000136c0 00000000000136c0
May 23 14:40:11 portablebastien kernel: [44280.728375]  ffff8800bdc19058 ffff8800bdc19060 ffff8800bdc18d80 00000000000136c0
May 23 14:40:11 portablebastien kernel: [44280.728387] Call Trace:
May 23 14:40:11 portablebastien kernel: [44280.728401]  [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 23 14:40:11 portablebastien kernel: [44280.728407]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 23 14:40:11 portablebastien kernel: [44280.728421]  [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 23 14:40:11 portablebastien kernel: [44280.728435]  [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 23 14:40:11 portablebastien kernel: [44280.728448]  [<ffffffffa02b87cb>] ? reiserfs_truncate_file+0x17a/0x27f [reiserfs]
May 23 14:40:11 portablebastien kernel: [44280.728455]  [<ffffffff810ceeaa>] ? unmap_mapping_range+0x59/0xf5
May 23 14:40:11 portablebastien kernel: [44280.728468]  [<ffffffffa02ba6d2>] ? reiserfs_vfs_truncate_file+0x22/0x2d [reiserfs]
May 23 14:40:11 portablebastien kernel: [44280.728475]  [<ffffffff810bef87>] ? vmtruncate+0x36/0x3f
May 23 14:40:11 portablebastien kernel: [44280.728487]  [<ffffffffa02b6d45>] ? reiserfs_setattr+0x26f/0x2f4 [reiserfs]
May 23 14:40:11 portablebastien kernel: [44280.728493]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 23 14:40:11 portablebastien kernel: [44280.728498]  [<ffffffff81106439>] ? notify_change+0x195/0x27e
May 23 14:40:11 portablebastien kernel: [44280.728503]  [<ffffffff810f2d4f>] ? do_truncate+0x68/0x86
May 23 14:40:11 portablebastien kernel: [44280.728508]  [<ffffffff810f21bb>] ? __dentry_open+0x186/0x291
May 23 14:40:11 portablebastien kernel: [44280.728513]  [<ffffffff810fb5c4>] ? get_write_access+0x10/0x3a
May 23 14:40:11 portablebastien kernel: [44280.728518]  [<ffffffff810fd00e>] ? do_last+0x453/0x526
May 23 14:40:11 portablebastien kernel: [44280.728523]  [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538
May 23 14:40:11 portablebastien kernel: [44280.728528]  [<ffffffff810f34a5>] ? do_sync_read+0xb1/0xea
May 23 14:40:11 portablebastien kernel: [44280.728533]  [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde
May 23 14:40:11 portablebastien kernel: [44280.728538]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
May 23 14:42:11 portablebastien kernel: [44400.728123] INFO: task firefox-bin:14948 blocked for more than 120 seconds.
May 23 14:42:11 portablebastien kernel: [44400.728128] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
May 23 14:42:11 portablebastien kernel: [44400.728133] firefox-bin   D ffff8800c3168000     0 14948   3917 0x00000000
May 23 14:42:11 portablebastien kernel: [44400.728140]  ffff8800c3168000 0000000000000086 0000000000000000 ffffffff8160b020
May 23 14:42:11 portablebastien kernel: [44400.728148]  00000000000136c0 ffff88004f5f5fd8 00000000000136c0 00000000000136c0
May 23 14:42:11 portablebastien kernel: [44400.728155]  ffff8800c31682d8 ffff8800c31682e0 ffff8800c3168000 00000000000136c0
May 23 14:42:11 portablebastien kernel: [44400.728162] Call Trace:
May 23 14:42:11 portablebastien kernel: [44400.728199]  [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs]
May 23 14:42:11 portablebastien kernel: [44400.728208]  [<ffffffff8104322f>] ? default_wake_function+0x0/0xe
May 23 14:42:11 portablebastien kernel: [44400.728223]  [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs]
May 23 14:42:11 portablebastien kernel: [44400.728236]  [<ffffffffa02d0aed>] ? xattr_lookup+0x17/0xef [reiserfs]
May 23 14:42:11 portablebastien kernel: [44400.728250]  [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs]
May 23 14:42:11 portablebastien kernel: [44400.728264]  [<ffffffffa02bf52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs]
May 23 14:42:11 portablebastien kernel: [44400.728270]  [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24
May 23 14:42:11 portablebastien kernel: [44400.728276]  [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac
May 23 14:42:11 portablebastien kernel: [44400.728283]  [<ffffffff81104c94>] ? file_update_time+0xf6/0x121
May 23 14:42:11 portablebastien kernel: [44400.728290]  [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280
May 23 14:42:11 portablebastien kernel: [44400.728296]  [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f
May 23 14:42:11 portablebastien kernel: [44400.728302]  [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea
May 23 14:42:11 portablebastien kernel: [44400.728308]  [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d
May 23 14:42:11 portablebastien kernel: [44400.728314]  [<ffffffff810f3909>] ? vfs_write+0xa4/0x100
May 23 14:42:11 portablebastien kernel: [44400.728318]  [<ffffffff810f3a18>] ? sys_write+0x45/0x6b
May 23 14:42:11 portablebastien kernel: [44400.728324]  [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b
Comment 22 roucaries.bastien+kernel 2011-05-23 16:35:19 UTC
BTW I use Cached IMAP over kmail. Crash often when mail is synchronized between local and remote
Comment 23 Frederic Weisbecker 2011-05-23 16:38:55 UTC
Ah good to know, I'm setting up OpenSuse 11.4 to get the same system than Maximilian. What distro are you using?

Once it's set, I'll try kmail with that cached imap option.
Comment 24 roucaries.bastien+kernel 2011-05-23 18:54:36 UTC
I use debian testing.

Bastien
Comment 25 Maximilian Decker 2011-05-23 20:02:55 UTC
Well I did *not* have the acl mount option set for the /home - partition, and it crashed nevertheless. The data partition uses acl, however.
That bug is quite weird.
Comment 26 roucaries.bastien+kernel 2011-06-07 14:23:13 UTC
Any news ?
Comment 27 Maximilian Decker 2011-06-10 12:41:08 UTC
I think we have to wait till Frederic has some way to reproduce the issue ...

I tried to reproduce it myself with different workloads on another machine, 
also created binaries with C doing multiple very fast I/O operations, ran
them for several hours, but it did not crash. (Intel Dualcore ~1,8Ghz).
Somehow it seems to also depend on the system config/specs.

So, to make it short - 
2 crashes on AMD Dualcore 3GHz, 0 crashes on Intel Dualcore 1.8Ghz for me.

@Bastien - what hardware are you running ?
Comment 28 roucaries.bastien+kernel 2011-06-11 17:29:31 UTC
@maximilian crashes here on intel with intel controler for hdd so not specific to amd.
Dual core laptop:
processor       : 0
vendor_id       : GenuineIntel
cpu family      : 6
model           : 23
model name      : Intel(R) Core(TM)2 Duo CPU     T6500  @ 2.10GHz
stepping        : 10
cpu MHz         : 2100.000
cache size      : 2048 KB
physical id     : 0
siblings        : 2
core id         : 0
cpu cores       : 2
apicid          : 0
initial apicid  : 0
fpu             : yes
fpu_exception   : yes
cpuid level     : 13
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl aperfmperf pni dtes64 monitor ds_cpl est tm2 ssse3 cx16 xtpr pdcm sse4_1 xsave lahf_lm dts
bogomips        : 4188.75
clflush size    : 64
cache_alignment : 64
address sizes   : 36 bits physical, 48 bits virtual
power management:

processor       : 1
............

lspci:
00:00.0 Host bridge: Intel Corporation Mobile 4 Series Chipset Memory Controller Hub (rev 07)
00:02.0 VGA compatible controller: Intel Corporation Mobile 4 Series Chipset Integrated Graphics Controller (rev 07)
00:02.1 Display controller: Intel Corporation Mobile 4 Series Chipset Integrated Graphics Controller (rev 07)
00:1a.0 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #4 (rev 03)
00:1a.1 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #5 (rev 03)
00:1a.2 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #6 (rev 03)
00:1a.7 USB Controller: Intel Corporation 82801I (ICH9 Family) USB2 EHCI Controller #2 (rev 03)
00:1b.0 Audio device: Intel Corporation 82801I (ICH9 Family) HD Audio Controller (rev 03)
00:1c.0 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 1 (rev 03)
00:1c.1 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 2 (rev 03)
00:1c.2 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 3 (rev 03)
00:1c.4 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 5 (rev 03)
00:1d.0 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #1 (rev 03)
00:1d.1 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #2 (rev 03)
00:1d.2 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #3 (rev 03)
00:1d.7 USB Controller: Intel Corporation 82801I (ICH9 Family) USB2 EHCI Controller #1 (rev 03)
00:1e.0 PCI bridge: Intel Corporation 82801 Mobile PCI Bridge (rev 93)
00:1f.0 ISA bridge: Intel Corporation ICH9M LPC Interface Controller (rev 03)
00:1f.2 SATA controller: Intel Corporation ICH9M/M-E SATA AHCI Controller (rev 03)
00:1f.3 SMBus: Intel Corporation 82801I (ICH9 Family) SMBus Controller (rev 03)
09:00.0 Ethernet controller: Marvell Technology Group Ltd. 88E8040 PCI-E Fast Ethernet Controller (rev 13)
0c:00.0 Network controller: Broadcom Corporation BCM4312 802.11b/g LP-PHY (rev 01)
Comment 29 roucaries.bastien+kernel 2011-06-11 17:32:20 UTC
Frederick could you give me some patch for testing ?
Comment 30 Jeff Mahoney 2011-06-13 15:10:47 UTC
I've been running 4 concurrent git clone; rm -rf cycles on a reiserfs file system with a default ACL set and still can't get this to trigger.
Comment 31 Maximilian Decker 2011-06-13 21:37:21 UTC
yes same here I tried to find some sort of testing setup that would allow for 
easy and reliable crash reproduction. No luck so far.

Anyway the machine that crashed twice (running openSuSE 11.4) differs from the
"try-to-reproduce"-machine in at least the following:

CPU running at 3.00 GHz instead of 1.80 GHz
AMD Radeon HD (w/ fglrx binary driver) instead of Intel GPU
had loaded VirtualBox kernel modules
had loaded VMWare kernel modules

That's it. So nothing to really worry about IMHO.
Well ok as far as I can remember the VMWare modules I used actually had some BKL dependencies, the patch for full 2.6.39 compatibility without BKL dep was not yet released that time. But it would be quite far-fetched to blame them.

@Bastien - is there anything notably special about your setup ? 
For now you seem to be the only one being able to reasonably reproduce the issue.
Comment 32 roucaries.bastien+kernel 2011-06-14 09:14:01 UTC
@maximilian: nothing special. Except that it is alway:
- deconnected (aka cached) imap to a 6G google mail account
- something else
Comment 33 roucaries.bastien+kernel 2011-06-14 09:16:04 UTC
@Jeff Mahoney It seems that in 90% of the case a background  deconnected (aka cached) imap to a 6G google mail account is the good way to trigger this bug.

In all cases thanks to try to trigger. Can I test some patch ?

Bastien

My lsmod is case:

Module                  Size  Used by
nls_utf8                1256  0 
nls_cp437               5841  0 
vfat                    8039  0 
fat                    40599  1 vfat
acpi_cpufreq            5351  1 
mperf                   1259  1 acpi_cpufreq
cpufreq_powersave        942  0 
cpufreq_stats           2633  0 
cpufreq_userspace       2032  0 
cpufreq_conservative     7646  0 
parport_pc             18869  0 
ppdev                   5139  0 
lp                      7966  0 
parport                25742  3 parport_pc,ppdev,lp
rfcomm                 28534  0 
sco                     7563  2 
bnep                    9960  2 
l2cap                  30438  6 rfcomm,bnep
crc16                   1327  1 l2cap
binfmt_misc             6573  1 
uinput                  6942  1 
fuse                   54779  1 
nfsd                  257368  2 
exportfs                3130  1 nfsd
nfs                   242558  0 
lockd                  57791  2 nfsd,nfs                                                                                                                                                        
fscache                29223  1 nfs                                                                                                                                                             
nfs_acl                 2055  2 nfsd,nfs                                                                                                                                                        
auth_rpcgss            33940  2 nfsd,nfs                                                                                                                                                        
sunrpc                159774  6 nfsd,nfs,lockd,nfs_acl,auth_rpcgss                                                                                                                              
tun                    12546  2                                                                                                                                                                 
ext3                  106517  1 
jbd                    37104  1 ext3
mbcache                 5104  1 ext3
loop                   13835  0 
dm_crypt               10527  0 
snd_hda_codec_idt      45867  1 
snd_hda_intel          19434  4 
snd_hda_codec          62429  2 snd_hda_codec_idt,snd_hda_intel
snd_hwdep               5484  1 snd_hda_codec
snd_pcm_oss            32140  0 
snd_mixer_oss          12767  1 snd_pcm_oss
snd_pcm                61869  4 snd_hda_intel,snd_hda_codec,snd_pcm_oss
arc4                    1330  2 
snd_seq_midi            4486  0 
ecb                     1881  2 
snd_rawmidi            15945  1 snd_seq_midi
i915                  293539  2 
snd_seq_midi_event      4786  1 snd_seq_midi
btusb                   9679  0 
b43                   149467  0 
uvcvideo               51688  0 
bluetooth              44517  7 sco,rfcomm,bnep,l2cap,btusb
rng_core                3118  1 b43
mac80211              168449  1 b43
snd_seq                42518  3 snd_seq_midi,snd_seq_midi_event
drm_kms_helper         22053  1 i915
drm                   152749  3 i915,drm_kms_helper
videodev               54054  1 uvcvideo
i2c_algo_bit            4105  1 i915
i2c_i801                7318  0 
tpm_tis                 7141  0 
v4l1_compat            11622  2 uvcvideo,videodev
v4l2_compat_ioctl32     9011  1 videodev
snd_timer              16304  2 snd_pcm,snd_seq
snd_seq_device          4531  3 snd_seq_midi,snd_rawmidi,snd_seq
cfg80211              114501  2 b43,mac80211
dell_wmi                1421  0 
dell_laptop             7308  0 
tpm                     9907  1 tpm_tis
video                  11139  1 i915
joydev                  9160  0 
dcdbas                  4928  1 dell_laptop
serio_raw               3726  0 
sparse_keymap           2400  1 dell_wmi
i2c_core               16458  6 i915,drm_kms_helper,drm,videodev,i2c_algo_bit,i2c_i801
tpm_bios                4709  1 tpm
rfkill                 13886  4 bluetooth,dell_laptop,cfg80211
evdev                   8115  28 
pcspkr                  1739  0 
output                  1764  1 video
snd                    47164  19 snd_hda_codec_idt,snd_hda_intel,snd_hda_codec,snd_hwdep,snd_pcm_oss,snd_mixer_oss,snd_pcm,snd_rawmidi,snd_seq,snd_timer,snd_seq_device
psmouse                45290  0 
wmi                     7204  1 dell_wmi
battery                 5710  0 
ac                      2280  0 
shpchp                 21923  0 
soundcore               4614  1 snd
power_supply            7683  3 dell_laptop,battery,ac
processor              25140  3 acpi_cpufreq
button                  4722  1 i915
pci_hotplug            19711  1 shpchp
snd_page_alloc          6321  2 snd_hda_intel,snd_pcm
reiserfs              194515  2 
raid10                 18667  0 
raid456                44185  0 
async_raid6_recov       5027  1 raid456
async_pq                3471  2 raid456,async_raid6_recov
raid6_pq               77179  2 async_raid6_recov,async_pq
async_xor               2305  3 raid456,async_raid6_recov,async_pq
xor                     4228  1 async_xor
async_memcpy            1222  2 raid456,async_raid6_recov
async_tx                1950  5 raid456,async_raid6_recov,async_pq,async_xor,async_memcpy
raid1                  18177  0 
raid0                   7145  0 
multipath               5745  0 
linear                  3399  0 
md_mod                 79839  6 raid10,raid456,raid1,raid0,multipath,linear
dm_mirror              11770  0 
dm_region_hash          6672  1 dm_mirror
dm_log                  7693  2 dm_mirror,dm_region_hash
dm_mod                 56131  3 dm_crypt,dm_mirror,dm_log
btrfs                 412190  0 
zlib_deflate           17650  1 btrfs
crc32c                  2600  1 
libcrc32c               1114  1 btrfs
usbhid                 30874  0 
hid                    65142  1 usbhid
sg                     19095  0 
sd_mod                 28370  5 
sr_mod                 12759  0 
cdrom                  29865  1 sr_mod
crc_t10dif              1300  1 sd_mod
uas                     6917  0 
usb_storage            39639  0 
uhci_hcd               18426  0 
ahci                   19409  4 
libahci                15973  1 ahci
libata                143334  2 ahci,libahci
ssb                    37554  1 b43
ehci_hcd               31486  0 
mmc_core               54857  2 b43,ssb
sky2                   39697  0 
scsi_mod              154687  6 sg,sr_mod,sd_mod,uas,usb_storage,libata
pcmcia                 29451  2 b43,ssb
usbcore               118919  8 btusb,uvcvideo,usbhid,uas,usb_storage,uhci_hcd,ehci_hcd
pcmcia_core            10413  1 pcmcia
thermal                 7538  0 
nls_base                6369  5 nls_utf8,nls_cp437,vfat,fat,usbcore
thermal_sys            11764  3 video,processor,thermal
Comment 34 Maximilian Decker 2011-06-20 07:37:45 UTC
I had 4 concurrent I/O tests running for one week now on my AMD machine that 
happened to crash reiserfs twice. The tests did lots of fopen, fclose, fgetc, 
gputc, chmod and stat. No crash. The system was loaded with I/O and CPU usage 
(with the testing processes summing up to nearly 200% (dual-core CPU)).

The filesystem was dm-crypted  and mounted "rw,relatime,acl,user_xattr",
running with the openSuSE 11.4 kernel (2.6.37.1-1.2-desktop SMP 64bits).

Another script randomly set different CPU clockspeeds (for whatever that might
help, but for me the crashes had happend with ondemand CPU scaling governor).

So, to me it seems there must be something else actually triggering the crash. 
Maybe some interfering CPU idling stuff or something like that. Or some very
specific I/O I did not cover with my test. Don't know.

Anyway I could not reproduce with "just" steady CPU and I/O.

Someone else any news on this ?
Comment 35 roucaries.bastien+kernel 2011-08-21 13:00:04 UTC
I can reproduce on 2.6.39. Could not save the trace, but by memory it is the same call trace.

Could you help me and send testing patch ?

I am trying to reproduce with 3.0
Comment 36 Frederic Weisbecker 2011-08-21 14:11:20 UTC
Can you still reproduce under a bound amount of time? Like two days or so?

If so, as I remember you told me your mount options are:
"rw,nosuid,nodev,relatime,user_xattr,acl", can you test without acl for several days, enough to usually reproduce it, and tell us if you can still see the bug? If so it may be nice to retry the same experience with user_xattr.

Thanks.
Comment 37 roucaries.bastien+kernel 2011-08-21 15:18:43 UTC
I could directly answer my / partition mounted with rw,nosuid,nodev,relatime,user_xattr does not crash.

Definivly linked to acl

bastien
Comment 38 roucaries.bastien+kernel 2011-08-22 12:34:25 UTC
Reproductible with 3.0 see trace:
Aug 22 12:05:21 portablebastien kernel: [53760.744138] INFO: task x-www-browser:3507 blocked for more than 120 seconds.
Aug 22 12:05:21 portablebastien kernel: [53760.744144] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug 22 12:05:21 portablebastien kernel: [53760.744149] x-www-browser   D ffff8800cbd22830     0  3507   2908 0x00000000
Aug 22 12:05:21 portablebastien kernel: [53760.744157]  ffff8800cbd22830 0000000000000082 ffff880117e0ce80 ffff880000000000
Aug 22 12:05:21 portablebastien kernel: [53760.744165]  ffff88011af580c0 0000000000012800 ffff8800cbdaffd8 ffff8800cbdaffd8
Aug 22 12:05:21 portablebastien kernel: [53760.744172]  0000000000012800 ffff8800cbd22830 0000000000012800 0000000000012800
Aug 22 12:05:21 portablebastien kernel: [53760.744179] Call Trace:
Aug 22 12:05:21 portablebastien kernel: [53760.744192]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Aug 22 12:05:21 portablebastien kernel: [53760.744200]  [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179
Aug 22 12:05:21 portablebastien kernel: [53760.744206]  [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d
Aug 22 12:05:21 portablebastien kernel: [53760.744212]  [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d
Aug 22 12:05:21 portablebastien kernel: [53760.744218]  [<ffffffff810fbc23>] ? vfs_read+0xb2/0xf2
Aug 22 12:05:21 portablebastien kernel: [53760.744223]  [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b
Aug 22 12:05:21 portablebastien kernel: [53760.744231]  [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b
Aug 22 12:05:21 portablebastien kernel: [53760.744236] INFO: task konqueror:3510 blocked for more than 120 seconds.
Aug 22 12:05:21 portablebastien kernel: [53760.744240] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug 22 12:05:21 portablebastien kernel: [53760.744244] konqueror       D ffff8800cbe88870     0  3510   2908 0x00000000
Aug 22 12:05:21 portablebastien kernel: [53760.744250]  ffff8800cbe88870 0000000000000086 ffff880117e0ce80 ffff880000000000
Aug 22 12:05:21 portablebastien kernel: [53760.744257]  ffffffff8160b020 0000000000012800 ffff8800cd239fd8 ffff8800cd239fd8
Aug 22 12:05:21 portablebastien kernel: [53760.744264]  0000000000012800 ffff8800cbe88870 0000000000012800 0000000000012800
Aug 22 12:05:21 portablebastien kernel: [53760.744271] Call Trace:
Aug 22 12:05:21 portablebastien kernel: [53760.744277]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Aug 22 12:05:21 portablebastien kernel: [53760.744283]  [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179
Aug 22 12:05:21 portablebastien kernel: [53760.744290]  [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d
Aug 22 12:05:21 portablebastien kernel: [53760.744294]  [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d
Aug 22 12:05:21 portablebastien kernel: [53760.744300]  [<ffffffff810fbc23>] ? vfs_read+0xb2/0xf2
Aug 22 12:05:21 portablebastien kernel: [53760.744304]  [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b
Aug 22 12:05:21 portablebastien kernel: [53760.744310]  [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b
Aug 22 12:05:21 portablebastien kernel: [53760.744315] INFO: task konqueror:3511 blocked for more than 120 seconds.
Aug 22 12:05:21 portablebastien kernel: [53760.744318] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug 22 12:05:21 portablebastien kernel: [53760.744322] konqueror       D ffff8800cbe88180     0  3511   2908 0x00000000
Aug 22 12:05:21 portablebastien kernel: [53760.744328]  ffff8800cbe88180 0000000000000082 ffff880117e0ce80 ffff8800d2b83080
Aug 22 12:05:21 portablebastien kernel: [53760.744335]  ffff8800cbd22830 0000000000012800 ffff8800cbf2bfd8 ffff8800cbf2bfd8
Aug 22 12:05:21 portablebastien kernel: [53760.744342]  0000000000012800 ffff8800cbe88180 0000000000012800 0000000000012800
Aug 22 12:05:21 portablebastien kernel: [53760.744349] Call Trace:
Aug 22 12:05:21 portablebastien kernel: [53760.744355]  [<ffffffff810383fc>] ? need_resched+0x1a/0x23
Aug 22 12:05:21 portablebastien kernel: [53760.744360]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Aug 22 12:05:21 portablebastien kernel: [53760.744366]  [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179
Aug 22 12:05:21 portablebastien kernel: [53760.744372]  [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d
Aug 22 12:05:21 portablebastien kernel: [53760.744377]  [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d
Aug 22 12:05:21 portablebastien kernel: [53760.744382]  [<ffffffff810fbc23>] ? vfs_read+0xb2/0xf2
Aug 22 12:05:21 portablebastien kernel: [53760.744387]  [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b
Aug 22 12:05:21 portablebastien kernel: [53760.744392]  [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b
Aug 22 12:05:21 portablebastien kernel: [53760.744397] INFO: task konqueror:3512 blocked for more than 120 seconds.
Aug 22 12:05:21 portablebastien kernel: [53760.744401] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug 22 12:05:21 portablebastien kernel: [53760.744405] konqueror       D ffff8800cbfbb690     0  3512   2908 0x00000000
Aug 22 12:05:21 portablebastien kernel: [53760.744411]  ffff8800cbfbb690 0000000000000082 ffff880117e0ce80 ffff8800d2b83080
Aug 22 12:05:21 portablebastien kernel: [53760.744418]  ffff8800cbe88870 0000000000012800 ffff8800cbfb7fd8 ffff8800cbfb7fd8
Aug 22 12:05:21 portablebastien kernel: [53760.744425]  0000000000012800 ffff8800cbfbb690 0000000000012800 0000000000012800
Aug 22 12:05:21 portablebastien kernel: [53760.744432] Call Trace:
Aug 22 12:05:21 portablebastien kernel: [53760.744438]  [<ffffffff810383fc>] ? need_resched+0x1a/0x23
Aug 22 12:05:21 portablebastien kernel: [53760.744443]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Aug 22 12:05:21 portablebastien kernel: [53760.744449]  [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179
Aug 22 12:05:21 portablebastien kernel: [53760.744455]  [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d
Aug 22 12:05:21 portablebastien kernel: [53760.744460]  [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d
Aug 22 12:05:21 portablebastien kernel: [53760.744465]  [<ffffffff810fbc23>] ? vfs_read+0xb2/0xf2
Aug 22 12:05:21 portablebastien kernel: [53760.744470]  [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b
Aug 22 12:05:21 portablebastien kernel: [53760.744475]  [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b
Aug 22 12:05:21 portablebastien kernel: [53760.744481] INFO: task konqueror:3513 blocked for more than 120 seconds.
Aug 22 12:05:21 portablebastien kernel: [53760.744484] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug 22 12:05:21 portablebastien kernel: [53760.744488] konqueror       D ffff8800d1d97750     0  3513   2908 0x00000000
Aug 22 12:05:21 portablebastien kernel: [53760.744494]  ffff8800d1d97750 0000000000000082 ffff880117e0ce80 ffff880000000000
Aug 22 12:05:21 portablebastien kernel: [53760.744501]  ffffffff8160b020 0000000000012800 ffff8800c9471fd8 ffff8800c9471fd8
Aug 22 12:05:21 portablebastien kernel: [53760.744508]  0000000000012800 ffff8800d1d97750 0000000000012800 0000000000012800
Aug 22 12:05:21 portablebastien kernel: [53760.744515] Call Trace:
Aug 22 12:05:21 portablebastien kernel: [53760.744521]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Aug 22 12:05:21 portablebastien kernel: [53760.744527]  [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179
Aug 22 12:05:21 portablebastien kernel: [53760.744533]  [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d
Aug 22 12:05:21 portablebastien kernel: [53760.744538]  [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d
Aug 22 12:05:21 portablebastien kernel: [53760.744543]  [<ffffffff810fbc23>] ? vfs_read+0xb2/0xf2
Aug 22 12:05:21 portablebastien kernel: [53760.744548]  [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b
Aug 22 12:05:21 portablebastien kernel: [53760.744553]  [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b
Aug 22 12:05:21 portablebastien kernel: [53760.744563] INFO: task konqueror:3602 blocked for more than 120 seconds.
Aug 22 12:05:21 portablebastien kernel: [53760.744567] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug 22 12:05:21 portablebastien kernel: [53760.744570] konqueror       D ffff8800d8530fe0     0  3602   2908 0x00000000
Aug 22 12:05:21 portablebastien kernel: [53760.744577]  ffff8800d8530fe0 0000000000000082 0000000000000000 0000000000000000
Aug 22 12:05:21 portablebastien kernel: [53760.744584]  ffffffff8160b020 0000000000012800 ffff8800d87e7fd8 ffff8800d87e7fd8
Aug 22 12:05:21 portablebastien kernel: [53760.744591]  0000000000012800 ffff8800d8530fe0 0000000000012800 0000000000012800
Aug 22 12:05:21 portablebastien kernel: [53760.744598] Call Trace:
Aug 22 12:05:21 portablebastien kernel: [53760.744604]  [<ffffffff81109605>] ? poll_freewait+0x8c/0x8c
Aug 22 12:05:21 portablebastien kernel: [53760.744640]  [<ffffffffa029217b>] ? queue_log_writer+0x7e/0xac [reiserfs]
Aug 22 12:05:21 portablebastien kernel: [53760.744647]  [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199
Aug 22 12:05:21 portablebastien kernel: [53760.744663]  [<ffffffffa0296e03>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs]
Aug 22 12:05:21 portablebastien kernel: [53760.744672]  [<ffffffff8113b53f>] ? dquot_active+0x19/0x3a
Aug 22 12:05:21 portablebastien kernel: [53760.744688]  [<ffffffffa0296f9d>] ? journal_begin+0xbb/0xf7 [reiserfs]
Aug 22 12:05:21 portablebastien kernel: [53760.744702]  [<ffffffffa027e1b8>] ? reiserfs_unlink+0x7d/0x279 [reiserfs]
Aug 22 12:05:21 portablebastien kernel: [53760.744709]  [<ffffffff81111b05>] ? mntput_no_expire+0x21/0xd5
Aug 22 12:05:21 portablebastien kernel: [53760.744715]  [<ffffffff8110669e>] ? path_lookupat+0x31b/0x335
Aug 22 12:05:21 portablebastien kernel: [53760.744720]  [<ffffffff810383fc>] ? need_resched+0x1a/0x23
Aug 22 12:05:21 portablebastien kernel: [53760.744725]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Aug 22 12:05:21 portablebastien kernel: [53760.744731]  [<ffffffff8133565f>] ? _cond_resched+0x9/0x20
Aug 22 12:05:21 portablebastien kernel: [53760.744736]  [<ffffffff81104523>] ? inode_permission+0x60/0xc6
Aug 22 12:05:21 portablebastien kernel: [53760.744741]  [<ffffffff810383fc>] ? need_resched+0x1a/0x23
Aug 22 12:05:21 portablebastien kernel: [53760.744747]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Aug 22 12:05:21 portablebastien kernel: [53760.744752]  [<ffffffff81104706>] ? vfs_unlink+0x65/0xbe
Aug 22 12:05:21 portablebastien kernel: [53760.744756]  [<ffffffff811068e3>] ? do_unlinkat+0xc6/0x14d
Aug 22 12:05:21 portablebastien kernel: [53760.744762]  [<ffffffff810fbc23>] ? vfs_read+0xb2/0xf2
Aug 22 12:05:21 portablebastien kernel: [53760.744766]  [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b
Aug 22 12:05:21 portablebastien kernel: [53760.744772]  [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b
Aug 22 12:05:21 portablebastien kernel: [53760.744785] INFO: task konqueror:6686 blocked for more than 120 seconds.
Aug 22 12:05:21 portablebastien kernel: [53760.744788] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug 22 12:05:21 portablebastien kernel: [53760.744792] konqueror       D ffff8800c77929b0     0  6686   3437 0x00000000
Aug 22 12:05:21 portablebastien kernel: [53760.744799]  ffff8800c77929b0 0000000000000082 ffff880117e0ce80 ffff880000000000
Aug 22 12:05:21 portablebastien kernel: [53760.744806]  ffff88011af580c0 0000000000012800 ffff880089523fd8 ffff880089523fd8
Aug 22 12:05:21 portablebastien kernel: [53760.744813]  0000000000012800 ffff8800c77929b0 0000000000012800 0000000000012800
Aug 22 12:05:21 portablebastien kernel: [53760.744820] Call Trace:
Aug 22 12:05:21 portablebastien kernel: [53760.744825]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Aug 22 12:05:21 portablebastien kernel: [53760.744832]  [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179
Aug 22 12:05:21 portablebastien kernel: [53760.744838]  [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d
Aug 22 12:05:21 portablebastien kernel: [53760.744843]  [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d
Aug 22 12:05:21 portablebastien kernel: [53760.744848]  [<ffffffff810fc8b0>] ? fput+0x1a/0x1a2
Aug 22 12:05:21 portablebastien kernel: [53760.744853]  [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b
Aug 22 12:05:21 portablebastien kernel: [53760.744858]  [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b
Aug 22 12:05:21 portablebastien kernel: [53760.744877] INFO: task konqueror:31954 blocked for more than 120 seconds.
Aug 22 12:05:21 portablebastien kernel: [53760.744881] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug 22 12:05:21 portablebastien kernel: [53760.744884] konqueror       D ffff8800b128f610     0 31954   2908 0x00000000
Aug 22 12:05:21 portablebastien kernel: [53760.744893]  ffff8800b128f610 0000000000000086 ffff880117e0ce80 ffff8800d2b83080
Aug 22 12:05:21 portablebastien kernel: [53760.744900]  ffff8800cbe88180 0000000000012800 ffff88003e141fd8 ffff88003e141fd8
Aug 22 12:05:21 portablebastien kernel: [53760.744907]  0000000000012800 ffff8800b128f610 0000000000012800 0000000000012800
Aug 22 12:05:21 portablebastien kernel: [53760.744914] Call Trace:
Aug 22 12:05:21 portablebastien kernel: [53760.744920]  [<ffffffff810383fc>] ? need_resched+0x1a/0x23
Aug 22 12:05:21 portablebastien kernel: [53760.744925]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Aug 22 12:05:21 portablebastien kernel: [53760.744931]  [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179
Aug 22 12:05:21 portablebastien kernel: [53760.744937]  [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d
Aug 22 12:05:21 portablebastien kernel: [53760.744942]  [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d
Aug 22 12:05:21 portablebastien kernel: [53760.744947]  [<ffffffff810fc8b0>] ? fput+0x1a/0x1a2
Aug 22 12:05:21 portablebastien kernel: [53760.744952]  [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b
Aug 22 12:05:21 portablebastien kernel: [53760.744958]  [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b
Aug 22 12:05:21 portablebastien kernel: [53760.744966] INFO: task cc1:18172 blocked for more than 120 seconds.
Aug 22 12:05:21 portablebastien kernel: [53760.744970] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug 22 12:05:21 portablebastien kernel: [53760.744973] cc1             D ffff88011af29550     0 18172  18171 0x00000000
Aug 22 12:05:21 portablebastien kernel: [53760.744980]  ffff88011af29550 0000000000000082 ffff88010047b9a8 0000000000000000
Aug 22 12:05:21 portablebastien kernel: [53760.744987]  ffffffff8160b020 0000000000012800 ffff88010047bfd8 ffff88010047bfd8
Aug 22 12:05:21 portablebastien kernel: [53760.744994]  0000000000012800 ffff88011af29550 0000000000012800 0000000000012800
Aug 22 12:05:21 portablebastien kernel: [53760.745001] Call Trace:
Aug 22 12:05:21 portablebastien kernel: [53760.745018]  [<ffffffffa029217b>] ? queue_log_writer+0x7e/0xac [reiserfs]
Aug 22 12:05:21 portablebastien kernel: [53760.745024]  [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199
Aug 22 12:05:21 portablebastien kernel: [53760.745040]  [<ffffffffa0296e03>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs]
Aug 22 12:05:21 portablebastien kernel: [53760.745056]  [<ffffffffa0296f9d>] ? journal_begin+0xbb/0xf7 [reiserfs]
Aug 22 12:05:21 portablebastien kernel: [53760.745071]  [<ffffffffa0280e1c>] ? reiserfs_truncate_file+0x16f/0x26e [reiserfs]
Aug 22 12:05:21 portablebastien kernel: [53760.745077]  [<ffffffff810383fc>] ? need_resched+0x1a/0x23
Aug 22 12:05:21 portablebastien kernel: [53760.745083]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Aug 22 12:05:21 portablebastien kernel: [53760.745097]  [<ffffffffa0283dfa>] ? reiserfs_vfs_truncate_file+0x22/0x30 [reiserfs]
Aug 22 12:05:21 portablebastien kernel: [53760.745104]  [<ffffffff810bfda0>] ? vmtruncate+0x33/0x3b
Aug 22 12:05:21 portablebastien kernel: [53760.745119]  [<ffffffffa0283d6a>] ? reiserfs_setattr+0x253/0x2c1 [reiserfs]
Aug 22 12:05:21 portablebastien kernel: [53760.745126]  [<ffffffff810b54ad>] ? generic_file_buffered_write+0x1b8/0x219
Aug 22 12:05:21 portablebastien kernel: [53760.745133]  [<ffffffff8110cb3c>] ? __d_lookup_rcu+0xb6/0xf2
Aug 22 12:05:21 portablebastien kernel: [53760.745139]  [<ffffffff810ba536>] ? get_pageblock_flags_group+0x3f/0x76
Aug 22 12:05:21 portablebastien kernel: [53760.745145]  [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24
Aug 22 12:05:21 portablebastien kernel: [53760.745150]  [<ffffffff8110f6db>] ? notify_change+0x1a7/0x291
Aug 22 12:05:21 portablebastien kernel: [53760.745156]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Aug 22 12:05:21 portablebastien kernel: [53760.745163]  [<ffffffff810fa6a9>] ? do_truncate+0x65/0x80
Aug 22 12:05:21 portablebastien kernel: [53760.745168]  [<ffffffff810fa353>] ? __dentry_open+0x1a7/0x29c
Aug 22 12:05:21 portablebastien kernel: [53760.745173]  [<ffffffff811058d3>] ? do_last+0x4df/0x584
Aug 22 12:05:21 portablebastien kernel: [53760.745178]  [<ffffffff81106bea>] ? path_openat+0xc7/0x349
Aug 22 12:05:21 portablebastien kernel: [53760.745184]  [<ffffffff810d0312>] ? tlb_flush_mmu+0x37/0x50
Aug 22 12:05:21 portablebastien kernel: [53760.745190]  [<ffffffff81106e98>] ? do_filp_open+0x2c/0x72
Aug 22 12:05:21 portablebastien kernel: [53760.745196]  [<ffffffff8133565f>] ? _cond_resched+0x9/0x20
Aug 22 12:05:21 portablebastien kernel: [53760.745203]  [<ffffffff811ac741>] ? __strncpy_from_user+0x19/0x4a
Aug 22 12:05:21 portablebastien kernel: [53760.745208]  [<ffffffff81110208>] ? alloc_fd+0x69/0x110
Aug 22 12:05:21 portablebastien kernel: [53760.745214]  [<ffffffff810fb138>] ? do_sys_open+0x5f/0xe6
Aug 22 12:05:21 portablebastien kernel: [53760.745220]  [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b
Comment 39 roucaries.bastien+kernel 2011-09-08 12:48:25 UTC
This time I achieved to get an interesting trace, journal begin was interrupted by an IPI, and stuck

What do you think about this ?

regards

Bastien

Sep  8 10:18:25 portablebastien kernel: [177000.740195] INFO: task kded4:31863 blocked for more than 120 seconds.
Sep  8 10:18:25 portablebastien kernel: [177000.740260] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep  8 10:18:25 portablebastien kernel: [177000.740326] kded4           D ffff880119d62830     0 31863      1 0x00000000
Sep  8 10:18:25 portablebastien kernel: [177000.740335]  ffff880119d62830 0000000000000082 ffff880000000040 0000000100000000
Sep  8 10:18:25 portablebastien kernel: [177000.740343]  ffffffff8160b020 0000000000012800 ffff8800cac65fd8 ffff8800cac65fd8
Sep  8 10:18:25 portablebastien kernel: [177000.740351]  0000000000012800 ffff880119d62830 0000000000012800 0000000000012800
Sep  8 10:18:25 portablebastien kernel: [177000.740358] Call Trace:
Sep  8 10:18:25 portablebastien kernel: [177000.740371]  [<ffffffff81336090>] ? __mutex_lock_common.clone.5+0x114/0x179
Sep  8 10:18:25 portablebastien kernel: [177000.740379]  [<ffffffff81335f69>] ? mutex_lock+0x1a/0x2d
Sep  8 10:18:25 portablebastien kernel: [177000.740386]  [<ffffffff810b6dbc>] ? generic_file_aio_write+0x3b/0xb2
Sep  8 10:18:25 portablebastien kernel: [177000.740392]  [<ffffffff810fb7eb>] ? do_sync_write+0xb1/0xea
Sep  8 10:18:25 portablebastien kernel: [177000.740401]  [<ffffffff811653e9>] ? security_file_permission+0x18/0x33
Sep  8 10:18:25 portablebastien kernel: [177000.740407]  [<ffffffff810fbe02>] ? vfs_write+0xa6/0xf9
Sep  8 10:18:25 portablebastien kernel: [177000.740412]  [<ffffffff810fbff7>] ? sys_write+0x45/0x6b
Sep  8 10:18:25 portablebastien kernel: [177000.740418]  [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b
Sep  8 10:18:25 portablebastien kernel: [177000.740442] INFO: task krunner:31987 blocked for more than 120 seconds.
Sep  8 10:18:25 portablebastien kernel: [177000.740498] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep  8 10:18:25 portablebastien kernel: [177000.740562] krunner         D ffff8801192d4300     0 31987      1 0x00000000
Sep  8 10:18:25 portablebastien kernel: [177000.740569]  ffff8801192d4300 0000000000000086 ffff880117744148 ffff8801181f2f40
Sep  8 10:18:25 portablebastien kernel: [177000.740577]  ffff8800caef0e60 0000000000012800 ffff88001d0ebfd8 ffff88001d0ebfd8
Sep  8 10:18:25 portablebastien kernel: [177000.740584]  0000000000012800 ffff8801192d4300 0000000000012800 0000000000012800
Sep  8 10:18:25 portablebastien kernel: [177000.740591] Call Trace:
Sep  8 10:18:25 portablebastien kernel: [177000.740598]  [<ffffffff81071f28>] ? arch_local_irq_save+0x14/0x1d
Sep  8 10:18:25 portablebastien kernel: [177000.740636]  [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs]
Sep  8 10:18:25 portablebastien kernel: [177000.740643]  [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199
Sep  8 10:18:25 portablebastien kernel: [177000.740662]  [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs]
Sep  8 10:18:25 portablebastien kernel: [177000.740670]  [<ffffffff81098a4a>] ? delayacct_end+0x72/0x7d
Sep  8 10:18:25 portablebastien kernel: [177000.740677]  [<ffffffff810b5ebc>] ? sleep_on_page+0x10/0x10
Sep  8 10:18:25 portablebastien kernel: [177000.740694]  [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs]
Sep  8 10:18:25 portablebastien kernel: [177000.740712]  [<ffffffffa0290d35>] ? reiserfs_dirty_inode+0x53/0x8f [reiserfs]
Sep  8 10:18:25 portablebastien kernel: [177000.740719]  [<ffffffff810600ad>] ? autoremove_wake_function+0x2a/0x2a
Sep  8 10:18:25 portablebastien kernel: [177000.740725]  [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24
Sep  8 10:18:25 portablebastien kernel: [177000.740732]  [<ffffffff8111846e>] ? __mark_inode_dirty+0x22/0x183
Sep  8 10:18:25 portablebastien kernel: [177000.740739]  [<ffffffff8110e2b6>] ? file_update_time+0xea/0x115
Sep  8 10:18:25 portablebastien kernel: [177000.740745]  [<ffffffff810b6c69>] ? __generic_file_aio_write+0x160/0x278
Sep  8 10:18:25 portablebastien kernel: [177000.740752]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Sep  8 10:18:25 portablebastien kernel: [177000.740758]  [<ffffffff810b6ddb>] ? generic_file_aio_write+0x5a/0xb2
Sep  8 10:18:25 portablebastien kernel: [177000.740764]  [<ffffffff810fb7eb>] ? do_sync_write+0xb1/0xea
Sep  8 10:18:25 portablebastien kernel: [177000.740771]  [<ffffffff811653e9>] ? security_file_permission+0x18/0x33
Sep  8 10:18:25 portablebastien kernel: [177000.740777]  [<ffffffff810fbe02>] ? vfs_write+0xa6/0xf9
Sep  8 10:18:25 portablebastien kernel: [177000.740782]  [<ffffffff810fbff7>] ? sys_write+0x45/0x6b
Sep  8 10:18:25 portablebastien kernel: [177000.740788]  [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b
Sep  8 10:18:25 portablebastien kernel: [177000.740811] INFO: task okular:12053 blocked for more than 120 seconds.
Sep  8 10:18:25 portablebastien kernel: [177000.740867] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep  8 10:18:25 portablebastien kernel: [177000.740931] okular          D ffff8800c9c8d060     0 12053  32057 0x00000000
Sep  8 10:18:25 portablebastien kernel: [177000.740938]  ffff8800c9c8d060 0000000000000086 ffff8800c9c8d0a8 ffff880000000000
Sep  8 10:18:25 portablebastien kernel: [177000.740946]  ffff88011af780c0 0000000000012800 ffff8800ab7dbfd8 ffff8800ab7dbfd8
Sep  8 10:18:25 portablebastien kernel: [177000.740953]  0000000000012800 ffff8800c9c8d060 0000000000012800 0000000000012800
Sep  8 10:18:25 portablebastien kernel: [177000.740960] Call Trace:
Sep  8 10:18:25 portablebastien kernel: [177000.740982]  [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs]
Sep  8 10:18:25 portablebastien kernel: [177000.740988]  [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199
Sep  8 10:18:25 portablebastien kernel: [177000.741007]  [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs]
Sep  8 10:18:25 portablebastien kernel: [177000.741025]  [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs]
Sep  8 10:18:25 portablebastien kernel: [177000.741042]  [<ffffffffa0289e1c>] ? reiserfs_truncate_file+0x16f/0x26e [reiserfs]
Sep  8 10:18:25 portablebastien kernel: [177000.741048]  [<ffffffff8110a7ba>] ? do_sys_poll+0x30d/0x37d
Sep  8 10:18:25 portablebastien kernel: [177000.741055]  [<ffffffff810383fc>] ? need_resched+0x1a/0x23
Sep  8 10:18:25 portablebastien kernel: [177000.741060]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Sep  8 10:18:25 portablebastien kernel: [177000.741077]  [<ffffffffa028cdfa>] ? reiserfs_vfs_truncate_file+0x22/0x30 [reiserfs]
Sep  8 10:18:25 portablebastien kernel: [177000.741084]  [<ffffffff810bffe8>] ? vmtruncate+0x33/0x3b
Sep  8 10:18:25 portablebastien kernel: [177000.741099]  [<ffffffffa028cd6a>] ? reiserfs_setattr+0x253/0x2c1 [reiserfs]
Sep  8 10:18:25 portablebastien kernel: [177000.741106]  [<ffffffff8110ce20>] ? __d_lookup_rcu+0xb6/0xf2
Sep  8 10:18:25 portablebastien kernel: [177000.741112]  [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24
Sep  8 10:18:25 portablebastien kernel: [177000.741118]  [<ffffffff8110f9bf>] ? notify_change+0x1a7/0x291
Sep  8 10:18:25 portablebastien kernel: [177000.741124]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Sep  8 10:18:25 portablebastien kernel: [177000.741131]  [<ffffffff810fa98d>] ? do_truncate+0x65/0x80
Sep  8 10:18:25 portablebastien kernel: [177000.741137]  [<ffffffff810fa637>] ? __dentry_open+0x1a7/0x29c
Sep  8 10:18:25 portablebastien kernel: [177000.741142]  [<ffffffff81105bb7>] ? do_last+0x4df/0x584
Sep  8 10:18:25 portablebastien kernel: [177000.741148]  [<ffffffff81106ece>] ? path_openat+0xc7/0x349
Sep  8 10:18:25 portablebastien kernel: [177000.741153]  [<ffffffff810fb8d5>] ? do_sync_read+0xb1/0xea
Sep  8 10:18:25 portablebastien kernel: [177000.741159]  [<ffffffff8110717c>] ? do_filp_open+0x2c/0x72
Sep  8 10:18:25 portablebastien kernel: [177000.741166]  [<ffffffff813358d7>] ? _cond_resched+0x9/0x20
Sep  8 10:18:25 portablebastien kernel: [177000.741172]  [<ffffffff811aca91>] ? __strncpy_from_user+0x19/0x4a
Sep  8 10:18:25 portablebastien kernel: [177000.741178]  [<ffffffff811104ec>] ? alloc_fd+0x69/0x110
Sep  8 10:18:25 portablebastien kernel: [177000.741184]  [<ffffffff810fb41c>] ? do_sys_open+0x5f/0xe6
Sep  8 10:18:25 portablebastien kernel: [177000.741191]  [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b
Sep  8 10:18:25 portablebastien kernel: [177000.741197] INFO: task firefox-bin:12794 blocked for more than 120 seconds.
Sep  8 10:18:25 portablebastien kernel: [177000.741256] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep  8 10:18:25 portablebastien kernel: [177000.741320] firefox-bin     D ffff8800c1e56400     0 12794  31987 0x00000000
Sep  8 10:18:25 portablebastien kernel: [177000.741326]  ffff8800c1e56400 0000000000000082 0000000000000246 ffffffff00000000
Sep  8 10:18:25 portablebastien kernel: [177000.741334]  ffff88011af780c0 0000000000012800 ffff880118589fd8 ffff880118589fd8
Sep  8 10:18:25 portablebastien kernel: [177000.741341]  0000000000012800 ffff8800c1e56400 0000000000012800 0000000000012800
Sep  8 10:18:25 portablebastien kernel: [177000.741349] Call Trace:
Sep  8 10:18:25 portablebastien kernel: [177000.741368]  [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs]
Sep  8 10:18:25 portablebastien kernel: [177000.741374]  [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199
Sep  8 10:18:25 portablebastien kernel: [177000.741392]  [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.741398]  [<ffffffff811098e9>] ? poll_freewait+0x8c/0x8c
Sep  8 10:18:26 portablebastien kernel: [177000.741405]  [<ffffffff810cb994>] ? __mod_zone_page_state+0x3c/0x45
Sep  8 10:18:26 portablebastien kernel: [177000.741413]  [<ffffffff8100e28d>] ? paravirt_read_tsc+0x5/0x8
Sep  8 10:18:26 portablebastien kernel: [177000.741430]  [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.741447]  [<ffffffffa0290d35>] ? reiserfs_dirty_inode+0x53/0x8f [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.741454]  [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24
Sep  8 10:18:26 portablebastien kernel: [177000.741460]  [<ffffffff8111846e>] ? __mark_inode_dirty+0x22/0x183
Sep  8 10:18:26 portablebastien kernel: [177000.741466]  [<ffffffff8110e3e4>] ? touch_atime+0x103/0x12c
Sep  8 10:18:26 portablebastien kernel: [177000.741472]  [<ffffffff810b7391>] ? generic_file_aio_read+0x55e/0x5c7
Sep  8 10:18:26 portablebastien kernel: [177000.741479]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Sep  8 10:18:26 portablebastien kernel: [177000.741485]  [<ffffffff810fb8d5>] ? do_sync_read+0xb1/0xea
Sep  8 10:18:26 portablebastien kernel: [177000.741491]  [<ffffffff810fbef4>] ? vfs_read+0x9f/0xf2
Sep  8 10:18:26 portablebastien kernel: [177000.741496]  [<ffffffff810fbf8c>] ? sys_read+0x45/0x6b
Sep  8 10:18:26 portablebastien kernel: [177000.741503]  [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b
Sep  8 10:18:26 portablebastien kernel: [177000.741510] INFO: task firefox-bin:13107 blocked for more than 120 seconds.
Sep  8 10:18:26 portablebastien kernel: [177000.741573] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep  8 10:18:26 portablebastien kernel: [177000.741639] firefox-bin     D ffff880004d76e60     0 13107  31987 0x00000000
Sep  8 10:18:26 portablebastien kernel: [177000.741646]  ffff880004d76e60 0000000000000082 0000000000000001 0000000000000000
Sep  8 10:18:26 portablebastien kernel: [177000.741653]  ffffffff8160b020 0000000000012800 ffff8800cafd1fd8 ffff8800cafd1fd8
Sep  8 10:18:26 portablebastien kernel: [177000.741661]  0000000000012800 ffff880004d76e60 0000000000012800 0000000000012800
Sep  8 10:18:26 portablebastien kernel: [177000.741668] Call Trace:
Sep  8 10:18:26 portablebastien kernel: [177000.741686]  [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.741692]  [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199
Sep  8 10:18:26 portablebastien kernel: [177000.741708]  [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.741714]  [<ffffffff8103aec8>] ? mmdrop+0xd/0x1c
Sep  8 10:18:26 portablebastien kernel: [177000.741719]  [<ffffffff8103b0a2>] ? finish_task_switch+0x84/0xaf
Sep  8 10:18:26 portablebastien kernel: [177000.741725]  [<ffffffff810383fc>] ? need_resched+0x1a/0x23
Sep  8 10:18:26 portablebastien kernel: [177000.741741]  [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.741756]  [<ffffffffa0290d35>] ? reiserfs_dirty_inode+0x53/0x8f [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.741762]  [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24
Sep  8 10:18:26 portablebastien kernel: [177000.741768]  [<ffffffff8111846e>] ? __mark_inode_dirty+0x22/0x183
Sep  8 10:18:26 portablebastien kernel: [177000.741775]  [<ffffffff8110e2b6>] ? file_update_time+0xea/0x115
Sep  8 10:18:26 portablebastien kernel: [177000.741781]  [<ffffffff810b6c69>] ? __generic_file_aio_write+0x160/0x278
Sep  8 10:18:26 portablebastien kernel: [177000.741787]  [<ffffffff8106e09f>] ? get_futex_key+0x8d/0x27a
Sep  8 10:18:26 portablebastien kernel: [177000.741793]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Sep  8 10:18:26 portablebastien kernel: [177000.741799]  [<ffffffff810b6ddb>] ? generic_file_aio_write+0x5a/0xb2
Sep  8 10:18:26 portablebastien kernel: [177000.741804]  [<ffffffff810fb7eb>] ? do_sync_write+0xb1/0xea
Sep  8 10:18:26 portablebastien kernel: [177000.741812]  [<ffffffff811653e9>] ? security_file_permission+0x18/0x33
Sep  8 10:18:26 portablebastien kernel: [177000.741818]  [<ffffffff810fbe02>] ? vfs_write+0xa6/0xf9
Sep  8 10:18:26 portablebastien kernel: [177000.741823]  [<ffffffff810fbff7>] ? sys_write+0x45/0x6b
Sep  8 10:18:26 portablebastien kernel: [177000.741829]  [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b
Sep  8 10:18:26 portablebastien kernel: [177000.741835] INFO: task firefox-bin:14131 blocked for more than 120 seconds.
Sep  8 10:18:26 portablebastien kernel: [177000.741894] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep  8 10:18:26 portablebastien kernel: [177000.741958] firefox-bin     D ffff8800143e8080     0 14131  31987 0x00000000
Sep  8 10:18:26 portablebastien kernel: [177000.741965]  ffff8800143e8080 0000000000000082 0000000000000292 ffffffff00000000
Sep  8 10:18:26 portablebastien kernel: [177000.741972]  ffff88011af780c0 0000000000012800 ffff88011949bfd8 ffff88011949bfd8
Sep  8 10:18:26 portablebastien kernel: [177000.741979]  0000000000012800 ffff8800143e8080 0000000000012800 0000000000012800
Sep  8 10:18:26 portablebastien kernel: [177000.741986] Call Trace:
Sep  8 10:18:26 portablebastien kernel: [177000.742003]  [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.742009]  [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199
Sep  8 10:18:26 portablebastien kernel: [177000.742026]  [<ffffffffa02a039b>] ? reiserfs_commit_for_inode+0x96/0x1b5 [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.742032]  [<ffffffff810383fc>] ? need_resched+0x1a/0x23
Sep  8 10:18:26 portablebastien kernel: [177000.742038]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Sep  8 10:18:26 portablebastien kernel: [177000.742044]  [<ffffffff813358d7>] ? _cond_resched+0x9/0x20
Sep  8 10:18:26 portablebastien kernel: [177000.742050]  [<ffffffff81335f5c>] ? mutex_lock+0xd/0x2d
Sep  8 10:18:26 portablebastien kernel: [177000.742064]  [<ffffffffa028ce6b>] ? reiserfs_sync_file+0x42/0x8b [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.742071]  [<ffffffff8111bc56>] ? vfs_fsync_range+0x52/0x74
Sep  8 10:18:26 portablebastien kernel: [177000.742077]  [<ffffffff8111bd00>] ? do_fsync+0x27/0x3d
Sep  8 10:18:26 portablebastien kernel: [177000.742082]  [<ffffffff8111bf1c>] ? sys_fsync+0xb/0x12
Sep  8 10:18:26 portablebastien kernel: [177000.742088]  [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b
Sep  8 10:18:26 portablebastien kernel: [177000.742098] INFO: task sync:14137 blocked for more than 120 seconds.
Sep  8 10:18:26 portablebastien kernel: [177000.742151] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep  8 10:18:26 portablebastien kernel: [177000.742215] sync            D ffff8800bfcf38d0     0 14137   3494 0x00000000
Sep  8 10:18:26 portablebastien kernel: [177000.742222]  ffff8800bfcf38d0 0000000000000082 0000000000000000 ffffffff8103b0a2
Sep  8 10:18:26 portablebastien kernel: [177000.742229]  ffffffff8160b020 0000000000012800 ffff880067405fd8 ffff880067405fd8
Sep  8 10:18:26 portablebastien kernel: [177000.742237]  0000000000012800 ffff8800bfcf38d0 0000000000012800 0000000000012800
Sep  8 10:18:26 portablebastien kernel: [177000.742244] Call Trace:
Sep  8 10:18:26 portablebastien kernel: [177000.742249]  [<ffffffff8103b0a2>] ? finish_task_switch+0x84/0xaf
Sep  8 10:18:26 portablebastien kernel: [177000.742255]  [<ffffffff81071f28>] ? arch_local_irq_save+0x14/0x1d
Sep  8 10:18:26 portablebastien kernel: [177000.742272]  [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.742278]  [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199
Sep  8 10:18:26 portablebastien kernel: [177000.742294]  [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.742301]  [<ffffffff81023145>] ? _flat_send__mask+0x6a/0x7c
Sep  8 10:18:26 portablebastien kernel: [177000.742307]  [<ffffffff81336a8d>] ? _raw_spin_lock_irq+0xd/0x1a
Sep  8 10:18:26 portablebastien kernel: [177000.742313]  [<ffffffff8111bdd5>] ? __sync_filesystem+0x78/0x78
Sep  8 10:18:26 portablebastien kernel: [177000.742328]  [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.742344]  [<ffffffffa0290c9e>] ? reiserfs_sync_fs+0x1e/0x53 [reiserfs]
Sep  8 10:18:26 portablebastien kernel: [177000.742350]  [<ffffffff8111bdb8>] ? __sync_filesystem+0x5b/0x78
Sep  8 10:18:26 portablebastien kernel: [177000.742356]  [<ffffffff810fe0ac>] ? iterate_supers+0x5e/0xab
Sep  8 10:18:26 portablebastien kernel: [177000.742362]  [<ffffffff8111bd2f>] ? sync_filesystems+0x19/0x1e
Sep  8 10:18:26 portablebastien kernel: [177000.742367]  [<ffffffff8111be43>] ? sys_sync+0x12/0x31
Sep  8 10:18:26 portablebastien kernel: [177000.742373]  [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b
Sep  8 10:20:25 portablebastien kernel: [177120.740213] INFO: task kded4:31863 blocked for more than 120 seconds.
Sep  8 10:20:25 portablebastien kernel: [177120.742048] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep  8 10:20:25 portablebastien kernel: [177120.743918] kded4           D ffff880119d62830     0 31863      1 0x00000000
Sep  8 10:20:25 portablebastien kernel: [177120.743926]  ffff880119d62830 0000000000000082 ffff880000000040 0000000100000000
Sep  8 10:20:25 portablebastien kernel: [177120.743935]  ffffffff8160b020 0000000000012800 ffff8800cac65fd8 ffff8800cac65fd8
Sep  8 10:20:25 portablebastien kernel: [177120.743942]  0000000000012800 ffff880119d62830 0000000000012800 0000000000012800
Sep  8 10:20:25 portablebastien kernel: [177120.743952] Call Trace:
Sep  8 10:20:25 portablebastien kernel: [177120.743965]  [<ffffffff81336090>] ? __mutex_lock_common.clone.5+0x114/0x179
Sep  8 10:20:25 portablebastien kernel: [177120.743972]  [<ffffffff81335f69>] ? mutex_lock+0x1a/0x2d
Sep  8 10:20:25 portablebastien kernel: [177120.743979]  [<ffffffff810b6dbc>] ? generic_file_aio_write+0x3b/0xb2
Sep  8 10:20:25 portablebastien kernel: [177120.743986]  [<ffffffff810fb7eb>] ? do_sync_write+0xb1/0xea
Sep  8 10:20:25 portablebastien kernel: [177120.743994]  [<ffffffff811653e9>] ? security_file_permission+0x18/0x33
Sep  8 10:20:25 portablebastien kernel: [177120.744026]  [<ffffffff810fbe02>] ? vfs_write+0xa6/0xf9
Sep  8 10:20:25 portablebastien kernel: [177120.744031]  [<ffffffff810fbff7>] ? sys_write+0x45/0x6b
Sep  8 10:20:25 portablebastien kernel: [177120.744038]  [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b
Sep  8 10:20:25 portablebastien kernel: [177120.744062] INFO: task krunner:31987 blocked for more than 120 seconds.
Sep  8 10:20:25 portablebastien kernel: [177120.745956] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep  8 10:20:25 portablebastien kernel: [177120.747877] krunner         D ffff8801192d4300     0 31987      1 0x00000000
Sep  8 10:20:25 portablebastien kernel: [177120.747884]  ffff8801192d4300 0000000000000086 ffff880117744148 ffff8801181f2f40
Sep  8 10:20:25 portablebastien kernel: [177120.747891]  ffff8800caef0e60 0000000000012800 ffff88001d0ebfd8 ffff88001d0ebfd8
Sep  8 10:20:25 portablebastien kernel: [177120.747898]  0000000000012800 ffff8801192d4300 0000000000012800 0000000000012800
Sep  8 10:20:25 portablebastien kernel: [177120.747906] Call Trace:
Sep  8 10:20:25 portablebastien kernel: [177120.747913]  [<ffffffff81071f28>] ? arch_local_irq_save+0x14/0x1d
Sep  8 10:20:25 portablebastien kernel: [177120.747951]  [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs]
Sep  8 10:20:25 portablebastien kernel: [177120.747958]  [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199
Sep  8 10:20:25 portablebastien kernel: [177120.747975]  [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs]
Sep  8 10:20:25 portablebastien kernel: [177120.747982]  [<ffffffff81098a4a>] ? delayacct_end+0x72/0x7d
Sep  8 10:20:25 portablebastien kernel: [177120.747989]  [<ffffffff810b5ebc>] ? sleep_on_page+0x10/0x10
Sep  8 10:20:25 portablebastien kernel: [177120.748026]  [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs]
Sep  8 10:20:25 portablebastien kernel: [177120.748042]  [<ffffffffa0290d35>] ? reiserfs_dirty_inode+0x53/0x8f [reiserfs]
Sep  8 10:20:25 portablebastien kernel: [177120.748051]  [<ffffffff810600ad>] ? autoremove_wake_function+0x2a/0x2a
Sep  8 10:20:25 portablebastien kernel: [177120.748059]  [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24
Sep  8 10:20:25 portablebastien kernel: [177120.748067]  [<ffffffff8111846e>] ? __mark_inode_dirty+0x22/0x183
Sep  8 10:20:25 portablebastien kernel: [177120.748075]  [<ffffffff8110e2b6>] ? file_update_time+0xea/0x115
Sep  8 10:20:25 portablebastien kernel: [177120.748083]  [<ffffffff810b6c69>] ? __generic_file_aio_write+0x160/0x278
Sep  8 10:20:25 portablebastien kernel: [177120.748092]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Sep  8 10:20:25 portablebastien kernel: [177120.748098]  [<ffffffff810b6ddb>] ? generic_file_aio_write+0x5a/0xb2
Sep  8 10:20:25 portablebastien kernel: [177120.748106]  [<ffffffff810fb7eb>] ? do_sync_write+0xb1/0xea
Sep  8 10:20:25 portablebastien kernel: [177120.748114]  [<ffffffff811653e9>] ? security_file_permission+0x18/0x33
Sep  8 10:20:25 portablebastien kernel: [177120.748121]  [<ffffffff810fbe02>] ? vfs_write+0xa6/0xf9
Sep  8 10:20:25 portablebastien kernel: [177120.748128]  [<ffffffff810fbff7>] ? sys_write+0x45/0x6b
Sep  8 10:20:25 portablebastien kernel: [177120.748136]  [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b
Sep  8 10:20:25 portablebastien kernel: [177120.748161] INFO: task okular:12053 blocked for more than 120 seconds.
Sep  8 10:20:25 portablebastien kernel: [177120.750079] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep  8 10:20:25 portablebastien kernel: [177120.751982] okular          D ffff8800c9c8d060     0 12053  32057 0x00000000
Sep  8 10:20:25 portablebastien kernel: [177120.751989]  ffff8800c9c8d060 0000000000000086 ffff8800c9c8d0a8 ffff880000000000
Sep  8 10:20:25 portablebastien kernel: [177120.752022]  ffff88011af780c0 0000000000012800 ffff8800ab7dbfd8 ffff8800ab7dbfd8
Sep  8 10:20:25 portablebastien kernel: [177120.752029]  0000000000012800 ffff8800c9c8d060 0000000000012800 0000000000012800
Sep  8 10:20:25 portablebastien kernel: [177120.752039] Call Trace:
Sep  8 10:20:25 portablebastien kernel: [177120.752060]  [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs]
Sep  8 10:20:25 portablebastien kernel: [177120.752068]  [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199
Sep  8 10:20:25 portablebastien kernel: [177120.752085]  [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs]
Sep  8 10:20:25 portablebastien kernel: [177120.752103]  [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs]
Sep  8 10:20:25 portablebastien kernel: [177120.752120]  [<ffffffffa0289e1c>] ? reiserfs_truncate_file+0x16f/0x26e [reiserfs]
Sep  8 10:20:25 portablebastien kernel: [177120.752127]  [<ffffffff8110a7ba>] ? do_sys_poll+0x30d/0x37d
Sep  8 10:20:25 portablebastien kernel: [177120.752135]  [<ffffffff810383fc>] ? need_resched+0x1a/0x23
Sep  8 10:20:25 portablebastien kernel: [177120.752142]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Sep  8 10:20:25 portablebastien kernel: [177120.752158]  [<ffffffffa028cdfa>] ? reiserfs_vfs_truncate_file+0x22/0x30 [reiserfs]
Sep  8 10:20:25 portablebastien kernel: [177120.752166]  [<ffffffff810bffe8>] ? vmtruncate+0x33/0x3b
Sep  8 10:20:25 portablebastien kernel: [177120.752182]  [<ffffffffa028cd6a>] ? reiserfs_setattr+0x253/0x2c1 [reiserfs]
Sep  8 10:20:25 portablebastien kernel: [177120.752190]  [<ffffffff8110ce20>] ? __d_lookup_rcu+0xb6/0xf2
Sep  8 10:20:25 portablebastien kernel: [177120.752197]  [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24
Sep  8 10:20:25 portablebastien kernel: [177120.752203]  [<ffffffff8110f9bf>] ? notify_change+0x1a7/0x291
Sep  8 10:20:25 portablebastien kernel: [177120.752210]  [<ffffffff8103840a>] ? should_resched+0x5/0x24
Sep  8 10:20:25 portablebastien kernel: [177120.752219]  [<ffffffff810fa98d>] ? do_truncate+0x65/0x80
Sep  8 10:20:25 portablebastien kernel: [177120.752226]  [<ffffffff810fa637>] ? __dentry_open+0x1a7/0x29c
Sep  8 10:20:25 portablebastien kernel: [177120.752234]  [<ffffffff81105bb7>] ? do_last+0x4df/0x584
Sep  8 10:20:25 portablebastien kernel: [177120.752241]  [<ffffffff81106ece>] ? path_openat+0xc7/0x349
Sep  8 10:20:25 portablebastien kernel: [177120.752249]  [<ffffffff810fb8d5>] ? do_sync_read+0xb1/0xea
Sep  8 10:20:25 portablebastien kernel: [177120.752256]  [<ffffffff8110717c>] ? do_filp_open+0x2c/0x72
Sep  8 10:20:25 portablebastien kernel: [177120.752264]  [<ffffffff813358d7>] ? _cond_resched+0x9/0x20
Sep  8 10:20:25 portablebastien kernel: [177120.752272]  [<ffffffff811aca91>] ? __strncpy_from_user+0x19/0x4a
Sep  8 10:20:25 portablebastien kernel: [177120.752279]  [<ffffffff811104ec>] ? alloc_fd+0x69/0x110
Sep  8 10:20:25 portablebastien kernel: [177120.752287]  [<ffffffff810fb41c>] ? do_sys_open+0x5f/0xe6
Sep  8 10:20:25 portablebastien kernel: [177120.752295]  [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b
Comment 40 Maximilian Decker 2012-04-12 11:32:10 UTC
hi all,

I just wonder if there have been any news on this in the meanwhile... ?

As far as I'm concerned the problem did not occur anymore after upgrading to openSuSE 12.1 (running kernel 3.1.x series) about half a year ago. I am still using the same reiserfs (3.6) partitions for crypted /home (no acl) as well as for a non-crypted /data (with acl). 
(in my case it was the non-acl mounted /home that happened to crash sporadically)


- Maximilian
Comment 41 Stephan Diestelhorst 2012-06-06 08:32:59 UTC
I do experience the same issue every now and then, with Ubuntu 3.0.0-20 kernel.  Will try to upgrade and see how it behaves.
Comment 42 c880562 2013-02-11 22:17:06 UTC
Hello,

I have the same problem with my linux BackTrack/Ubuntu Full encrypted (/, /home and swap), with kernel 2.6.39.4, 3.2.6 and 3.0.0-23-pae:

I have tried to disable swap, but same problem.
I have tried to make swap not encrypted, but same problem.
I have tried to disable my nvidia card module, but same problem.
I have done fsck & badblock & memtest but no problem on disk & ram.
I have tried to play with dirty_pages and other sysctl variables but same
problem...


Please, some news about???


thanks

[ 6600.396116] gnome-power-man D 00000000     0 14398  14366 0x00000000
[ 6600.396128]  f6c03cac 00200086 f6c03f98 00000000 09895418 00000008 c1148bb0 ffffffff
[ 6600.396145]  c18acd00 c18acd00 c18acd00 c18acd00 06fdfdab 000005d8 c18acd00 f7be4d00
[ 6600.396162]  eed00cc0 f04af2c0 0000032a 00000000 000003fe 00000195 00000000 00000000
[ 6600.396178] Call Trace:
[ 6600.396197]  [<c1148bb0>] ? poll_freewait+0x80/0x80
[ 6600.396210]  [<c100f928>] ? sched_clock+0x8/0x10
[ 6600.396222]  [<c102eec8>] ? default_spin_lock_flags+0x8/0x10
[ 6600.396233]  [<c155742f>] ? _raw_spin_lock_irqsave+0x2f/0x50
[ 6600.396271]  [<c1555855>] schedule+0x35/0x50
[ 6600.396300]  [<f86725ef>] queue_log_writer+0x6f/0xa0 [reiserfs]
[ 6600.396314]  [<c104a110>] ? try_to_wake_up+0x220/0x220
[ 6600.396343]  [<f86774d8>] do_journal_begin_r+0x1d8/0x310 [reiserfs]
[ 6600.396361]  [<c104a0ae>] ? try_to_wake_up+0x1be/0x220
[ 6600.396387]  [<f867768f>] journal_begin+0x7f/0x160 [reiserfs]
[ 6600.396395]  [<c1556249>] ? mutex_lock+0x19/0x40
[ 6600.396420]  [<f8665868>] reiserfs_dirty_inode+0x38/0xc0 [reiserfs]
[ 6600.396431]  [<c103eb2c>] ? __wake_up_sync_key+0x4c/0x60
[ 6600.396442]  [<c115a94f>] __mark_inode_dirty+0x2f/0x220
[ 6600.396451]  [<c14f375b>] ? unix_stream_sendmsg+0x37b/0x390
[ 6600.396461]  [<c114e9e1>] file_update_time+0xc1/0x140
[ 6600.396472]  [<c10ec8e9>] __generic_file_aio_write+0x1b9/0x540
[ 6600.396481]  [<c103f206>] ? update_cfs_load+0x136/0x300
[ 6600.396490]  [<c10442d5>] ? update_curr+0x195/0x2c0
[ 6600.396500]  [<c10eccda>] generic_file_aio_write+0x6a/0xd0
[ 6600.396514]  [<c11381e4>] do_sync_write+0xa4/0xe0
[ 6600.396527]  [<c12658b6>] ? apparmor_file_permission+0x16/0x20
[ 6600.396538]  [<c123785e>] ? security_file_permission+0x1e/0xa0
[ 6600.396562]  [<f86602f8>] reiserfs_file_write+0x88/0xa0 [reiserfs]
[ 6600.396571]  [<c1138792>] vfs_write+0xa2/0x170
[ 6600.396594]  [<f8660270>] ? reiserfs_file_open+0x90/0x90 [reiserfs]
[ 6600.396603]  [<c1138932>] sys_write+0x42/0x70
[ 6600.396613]  [<c155e49f>] sysenter_do_call+0x12/0x28
[ 6600.396630] INFO: task firefox-bin:16522 blocked for more than 120 seconds.
[ 6600.396636] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 6600.396642] firefox-bin     D e1b49c44     0 16522      1 0x00000000
[ 6600.396653]  e1b49c54 00000086 00000002 e1b49c44 ffffffff 00000002 f7be5824 00000000
[ 6600.396670]  c18acd00 c18acd00 c18acd00 c18acd00 00000000 00000000 c18acd00 f7be4d00
[ 6600.396686]  ef8072c0 f74c0000 00000000 e1b49d18 f6940600 00000005 00000001 00000001
[ 6600.396702] Call Trace:
[ 6600.396715]  [<c102eec8>] ? default_spin_lock_flags+0x8/0x10
[ 6600.396724]  [<c155742f>] ? _raw_spin_lock_irqsave+0x2f/0x50
[ 6600.396736]  [<c1555855>] schedule+0x35/0x50
[ 6600.396761]  [<f86725ef>] queue_log_writer+0x6f/0xa0 [reiserfs]
[ 6600.396773]  [<c104a110>] ? try_to_wake_up+0x220/0x220
[ 6600.396804]  [<f86774d8>] do_journal_begin_r+0x1d8/0x310 [reiserfs]
[ 6600.396837]  [<f865c302>] ? reiserfs_read_locked_inode+0xc2/0x130 [reiserfs]
[ 6600.396849]  [<c10730ab>] ? hrtimer_forward+0x16b/0x1b0
[ 6600.396874]  [<f867768f>] journal_begin+0x7f/0x160 [reiserfs]
[ 6600.396883]  [<c1556249>] ? mutex_lock+0x19/0x40
[ 6600.396906]  [<f865b64d>] reiserfs_truncate_file+0x6d/0x230 [reiserfs]
[ 6600.396916]  [<c15573fd>] ? _raw_spin_lock+0xd/0x10
[ 6600.396924]  [<c114a595>] ? __d_instantiate+0x95/0xd0
[ 6600.396960]  [<f865fd4a>] reiserfs_vfs_truncate_file+0x2a/0x40 [reiserfs]
[ 6600.396971]  [<c10f5c71>] vmtruncate+0x51/0x60
[ 6600.396993]  [<f865b007>] reiserfs_setattr+0x317/0x3a0 [reiserfs]
[ 6600.397005]  [<c117f18f>] ? __dquot_initialize+0x1f/0x140
[ 6600.397014]  [<c1150320>] notify_change+0x180/0x2f0
[ 6600.397023]  [<c1556249>] ? mutex_lock+0x19/0x40
[ 6600.397032]  [<c1136f32>] do_truncate+0x62/0x90
[ 6600.397041]  [<c113747a>] ? __dentry_open+0x22a/0x2c0
[ 6600.397067]  [<f8679df0>] ? reiserfs_permission+0x50/0x50 [reiserfs]
[ 6600.397077]  [<c1144387>] do_last+0x557/0x730
[ 6600.397086]  [<c1144e48>] path_openat+0x98/0x330
[ 6600.397095]  [<c11451c5>] do_filp_open+0x35/0x80
[ 6600.397105]  [<c115120d>] ? alloc_fd+0xbd/0xf0
[ 6600.397114]  [<c11421ed>] ? getname_flags+0xcd/0x140
[ 6600.397123]  [<c1137ace>] do_sys_open+0xee/0x1f0
[ 6600.397132]  [<c1110532>] ? do_munmap+0x212/0x2a0
[ 6600.397141]  [<c1137c3e>] sys_open+0x2e/0x40
[ 6600.397150]  [<c155e49f>] sysenter_do_call+0x12/0x28
[ 6600.397161]  [<c1550000>] ? wakeup_secondary_cpu_via_init+0xc3/0x1d9
[ 6720.396220] INFO: task gnome-power-man:14398 blocked for more than 120 seconds.
[ 6720.396229] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 6720.396236] gnome-power-man D 00000000     0 14398  14366 0x00000000
[ 6720.396248]  f6c03cac 00200086 f6c03f98 00000000 09895418 00000008 c1148bb0 ffffffff
[ 6720.396266]  c18acd00 c18acd00 c18acd00 c18acd00 06fdfdab 000005d8 c18acd00 f7be4d00
[ 6720.396283]  eed00cc0 f04af2c0 0000032a 00000000 000003fe 00000195 00000000 00000000
[ 6720.396298] Call Trace:
[ 6720.396317]  [<c1148bb0>] ? poll_freewait+0x80/0x80
[ 6720.396330]  [<c100f928>] ? sched_clock+0x8/0x10
[ 6720.396342]  [<c102eec8>] ? default_spin_lock_flags+0x8/0x10
[ 6720.396353]  [<c155742f>] ? _raw_spin_lock_irqsave+0x2f/0x50
[ 6720.396390]  [<c1555855>] schedule+0x35/0x50
[ 6720.396418]  [<f86725ef>] queue_log_writer+0x6f/0xa0 [reiserfs]
[ 6720.396431]  [<c104a110>] ? try_to_wake_up+0x220/0x220
[ 6720.396460]  [<f86774d8>] do_journal_begin_r+0x1d8/0x310 [reiserfs]
[ 6720.396478]  [<c104a0ae>] ? try_to_wake_up+0x1be/0x220
[ 6720.396503]  [<f867768f>] journal_begin+0x7f/0x160 [reiserfs]
[ 6720.396512]  [<c1556249>] ? mutex_lock+0x19/0x40
[ 6720.396536]  [<f8665868>] reiserfs_dirty_inode+0x38/0xc0 [reiserfs]
[ 6720.396546]  [<c103eb2c>] ? __wake_up_sync_key+0x4c/0x60
[ 6720.396557]  [<c115a94f>] __mark_inode_dirty+0x2f/0x220
[ 6720.396566]  [<c14f375b>] ? unix_stream_sendmsg+0x37b/0x390
[ 6720.396576]  [<c114e9e1>] file_update_time+0xc1/0x140
[ 6720.396586]  [<c10ec8e9>] __generic_file_aio_write+0x1b9/0x540
[ 6720.396595]  [<c103f206>] ? update_cfs_load+0x136/0x300
[ 6720.396604]  [<c10442d5>] ? update_curr+0x195/0x2c0
[ 6720.396613]  [<c10eccda>] generic_file_aio_write+0x6a/0xd0
[ 6720.396627]  [<c11381e4>] do_sync_write+0xa4/0xe0
[ 6720.396640]  [<c12658b6>] ? apparmor_file_permission+0x16/0x20
[ 6720.396651]  [<c123785e>] ? security_file_permission+0x1e/0xa0
[ 6720.396675]  [<f86602f8>] reiserfs_file_write+0x88/0xa0 [reiserfs]
[ 6720.396685]  [<c1138792>] vfs_write+0xa2/0x170
[ 6720.396707]  [<f8660270>] ? reiserfs_file_open+0x90/0x90 [reiserfs]
[ 6720.396716]  [<c1138932>] sys_write+0x42/0x70
[ 6720.396727]  [<c155e49f>] sysenter_do_call+0x12/0x28
Comment 43 Maximilian Decker 2013-02-27 09:27:03 UTC
hi,

could you provide some step-by-step instruction on how to reliably reproduce the issue with current kernels ?
I guess the main point of this bug being kind of stale is its hard-to-trigger nature.
Well, and of course, decreasing developer interest as reiserfs3 is less often used in new installations.
But IMHO still a good fs with nice feature set, would love to see it around in a working state again... 


- Maximilian
Comment 44 Raúl 2013-03-02 10:36:30 UTC
Created attachment 94271 [details]
dmesg for the oops

Hi:

 Unfortunately, I can't explain how to reliably reproduce this problem but this time it happenned quite soon as I upgraded to 3.8.0, exactly debian package linux-image-3.8-trunk-amd64 (3.8-1~experimental.1) The only thing I had to do was hibernate and after I resume the problem was already there.

  All partitions, but /boot are crypted. My disk and partition layout is this:
# pvs
  PV                     VG      Fmt  Attr PSize   PFree
  /dev/mapper/sda5_crypt portaka lvm2 a--  186,07g    0 

# vgs
  VG      #PV #LV #SN Attr   VSize   VFree
  portaka   1   5   0 wz--n- 186,07g    0 

# lvs
  LV   VG      Attr     LSize   Pool Origin Data%  Move Log Copy%  Convert
  home portaka -wi-ao-- 170,45g                                           
  root portaka -wi-ao--   1,73g                                           
  swap portaka -wc-ao--   2,00g                                           
  usr  portaka -wi-ao--   6,89g                                           
  var  portaka -wi-ao--   5,00g 

# cat /proc/mounts 
rootfs / rootfs rw 0 0
sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
udev /dev devtmpfs rw,relatime,size=10240k,nr_inodes=504930,mode=755 0 0
devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=405388k,mode=755 0 0
/dev/mapper/portaka-root / reiserfs rw,noatime 0 0
tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0
tmpfs /run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=810760k 0 0
fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0
tmpfs /tmp tmpfs rw,nosuid,nodev,noatime,size=2026936k 0 0
/dev/sda1 /boot ext3 rw,noatime,errors=continue,barrier=1,data=ordered 0 0
/dev/mapper/portaka-home /home reiserfs rw,noatime 0 0
/dev/mapper/portaka-usr /usr reiserfs rw,noatime 0 0
/dev/mapper/portaka-var /var reiserfs rw,noatime 0 0
rpc_pipefs /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0
binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0

  I knew I triggered the problem when I tried to issue a "sync" command. But other options may be touching a file in a directory which is in the affected filesystem. I could recover from this situation doing a sysrq-E, which terminates all processes.

  I assume the best way to help is giving exact instructions to reproduce the crash but till I could get that information let me know if I can be of help some other way.

  This is an excerpt of the dmesg which I'm attaching:
[ 8400.524149] INFO: task flush-254:2:2147 blocked for more than 120 seconds.
[ 8400.524156] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524160] flush-254:2     D ffff88013fd13bc0     0  2147      2 0x00000000
[ 8400.524172]  ffff880137dcc760 0000000000000046 ffff880035bb4910 ffff88009c0738a0
[ 8400.524178]  0000000000013bc0 ffff8801384a3fd8 ffff8801384a3fd8 ffff880137dcc760
[ 8400.524183]  0000000000000000 ffff88013fd13bc0 ffff880137dcc760 ffff8801384a3aa0
[ 8400.524188] Call Trace:
[ 8400.524200]  [<ffffffff810c21e9>] ? __lock_page+0x66/0x66
[ 8400.524206]  [<ffffffff813811d0>] ? io_schedule+0x56/0x6d
[ 8400.524210]  [<ffffffff810c21f0>] ? sleep_on_page+0x7/0xc
[ 8400.524215]  [<ffffffff81380232>] ? __wait_on_bit_lock+0x3c/0x85
[ 8400.524219]  [<ffffffff810c279a>] ? find_get_pages_tag+0xe7/0x121
[ 8400.524223]  [<ffffffff810c21e4>] ? __lock_page+0x61/0x66
[ 8400.524229]  [<ffffffff81057b85>] ? autoremove_wake_function+0x2a/0x2a
[ 8400.524234]  [<ffffffff810ca2be>] ? write_cache_pages+0x166/0x2e2
[ 8400.524239]  [<ffffffff810c991b>] ? page_index+0x14/0x14
[ 8400.524244]  [<ffffffff810ca472>] ? generic_writepages+0x38/0x54
[ 8400.524250]  [<ffffffff81129c55>] ? __writeback_single_inode+0x3e/0x115
[ 8400.524255]  [<ffffffff8112a9ac>] ? writeback_sb_inodes+0x1dd/0x30c
[ 8400.524260]  [<ffffffff8112ab44>] ? __writeback_inodes_wb+0x69/0xab
[ 8400.524265]  [<ffffffff8112acbd>] ? wb_writeback+0x137/0x28c
[ 8400.524269]  [<ffffffff810ca71e>] ? bdi_dirty_limit+0x27/0x84
[ 8400.524273]  [<ffffffff8112b0f4>] ? wb_do_writeback+0x186/0x1bb
[ 8400.524279]  [<ffffffff81049538>] ? del_timer_sync+0x27/0x44
[ 8400.524283]  [<ffffffff8112b129>] ? wb_do_writeback+0x1bb/0x1bb
[ 8400.524288]  [<ffffffff8112b1d1>] ? bdi_writeback_thread+0xa8/0x1db
[ 8400.524293]  [<ffffffff8112b129>] ? wb_do_writeback+0x1bb/0x1bb
[ 8400.524297]  [<ffffffff8112b129>] ? wb_do_writeback+0x1bb/0x1bb
[ 8400.524301]  [<ffffffff81057280>] ? kthread+0x81/0x89
[ 8400.524306]  [<ffffffff8105fbd0>] ? mmdrop+0xd/0x1c
[ 8400.524310]  [<ffffffff81061447>] ? finish_task_switch+0x83/0xb3
[ 8400.524315]  [<ffffffff810571ff>] ? __kthread_parkme+0x5c/0x5c
[ 8400.524320]  [<ffffffff81386cbc>] ? ret_from_fork+0x7c/0xb0
[ 8400.524324]  [<ffffffff810571ff>] ? __kthread_parkme+0x5c/0x5c
[ 8400.524354] INFO: task klauncher:3794 blocked for more than 120 seconds.
[ 8400.524357] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524359] klauncher       D ffff880139fce7e0     0  3794   3791 0x00000000
[ 8400.524364]  ffff880139fce7e0 0000000000000082 0000000000000282 ffff880124ff4080
[ 8400.524369]  0000000000013bc0 ffff880139777fd8 ffff880139777fd8 ffff880139fce7e0
[ 8400.524373]  ffffffff81381a6d ffffc900108ae000 ffff880139fce7e0 ffff880138793c00
[ 8400.524378] Call Trace:
[ 8400.524383]  [<ffffffff81381a6d>] ? _raw_spin_lock_irqsave+0x14/0x35
[ 8400.524416]  [<ffffffffa0242d48>] ? queue_log_writer+0x7d/0xad [reiserfs]
[ 8400.524421]  [<ffffffff81064071>] ? try_to_wake_up+0x199/0x199
[ 8400.524433]  [<ffffffffa02475e1>] ? do_journal_begin_r+0x177/0x23e [reiserfs]
[ 8400.524438]  [<ffffffff81381a6d>] ? _raw_spin_lock_irqsave+0x14/0x35
[ 8400.524443]  [<ffffffff811300b2>] ? create_page_buffers+0x42/0x51
[ 8400.524455]  [<ffffffffa024775d>] ? journal_begin+0xb5/0xec [reiserfs]
[ 8400.524466]  [<ffffffffa0232883>] ? reiserfs_write_end+0x10a/0x22b [reiserfs]
[ 8400.524477]  [<ffffffffa0231c5c>] ? reiserfs_write_begin+0xcf/0x176 [reiserfs]
[ 8400.524481]  [<ffffffff810c2dbf>] ? generic_file_buffered_write+0x17e/0x235
[ 8400.524488]  [<ffffffff810c38c2>] ? __generic_file_aio_write+0x1cc/0x1fc
[ 8400.524493]  [<ffffffff8110cc0c>] ? __sb_start_write+0xb6/0xe8
[ 8400.524498]  [<ffffffff810613a6>] ? should_resched+0x5/0x23
[ 8400.524502]  [<ffffffff810c395b>] ? generic_file_aio_write+0x69/0xc9
[ 8400.524507]  [<ffffffff8110adcf>] ? do_sync_write+0x62/0x9b
[ 8400.524512]  [<ffffffff8110b376>] ? vfs_write+0x96/0xf8
[ 8400.524517]  [<ffffffff8110b59e>] ? sys_write+0x51/0x80
[ 8400.524522]  [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.524525] INFO: task kded4:3796 blocked for more than 120 seconds.
[ 8400.524528] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524530] kded4           D ffff88013fd13bc0     0  3796      1 0x00000000
[ 8400.524534]  ffff880137aea820 0000000000000082 0200000000020028 ffff88013aeb4180
[ 8400.524539]  0000000000013bc0 ffff880139c8bfd8 ffff880139c8bfd8 ffff880137aea820
[ 8400.524544]  00007fffcfc48d90 ffff8801392d4c60 ffff880137aea820 ffff8801392d4c64
[ 8400.524549] Call Trace:
[ 8400.524554]  [<ffffffff813804f5>] ? __mutex_lock_common.isra.6+0x149/0x165
[ 8400.524559]  [<ffffffff81380320>] ? mutex_lock+0x1a/0x2d
[ 8400.524563]  [<ffffffff810c3947>] ? generic_file_aio_write+0x55/0xc9
[ 8400.524567]  [<ffffffff8110adcf>] ? do_sync_write+0x62/0x9b
[ 8400.524572]  [<ffffffff8110b376>] ? vfs_write+0x96/0xf8
[ 8400.524577]  [<ffffffff8110b59e>] ? sys_write+0x51/0x80
[ 8400.524581]  [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.524591] INFO: task plasma-desktop:4165 blocked for more than 120 seconds.
[ 8400.524594] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524596] plasma-desktop  D ffff88013fc13bc0     0  4165      1 0x00000000
[ 8400.524600]  ffff880138782100 0000000000000086 0200000000020028 ffffffff81614400
[ 8400.524605]  0000000000013bc0 ffff880139d4dfd8 ffff880139d4dfd8 ffff880138782100
[ 8400.524610]  00000000fffffffd ffff8801392d4c60 ffff880138782100 ffff8801392d4c64
[ 8400.524615] Call Trace:
[ 8400.524620]  [<ffffffff813804f5>] ? __mutex_lock_common.isra.6+0x149/0x165
[ 8400.524625]  [<ffffffff81380320>] ? mutex_lock+0x1a/0x2d
[ 8400.524629]  [<ffffffff810c3947>] ? generic_file_aio_write+0x55/0xc9
[ 8400.524633]  [<ffffffff8110adcf>] ? do_sync_write+0x62/0x9b
[ 8400.524638]  [<ffffffff8110b376>] ? vfs_write+0x96/0xf8
[ 8400.524642]  [<ffffffff8110b59e>] ? sys_write+0x51/0x80
[ 8400.524647]  [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.524659] INFO: task nepomukservices:4232 blocked for more than 120 seconds.
[ 8400.524661] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524664] nepomukservices D ffff88013fd13bc0     0  4232   4227 0x00000000
[ 8400.524668]  ffff880108a92140 0000000000000082 ffff88013abcea00 ffff88013aeb4180
[ 8400.524673]  0000000000013bc0 ffff880104c37fd8 ffff880104c37fd8 ffff880108a92140
[ 8400.524677]  ffffffff81381a6d ffffc900108ae000 ffff880108a92140 ffff880138793c00
[ 8400.524682] Call Trace:
[ 8400.524687]  [<ffffffff81381a6d>] ? _raw_spin_lock_irqsave+0x14/0x35
[ 8400.524699]  [<ffffffffa0242d48>] ? queue_log_writer+0x7d/0xad [reiserfs]
[ 8400.524704]  [<ffffffff81064071>] ? try_to_wake_up+0x199/0x199
[ 8400.524716]  [<ffffffffa02475e1>] ? do_journal_begin_r+0x177/0x23e [reiserfs]
[ 8400.524728]  [<ffffffffa024775d>] ? journal_begin+0xb5/0xec [reiserfs]
[ 8400.524740]  [<ffffffffa02313a3>] ? reiserfs_evict_inode+0x9a/0x137 [reiserfs]
[ 8400.524747]  [<ffffffff8111d937>] ? evict+0xa3/0x153
[ 8400.524752]  [<ffffffff8111aed7>] ? dentry_kill+0x10a/0x12b
[ 8400.524756]  [<ffffffff8111b349>] ? dput+0xe6/0xf3
[ 8400.524760]  [<ffffffff81112778>] ? path_put+0xd/0x16
[ 8400.524765]  [<ffffffff811392e3>] ? fsnotify_put_event+0x23/0x53
[ 8400.524770]  [<ffffffff8113b5fd>] ? inotify_read+0x209/0x290
[ 8400.524775]  [<ffffffff81057b5b>] ? abort_exclusive_wait+0x79/0x79
[ 8400.524779]  [<ffffffff8110b46b>] ? vfs_read+0x93/0xf5
[ 8400.524784]  [<ffffffff81118a73>] ? set_restore_sigmask+0x2d/0x2d
[ 8400.524788]  [<ffffffff8110b51e>] ? sys_read+0x51/0x80
[ 8400.524793]  [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.524800] INFO: task dolphin:4256 blocked for more than 120 seconds.
[ 8400.524803] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524805] dolphin         D ffff88013fd13bc0     0  4256   3791 0x00000000
[ 8400.524809]  ffff880124ff4080 0000000000000082 020000000002006c ffff88013aeb4180
[ 8400.524814]  0000000000013bc0 ffff880104cddfd8 ffff880104cddfd8 ffff880124ff4080
[ 8400.524819]  0000000000000023 ffff8801392d4c60 ffff880124ff4080 ffff8801392d4c64
[ 8400.524823] Call Trace:
[ 8400.524829]  [<ffffffff813804f5>] ? __mutex_lock_common.isra.6+0x149/0x165
[ 8400.524834]  [<ffffffff81380320>] ? mutex_lock+0x1a/0x2d
[ 8400.524838]  [<ffffffff810c3947>] ? generic_file_aio_write+0x55/0xc9
[ 8400.524842]  [<ffffffff8110adcf>] ? do_sync_write+0x62/0x9b
[ 8400.524847]  [<ffffffff8110b376>] ? vfs_write+0x96/0xf8
[ 8400.524851]  [<ffffffff8110b59e>] ? sys_write+0x51/0x80
[ 8400.524856]  [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.524870] INFO: task virtuoso-t:4572 blocked for more than 120 seconds.
[ 8400.524873] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524875] virtuoso-t      D ffff88013fd13bc0     0  4572   4232 0x00000000
[ 8400.524879]  ffff8800ae54d0c0 0000000000000086 0000000000000000 ffff88013aeb4180
[ 8400.524884]  0000000000013bc0 ffff8800ae6c5fd8 ffff8800ae6c5fd8 ffff8800ae54d0c0
[ 8400.524889]  ffffffff81381a6d ffffc900108ae000 ffff8800ae54d0c0 ffff880138793c00
[ 8400.524893] Call Trace:
[ 8400.524898]  [<ffffffff81381a6d>] ? _raw_spin_lock_irqsave+0x14/0x35
[ 8400.524910]  [<ffffffffa0242d48>] ? queue_log_writer+0x7d/0xad [reiserfs]
[ 8400.524915]  [<ffffffff81064071>] ? try_to_wake_up+0x199/0x199
[ 8400.524927]  [<ffffffffa02475e1>] ? do_journal_begin_r+0x177/0x23e [reiserfs]
[ 8400.524939]  [<ffffffffa024775d>] ? journal_begin+0xb5/0xec [reiserfs]
[ 8400.524949]  [<ffffffffa0230120>] ? reiserfs_create+0xcf/0x1eb [reiserfs]
[ 8400.524954]  [<ffffffff81114cf7>] ? vfs_create+0x62/0x8b
[ 8400.524958]  [<ffffffff811129f3>] ? lookup_dcache+0x22/0x95
[ 8400.524963]  [<ffffffff81115c39>] ? do_last+0x591/0xa0f
[ 8400.524968]  [<ffffffff81116178>] ? path_openat+0xc1/0x33b
[ 8400.524972]  [<ffffffff811166a9>] ? do_filp_open+0x2a/0x6e
[ 8400.524977]  [<ffffffff8111fc35>] ? __alloc_fd+0xdc/0xed
[ 8400.524981]  [<ffffffff8110aba4>] ? do_sys_open+0x5c/0xe0
[ 8400.524986]  [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.524994] INFO: task konqueror:14018 blocked for more than 120 seconds.
[ 8400.524996] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524999] konqueror       D ffff88013fd13bc0     0 14018   3791 0x00000000
[ 8400.525003]  ffff8801378aa180 0000000000000086 ffff8800aef4bc58 ffff88013aeb4180
[ 8400.525008]  0000000000013bc0 ffff8800aef4bfd8 ffff8800aef4bfd8 ffff8801378aa180
[ 8400.525012]  ffffffff81381a6d ffffc900108ae000 ffff8801378aa180 ffff880138793c00
[ 8400.525017] Call Trace:
[ 8400.525022]  [<ffffffff81381a6d>] ? _raw_spin_lock_irqsave+0x14/0x35
[ 8400.525034]  [<ffffffffa0242d48>] ? queue_log_writer+0x7d/0xad [reiserfs]
[ 8400.525039]  [<ffffffff81064071>] ? try_to_wake_up+0x199/0x199
[ 8400.525051]  [<ffffffffa02475e1>] ? do_journal_begin_r+0x177/0x23e [reiserfs]
[ 8400.525055]  [<ffffffff81113447>] ? lookup_fast+0x39/0x211
[ 8400.525060]  [<ffffffff8114ed87>] ? dquot_active+0x28/0x50
[ 8400.525072]  [<ffffffffa024775d>] ? journal_begin+0xb5/0xec [reiserfs]
[ 8400.525082]  [<ffffffffa022f26a>] ? reiserfs_unlink+0x7c/0x24c [reiserfs]
[ 8400.525087]  [<ffffffff811208b0>] ? mntget+0x17/0x1c
[ 8400.525091]  [<ffffffff8111324e>] ? complete_walk+0x89/0xda
[ 8400.525096]  [<ffffffff81114424>] ? path_lookupat+0x6a/0x2b1
[ 8400.525100]  [<ffffffff810613a6>] ? should_resched+0x5/0x23
[ 8400.525104]  [<ffffffff81114e81>] ? vfs_unlink+0x63/0xbc
[ 8400.525109]  [<ffffffff81114fbc>] ? do_unlinkat+0xe2/0x18c
[ 8400.525113]  [<ffffffff8110edd9>] ? sys_newstat+0x25/0x2d
[ 8400.525118]  [<ffffffff81380ef1>] ? __schedule+0x4b2/0x4e0
[ 8400.525123]  [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.525131] INFO: task kworker/0:4:17879 blocked for more than 120 seconds.
[ 8400.525133] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.525135] kworker/0:4     D ffff88013fc13bc0     0 17879      2 0x00000000
[ 8400.525140]  ffff8800af5fb040 0000000000000046 ffff880139434584 ffff88013692f0c0
[ 8400.525145]  0000000000013bc0 ffff88009c389fd8 ffff88009c389fd8 ffff8800af5fb040
[ 8400.525149]  ffffffff81381a6d ffffc900108ae000 ffff8800af5fb040 ffff880138793c00
[ 8400.525154] Call Trace:
[ 8400.525158]  [<ffffffff81381a6d>] ? _raw_spin_lock_irqsave+0x14/0x35
[ 8400.525171]  [<ffffffffa0242d48>] ? queue_log_writer+0x7d/0xad [reiserfs]
[ 8400.525175]  [<ffffffff81064071>] ? try_to_wake_up+0x199/0x199
[ 8400.525187]  [<ffffffffa0246a55>] ? do_journal_end.isra.23+0x1ba/0xbcf [reiserfs]
[ 8400.525199]  [<ffffffffa0238cd3>] ? reiserfs_sync_fs+0x40/0x5c [reiserfs]
[ 8400.525210]  [<ffffffffa0239de0>] ? flush_old_commits+0x1d/0x39 [reiserfs]
[ 8400.525216]  [<ffffffff810536ad>] ? process_one_work+0x16d/0x2c5
[ 8400.525220]  [<ffffffff813819f8>] ? _raw_spin_lock_irq+0xb/0x15
[ 8400.525232]  [<ffffffffa0239dc3>] ? reiserfs_freeze+0xc5/0xc5 [reiserfs]
[ 8400.525237]  [<ffffffff8105381d>] ? process_scheduled_works+0x18/0x25
[ 8400.525241]  [<ffffffff81053ae2>] ? worker_thread+0x131/0x1b1
[ 8400.525246]  [<ffffffff810539b1>] ? rescuer_thread+0x187/0x187
[ 8400.525250]  [<ffffffff81057280>] ? kthread+0x81/0x89
[ 8400.525255]  [<ffffffff810571ff>] ? __kthread_parkme+0x5c/0x5c
[ 8400.525259]  [<ffffffff81386cbc>] ? ret_from_fork+0x7c/0xb0
[ 8400.525264]  [<ffffffff810571ff>] ? __kthread_parkme+0x5c/0x5c
[ 8400.525272] INFO: task kscreenlocker:19028 blocked for more than 120 seconds.
[ 8400.525274] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.525277] kscreenlocker   D ffff88013fd13bc0     0 19028   4230 0x00000000
[ 8400.525281]  ffff88013a3df8a0 0000000000000086 0200000000020028 ffff88013aeb4180
[ 8400.525286]  0000000000013bc0 ffff88012fc8dfd8 ffff88012fc8dfd8 ffff88013a3df8a0
[ 8400.525291]  0000000000000117 ffff8801392d4c60 ffff88013a3df8a0 ffff8801392d4c64
[ 8400.525295] Call Trace:
[ 8400.525301]  [<ffffffff813804f5>] ? __mutex_lock_common.isra.6+0x149/0x165
[ 8400.525306]  [<ffffffff81380320>] ? mutex_lock+0x1a/0x2d
[ 8400.525310]  [<ffffffff810c3947>] ? generic_file_aio_write+0x55/0xc9
[ 8400.525315]  [<ffffffff8110adcf>] ? do_sync_write+0x62/0x9b
[ 8400.525320]  [<ffffffff8110b376>] ? vfs_write+0x96/0xf8
[ 8400.525324]  [<ffffffff810613a6>] ? should_resched+0x5/0x23
[ 8400.525328]  [<ffffffff8110b59e>] ? sys_write+0x51/0x80
[ 8400.525332]  [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
Comment 45 Raúl 2013-05-11 15:03:36 UTC
Hi:

I've run into a series of locks of this kind. I can't add much more to what I've already reported. I haven't found a method of reliably reproduce this lock, my impression so far is that this one is related to:
a) wake up from suspend to ram (maybe also to disk) and 
b) certain /corruption/ layout in disk

Latest locks happened after I resume from ram. Disk was not much loaded at the lock moment, there was a high user activity though: like running and closing apps, email and an important amount of download threads in the background. I had the lock there.

As usual, the cleanest way to get out of this was alt-sysrq-E that terms all processes. Then three finger salute.

On a fresh boot, I tried the same usage pattern, soon after I had the lock again. In this case STR or STD (Suspend to Disk) weren't involved.

I decided to go into a reiserfsck --rebuild-tree in my home partition. This is a log excerpt:
"""
Replaying journal: Done.
Reiserfs journal '/dev/mapper/portaka-home' in blocks [18..8211]: 0 transactions replayed
###########
reiserfsck --rebuild-tree started at Fri May 10 11:04:30 2013
###########

Pass 0:
####### Pass 0 #######
Loading on-disk bitmap .. ok, 43532529 blocks marked used
Skipping 9574 blocks (super block, journal, bitmaps) 43522955 blocks will be read
0%...block 6328224: The number of items (34381) is incorrect, should be (1) - corrected
block 6328224: The free space (15751) is incorrect, should be (2256) - corrected
pass0: vpf-10110: block 6328224, item (0): Unknown item type found [2130706432 1023807744 0x3d970000 ??? (13)] - deleted
block 6343857: The number of items (34381) is incorrect, should be (1) - corrected
block 6343857: The free space (15751) is incorrect, should be (2256) - corrected
pass0: vpf-10110: block 6343857, item (0): Unknown item type found [2130706432 1023807744 0x3d970000 ??? (13)] - deleted
.20%...block 15040910: The number of items (34826) is incorrect, should be (1) - corrected
block 15040910: The free space (2) is incorrect, should be (4048) - corrected
pass0: vpf-10110: block 15040910, item (0): Unknown item type found [3506543104 3523215796 0xa3000784 ??? (15)] - deleted
.block 16215906: The number of items (287) is incorrect, should be (1) - corrected
block 16215906: The free space (0) is incorrect, should be (4048) - corrected
pass0: vpf-10200: block 16215906, item 0: The item [218104576 203714 0x790e01 IND (1)] with wrong offset is deleted
block 17156098: The number of items (12648) is incorrect, should be (1) - corrected
block 17156098: The free space (0) is incorrect, should be (4048) - corrected
40%block 18917377: The number of items (6) is incorrect, should be (0) - corrected
block 18917377: The free space (15481) is incorrect, should be (4072) - corrected
block 19611181: The number of items (6) is incorrect, should be (0) - corrected
block 19611181: The free space (15481) is incorrect, should be (4072) - corrected
.block 20333852: The number of items (15) is incorrect, should be (1) - corrected
block 20333852: The free space (0) is incorrect, should be (3792) - corrected
pass0: vpf-10210: block 20333852, item 0: The item with wrong offset or length found [4608 16778752 0x63030000 DRCT (2)], len 256 - deleted
..block 25257511: The number of items (287) is incorrect, should be (1) - corrected
block 25257511: The free space (29793) is incorrect, should be (4048) - corrected
pass0: vpf-10200: block 25257511, item 0: The item [218103998 65810 0x6e0e01 IND (1)] with wrong offset is deleted
.60%block 28012850: The number of items (41488) is incorrect, should be (1) - corrected
block 28012850: The free space (24) is incorrect, should be (4048) - corrected
pass0: vpf-10110: block 28012850, item (0): Unknown item type found [38049792 1032720128 0x10010002 ??? (15)] - deleted
.block 30356195: The number of items (282) is incorrect, should be (1) - corrected
block 30356195: The free space (0) is incorrect, should be (2256) - corrected
pass0: vpf-10110: block 30356195, item (0): Unknown item type found [205917185 285212679 0x1 ??? (15)] - deleted
.block 30911284: The number of items (12648) is incorrect, should be (1) - corrected
block 30911284: The free space (0) is incorrect, should be (4048) - corrected
block 31013511: The number of items (6) is incorrect, should be (0) - corrected
block 31013511: The free space (1472) is incorrect, should be (4072) - corrected
block 31038991: The number of items (6) is incorrect, should be (0) - corrected
block 31038991: The free space (1472) is incorrect, should be (4072) - corrected
.block 33620308: The number of items (15) is incorrect, should be (1) - corrected
block 33620308: The free space (0) is incorrect, should be (3792) - corrected
pass0: vpf-10210: block 33620308, item 0: The item with wrong offset or length found [4608 16778752 0x63030000 DRCT (2)], len 256 - deleted
.block 34356027: The number of items (282) is incorrect, should be (1) - corrected
block 34356027: The free space (0) is incorrect, should be (2256) - corrected
pass0: vpf-10110: block 34356027, item (0): Unknown item type found [205917185 285212679 0x1 ??? (15)] - deleted
block 34621658: The number of items (4352) is incorrect, should be (1) - corrected
block 34621658: The free space (39937) is incorrect, should be (207) - corrected
pass0: vpf-10110: block 34621658, item (0): Unknown item type found [218169345 114 0x1180001 ??? (15)] - deleted
"""

I wonder if those "Unknown item type found" or several of those poiting to same block, e.g.: 205917185 mean anything or could trigger the unexpected lock.

HTH,
Comment 46 Matwey V. Kornilov 2013-05-11 15:23:18 UTC
(In reply to comment #45)
> I've run into a series of locks of this kind. I can't add much more to what
> I've already reported. I haven't found a method of reliably reproduce this
> lock, my impression so far is that this one is related to:
> a) wake up from suspend to ram (maybe also to disk) and 

As for me, I've never used suspend on the PC where the problem is present. 

> b) certain /corruption/ layout in disk

Yep, this is quite interesting, because usual startup file-system check doesn't report anything. Did the problem disappear after the file system had been repaired? 

However, yet I've bought new hard drive for that PC, and installed new OS and ext4, I still have old hard drive with the vulnerable reiserfs partition. I think it will be useful if I reach it and run --rebuild-tree in order to see my output.
Comment 47 Raúl 2013-05-11 15:51:00 UTC
I think rebuild-tree is more comprehensive than an usual --check or --fix-fixable and therefore is able to find (and fix) hidden (yet usable) problems.

Regarding definte repair, I wouldn't know yet. Lock could trigger after 5' or maybe after months, depeding on my usage pattern. I'll report back if the lock happens or after a reasonable time.
Regards,
Comment 48 Jeff Mahoney 2013-05-11 16:11:06 UTC
There are few misconceptions here about reiserfsck.

1) --rebuild-tree will not detect more problems than a --check will. It is the biggest, heaviest hammer we have in order to recover a file system and should not be used unless it absolutely must.

2) Only use --fix-fixable if you run into problems on the file system after mounting. The reason is that reiserfsck --check doesn't handle save links, which are placed in the file system when a file is truncated or removed while the file is still open. A file system with unhandled save links will have stat data that doesn't make sense right away and reiserfsck --check will suggest --fix-fixable as a result. I spent some time yesterday looking into how to fix this, but I'm not sure how to handle it gracefully WRT the system/disk/reiserfsck crashing mid-execution since it will essentially be operating directly on the file system without a journal for some fairly involved operations. So, for now, try to mount first. It'll replay the journal and clear the save links out.

---

I suspect that the root cause of these hangs is the reiserfs write lock not being dropped completely across schedules the way Frederic expected. I have a patch that makes the distinction between "dropping because we're done using it" and "dropping because we're scheduling" but I need to clean it up. I'll post it here tomorrow or Monday for testing.
Comment 49 Jeff Mahoney 2013-05-30 21:54:09 UTC
Created attachment 103031 [details]
[PATCHSET] reiserfs locking fixes

Here's a tarball containing patches and a series file that should fix quota/write lock deadlocks as well as several other potential problem sites.
Comment 50 Jeff Mahoney 2013-05-30 21:55:02 UTC
It's against mainline git @ commit dcdbe33a.
Comment 51 Jeff Mahoney 2013-09-20 19:23:48 UTC
Anyone who has experienced this problem should re-test with 3.12-rc1 or later. It has the locking fixes that should address the issue.
Comment 52 Frederic Weisbecker 2013-09-21 23:39:39 UTC
On Fri, Sep 20, 2013 at 07:23:48PM +0000, bugzilla-daemon@bugzilla.kernel.org wrote:
> https://bugzilla.kernel.org/show_bug.cgi?id=29162
> 
> --- Comment #51 from Jeff Mahoney <jeffm@suse.com> ---
> Anyone who has experienced this problem should re-test with 3.12-rc1 or
> later.
> It has the locking fixes that should address the issue.

Thanks a lot for fixing all these, Jeff!
Comment 53 David Kowis 2013-12-18 21:01:16 UTC
I'm uncertain if the problem I'm encountering is the same problem or not, but it appears extremely similar. Forgive me if I'm not contributing properly.

I've got a Xen VM that is exhibiting the locking symptoms, but not the corruption symptoms. A reiserfsck only replays journal entries and does not find any corruptions. This is the only VM that does this out of about 14 VMs. I see no error messages in the dom0 dmesg.

This is an ArchLinux distro Kernel 3.12.5-1-ARCH. it'll block anything that wants to do IO, the kworker here, and dropbox as well. Eventually it gets to the point that the system wedges and dies. I can Emergency Sync it via xl sysrq, but it won't shut down cleanly. I have to xl destroy it. My other VMs, some with higher IO loads are on 3.11.6-1-ARCH and have no problems.

[138600.507760] INFO: task kworker/0:1:3397 blocked for more than 120 seconds.
[138600.507775]       Not tainted 3.12.5-1-ARCH #1
[138600.507785] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[138600.507800] kworker/0:1     D 0000000000000000     0  3397      2 0x00000000
[138600.507818] Workqueue: events_long flush_old_commits [reiserfs]
[138600.507822]  ffff88002ea3bc78 0000000000000246 00000000000144c0 ffff88002ea3bfd8
[138600.507830]  ffff88002ea3bfd8 00000000000144c0 ffff88003b85a2c0 0000000000000000
[138600.507837]  0000000000000000 0000000000000000 0000000000000000 0000000000000000
[138600.507843] Call Trace:
[138600.507854]  [<ffffffff814f2109>] ? __mutex_unlock_slowpath+0xa9/0x170
[138600.507861]  [<ffffffff814f3a69>] schedule+0x29/0x70
[138600.507875]  [<ffffffffa004d5e5>] queue_log_writer+0x85/0xc0 [reiserfs]
[138600.507883]  [<ffffffff810952a0>] ? wake_up_process+0x40/0x40
[138600.507897]  [<ffffffffa005243c>] do_journal_end.isra.21+0x1cc/0xe60 [reiserfs]
[138600.507911]  [<ffffffffa0053244>] ? do_journal_begin_r+0x174/0x410 [reiserfs]
[138600.507925]  [<ffffffffa0053b59>] journal_end_sync+0x69/0x80 [reiserfs]
[138600.507939]  [<ffffffffa003f071>] reiserfs_sync_fs+0x61/0x80 [reiserfs]
[138600.507953]  [<ffffffffa003f0da>] flush_old_commits+0x4a/0x60 [reiserfs]
[138600.507961]  [<ffffffff8107dbc7>] process_one_work+0x167/0x450
[138600.507969]  [<ffffffff8107e5d1>] worker_thread+0x121/0x3a0
[138600.507977]  [<ffffffff8107e4b0>] ? manage_workers.isra.23+0x2b0/0x2b0
[138600.507986]  [<ffffffff81084fe0>] kthread+0xc0/0xd0
[138600.507995]  [<ffffffff814f0000>] ? inet6_set_link_af.part.39+0x3/0xb
[138600.508004]  [<ffffffff81084f20>] ? kthread_create_on_node+0x120/0x120
[138600.508010]  [<ffffffff814fcf3c>] ret_from_fork+0x7c/0xb0
[138600.508019]  [<ffffffff81084f20>] ? kthread_create_on_node+0x120/0x120
Comment 54 David Kowis 2013-12-18 21:08:57 UTC
(In reply to David Kowis from comment #53)
> I'm uncertain if the problem I'm encountering is the same problem or not,
> but it appears extremely similar. Forgive me if I'm not contributing
> properly.

Forgive me, I'm not using any quotas at least I don't have quotas enabled for mounting:

$ mount
/dev/xvda1 on / type reiserfs (rw,relatime)

$ dmesg | grep quota
[    0.378754] VFS: Disk quotas dquot_6.5.2

That does show up, but I believe that's simply because it's builtin.
Comment 55 D.K. 2013-12-20 22:41:59 UTC
I am also seeing what I believe to be an identical issue ( although it may not be ). In an attempt to make it reproducible I have written a C++ program to abuse a filesystem. I have been able to make the filesystem lock up after running the program for a few hours. I should be able to reproduce this fairly consistently so if there is some kind of information that will help in the troubleshooting process for other please let me know and I can try to get it for you. 

I am attaching my test program. 
The partition that is hanging is a PCI based SSD, but I have also seen this problem on a RAID array on Spinning circular media and on a VM mounted on a SAN. 

I have testing this with Kernel 3.2.28 and 3.12.2. I am currently compiling 3.12.5 and the tip of 3.12.y
Comment 56 D.K. 2013-12-20 22:44:20 UTC
Created attachment 119181 [details]
Program to deadlock reiserfs

Compiled with gcc 4.7.1, glibc 2.15  

g++ torture.cpp -o torture -lpthread -lrt -std=c++11 -O2
Comment 57 Raúl 2014-01-05 19:47:16 UTC
Created attachment 121041 [details]
dmesg for the oops (3.12.6)

I got this same hang on my laptop running Debian sid 3.12.6. Provided how unrepeatable this bug is I can't tell if this is happenning more or less often than before Jeff's changes.

I have run the proposed torture tests (thanks D.K.), but I think short shoots are not enough. I'll try overnight when I'm able to.
Regards,
Comment 58 D.K. 2014-01-05 22:02:42 UTC
I just pulled git from torvalds tree and the changes listed by Jeff Mahoney are not in there. Also the patches do not apply cleanly.
Comment 59 Jeff Mahoney 2014-01-06 16:05:36 UTC
(In reply to D.K. from comment #58)
> I just pulled git from torvalds tree and the changes listed by Jeff Mahoney
> are not in there. Also the patches do not apply cleanly.

Yeah they are:
d2d0395fd1778d4bf714adc5bfd23a5d748d7802 reiserfs: locking, release lock around quota operations
278f6679f454bf185a07d9a4ca355b153482d17a reiserfs: locking, handle nested locks properly
4c05141df57f4ffc1a9a28f1925434924179bfe4 reiserfs: locking, push write lock out of xattr code
a1457c0ce976bad1356b9b0437f2a5c3ab8a9cfc reiserfs: fix deadlock with nfs racing on create/lookup
Comment 60 Jeff Mahoney 2014-01-06 16:07:42 UTC
(In reply to Raúl from comment #57)
> Created attachment 121041 [details]
> dmesg for the oops (3.12.6)
> 
> I got this same hang on my laptop running Debian sid 3.12.6. Provided how
> unrepeatable this bug is I can't tell if this is happenning more or less
> often than before Jeff's changes.
> 
> I have run the proposed torture tests (thanks D.K.), but I think short
> shoots are not enough. I'll try overnight when I'm able to.


Thanks. The trace shows that we:

1) Have threads queued up on i_mutex
2) Have threads queued up on queue_log_writer holding i_mutex
3) Have a thread queued up on queue_log_writer holding i_mutex and the page lock
4) Have a thread queued up on the page lock

Now to figure out what is causing the queue_log_writer condition to not continue.
Comment 61 D.K. 2014-01-06 18:45:34 UTC
So I see the changes in the kernel tree are slightly different from the ones in the patch. I imagine that was the result of review and testing so adding them back in won't change too much.
Comment 62 D.K. 2014-01-28 21:45:06 UTC
Turning off the journal ( via nolog ) does not appear to alter this behavior, and I have not been able to get this to be reproduced when turning on LOCKDEP.
Comment 63 D.K. 2014-02-04 20:20:44 UTC
Attached are two logs one is the output from LOCKDEP showing all locks held on a system. The second is the log showing all running tasks on the system when it locked up.
Comment 64 D.K. 2014-02-04 20:21:50 UTC
Created attachment 124491 [details]
Output of LOCKDEP on a locked system
Comment 65 D.K. 2014-02-04 20:22:42 UTC
Created attachment 124511 [details]
All Blocked processes when system locked up
Comment 66 Hamdi Hamdi 2015-04-07 10:05:14 UTC
Hi,

After some research there is a scenario which triggered my suspicion (ref http://lxr.free-electrons.com/source/fs/reiserfs/journal.c?v=3.3):
	1) several threads call `queue_log_writer` and are put to sleep
	2) J_WRITERS_QUEUED bit is set
	3) `check_journal_end` returns nonzero value and the `do_journal_end` continues it's execution
	4) at line 4252 it clears the bit and wakes 1 thread
	5) no other thread enters `queue_log_writer` due to some unknown reason and the bit is not set again
	5) the awaken thread ends up with `if (!check_journal_end(th, sb, nblocks, flags)` 
		returning 0 which triggers the awakening of another thread
	6) No one will be awaken since there is no bit set on `if (test_and_clear_bit(J_WRITERS_QUEUED, &journal->j_state))`,
		except when the execution reaches line 4253

One ugly workaround for testing purposes at line 4253:
4253	wake_up(&(journal->j_join_wait));
	replaced with
4253	wake_up_all(&(journal->j_join_wait));

There must be a reason for this to happen on high loads only so any help and/or suggestions is more that welcome !