Bug 29162
| Summary: | Reiserfs hang with dataloss sometimes | ||
|---|---|---|---|
| Product: | File System | Reporter: | roucaries.bastien+kernel |
| Component: | ReiserFS | Assignee: | ReiseFS developers team (reiserfs-devel) |
| Status: | NEW --- | ||
| Severity: | high | CC: | amg1127, ansla80, burbon04, c880562, dkowis+kbt, dkozlowski, fweisbec, hhamdi, jeffm, matwey.kornilov, n.milovanov, rasasi78, stephan.diestelhorst, szg00000, thkoch2001 |
| Priority: | P1 | ||
| Hardware: | All | ||
| OS: | Linux | ||
| Kernel Version: | 2.6.36,2.6.37,2.6.39,3.0 | Subsystem: | |
| Regression: | Yes | Bisected commit-id: | |
| Attachments: |
log with debug enable (see patch debug)
Debug patch log with lockdep enable New trace of this bug under kernel 2.6.37 No kmail dmesg for the oops [PATCHSET] reiserfs locking fixes Program to deadlock reiserfs dmesg for the oops (3.12.6) Output of LOCKDEP on a locked system All Blocked processes when system locked up |
||
|
Description
roucaries.bastien+kernel
2011-02-15 09:36:39 UTC
Add a new log with lockdep Created attachment 47832 [details]
log with debug enable (see patch debug)
log with lockdep
Created attachment 47842 [details]
Debug patch
Created attachment 47852 [details]
log with lockdep enable
I get also this
[20404.979618] =================================
[20404.979659] [ INFO: inconsistent lock state ]
[20404.979683] 2.6.36reiser #6
[20404.979698] ---------------------------------
[20404.979722] inconsistent {IN-RECLAIM_FS-R} -> {RECLAIM_FS-ON-W} usage.
[20404.979759] khubd/268 [HC0[0]:SC0[0]:HE1:SE1] takes:
[20404.979789] (iprune_sem){+++++-}, at: [<ffffffff811175b9>] invalidate_inodes+0x39/0x142
[20404.979849] {IN-RECLAIM_FS-R} state was registered at:
[20404.979880] [<ffffffff81076053>] __lock_acquire+0x385/0xd1a
[20404.979921] [<ffffffff81076abf>] lock_acquire+0xd7/0x104
[20404.979957] [<ffffffff8134b9de>] down_read+0x47/0x5c
[20404.979993] [<ffffffff8111794e>] shrink_icache_memory+0x48/0x224
[20404.980025] [<ffffffff810d0256>] shrink_slab+0xdb/0x15f
[20404.980025] [<ffffffff810d1a21>] balance_pgdat+0x2ff/0x525
[20404.980025] [<ffffffff810d1f24>] kswapd+0x2dd/0x31a
[20404.980025] [<ffffffff810642ae>] kthread+0x8c/0x94
[20404.980025] [<ffffffff8100a964>] kernel_thread_helper+0x4/0x10
[20404.980025] irq event stamp: 18699
[20404.980025] hardirqs last enabled at (18699): [<ffffffff810a1d98>] __call_rcu+0x136/0x149
[20404.980025] hardirqs last disabled at (18698): [<ffffffff810a1c97>] __call_rcu+0x35/0x149
[20404.980025] softirqs last enabled at (17986): [<ffffffff81121369>] bdi_queue_work+0xcb/0xd4
[20404.980025] softirqs last disabled at (17982): [<ffffffff8134c655>] _raw_spin_lock_bh+0x11/0x40
[20404.980025]
[20404.980025] other info that might help us debug this:
[20404.980025] 8 locks held by khubd/268:
[20404.980025] #0: (&__lockdep_no_validate__){+.+.+.}, at: [<ffffffffa014d759>] hub_thread+0x11f/0xe77 [usbcore]
[20404.980025] #1: (&__lockdep_no_validate__){+.+.+.}, at: [<ffffffffa014c702>] usb_disconnect+0x58/0x11e [usbcore]
[20404.980025] #2: (&__lockdep_no_validate__){+.+.+.}, at: [<ffffffff812580bc>] device_release_driver+0x18/0x2d
[20404.980025] #3: (&shost->scan_mutex){+.+.+.}, at: [<ffffffffa0026059>] scsi_remove_host+0x21/0x110 [scsi_mod]
[20404.980025] #4: (&__lockdep_no_validate__){+.+.+.}, at: [<ffffffff812580bc>] device_release_driver+0x18/0x2d
[20404.980025] #5: (&type->s_umount_key#38){.+.+.+}, at: [<ffffffff81105900>] get_super+0x67/0xb7
[20404.980025] #6: (iprune_sem){+++++-}, at: [<ffffffff811175b9>] invalidate_inodes+0x39/0x142
[20404.980025] #7: (&fsnotify_mark_srcu){.+.+.+}, at: [<ffffffff8113060a>] fsnotify+0x79/0x449
[20404.980025]
[20404.980025] stack backtrace:
[20404.980025] Pid: 268, comm: khubd Not tainted 2.6.36reiser #6
[20404.980025] Call Trace:
[20404.980025] [<ffffffff81074afa>] valid_state+0x17f/0x192
[20404.980025] [<ffffffff8107546e>] ? check_usage_backwards+0x0/0x81
[20404.980025] [<ffffffff81074c66>] mark_lock+0x159/0x235
[20404.980025] [<ffffffff81130c99>] ? fsnotify_create_event+0x39/0x162
[20404.980025] [<ffffffff81074d94>] mark_held_locks+0x52/0x70
[20404.980025] [<ffffffff81074e4b>] lockdep_trace_alloc+0x99/0xbb
[20404.980025] [<ffffffff810fb7d0>] kmem_cache_alloc+0x2d/0x141
[20404.980025] [<ffffffff81130c99>] fsnotify_create_event+0x39/0x162
[20404.980025] [<ffffffff81130553>] send_to_group+0x10f/0x14d
[20404.980025] [<ffffffff81130859>] fsnotify+0x2c8/0x449
[20404.980025] [<ffffffff811315ac>] fsnotify_unmount_inodes+0xb8/0xf9
[20404.980025] [<ffffffff811175cd>] invalidate_inodes+0x4d/0x142
[20404.980025] [<ffffffff8112b98f>] __invalidate_device+0x30/0x4e
[20404.980025] [<ffffffff811a731b>] invalidate_partition+0x28/0x3d
[20404.980025] [<ffffffff811565e7>] del_gendisk+0x36/0xf1
[20404.980025] [<ffffffff81255760>] ? device_del+0x19e/0x1a6
[20404.980025] [<ffffffffa00f1f45>] sd_remove+0x61/0x9f [sd_mod]
[20404.980025] [<ffffffff81257f9a>] __device_release_driver+0x76/0xcc
[20404.991845] [<ffffffff812580c4>] device_release_driver+0x20/0x2d
[20404.991845] [<ffffffff812573cc>] bus_remove_device+0xb1/0xc6
[20404.993852] [<ffffffff812556fc>] device_del+0x13a/0x1a6
[20404.993852] [<ffffffffa002f830>] __scsi_remove_device+0x4d/0x98 [scsi_mod]
[20404.993852] [<ffffffffa002c77d>] scsi_forget_host+0x47/0x6c [scsi_mod]
[20404.993852] [<ffffffffa00260c5>] scsi_remove_host+0x8d/0x110 [scsi_mod]
[20404.993852] [<ffffffffa0066c70>] quiesce_and_remove_host+0x60/0x9c [usb_storage]
[20404.993852] [<ffffffffa0066d69>] usb_stor_disconnect+0x1d/0x29 [usb_storage]
[20404.993852] [<ffffffffa0154480>] usb_unbind_interface+0x6c/0x13f [usbcore]
[20404.993852] [<ffffffff81257f9a>] __device_release_driver+0x76/0xcc
[20405.003718] [<ffffffff812580c4>] device_release_driver+0x20/0x2d
[20405.003718] [<ffffffff812573cc>] bus_remove_device+0xb1/0xc6
[20405.006684] [<ffffffff812556fc>] device_del+0x13a/0x1a6
[20405.006684] [<ffffffffa01519ee>] usb_disable_device+0x80/0xf7 [usbcore]
[20405.006684] [<ffffffffa014c738>] usb_disconnect+0x8e/0x11e [usbcore]
[20405.010204] [<ffffffffa014db04>] hub_thread+0x4ca/0xe77 [usbcore]
[20405.010204] [<ffffffff81075014>] ? trace_hardirqs_on_caller+0x111/0x135
[20405.010204] [<ffffffff81064747>] ? autoremove_wake_function+0x0/0x34
[20405.010204] [<ffffffffa014d63a>] ? hub_thread+0x0/0xe77 [usbcore]
[20405.010204] [<ffffffff810642ae>] kthread+0x8c/0x94
[20405.010204] [<ffffffff8100a964>] kernel_thread_helper+0x4/0x10
[20405.010204] [<ffffffff8134cf10>] ? restore_args+0x0/0x30
[20405.010204] [<ffffffff81064222>] ? kthread+0x0/0x94
[20405.010204] [<ffffffff8100a960>] ? kernel_thread_helper+0x0/0x10
Very hard to reproduce. Take between 30 to 6 hours to get it. using git pull in parallel increase the chance to hit. I suffer dataloss at reboot and I rebuild twice my / partition using reiserfsck and restore using a backup once. Reported also for Debian unstable: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=616334 Bastien, are you using ACLs or security xattrs (e.g. selinux) on your file system? If you're not, I'll have to keep looking, but it seems as though Frederic's BKL replacement patches got the nested behavior of the BKL right but not the drop-over-schedule part completely right. The BKL can do nesting but drops the lock entirely over schedule. The reiserfs write lock can do nesting but only drops one reference to the lock over schedule. So if the lock is nested and a schedule occurs, the lock isn't truly dropped. The most obvious case of nesting the write lock like this is when using extended attributes since it will nest journal transactions. There are others, though. I'll work up a patch to test this theory and post it shortly. Dear Jeff, Yes I have acl enable. If your theory is right why lockdep does not detect this kind of scenario ? Do you need a virtual lock in order to lockdep to automatically detect this ? Sorry for the delay, real life suck Bastien hi there, I'm just curious if there are any news on this ? I ran into the very same problem (well, at least same symptoms, but nothing specific in the logs) after upgrading openSuSE 11.3 to 11.4 (kernel 2.6.37.1+suse), running rootfs on ext4, dm-crypted /home with reiserfs (rw,relatime) and a non-encrypted reiserfs data volume on top of LVM (rw,noatime,acl). In my case the system was running for some hours and suddenly after trying to start "kwrite" (I'm running KDE 4 btw.) the /home - Partition was dead, but without dataloss after SysRq-reboot. As that specific system is kind of support and development system for me, I immediately reverted back to kernel 2.6.34 (i.e. openSuSE 11.3 kernel) as a workaround, no freezes since then (several weeks). I recently also tried to reproduce that issue with Ubuntu and openSuSE on top of a 2.6.38 kernel, using ramdisks and hard disk partitions, but no luck so far, test cases ran for hours without a single glitch. Well, today I switched my openSuSE (the one that crashed the reiserfs once) to 2.6.38. I have made backups, so let's see what happens. I wonder if either hardly anyone suffers from this bug or if it is only caused in some very special combinations, or if it is just gone with 2.6.38. Reiserfs IMHO has been a rock solid, fast and reliable file system over the last years, and I would hate to be forced to drop it just because of that silly weird bug .... :-/ cheers, - Maximilian I'm still investigating on this. I had tested concurrent loops of git-reset/git-merge for 2 days few weeks ago but couldn't reproduce. I think it was on 2.6.38 though. I've tested the same this night with 2.6.37.1 as in your latest report, but couldn't manage to trigger the issue either. So now I'm going to test kmail as it seems to often happen as a good trigger for this bug. I'll give you more news soon. Ah I think I finally got something. I've run those git-reset/git-merge parallel loops for one night. No result. I retried with kmail in parallel fetching hundreds thousands emails. Still no result. Then I let the machine this night doing nothing, there was just kmail in the background. And today it seems frozen. I can't login, the screen is shutdown and typing on the keyboard doesn't shed it as usual. So I think I finally succeded to get a crash :-D Now whether it's that reiserfs crash or not, I don't know. So I'm going to try some more things, this time with a serial console to get the messages. If you are aware of something more mechanical to reproduce, I'm really interested. Thanks. well my openSuSE box running on 2.6.38.4 is up for 14 days now, usage is everything between idle and stressed under quite different workloads. No crash so far. Suspicion arises that somehow the problem is either gone or at least much more harder to reproduce on 2.6.38. It would be interesting why, though. @Bastien - did you ever get to test on 2.6.38 ? oh no, it just happened again - I should not have commended the 2.6.38.4 kernel for being fine again with reiserfs :-/ The dm-crypted /home reiserfs - Partition is dead again, whereas the other non-encrypted reiserfs partition on top of LVM2 is still accessible. Every process trying to access /home gets stuck now. All the other mounted filesystems (based on ext4, cifs) are ok. There is nothing unusual in the logs oder dmesg (no debug patches or config options were set in this kernel, however). The crash happend while trying to save a screenshot, the "save as" dialog opened but did not manage to show the folder contents. At that time the system was quite loaded running several applications and virtual machines (but no out-of-memory condition or whatsoever occured). So, looks like there still is a serious issue with reiserfs on 2.6.38. Ok, good to know. Well it's fairly possible that 2.6.38 got some patch that lowered the likeliness of this to happen. In any case I still need to find a way to reproduce that. I've been unable to trigger the issue again. I'm going to use some stress test tools like xfstools or so and see if that can trigger the thing faster. I achieved to reproduce on 2.6.37, new trace: May 21 14:18:00 portablebastien kernel: [63360.729426] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 14:18:00 portablebastien kernel: [63360.730680] kglobalaccel D ffff8800dd9136c0 0 16193 1 0x00000000 May 21 14:18:00 portablebastien kernel: [63360.730689] ffff88002f2ba1c0 0000000000000086 0000000000000000 ffff88007ddeb600 May 21 14:18:00 portablebastien kernel: [63360.730696] 00000000000136c0 ffff880036c95fd8 00000000000136c0 00000000000136c0 May 21 14:18:00 portablebastien kernel: [63360.730703] ffff88002f2ba498 ffff88002f2ba4a0 ffff88002f2ba1c0 00000000000136c0 May 21 14:18:00 portablebastien kernel: [63360.730710] Call Trace: May 21 14:18:00 portablebastien kernel: [63360.730724] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 14:18:00 portablebastien kernel: [63360.730764] [<ffffffffa02d7b83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 21 14:18:00 portablebastien kernel: [63360.730771] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 14:18:00 portablebastien kernel: [63360.730785] [<ffffffffa02db57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 21 14:18:00 portablebastien kernel: [63360.730799] [<ffffffffa02deaed>] ? xattr_lookup+0x17/0xef [reiserfs] May 21 14:18:00 portablebastien kernel: [63360.730813] [<ffffffffa02db726>] ? journal_begin+0xbd/0xfa [reiserfs] May 21 14:18:00 portablebastien kernel: [63360.730826] [<ffffffffa02cd52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs] May 21 14:18:00 portablebastien kernel: [63360.730833] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 21 14:18:00 portablebastien kernel: [63360.730839] [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac May 21 14:18:00 portablebastien kernel: [63360.730846] [<ffffffff81104c94>] ? file_update_time+0xf6/0x121 May 21 14:18:00 portablebastien kernel: [63360.730853] [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280 May 21 14:18:00 portablebastien kernel: [63360.730860] [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5 May 21 14:18:00 portablebastien kernel: [63360.730866] [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f May 21 14:18:00 portablebastien kernel: [63360.730872] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 21 14:18:00 portablebastien kernel: [63360.730878] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 21 14:18:00 portablebastien kernel: [63360.730883] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 21 14:18:00 portablebastien kernel: [63360.730888] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 21 14:18:00 portablebastien kernel: [63360.730894] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 14:18:00 portablebastien kernel: [63360.730901] INFO: task krunner:16219 blocked for more than 120 seconds. May 21 14:18:00 portablebastien kernel: [63360.732085] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 14:18:00 portablebastien kernel: [63360.733226] krunner D ffff8800dd8136c0 0 16219 1 0x00000000 May 21 14:18:00 portablebastien kernel: [63360.733233] ffff880095dbde80 0000000000000086 0000004000000000 ffff88007ddef2c0 May 21 14:18:00 portablebastien kernel: [63360.733240] 00000000000136c0 ffff880076453fd8 00000000000136c0 00000000000136c0 May 21 14:18:00 portablebastien kernel: [63360.733246] ffff880095dbe158 ffff880095dbe160 ffff880095dbde80 00000000000136c0 May 21 14:18:00 portablebastien kernel: [63360.733252] Call Trace: May 21 14:18:00 portablebastien kernel: [63360.733259] [<ffffffff81100bc8>] ? pollwake+0x0/0x4e May 21 14:18:00 portablebastien kernel: [63360.733265] [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193 May 21 14:18:00 portablebastien kernel: [63360.733271] [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5 May 21 14:18:00 portablebastien kernel: [63360.733276] [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33 May 21 14:18:00 portablebastien kernel: [63360.733282] [<ffffffff810b631d>] ? generic_file_aio_write+0x40/0x9f May 21 14:18:00 portablebastien kernel: [63360.733288] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 21 14:18:00 portablebastien kernel: [63360.733293] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 21 14:18:00 portablebastien kernel: [63360.733298] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 21 14:18:00 portablebastien kernel: [63360.733303] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 21 14:18:00 portablebastien kernel: [63360.733308] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 14:18:00 portablebastien kernel: [63360.733318] INFO: task konsole:16274 blocked for more than 120 seconds. May 21 14:18:00 portablebastien kernel: [63360.734470] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 14:18:00 portablebastien kernel: [63360.735647] konsole D ffff8800d04e1440 0 16274 1 0x00000000 May 21 14:18:00 portablebastien kernel: [63360.735653] ffff8800d04e1440 0000000000000082 ffff880000000000 ffffffff8160b020 May 21 14:18:00 portablebastien kernel: [63360.735660] 00000000000136c0 ffff880044c5dfd8 00000000000136c0 00000000000136c0 May 21 14:18:00 portablebastien kernel: [63360.735666] ffff8800d04e1718 ffff8800d04e1720 ffff8800d04e1440 00000000000136c0 May 21 14:18:00 portablebastien kernel: [63360.735673] Call Trace: May 21 14:18:00 portablebastien kernel: [63360.735689] [<ffffffffa02d7b83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 21 14:18:00 portablebastien kernel: [63360.735696] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 14:18:00 portablebastien kernel: [63360.735710] [<ffffffffa02db57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 21 14:18:00 portablebastien kernel: [63360.735716] [<ffffffff811035c5>] ? d_instantiate+0x31/0x46 May 21 14:18:00 portablebastien kernel: [63360.735723] [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172 May 21 14:18:00 portablebastien kernel: [63360.735737] [<ffffffffa02db726>] ? journal_begin+0xbd/0xfa [reiserfs] May 21 14:18:00 portablebastien kernel: [63360.735749] [<ffffffffa02c3c03>] ? reiserfs_create+0xe6/0x205 [reiserfs] May 21 14:18:00 portablebastien kernel: [63360.735755] [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a May 21 14:18:00 portablebastien kernel: [63360.735760] [<ffffffff810fc470>] ? vfs_create+0x66/0x88 May 21 14:18:00 portablebastien kernel: [63360.735765] [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67 May 21 14:18:00 portablebastien kernel: [63360.735770] [<ffffffff810fce1a>] ? do_last+0x25f/0x526 May 21 14:18:00 portablebastien kernel: [63360.735775] [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538 May 21 14:18:00 portablebastien kernel: [63360.735781] [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde May 21 14:18:00 portablebastien kernel: [63360.735786] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 14:18:00 portablebastien kernel: [63360.735792] INFO: task firefox-bin:16275 blocked for more than 120 seconds. May 21 14:18:00 portablebastien kernel: [63360.736992] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 14:18:00 portablebastien kernel: [63360.738217] firefox-bin D ffff8800d04e57c0 0 16275 16158 0x00000004 May 21 14:18:00 portablebastien kernel: [63360.738223] ffff8800d04e57c0 0000000000000082 0000000000000041 ffffffff8160b020 May 21 14:18:00 portablebastien kernel: [63360.738230] 00000000000136c0 ffff8800d0473fd8 00000000000136c0 00000000000136c0 May 21 14:18:00 portablebastien kernel: [63360.738236] ffff8800d04e5a98 ffff8800d04e5aa0 ffff8800d04e57c0 00000000000136c0 May 21 14:18:00 portablebastien kernel: [63360.738243] Call Trace: May 21 14:18:00 portablebastien kernel: [63360.738250] [<ffffffff810bb2e4>] ? get_page_from_freelist+0x538/0x733 May 21 14:18:00 portablebastien kernel: [63360.738265] [<ffffffffa02d7b83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 21 14:18:00 portablebastien kernel: [63360.738272] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 14:18:00 portablebastien kernel: [63360.738286] [<ffffffffa02db57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 21 14:18:00 portablebastien kernel: [63360.738292] [<ffffffff811035c5>] ? d_instantiate+0x31/0x46 May 21 14:18:00 portablebastien kernel: [63360.738298] [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172 May 21 14:18:00 portablebastien kernel: [63360.738311] [<ffffffffa02db726>] ? journal_begin+0xbd/0xfa [reiserfs] May 21 14:18:00 portablebastien kernel: [63360.738324] [<ffffffffa02c3c03>] ? reiserfs_create+0xe6/0x205 [reiserfs] May 21 14:18:00 portablebastien kernel: [63360.738329] [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a May 21 14:18:00 portablebastien kernel: [63360.738334] [<ffffffff810fc470>] ? vfs_create+0x66/0x88 May 21 14:18:00 portablebastien kernel: [63360.738339] [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67 May 21 14:18:00 portablebastien kernel: [63360.738344] [<ffffffff810fce1a>] ? do_last+0x25f/0x526 May 21 14:18:00 portablebastien kernel: [63360.738349] [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538 May 21 14:18:00 portablebastien kernel: [63360.738355] [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde May 21 14:18:00 portablebastien kernel: [63360.738360] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 14:18:00 portablebastien kernel: [63360.738365] INFO: task firefox-bin:16343 blocked for more than 120 seconds. May 21 14:18:00 portablebastien kernel: [63360.739632] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 14:18:00 portablebastien kernel: [63360.740973] firefox-bin D ffff8800dd9136c0 0 16343 16158 0x00000000 May 21 14:18:00 portablebastien kernel: [63360.740980] ffff8800b93dca40 0000000000000082 0000000000000010 ffff88010fb5f2c0 May 21 14:18:00 portablebastien kernel: [63360.740986] 00000000000136c0 ffff88006d03ffd8 00000000000136c0 00000000000136c0 May 21 14:18:00 portablebastien kernel: [63360.740994] ffff8800b93dcd18 ffff8800b93dcd20 ffff8800b93dca40 00000000000136c0 May 21 14:18:00 portablebastien kernel: [63360.741004] Call Trace: May 21 14:18:00 portablebastien kernel: [63360.741011] [<ffffffff8110333c>] ? dput+0x2c/0x12f May 21 14:18:00 portablebastien kernel: [63360.741018] [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193 May 21 14:18:00 portablebastien kernel: [63360.741024] [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33 May 21 14:18:00 portablebastien kernel: [63360.741030] [<ffffffff810fe073>] ? do_unlinkat+0x52/0x157 May 21 14:18:00 portablebastien kernel: [63360.741038] [<ffffffff8131fa95>] ? page_fault+0x25/0x30 May 21 14:18:00 portablebastien kernel: [63360.741043] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 14:20:00 portablebastien kernel: [63480.740134] INFO: task kdeinit4:16158 blocked for more than 120 seconds. May 21 14:20:00 portablebastien kernel: [63480.744377] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 14:20:00 portablebastien kernel: [63480.746337] kdeinit4 D ffff8800dd9136c0 0 16158 1 0x00000000 May 21 14:20:00 portablebastien kernel: [63480.746344] ffff8800c208b600 0000000000000082 ffff8800a164ba80 ffff8800c208d7c0 May 21 14:20:00 portablebastien kernel: [63480.746352] 00000000000136c0 ffff880119a65fd8 00000000000136c0 00000000000136c0 May 21 14:20:00 portablebastien kernel: [63480.746359] ffff8800c208b8d8 ffff8800c208b8e0 ffff8800c208b600 00000000000136c0 May 21 14:20:00 portablebastien kernel: [63480.746366] Call Trace: May 21 14:20:00 portablebastien kernel: [63480.746380] [<ffffffff810d79c6>] ? page_move_anon_rmap+0x1e/0x29 May 21 14:20:00 portablebastien kernel: [63480.746388] [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193 May 21 14:20:00 portablebastien kernel: [63480.746393] [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33 May 21 14:20:00 portablebastien kernel: [63480.746400] [<ffffffff810b631d>] ? generic_file_aio_write+0x40/0x9f May 21 14:20:00 portablebastien kernel: [63480.746406] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 21 14:20:00 portablebastien kernel: [63480.746412] [<ffffffff8103bcd1>] ? enqueue_task_fair+0x21/0x62 May 21 14:20:00 portablebastien kernel: [63480.746419] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 21 14:20:00 portablebastien kernel: [63480.746424] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 21 14:20:00 portablebastien kernel: [63480.746429] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 21 14:20:00 portablebastien kernel: [63480.746435] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 14:20:00 portablebastien kernel: [63480.746440] INFO: task kded4:16161 blocked for more than 120 seconds. May 21 14:20:00 portablebastien kernel: [63480.748399] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 14:20:00 portablebastien kernel: [63480.750368] kded4 D ffff8800c208d7c0 0 16161 1 0x00000000 May 21 14:20:00 portablebastien kernel: [63480.750374] ffff8800c208d7c0 0000000000000082 0000004000000000 ffff88011b65ca40 May 21 14:20:00 portablebastien kernel: [63480.750381] 00000000000136c0 ffff880112c6ffd8 00000000000136c0 00000000000136c0 May 21 14:20:00 portablebastien kernel: [63480.750387] ffff8800c208da98 ffff8800c208daa0 ffff8800c208d7c0 00000000000136c0 May 21 14:20:00 portablebastien kernel: [63480.750394] Call Trace: May 21 14:20:00 portablebastien kernel: [63480.750400] [<ffffffff81100bc8>] ? pollwake+0x0/0x4e May 21 14:20:00 portablebastien kernel: [63480.750406] [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193 May 21 14:20:00 portablebastien kernel: [63480.750413] [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5 May 21 14:20:00 portablebastien kernel: [63480.750418] [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33 May 21 14:20:00 portablebastien kernel: [63480.750424] [<ffffffff810b631d>] ? generic_file_aio_write+0x40/0x9f May 21 14:20:00 portablebastien kernel: [63480.750429] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 21 14:20:00 portablebastien kernel: [63480.750434] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 21 14:20:00 portablebastien kernel: [63480.750440] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 21 14:20:00 portablebastien kernel: [63480.750444] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 21 14:20:00 portablebastien kernel: [63480.750449] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 14:20:00 portablebastien kernel: [63480.750454] INFO: task kwalletd:16175 blocked for more than 120 seconds. May 21 14:20:00 portablebastien kernel: [63480.752480] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 14:20:00 portablebastien kernel: [63480.754493] kwalletd D ffff8800c2089440 0 16175 1 0x00000000 May 21 14:20:00 portablebastien kernel: [63480.754499] ffff8800c2089440 0000000000000086 ffff880000000000 ffffffff8160b020 May 21 14:20:00 portablebastien kernel: [63480.754506] 00000000000136c0 ffff8801114cbfd8 00000000000136c0 00000000000136c0 May 21 14:20:00 portablebastien kernel: [63480.754512] ffff8800c2089718 ffff8800c2089720 ffff8800c2089440 00000000000136c0 May 21 14:20:00 portablebastien kernel: [63480.754519] Call Trace: May 21 14:20:00 portablebastien kernel: [63480.754525] [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193 May 21 14:20:00 portablebastien kernel: [63480.754531] [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33 May 21 14:20:00 portablebastien kernel: [63480.754536] [<ffffffff810b631d>] ? generic_file_aio_write+0x40/0x9f May 21 14:20:00 portablebastien kernel: [63480.754541] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 21 14:20:00 portablebastien kernel: [63480.754547] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 21 14:20:00 portablebastien kernel: [63480.754552] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 21 14:20:00 portablebastien kernel: [63480.754557] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 21 14:20:00 portablebastien kernel: [63480.754562] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 14:20:00 portablebastien kernel: [63480.754567] INFO: task ksmserver:16179 blocked for more than 120 seconds. May 21 14:20:00 portablebastien kernel: [63480.756617] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 14:20:00 portablebastien kernel: [63480.758707] ksmserver D ffff88007ddeb600 0 16179 16158 0x00000004 May 21 14:20:00 portablebastien kernel: [63480.758713] ffff88007ddeb600 0000000000000082 ffff880000000000 ffff88011b65ca40 May 21 14:20:00 portablebastien kernel: [63480.758720] 00000000000136c0 ffff8800c6513fd8 00000000000136c0 00000000000136c0 May 21 14:20:00 portablebastien kernel: [63480.758726] ffff88007ddeb8d8 ffff88007ddeb8e0 ffff88007ddeb600 00000000000136c0 May 21 14:20:00 portablebastien kernel: [63480.758732] Call Trace: May 21 14:20:00 portablebastien kernel: [63480.758739] [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193 May 21 14:20:00 portablebastien kernel: [63480.758745] [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33 May 21 14:20:00 portablebastien kernel: [63480.758750] [<ffffffff810b631d>] ? generic_file_aio_write+0x40/0x9f May 21 14:20:00 portablebastien kernel: [63480.758755] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 21 14:20:00 portablebastien kernel: [63480.758761] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 21 14:20:00 portablebastien kernel: [63480.758766] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 21 14:20:00 portablebastien kernel: [63480.758771] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 21 14:20:00 portablebastien kernel: [63480.758776] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 14:20:00 portablebastien kernel: [63480.758781] INFO: task kwin:16181 blocked for more than 120 seconds. May 21 14:20:00 portablebastien kernel: [63480.760891] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 14:20:00 portablebastien kernel: [63480.763018] kwin D ffff88007ddef2c0 0 16181 16179 0x00000000 May 21 14:20:00 portablebastien kernel: [63480.763024] ffff88007ddef2c0 0000000000000082 0000004000000000 ffff88011b65ca40 May 21 14:20:00 portablebastien kernel: [63480.763031] 00000000000136c0 ffff8800b924dfd8 00000000000136c0 00000000000136c0 May 21 14:20:00 portablebastien kernel: [63480.763038] ffff88007ddef598 ffff88007ddef5a0 ffff88007ddef2c0 00000000000136c0 May 21 14:20:00 portablebastien kernel: [63480.763044] Call Trace: May 21 14:20:00 portablebastien kernel: [63480.763050] [<ffffffff81100bc8>] ? pollwake+0x0/0x4e May 21 14:20:00 portablebastien kernel: [63480.763056] [<ffffffff8131e74d>] ? __mutex_lock_common+0x127/0x193 May 21 14:20:00 portablebastien kernel: [63480.763062] [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5 May 21 14:20:00 portablebastien kernel: [63480.763067] [<ffffffff8131e885>] ? mutex_lock+0x1a/0x33 May 21 14:20:00 portablebastien kernel: [63480.763073] [<ffffffff810b631d>] ? generic_file_aio_write+0x40/0x9f May 21 14:20:00 portablebastien kernel: [63480.763078] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 21 14:20:00 portablebastien kernel: [63480.763083] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 21 14:20:00 portablebastien kernel: [63480.763089] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 21 14:20:00 portablebastien kernel: [63480.763093] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 21 14:20:00 portablebastien kernel: [63480.763099] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b Created attachment 58912 [details]
New trace of this bug under kernel 2.6.37 No kmail
Bastien, could you please provide some additional information about your system ? Maybe it helps finding some appropriate setup for Frederic to reproduce. Here some specs about my openSuSE that crashed reiserfs twice (2.6.37.1 after about 6 hours, 2.6.38.4 after about 14 days, now back on 2.6.34) CPU: Dual-Code AMD running at 800MHz - 3 GHz GPU: Radeon HD 4200 (shared mem) RAM: 7 GB Kernel: Desktop-Kernel (i.e. PREEMPT) 64bits reiserfs-Partitions: /dev/sda7 61GB, dm-crypted, 74% usage, mounted "rw,relatime" (home-partition) LVM2-pooled 160G volume (PV /dev/sdb1), ~90% usage, mounted "rw,noatime,acl" (data-partition) I tried to create some proof-of-concept setup with VMWare and direct mapped old (i.e. intentionally slow) USB-harddrive (2,5G), using 96MB RAM for the guest OS (to force more hdd activity and less cache), using 8 parallel tests and 2 reiserfs partitions, running on 2.6.37.1 for 2 days without problems. Another test setup running on native Intel hardware with same kernel and 2 reiserfs partitions on one fast local SATA drive also did not crash within 1,5 days. Do you mount reiserfs with acl,relatime option ? I believe it is related to acl option. New trace also May 21 17:03:28 portablebastien kernel: [ 9720.730560] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 17:03:28 portablebastien kernel: [ 9720.732965] krunner D ffff8800dd8136c0 0 3838 1 0x00000000 May 21 17:03:28 portablebastien kernel: [ 9720.732973] ffff880119784a40 0000000000000082 0000000000000000 ffff880117dc21c0 May 21 17:03:28 portablebastien kernel: [ 9720.732983] 00000000000136c0 ffff8800c948bfd8 00000000000136c0 00000000000136c0 May 21 17:03:28 portablebastien kernel: [ 9720.732992] ffff880119784d18 ffff880119784d20 ffff880119784a40 00000000000136c0 May 21 17:03:28 portablebastien kernel: [ 9720.733009] Call Trace: May 21 17:03:28 portablebastien kernel: [ 9720.733048] [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 21 17:03:28 portablebastien kernel: [ 9720.733058] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 17:03:28 portablebastien kernel: [ 9720.733073] [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 21 17:03:28 portablebastien kernel: [ 9720.733087] [<ffffffffa02b3aed>] ? xattr_lookup+0x17/0xef [reiserfs] May 21 17:03:28 portablebastien kernel: [ 9720.733102] [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs] May 21 17:03:28 portablebastien kernel: [ 9720.733116] [<ffffffffa02a252f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs] May 21 17:03:28 portablebastien kernel: [ 9720.733123] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 21 17:03:28 portablebastien kernel: [ 9720.733130] [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac May 21 17:03:28 portablebastien kernel: [ 9720.733138] [<ffffffff81104c94>] ? file_update_time+0xf6/0x121 May 21 17:03:28 portablebastien kernel: [ 9720.733146] [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280 May 21 17:03:28 portablebastien kernel: [ 9720.733154] [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5 May 21 17:03:28 portablebastien kernel: [ 9720.733160] [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f May 21 17:03:28 portablebastien kernel: [ 9720.733167] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 21 17:03:28 portablebastien kernel: [ 9720.733175] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 21 17:03:28 portablebastien kernel: [ 9720.733181] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 21 17:03:28 portablebastien kernel: [ 9720.733186] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 21 17:03:28 portablebastien kernel: [ 9720.733193] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 17:03:28 portablebastien kernel: [ 9720.733204] INFO: task firefox-bin:3884 blocked for more than 120 seconds. May 21 17:03:28 portablebastien kernel: [ 9720.735623] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 17:03:28 portablebastien kernel: [ 9720.738074] firefox-bin D ffff8800c2d721c0 0 3884 3544 0x00000000 May 21 17:03:28 portablebastien kernel: [ 9720.738081] ffff8800c2d721c0 0000000000000086 0000000000000000 ffffffff8160b020 May 21 17:03:28 portablebastien kernel: [ 9720.738088] 00000000000136c0 ffff8800c2fcdfd8 00000000000136c0 00000000000136c0 May 21 17:03:28 portablebastien kernel: [ 9720.738097] ffff8800c2d72498 ffff8800c2d724a0 ffff8800c2d721c0 00000000000136c0 May 21 17:03:28 portablebastien kernel: [ 9720.738106] Call Trace: May 21 17:03:28 portablebastien kernel: [ 9720.738124] [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 21 17:03:28 portablebastien kernel: [ 9720.738132] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 17:03:28 portablebastien kernel: [ 9720.738147] [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 21 17:03:28 portablebastien kernel: [ 9720.738154] [<ffffffff811035c5>] ? d_instantiate+0x31/0x46 May 21 17:03:28 portablebastien kernel: [ 9720.738162] [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172 May 21 17:03:28 portablebastien kernel: [ 9720.738176] [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs] May 21 17:03:28 portablebastien kernel: [ 9720.738189] [<ffffffffa0298c03>] ? reiserfs_create+0xe6/0x205 [reiserfs] May 21 17:03:28 portablebastien kernel: [ 9720.738196] [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a May 21 17:03:28 portablebastien kernel: [ 9720.738202] [<ffffffff810fc470>] ? vfs_create+0x66/0x88 May 21 17:03:28 portablebastien kernel: [ 9720.738208] [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67 May 21 17:03:28 portablebastien kernel: [ 9720.738213] [<ffffffff810fce1a>] ? do_last+0x25f/0x526 May 21 17:03:28 portablebastien kernel: [ 9720.738219] [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538 May 21 17:03:28 portablebastien kernel: [ 9720.738226] [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde May 21 17:03:28 portablebastien kernel: [ 9720.738232] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 17:05:28 portablebastien kernel: [ 9840.736224] INFO: task krunner:3838 blocked for more than 120 seconds. May 21 17:05:28 portablebastien kernel: [ 9840.738576] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 17:05:28 portablebastien kernel: [ 9840.740930] krunner D ffff8800dd8136c0 0 3838 1 0x00000000 May 21 17:05:28 portablebastien kernel: [ 9840.740938] ffff880119784a40 0000000000000082 0000000000000000 ffff880117dc21c0 May 21 17:05:28 portablebastien kernel: [ 9840.740948] 00000000000136c0 ffff8800c948bfd8 00000000000136c0 00000000000136c0 May 21 17:05:28 portablebastien kernel: [ 9840.740958] ffff880119784d18 ffff880119784d20 ffff880119784a40 00000000000136c0 May 21 17:05:28 portablebastien kernel: [ 9840.740967] Call Trace: May 21 17:05:28 portablebastien kernel: [ 9840.741006] [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 21 17:05:28 portablebastien kernel: [ 9840.741016] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 17:05:28 portablebastien kernel: [ 9840.741032] [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 21 17:05:28 portablebastien kernel: [ 9840.741046] [<ffffffffa02b3aed>] ? xattr_lookup+0x17/0xef [reiserfs] May 21 17:05:28 portablebastien kernel: [ 9840.741064] [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs] May 21 17:05:28 portablebastien kernel: [ 9840.741078] [<ffffffffa02a252f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs] May 21 17:05:28 portablebastien kernel: [ 9840.741085] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 21 17:05:28 portablebastien kernel: [ 9840.741092] [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac May 21 17:05:28 portablebastien kernel: [ 9840.741100] [<ffffffff81104c94>] ? file_update_time+0xf6/0x121 May 21 17:05:28 portablebastien kernel: [ 9840.741108] [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280 May 21 17:05:28 portablebastien kernel: [ 9840.741116] [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5 May 21 17:05:28 portablebastien kernel: [ 9840.741122] [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f May 21 17:05:28 portablebastien kernel: [ 9840.741129] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 21 17:05:28 portablebastien kernel: [ 9840.741137] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 21 17:05:28 portablebastien kernel: [ 9840.741143] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 21 17:05:28 portablebastien kernel: [ 9840.741148] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 21 17:05:28 portablebastien kernel: [ 9840.741155] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 17:05:28 portablebastien kernel: [ 9840.741167] INFO: task firefox-bin:3884 blocked for more than 120 seconds. May 21 17:05:28 portablebastien kernel: [ 9840.743488] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 17:05:28 portablebastien kernel: [ 9840.745866] firefox-bin D ffff8800c2d721c0 0 3884 3544 0x00000000 May 21 17:05:28 portablebastien kernel: [ 9840.745872] ffff8800c2d721c0 0000000000000086 0000000000000000 ffffffff8160b020 May 21 17:05:28 portablebastien kernel: [ 9840.745879] 00000000000136c0 ffff8800c2fcdfd8 00000000000136c0 00000000000136c0 May 21 17:05:28 portablebastien kernel: [ 9840.745889] ffff8800c2d72498 ffff8800c2d724a0 ffff8800c2d721c0 00000000000136c0 May 21 17:05:28 portablebastien kernel: [ 9840.745898] Call Trace: May 21 17:05:28 portablebastien kernel: [ 9840.745916] [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 21 17:05:28 portablebastien kernel: [ 9840.745924] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 17:05:28 portablebastien kernel: [ 9840.745939] [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 21 17:05:28 portablebastien kernel: [ 9840.745946] [<ffffffff811035c5>] ? d_instantiate+0x31/0x46 May 21 17:05:28 portablebastien kernel: [ 9840.745954] [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172 May 21 17:05:28 portablebastien kernel: [ 9840.745968] [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs] May 21 17:05:28 portablebastien kernel: [ 9840.745981] [<ffffffffa0298c03>] ? reiserfs_create+0xe6/0x205 [reiserfs] May 21 17:05:28 portablebastien kernel: [ 9840.745988] [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a May 21 17:05:28 portablebastien kernel: [ 9840.745994] [<ffffffff810fc470>] ? vfs_create+0x66/0x88 May 21 17:05:28 portablebastien kernel: [ 9840.746000] [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67 May 21 17:05:28 portablebastien kernel: [ 9840.746006] [<ffffffff810fce1a>] ? do_last+0x25f/0x526 May 21 17:05:28 portablebastien kernel: [ 9840.746012] [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538 May 21 17:05:28 portablebastien kernel: [ 9840.746019] [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde May 21 17:05:28 portablebastien kernel: [ 9840.746025] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 17:07:28 portablebastien kernel: [ 9960.744122] INFO: task krunner:3838 blocked for more than 120 seconds. May 21 17:07:28 portablebastien kernel: [ 9960.746505] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 17:07:28 portablebastien kernel: [ 9960.748918] krunner D ffff8800dd8136c0 0 3838 1 0x00000000 May 21 17:07:28 portablebastien kernel: [ 9960.748927] ffff880119784a40 0000000000000082 0000000000000000 ffff880117dc21c0 May 21 17:07:28 portablebastien kernel: [ 9960.748936] 00000000000136c0 ffff8800c948bfd8 00000000000136c0 00000000000136c0 May 21 17:07:28 portablebastien kernel: [ 9960.748946] ffff880119784d18 ffff880119784d20 ffff880119784a40 00000000000136c0 May 21 17:07:28 portablebastien kernel: [ 9960.748955] Call Trace: May 21 17:07:28 portablebastien kernel: [ 9960.748994] [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 21 17:07:28 portablebastien kernel: [ 9960.749005] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 17:07:28 portablebastien kernel: [ 9960.749020] [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 21 17:07:28 portablebastien kernel: [ 9960.749034] [<ffffffffa02b3aed>] ? xattr_lookup+0x17/0xef [reiserfs] May 21 17:07:28 portablebastien kernel: [ 9960.749049] [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs] May 21 17:07:28 portablebastien kernel: [ 9960.749063] [<ffffffffa02a252f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs] May 21 17:07:28 portablebastien kernel: [ 9960.749070] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 21 17:07:28 portablebastien kernel: [ 9960.749077] [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac May 21 17:07:28 portablebastien kernel: [ 9960.749085] [<ffffffff81104c94>] ? file_update_time+0xf6/0x121 May 21 17:07:28 portablebastien kernel: [ 9960.749093] [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280 May 21 17:07:28 portablebastien kernel: [ 9960.749101] [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5 May 21 17:07:28 portablebastien kernel: [ 9960.749107] [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f May 21 17:07:28 portablebastien kernel: [ 9960.749114] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 21 17:07:28 portablebastien kernel: [ 9960.749121] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 21 17:07:28 portablebastien kernel: [ 9960.749128] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 21 17:07:28 portablebastien kernel: [ 9960.749133] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 21 17:07:28 portablebastien kernel: [ 9960.749140] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 17:07:28 portablebastien kernel: [ 9960.749151] INFO: task firefox-bin:3884 blocked for more than 120 seconds. May 21 17:07:28 portablebastien kernel: [ 9960.751556] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 17:07:28 portablebastien kernel: [ 9960.754002] firefox-bin D ffff8800c2d721c0 0 3884 3544 0x00000000 May 21 17:07:28 portablebastien kernel: [ 9960.754008] ffff8800c2d721c0 0000000000000086 0000000000000000 ffffffff8160b020 May 21 17:07:28 portablebastien kernel: [ 9960.754015] 00000000000136c0 ffff8800c2fcdfd8 00000000000136c0 00000000000136c0 May 21 17:07:28 portablebastien kernel: [ 9960.754024] ffff8800c2d72498 ffff8800c2d724a0 ffff8800c2d721c0 00000000000136c0 May 21 17:07:28 portablebastien kernel: [ 9960.754033] Call Trace: May 21 17:07:28 portablebastien kernel: [ 9960.754051] [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 21 17:07:28 portablebastien kernel: [ 9960.754058] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 17:07:28 portablebastien kernel: [ 9960.754073] [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 21 17:07:28 portablebastien kernel: [ 9960.754081] [<ffffffff811035c5>] ? d_instantiate+0x31/0x46 May 21 17:07:28 portablebastien kernel: [ 9960.754088] [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172 May 21 17:07:28 portablebastien kernel: [ 9960.754103] [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs] May 21 17:07:28 portablebastien kernel: [ 9960.754116] [<ffffffffa0298c03>] ? reiserfs_create+0xe6/0x205 [reiserfs] May 21 17:07:28 portablebastien kernel: [ 9960.754123] [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a May 21 17:07:28 portablebastien kernel: [ 9960.754129] [<ffffffff810fc470>] ? vfs_create+0x66/0x88 May 21 17:07:28 portablebastien kernel: [ 9960.754134] [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67 May 21 17:07:28 portablebastien kernel: [ 9960.754140] [<ffffffff810fce1a>] ? do_last+0x25f/0x526 May 21 17:07:28 portablebastien kernel: [ 9960.754146] [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538 May 21 17:07:28 portablebastien kernel: [ 9960.754153] [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde May 21 17:07:28 portablebastien kernel: [ 9960.754159] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 17:09:28 portablebastien kernel: [10080.752184] INFO: task krunner:3838 blocked for more than 120 seconds. May 21 17:09:28 portablebastien kernel: [10080.754639] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 17:09:28 portablebastien kernel: [10080.757099] krunner D ffff8800dd8136c0 0 3838 1 0x00000000 May 21 17:09:28 portablebastien kernel: [10080.757107] ffff880119784a40 0000000000000082 0000000000000000 ffff880117dc21c0 May 21 17:09:28 portablebastien kernel: [10080.757116] 00000000000136c0 ffff8800c948bfd8 00000000000136c0 00000000000136c0 May 21 17:09:28 portablebastien kernel: [10080.757126] ffff880119784d18 ffff880119784d20 ffff880119784a40 00000000000136c0 May 21 17:09:28 portablebastien kernel: [10080.757135] Call Trace: May 21 17:09:28 portablebastien kernel: [10080.757175] [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 21 17:09:28 portablebastien kernel: [10080.757185] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 17:09:28 portablebastien kernel: [10080.757200] [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 21 17:09:28 portablebastien kernel: [10080.757215] [<ffffffffa02b3aed>] ? xattr_lookup+0x17/0xef [reiserfs] May 21 17:09:28 portablebastien kernel: [10080.757229] [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs] May 21 17:09:28 portablebastien kernel: [10080.757243] [<ffffffffa02a252f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs] May 21 17:09:28 portablebastien kernel: [10080.757251] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 21 17:09:28 portablebastien kernel: [10080.757258] [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac May 21 17:09:28 portablebastien kernel: [10080.757266] [<ffffffff81104c94>] ? file_update_time+0xf6/0x121 May 21 17:09:28 portablebastien kernel: [10080.757273] [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280 May 21 17:09:28 portablebastien kernel: [10080.757281] [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5 May 21 17:09:28 portablebastien kernel: [10080.757288] [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f May 21 17:09:28 portablebastien kernel: [10080.757295] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 21 17:09:28 portablebastien kernel: [10080.757302] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 21 17:09:28 portablebastien kernel: [10080.757308] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 21 17:09:28 portablebastien kernel: [10080.757314] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 21 17:09:28 portablebastien kernel: [10080.757321] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 17:09:28 portablebastien kernel: [10080.757332] INFO: task firefox-bin:3884 blocked for more than 120 seconds. May 21 17:09:28 portablebastien kernel: [10080.759822] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 17:09:28 portablebastien kernel: [10080.762417] firefox-bin D ffff8800c2d721c0 0 3884 3544 0x00000000 May 21 17:09:28 portablebastien kernel: [10080.762424] ffff8800c2d721c0 0000000000000086 0000000000000000 ffffffff8160b020 May 21 17:09:28 portablebastien kernel: [10080.762434] 00000000000136c0 ffff8800c2fcdfd8 00000000000136c0 00000000000136c0 May 21 17:09:28 portablebastien kernel: [10080.762443] ffff8800c2d72498 ffff8800c2d724a0 ffff8800c2d721c0 00000000000136c0 May 21 17:09:28 portablebastien kernel: [10080.762453] Call Trace: May 21 17:09:28 portablebastien kernel: [10080.762473] [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 21 17:09:28 portablebastien kernel: [10080.762481] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 17:09:28 portablebastien kernel: [10080.762496] [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 21 17:09:28 portablebastien kernel: [10080.762503] [<ffffffff811035c5>] ? d_instantiate+0x31/0x46 May 21 17:09:28 portablebastien kernel: [10080.762511] [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172 May 21 17:09:28 portablebastien kernel: [10080.762525] [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs] May 21 17:09:28 portablebastien kernel: [10080.762538] [<ffffffffa0298c03>] ? reiserfs_create+0xe6/0x205 [reiserfs] May 21 17:09:28 portablebastien kernel: [10080.762545] [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a May 21 17:09:28 portablebastien kernel: [10080.762551] [<ffffffff810fc470>] ? vfs_create+0x66/0x88 May 21 17:09:28 portablebastien kernel: [10080.762557] [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67 May 21 17:09:28 portablebastien kernel: [10080.762563] [<ffffffff810fce1a>] ? do_last+0x25f/0x526 May 21 17:09:28 portablebastien kernel: [10080.762568] [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538 May 21 17:09:28 portablebastien kernel: [10080.762576] [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde May 21 17:09:28 portablebastien kernel: [10080.762582] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 17:11:28 portablebastien kernel: [10200.760197] INFO: task krunner:3838 blocked for more than 120 seconds. May 21 17:11:28 portablebastien kernel: [10200.762733] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 17:11:28 portablebastien kernel: [10200.765324] krunner D ffff8800dd8136c0 0 3838 1 0x00000000 May 21 17:11:28 portablebastien kernel: [10200.765333] ffff880119784a40 0000000000000082 0000000000000000 ffff880117dc21c0 May 21 17:11:28 portablebastien kernel: [10200.765344] 00000000000136c0 ffff8800c948bfd8 00000000000136c0 00000000000136c0 May 21 17:11:28 portablebastien kernel: [10200.765353] ffff880119784d18 ffff880119784d20 ffff880119784a40 00000000000136c0 May 21 17:11:28 portablebastien kernel: [10200.765363] Call Trace: May 21 17:11:28 portablebastien kernel: [10200.765404] [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 21 17:11:28 portablebastien kernel: [10200.765414] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 17:11:28 portablebastien kernel: [10200.765429] [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 21 17:11:28 portablebastien kernel: [10200.765444] [<ffffffffa02b3aed>] ? xattr_lookup+0x17/0xef [reiserfs] May 21 17:11:28 portablebastien kernel: [10200.765458] [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs] May 21 17:11:28 portablebastien kernel: [10200.765473] [<ffffffffa02a252f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs] May 21 17:11:28 portablebastien kernel: [10200.765482] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 21 17:11:28 portablebastien kernel: [10200.765489] [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac May 21 17:11:28 portablebastien kernel: [10200.765497] [<ffffffff81104c94>] ? file_update_time+0xf6/0x121 May 21 17:11:28 portablebastien kernel: [10200.765505] [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280 May 21 17:11:28 portablebastien kernel: [10200.765513] [<ffffffff8125c21e>] ? sock_aio_read+0xb6/0xc5 May 21 17:11:28 portablebastien kernel: [10200.765519] [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f May 21 17:11:28 portablebastien kernel: [10200.765526] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 21 17:11:28 portablebastien kernel: [10200.765534] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 21 17:11:28 portablebastien kernel: [10200.765540] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 21 17:11:28 portablebastien kernel: [10200.765546] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 21 17:11:28 portablebastien kernel: [10200.765552] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 21 17:11:28 portablebastien kernel: [10200.765564] INFO: task firefox-bin:3884 blocked for more than 120 seconds. May 21 17:11:28 portablebastien kernel: [10200.768165] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 21 17:11:28 portablebastien kernel: [10200.770750] firefox-bin D ffff8800c2d721c0 0 3884 3544 0x00000000 May 21 17:11:28 portablebastien kernel: [10200.770757] ffff8800c2d721c0 0000000000000086 0000000000000000 ffffffff8160b020 May 21 17:11:28 portablebastien kernel: [10200.770764] 00000000000136c0 ffff8800c2fcdfd8 00000000000136c0 00000000000136c0 May 21 17:11:28 portablebastien kernel: [10200.770770] ffff8800c2d72498 ffff8800c2d724a0 ffff8800c2d721c0 00000000000136c0 May 21 17:11:28 portablebastien kernel: [10200.770777] Call Trace: May 21 17:11:28 portablebastien kernel: [10200.770795] [<ffffffffa02acb83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 21 17:11:28 portablebastien kernel: [10200.770801] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 21 17:11:28 portablebastien kernel: [10200.770815] [<ffffffffa02b057c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 21 17:11:28 portablebastien kernel: [10200.770821] [<ffffffff811035c5>] ? d_instantiate+0x31/0x46 May 21 17:11:28 portablebastien kernel: [10200.770829] [<ffffffff81132f58>] ? __dquot_initialize+0x20/0x172 May 21 17:11:28 portablebastien kernel: [10200.770842] [<ffffffffa02b0726>] ? journal_begin+0xbd/0xfa [reiserfs] May 21 17:11:28 portablebastien kernel: [10200.770855] [<ffffffffa0298c03>] ? reiserfs_create+0xe6/0x205 [reiserfs] May 21 17:11:28 portablebastien kernel: [10200.770860] [<ffffffff810fb6ee>] ? generic_permission+0xe/0x8a May 21 17:11:28 portablebastien kernel: [10200.770866] [<ffffffff810fc470>] ? vfs_create+0x66/0x88 May 21 17:11:28 portablebastien kernel: [10200.770871] [<ffffffff810fb9a1>] ? d_alloc_and_lookup+0x4a/0x67 May 21 17:11:28 portablebastien kernel: [10200.770875] [<ffffffff810fce1a>] ? do_last+0x25f/0x526 May 21 17:11:28 portablebastien kernel: [10200.770880] [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538 May 21 17:11:28 portablebastien kernel: [10200.770887] [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde May 21 17:11:28 portablebastien kernel: [10200.770892] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b New trace May 23 14:32:11 portablebastien kernel: [43800.728142] INFO: task firefox-bin:14948 blocked for more than 120 seconds. May 23 14:32:11 portablebastien kernel: [43800.728147] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 23 14:32:11 portablebastien kernel: [43800.728151] firefox-bin D ffff8800c3168000 0 14948 3917 0x00000000 May 23 14:32:11 portablebastien kernel: [43800.728159] ffff8800c3168000 0000000000000086 0000000000000000 ffffffff8160b020 May 23 14:32:11 portablebastien kernel: [43800.728168] 00000000000136c0 ffff88004f5f5fd8 00000000000136c0 00000000000136c0 May 23 14:32:11 portablebastien kernel: [43800.728174] ffff8800c31682d8 ffff8800c31682e0 ffff8800c3168000 00000000000136c0 May 23 14:32:11 portablebastien kernel: [43800.728181] Call Trace: May 23 14:32:11 portablebastien kernel: [43800.728219] [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 23 14:32:11 portablebastien kernel: [43800.728227] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 23 14:32:11 portablebastien kernel: [43800.728242] [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 23 14:32:11 portablebastien kernel: [43800.728255] [<ffffffffa02d0aed>] ? xattr_lookup+0x17/0xef [reiserfs] May 23 14:32:11 portablebastien kernel: [43800.728269] [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs] May 23 14:32:11 portablebastien kernel: [43800.728283] [<ffffffffa02bf52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs] May 23 14:32:11 portablebastien kernel: [43800.728289] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 23 14:32:11 portablebastien kernel: [43800.728295] [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac May 23 14:32:11 portablebastien kernel: [43800.728302] [<ffffffff81104c94>] ? file_update_time+0xf6/0x121 May 23 14:32:11 portablebastien kernel: [43800.728309] [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280 May 23 14:32:11 portablebastien kernel: [43800.728315] [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f May 23 14:32:11 portablebastien kernel: [43800.728321] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 23 14:32:11 portablebastien kernel: [43800.728327] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 23 14:32:11 portablebastien kernel: [43800.728332] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 23 14:32:11 portablebastien kernel: [43800.728337] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 23 14:32:11 portablebastien kernel: [43800.728342] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 23 14:34:11 portablebastien kernel: [43920.728239] INFO: task firefox-bin:14948 blocked for more than 120 seconds. May 23 14:34:11 portablebastien kernel: [43920.728247] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 23 14:34:11 portablebastien kernel: [43920.728251] firefox-bin D ffff8800c3168000 0 14948 3917 0x00000000 May 23 14:34:11 portablebastien kernel: [43920.728258] ffff8800c3168000 0000000000000086 0000000000000000 ffffffff8160b020 May 23 14:34:11 portablebastien kernel: [43920.728266] 00000000000136c0 ffff88004f5f5fd8 00000000000136c0 00000000000136c0 May 23 14:34:11 portablebastien kernel: [43920.728273] ffff8800c31682d8 ffff8800c31682e0 ffff8800c3168000 00000000000136c0 May 23 14:34:11 portablebastien kernel: [43920.728279] Call Trace: May 23 14:34:11 portablebastien kernel: [43920.728317] [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 23 14:34:11 portablebastien kernel: [43920.728326] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 23 14:34:11 portablebastien kernel: [43920.728340] [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 23 14:34:11 portablebastien kernel: [43920.728354] [<ffffffffa02d0aed>] ? xattr_lookup+0x17/0xef [reiserfs] May 23 14:34:11 portablebastien kernel: [43920.728368] [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs] May 23 14:34:11 portablebastien kernel: [43920.728381] [<ffffffffa02bf52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs] May 23 14:34:11 portablebastien kernel: [43920.728388] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 23 14:34:11 portablebastien kernel: [43920.728394] [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac May 23 14:34:11 portablebastien kernel: [43920.728401] [<ffffffff81104c94>] ? file_update_time+0xf6/0x121 May 23 14:34:11 portablebastien kernel: [43920.728408] [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280 May 23 14:34:11 portablebastien kernel: [43920.728414] [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f May 23 14:34:11 portablebastien kernel: [43920.728420] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 23 14:34:11 portablebastien kernel: [43920.728426] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 23 14:34:11 portablebastien kernel: [43920.728431] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 23 14:34:11 portablebastien kernel: [43920.728436] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 23 14:34:11 portablebastien kernel: [43920.728442] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 23 14:34:11 portablebastien kernel: [43920.728456] INFO: task okular:16181 blocked for more than 120 seconds. May 23 14:34:11 portablebastien kernel: [43920.728459] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 23 14:34:11 portablebastien kernel: [43920.728462] okular D ffff8800bdc18d80 0 16181 3586 0x00000000 May 23 14:34:11 portablebastien kernel: [43920.728468] ffff8800bdc18d80 0000000000000086 0000000000000000 ffff88011b65ca40 May 23 14:34:11 portablebastien kernel: [43920.728475] 00000000000136c0 ffff88011a73bfd8 00000000000136c0 00000000000136c0 May 23 14:34:11 portablebastien kernel: [43920.728481] ffff8800bdc19058 ffff8800bdc19060 ffff8800bdc18d80 00000000000136c0 May 23 14:34:11 portablebastien kernel: [43920.728488] Call Trace: May 23 14:34:11 portablebastien kernel: [43920.728502] [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 23 14:34:11 portablebastien kernel: [43920.728509] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 23 14:34:11 portablebastien kernel: [43920.728522] [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 23 14:34:11 portablebastien kernel: [43920.728536] [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs] May 23 14:34:11 portablebastien kernel: [43920.728549] [<ffffffffa02b87cb>] ? reiserfs_truncate_file+0x17a/0x27f [reiserfs] May 23 14:34:11 portablebastien kernel: [43920.728558] [<ffffffff810ceeaa>] ? unmap_mapping_range+0x59/0xf5 May 23 14:34:11 portablebastien kernel: [43920.728571] [<ffffffffa02ba6d2>] ? reiserfs_vfs_truncate_file+0x22/0x2d [reiserfs] May 23 14:34:11 portablebastien kernel: [43920.728577] [<ffffffff810bef87>] ? vmtruncate+0x36/0x3f May 23 14:34:11 portablebastien kernel: [43920.728590] [<ffffffffa02b6d45>] ? reiserfs_setattr+0x26f/0x2f4 [reiserfs] May 23 14:34:11 portablebastien kernel: [43920.728596] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 23 14:34:11 portablebastien kernel: [43920.728601] [<ffffffff81106439>] ? notify_change+0x195/0x27e May 23 14:34:11 portablebastien kernel: [43920.728606] [<ffffffff810f2d4f>] ? do_truncate+0x68/0x86 May 23 14:34:11 portablebastien kernel: [43920.728611] [<ffffffff810f21bb>] ? __dentry_open+0x186/0x291 May 23 14:34:11 portablebastien kernel: [43920.728616] [<ffffffff810fb5c4>] ? get_write_access+0x10/0x3a May 23 14:34:11 portablebastien kernel: [43920.728621] [<ffffffff810fd00e>] ? do_last+0x453/0x526 May 23 14:34:11 portablebastien kernel: [43920.728626] [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538 May 23 14:34:11 portablebastien kernel: [43920.728631] [<ffffffff810f34a5>] ? do_sync_read+0xb1/0xea May 23 14:34:11 portablebastien kernel: [43920.728637] [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde May 23 14:34:11 portablebastien kernel: [43920.728642] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 23 14:36:11 portablebastien kernel: [44040.728162] INFO: task firefox-bin:14948 blocked for more than 120 seconds. May 23 14:36:11 portablebastien kernel: [44040.728168] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 23 14:36:11 portablebastien kernel: [44040.728172] firefox-bin D ffff8800c3168000 0 14948 3917 0x00000000 May 23 14:36:11 portablebastien kernel: [44040.728179] ffff8800c3168000 0000000000000086 0000000000000000 ffffffff8160b020 May 23 14:36:11 portablebastien kernel: [44040.728187] 00000000000136c0 ffff88004f5f5fd8 00000000000136c0 00000000000136c0 May 23 14:36:11 portablebastien kernel: [44040.728193] ffff8800c31682d8 ffff8800c31682e0 ffff8800c3168000 00000000000136c0 May 23 14:36:11 portablebastien kernel: [44040.728200] Call Trace: May 23 14:36:11 portablebastien kernel: [44040.728239] [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 23 14:36:11 portablebastien kernel: [44040.728248] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 23 14:36:11 portablebastien kernel: [44040.728262] [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 23 14:36:11 portablebastien kernel: [44040.728276] [<ffffffffa02d0aed>] ? xattr_lookup+0x17/0xef [reiserfs] May 23 14:36:11 portablebastien kernel: [44040.728290] [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs] May 23 14:36:11 portablebastien kernel: [44040.728303] [<ffffffffa02bf52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs] May 23 14:36:11 portablebastien kernel: [44040.728309] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 23 14:36:11 portablebastien kernel: [44040.728316] [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac May 23 14:36:11 portablebastien kernel: [44040.728322] [<ffffffff81104c94>] ? file_update_time+0xf6/0x121 May 23 14:36:11 portablebastien kernel: [44040.728329] [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280 May 23 14:36:11 portablebastien kernel: [44040.728335] [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f May 23 14:36:11 portablebastien kernel: [44040.728341] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 23 14:36:11 portablebastien kernel: [44040.728347] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 23 14:36:11 portablebastien kernel: [44040.728352] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 23 14:36:11 portablebastien kernel: [44040.728357] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 23 14:36:11 portablebastien kernel: [44040.728362] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 23 14:36:11 portablebastien kernel: [44040.728373] INFO: task okular:16181 blocked for more than 120 seconds. May 23 14:36:11 portablebastien kernel: [44040.728377] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 23 14:36:11 portablebastien kernel: [44040.728380] okular D ffff8800bdc18d80 0 16181 3586 0x00000000 May 23 14:36:11 portablebastien kernel: [44040.728386] ffff8800bdc18d80 0000000000000086 0000000000000000 ffff88011b65ca40 May 23 14:36:11 portablebastien kernel: [44040.728393] 00000000000136c0 ffff88011a73bfd8 00000000000136c0 00000000000136c0 May 23 14:36:11 portablebastien kernel: [44040.728399] ffff8800bdc19058 ffff8800bdc19060 ffff8800bdc18d80 00000000000136c0 May 23 14:36:11 portablebastien kernel: [44040.728405] Call Trace: May 23 14:36:11 portablebastien kernel: [44040.728420] [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 23 14:36:11 portablebastien kernel: [44040.728426] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 23 14:36:11 portablebastien kernel: [44040.728440] [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 23 14:36:11 portablebastien kernel: [44040.728453] [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs] May 23 14:36:11 portablebastien kernel: [44040.728467] [<ffffffffa02b87cb>] ? reiserfs_truncate_file+0x17a/0x27f [reiserfs] May 23 14:36:11 portablebastien kernel: [44040.728473] [<ffffffff810ceeaa>] ? unmap_mapping_range+0x59/0xf5 May 23 14:36:11 portablebastien kernel: [44040.728486] [<ffffffffa02ba6d2>] ? reiserfs_vfs_truncate_file+0x22/0x2d [reiserfs] May 23 14:36:11 portablebastien kernel: [44040.728493] [<ffffffff810bef87>] ? vmtruncate+0x36/0x3f May 23 14:36:11 portablebastien kernel: [44040.728505] [<ffffffffa02b6d45>] ? reiserfs_setattr+0x26f/0x2f4 [reiserfs] May 23 14:36:11 portablebastien kernel: [44040.728511] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 23 14:36:11 portablebastien kernel: [44040.728516] [<ffffffff81106439>] ? notify_change+0x195/0x27e May 23 14:36:11 portablebastien kernel: [44040.728522] [<ffffffff810f2d4f>] ? do_truncate+0x68/0x86 May 23 14:36:11 portablebastien kernel: [44040.728526] [<ffffffff810f21bb>] ? __dentry_open+0x186/0x291 May 23 14:36:11 portablebastien kernel: [44040.728532] [<ffffffff810fb5c4>] ? get_write_access+0x10/0x3a May 23 14:36:11 portablebastien kernel: [44040.728537] [<ffffffff810fd00e>] ? do_last+0x453/0x526 May 23 14:36:11 portablebastien kernel: [44040.728542] [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538 May 23 14:36:11 portablebastien kernel: [44040.728547] [<ffffffff810f34a5>] ? do_sync_read+0xb1/0xea May 23 14:36:11 portablebastien kernel: [44040.728552] [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde May 23 14:36:11 portablebastien kernel: [44040.728557] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 23 14:38:11 portablebastien kernel: [44160.728166] INFO: task firefox-bin:14948 blocked for more than 120 seconds. May 23 14:38:11 portablebastien kernel: [44160.728182] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 23 14:38:11 portablebastien kernel: [44160.728186] firefox-bin D ffff8800c3168000 0 14948 3917 0x00000000 May 23 14:38:11 portablebastien kernel: [44160.728193] ffff8800c3168000 0000000000000086 0000000000000000 ffffffff8160b020 May 23 14:38:11 portablebastien kernel: [44160.728201] 00000000000136c0 ffff88004f5f5fd8 00000000000136c0 00000000000136c0 May 23 14:38:11 portablebastien kernel: [44160.728208] ffff8800c31682d8 ffff8800c31682e0 ffff8800c3168000 00000000000136c0 May 23 14:38:11 portablebastien kernel: [44160.728215] Call Trace: May 23 14:38:11 portablebastien kernel: [44160.728255] [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 23 14:38:11 portablebastien kernel: [44160.728264] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 23 14:38:11 portablebastien kernel: [44160.728279] [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 23 14:38:11 portablebastien kernel: [44160.728293] [<ffffffffa02d0aed>] ? xattr_lookup+0x17/0xef [reiserfs] May 23 14:38:11 portablebastien kernel: [44160.728307] [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs] May 23 14:38:11 portablebastien kernel: [44160.728321] [<ffffffffa02bf52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs] May 23 14:38:11 portablebastien kernel: [44160.728327] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 23 14:38:11 portablebastien kernel: [44160.728333] [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac May 23 14:38:11 portablebastien kernel: [44160.728340] [<ffffffff81104c94>] ? file_update_time+0xf6/0x121 May 23 14:38:11 portablebastien kernel: [44160.728347] [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280 May 23 14:38:11 portablebastien kernel: [44160.728353] [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f May 23 14:38:11 portablebastien kernel: [44160.728359] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 23 14:38:11 portablebastien kernel: [44160.728365] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 23 14:38:11 portablebastien kernel: [44160.728370] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 23 14:38:11 portablebastien kernel: [44160.728375] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 23 14:38:11 portablebastien kernel: [44160.728381] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 23 14:38:11 portablebastien kernel: [44160.728393] INFO: task okular:16181 blocked for more than 120 seconds. May 23 14:38:11 portablebastien kernel: [44160.728397] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 23 14:38:11 portablebastien kernel: [44160.728400] okular D ffff8800bdc18d80 0 16181 3586 0x00000000 May 23 14:38:11 portablebastien kernel: [44160.728406] ffff8800bdc18d80 0000000000000086 0000000000000000 ffff88011b65ca40 May 23 14:38:11 portablebastien kernel: [44160.728413] 00000000000136c0 ffff88011a73bfd8 00000000000136c0 00000000000136c0 May 23 14:38:11 portablebastien kernel: [44160.728419] ffff8800bdc19058 ffff8800bdc19060 ffff8800bdc18d80 00000000000136c0 May 23 14:38:11 portablebastien kernel: [44160.728425] Call Trace: May 23 14:38:11 portablebastien kernel: [44160.728440] [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 23 14:38:11 portablebastien kernel: [44160.728446] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 23 14:38:11 portablebastien kernel: [44160.728460] [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 23 14:38:11 portablebastien kernel: [44160.728473] [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs] May 23 14:38:11 portablebastien kernel: [44160.728487] [<ffffffffa02b87cb>] ? reiserfs_truncate_file+0x17a/0x27f [reiserfs] May 23 14:38:11 portablebastien kernel: [44160.728493] [<ffffffff810ceeaa>] ? unmap_mapping_range+0x59/0xf5 May 23 14:38:11 portablebastien kernel: [44160.728506] [<ffffffffa02ba6d2>] ? reiserfs_vfs_truncate_file+0x22/0x2d [reiserfs] May 23 14:38:11 portablebastien kernel: [44160.728513] [<ffffffff810bef87>] ? vmtruncate+0x36/0x3f May 23 14:38:11 portablebastien kernel: [44160.728525] [<ffffffffa02b6d45>] ? reiserfs_setattr+0x26f/0x2f4 [reiserfs] May 23 14:38:11 portablebastien kernel: [44160.728531] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 23 14:38:11 portablebastien kernel: [44160.728536] [<ffffffff81106439>] ? notify_change+0x195/0x27e May 23 14:38:11 portablebastien kernel: [44160.728541] [<ffffffff810f2d4f>] ? do_truncate+0x68/0x86 May 23 14:38:11 portablebastien kernel: [44160.728546] [<ffffffff810f21bb>] ? __dentry_open+0x186/0x291 May 23 14:38:11 portablebastien kernel: [44160.728551] [<ffffffff810fb5c4>] ? get_write_access+0x10/0x3a May 23 14:38:11 portablebastien kernel: [44160.728556] [<ffffffff810fd00e>] ? do_last+0x453/0x526 May 23 14:38:11 portablebastien kernel: [44160.728561] [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538 May 23 14:38:11 portablebastien kernel: [44160.728566] [<ffffffff810f34a5>] ? do_sync_read+0xb1/0xea May 23 14:38:11 portablebastien kernel: [44160.728572] [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde May 23 14:38:11 portablebastien kernel: [44160.728577] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 23 14:40:11 portablebastien kernel: [44280.728140] INFO: task firefox-bin:14948 blocked for more than 120 seconds. May 23 14:40:11 portablebastien kernel: [44280.728145] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 23 14:40:11 portablebastien kernel: [44280.728150] firefox-bin D ffff8800c3168000 0 14948 3917 0x00000000 May 23 14:40:11 portablebastien kernel: [44280.728157] ffff8800c3168000 0000000000000086 0000000000000000 ffffffff8160b020 May 23 14:40:11 portablebastien kernel: [44280.728165] 00000000000136c0 ffff88004f5f5fd8 00000000000136c0 00000000000136c0 May 23 14:40:11 portablebastien kernel: [44280.728171] ffff8800c31682d8 ffff8800c31682e0 ffff8800c3168000 00000000000136c0 May 23 14:40:11 portablebastien kernel: [44280.728178] Call Trace: May 23 14:40:11 portablebastien kernel: [44280.728215] [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 23 14:40:11 portablebastien kernel: [44280.728224] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 23 14:40:11 portablebastien kernel: [44280.728238] [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 23 14:40:11 portablebastien kernel: [44280.728252] [<ffffffffa02d0aed>] ? xattr_lookup+0x17/0xef [reiserfs] May 23 14:40:11 portablebastien kernel: [44280.728266] [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs] May 23 14:40:11 portablebastien kernel: [44280.728279] [<ffffffffa02bf52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs] May 23 14:40:11 portablebastien kernel: [44280.728285] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 23 14:40:11 portablebastien kernel: [44280.728291] [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac May 23 14:40:11 portablebastien kernel: [44280.728298] [<ffffffff81104c94>] ? file_update_time+0xf6/0x121 May 23 14:40:11 portablebastien kernel: [44280.728305] [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280 May 23 14:40:11 portablebastien kernel: [44280.728311] [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f May 23 14:40:11 portablebastien kernel: [44280.728316] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 23 14:40:11 portablebastien kernel: [44280.728323] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 23 14:40:11 portablebastien kernel: [44280.728328] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 23 14:40:11 portablebastien kernel: [44280.728333] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 23 14:40:11 portablebastien kernel: [44280.728338] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 23 14:40:11 portablebastien kernel: [44280.728349] INFO: task okular:16181 blocked for more than 120 seconds. May 23 14:40:11 portablebastien kernel: [44280.728352] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 23 14:40:11 portablebastien kernel: [44280.728356] okular D ffff8800bdc18d80 0 16181 3586 0x00000000 May 23 14:40:11 portablebastien kernel: [44280.728362] ffff8800bdc18d80 0000000000000086 0000000000000000 ffff88011b65ca40 May 23 14:40:11 portablebastien kernel: [44280.728368] 00000000000136c0 ffff88011a73bfd8 00000000000136c0 00000000000136c0 May 23 14:40:11 portablebastien kernel: [44280.728375] ffff8800bdc19058 ffff8800bdc19060 ffff8800bdc18d80 00000000000136c0 May 23 14:40:11 portablebastien kernel: [44280.728387] Call Trace: May 23 14:40:11 portablebastien kernel: [44280.728401] [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 23 14:40:11 portablebastien kernel: [44280.728407] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 23 14:40:11 portablebastien kernel: [44280.728421] [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 23 14:40:11 portablebastien kernel: [44280.728435] [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs] May 23 14:40:11 portablebastien kernel: [44280.728448] [<ffffffffa02b87cb>] ? reiserfs_truncate_file+0x17a/0x27f [reiserfs] May 23 14:40:11 portablebastien kernel: [44280.728455] [<ffffffff810ceeaa>] ? unmap_mapping_range+0x59/0xf5 May 23 14:40:11 portablebastien kernel: [44280.728468] [<ffffffffa02ba6d2>] ? reiserfs_vfs_truncate_file+0x22/0x2d [reiserfs] May 23 14:40:11 portablebastien kernel: [44280.728475] [<ffffffff810bef87>] ? vmtruncate+0x36/0x3f May 23 14:40:11 portablebastien kernel: [44280.728487] [<ffffffffa02b6d45>] ? reiserfs_setattr+0x26f/0x2f4 [reiserfs] May 23 14:40:11 portablebastien kernel: [44280.728493] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 23 14:40:11 portablebastien kernel: [44280.728498] [<ffffffff81106439>] ? notify_change+0x195/0x27e May 23 14:40:11 portablebastien kernel: [44280.728503] [<ffffffff810f2d4f>] ? do_truncate+0x68/0x86 May 23 14:40:11 portablebastien kernel: [44280.728508] [<ffffffff810f21bb>] ? __dentry_open+0x186/0x291 May 23 14:40:11 portablebastien kernel: [44280.728513] [<ffffffff810fb5c4>] ? get_write_access+0x10/0x3a May 23 14:40:11 portablebastien kernel: [44280.728518] [<ffffffff810fd00e>] ? do_last+0x453/0x526 May 23 14:40:11 portablebastien kernel: [44280.728523] [<ffffffff810fea8d>] ? do_filp_open+0x1e2/0x538 May 23 14:40:11 portablebastien kernel: [44280.728528] [<ffffffff810f34a5>] ? do_sync_read+0xb1/0xea May 23 14:40:11 portablebastien kernel: [44280.728533] [<ffffffff810f1f70>] ? do_sys_open+0x56/0xde May 23 14:40:11 portablebastien kernel: [44280.728538] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b May 23 14:42:11 portablebastien kernel: [44400.728123] INFO: task firefox-bin:14948 blocked for more than 120 seconds. May 23 14:42:11 portablebastien kernel: [44400.728128] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 23 14:42:11 portablebastien kernel: [44400.728133] firefox-bin D ffff8800c3168000 0 14948 3917 0x00000000 May 23 14:42:11 portablebastien kernel: [44400.728140] ffff8800c3168000 0000000000000086 0000000000000000 ffffffff8160b020 May 23 14:42:11 portablebastien kernel: [44400.728148] 00000000000136c0 ffff88004f5f5fd8 00000000000136c0 00000000000136c0 May 23 14:42:11 portablebastien kernel: [44400.728155] ffff8800c31682d8 ffff8800c31682e0 ffff8800c3168000 00000000000136c0 May 23 14:42:11 portablebastien kernel: [44400.728162] Call Trace: May 23 14:42:11 portablebastien kernel: [44400.728199] [<ffffffffa02c9b83>] ? queue_log_writer+0x7e/0xac [reiserfs] May 23 14:42:11 portablebastien kernel: [44400.728208] [<ffffffff8104322f>] ? default_wake_function+0x0/0xe May 23 14:42:11 portablebastien kernel: [44400.728223] [<ffffffffa02cd57c>] ? do_journal_begin_r+0x1d3/0x2c0 [reiserfs] May 23 14:42:11 portablebastien kernel: [44400.728236] [<ffffffffa02d0aed>] ? xattr_lookup+0x17/0xef [reiserfs] May 23 14:42:11 portablebastien kernel: [44400.728250] [<ffffffffa02cd726>] ? journal_begin+0xbd/0xfa [reiserfs] May 23 14:42:11 portablebastien kernel: [44400.728264] [<ffffffffa02bf52f>] ? reiserfs_dirty_inode+0x56/0x95 [reiserfs] May 23 14:42:11 portablebastien kernel: [44400.728270] [<ffffffff8104b676>] ? current_fs_time+0x1e/0x24 May 23 14:42:11 portablebastien kernel: [44400.728276] [<ffffffff8110f04b>] ? __mark_inode_dirty+0x27/0x1ac May 23 14:42:11 portablebastien kernel: [44400.728283] [<ffffffff81104c94>] ? file_update_time+0xf6/0x121 May 23 14:42:11 portablebastien kernel: [44400.728290] [<ffffffff810b61c1>] ? __generic_file_aio_write+0x164/0x280 May 23 14:42:11 portablebastien kernel: [44400.728296] [<ffffffff810b6332>] ? generic_file_aio_write+0x55/0x9f May 23 14:42:11 portablebastien kernel: [44400.728302] [<ffffffff810f33bb>] ? do_sync_write+0xb1/0xea May 23 14:42:11 portablebastien kernel: [44400.728308] [<ffffffff8115a9f6>] ? security_file_permission+0x18/0x2d May 23 14:42:11 portablebastien kernel: [44400.728314] [<ffffffff810f3909>] ? vfs_write+0xa4/0x100 May 23 14:42:11 portablebastien kernel: [44400.728318] [<ffffffff810f3a18>] ? sys_write+0x45/0x6b May 23 14:42:11 portablebastien kernel: [44400.728324] [<ffffffff81009a12>] ? system_call_fastpath+0x16/0x1b BTW I use Cached IMAP over kmail. Crash often when mail is synchronized between local and remote Ah good to know, I'm setting up OpenSuse 11.4 to get the same system than Maximilian. What distro are you using? Once it's set, I'll try kmail with that cached imap option. I use debian testing. Bastien Well I did *not* have the acl mount option set for the /home - partition, and it crashed nevertheless. The data partition uses acl, however. That bug is quite weird. Any news ? I think we have to wait till Frederic has some way to reproduce the issue ... I tried to reproduce it myself with different workloads on another machine, also created binaries with C doing multiple very fast I/O operations, ran them for several hours, but it did not crash. (Intel Dualcore ~1,8Ghz). Somehow it seems to also depend on the system config/specs. So, to make it short - 2 crashes on AMD Dualcore 3GHz, 0 crashes on Intel Dualcore 1.8Ghz for me. @Bastien - what hardware are you running ? @maximilian crashes here on intel with intel controler for hdd so not specific to amd. Dual core laptop: processor : 0 vendor_id : GenuineIntel cpu family : 6 model : 23 model name : Intel(R) Core(TM)2 Duo CPU T6500 @ 2.10GHz stepping : 10 cpu MHz : 2100.000 cache size : 2048 KB physical id : 0 siblings : 2 core id : 0 cpu cores : 2 apicid : 0 initial apicid : 0 fpu : yes fpu_exception : yes cpuid level : 13 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl aperfmperf pni dtes64 monitor ds_cpl est tm2 ssse3 cx16 xtpr pdcm sse4_1 xsave lahf_lm dts bogomips : 4188.75 clflush size : 64 cache_alignment : 64 address sizes : 36 bits physical, 48 bits virtual power management: processor : 1 ............ lspci: 00:00.0 Host bridge: Intel Corporation Mobile 4 Series Chipset Memory Controller Hub (rev 07) 00:02.0 VGA compatible controller: Intel Corporation Mobile 4 Series Chipset Integrated Graphics Controller (rev 07) 00:02.1 Display controller: Intel Corporation Mobile 4 Series Chipset Integrated Graphics Controller (rev 07) 00:1a.0 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #4 (rev 03) 00:1a.1 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #5 (rev 03) 00:1a.2 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #6 (rev 03) 00:1a.7 USB Controller: Intel Corporation 82801I (ICH9 Family) USB2 EHCI Controller #2 (rev 03) 00:1b.0 Audio device: Intel Corporation 82801I (ICH9 Family) HD Audio Controller (rev 03) 00:1c.0 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 1 (rev 03) 00:1c.1 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 2 (rev 03) 00:1c.2 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 3 (rev 03) 00:1c.4 PCI bridge: Intel Corporation 82801I (ICH9 Family) PCI Express Port 5 (rev 03) 00:1d.0 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #1 (rev 03) 00:1d.1 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #2 (rev 03) 00:1d.2 USB Controller: Intel Corporation 82801I (ICH9 Family) USB UHCI Controller #3 (rev 03) 00:1d.7 USB Controller: Intel Corporation 82801I (ICH9 Family) USB2 EHCI Controller #1 (rev 03) 00:1e.0 PCI bridge: Intel Corporation 82801 Mobile PCI Bridge (rev 93) 00:1f.0 ISA bridge: Intel Corporation ICH9M LPC Interface Controller (rev 03) 00:1f.2 SATA controller: Intel Corporation ICH9M/M-E SATA AHCI Controller (rev 03) 00:1f.3 SMBus: Intel Corporation 82801I (ICH9 Family) SMBus Controller (rev 03) 09:00.0 Ethernet controller: Marvell Technology Group Ltd. 88E8040 PCI-E Fast Ethernet Controller (rev 13) 0c:00.0 Network controller: Broadcom Corporation BCM4312 802.11b/g LP-PHY (rev 01) Frederick could you give me some patch for testing ? I've been running 4 concurrent git clone; rm -rf cycles on a reiserfs file system with a default ACL set and still can't get this to trigger. yes same here I tried to find some sort of testing setup that would allow for easy and reliable crash reproduction. No luck so far. Anyway the machine that crashed twice (running openSuSE 11.4) differs from the "try-to-reproduce"-machine in at least the following: CPU running at 3.00 GHz instead of 1.80 GHz AMD Radeon HD (w/ fglrx binary driver) instead of Intel GPU had loaded VirtualBox kernel modules had loaded VMWare kernel modules That's it. So nothing to really worry about IMHO. Well ok as far as I can remember the VMWare modules I used actually had some BKL dependencies, the patch for full 2.6.39 compatibility without BKL dep was not yet released that time. But it would be quite far-fetched to blame them. @Bastien - is there anything notably special about your setup ? For now you seem to be the only one being able to reasonably reproduce the issue. @maximilian: nothing special. Except that it is alway: - deconnected (aka cached) imap to a 6G google mail account - something else @Jeff Mahoney It seems that in 90% of the case a background deconnected (aka cached) imap to a 6G google mail account is the good way to trigger this bug. In all cases thanks to try to trigger. Can I test some patch ? Bastien My lsmod is case: Module Size Used by nls_utf8 1256 0 nls_cp437 5841 0 vfat 8039 0 fat 40599 1 vfat acpi_cpufreq 5351 1 mperf 1259 1 acpi_cpufreq cpufreq_powersave 942 0 cpufreq_stats 2633 0 cpufreq_userspace 2032 0 cpufreq_conservative 7646 0 parport_pc 18869 0 ppdev 5139 0 lp 7966 0 parport 25742 3 parport_pc,ppdev,lp rfcomm 28534 0 sco 7563 2 bnep 9960 2 l2cap 30438 6 rfcomm,bnep crc16 1327 1 l2cap binfmt_misc 6573 1 uinput 6942 1 fuse 54779 1 nfsd 257368 2 exportfs 3130 1 nfsd nfs 242558 0 lockd 57791 2 nfsd,nfs fscache 29223 1 nfs nfs_acl 2055 2 nfsd,nfs auth_rpcgss 33940 2 nfsd,nfs sunrpc 159774 6 nfsd,nfs,lockd,nfs_acl,auth_rpcgss tun 12546 2 ext3 106517 1 jbd 37104 1 ext3 mbcache 5104 1 ext3 loop 13835 0 dm_crypt 10527 0 snd_hda_codec_idt 45867 1 snd_hda_intel 19434 4 snd_hda_codec 62429 2 snd_hda_codec_idt,snd_hda_intel snd_hwdep 5484 1 snd_hda_codec snd_pcm_oss 32140 0 snd_mixer_oss 12767 1 snd_pcm_oss snd_pcm 61869 4 snd_hda_intel,snd_hda_codec,snd_pcm_oss arc4 1330 2 snd_seq_midi 4486 0 ecb 1881 2 snd_rawmidi 15945 1 snd_seq_midi i915 293539 2 snd_seq_midi_event 4786 1 snd_seq_midi btusb 9679 0 b43 149467 0 uvcvideo 51688 0 bluetooth 44517 7 sco,rfcomm,bnep,l2cap,btusb rng_core 3118 1 b43 mac80211 168449 1 b43 snd_seq 42518 3 snd_seq_midi,snd_seq_midi_event drm_kms_helper 22053 1 i915 drm 152749 3 i915,drm_kms_helper videodev 54054 1 uvcvideo i2c_algo_bit 4105 1 i915 i2c_i801 7318 0 tpm_tis 7141 0 v4l1_compat 11622 2 uvcvideo,videodev v4l2_compat_ioctl32 9011 1 videodev snd_timer 16304 2 snd_pcm,snd_seq snd_seq_device 4531 3 snd_seq_midi,snd_rawmidi,snd_seq cfg80211 114501 2 b43,mac80211 dell_wmi 1421 0 dell_laptop 7308 0 tpm 9907 1 tpm_tis video 11139 1 i915 joydev 9160 0 dcdbas 4928 1 dell_laptop serio_raw 3726 0 sparse_keymap 2400 1 dell_wmi i2c_core 16458 6 i915,drm_kms_helper,drm,videodev,i2c_algo_bit,i2c_i801 tpm_bios 4709 1 tpm rfkill 13886 4 bluetooth,dell_laptop,cfg80211 evdev 8115 28 pcspkr 1739 0 output 1764 1 video snd 47164 19 snd_hda_codec_idt,snd_hda_intel,snd_hda_codec,snd_hwdep,snd_pcm_oss,snd_mixer_oss,snd_pcm,snd_rawmidi,snd_seq,snd_timer,snd_seq_device psmouse 45290 0 wmi 7204 1 dell_wmi battery 5710 0 ac 2280 0 shpchp 21923 0 soundcore 4614 1 snd power_supply 7683 3 dell_laptop,battery,ac processor 25140 3 acpi_cpufreq button 4722 1 i915 pci_hotplug 19711 1 shpchp snd_page_alloc 6321 2 snd_hda_intel,snd_pcm reiserfs 194515 2 raid10 18667 0 raid456 44185 0 async_raid6_recov 5027 1 raid456 async_pq 3471 2 raid456,async_raid6_recov raid6_pq 77179 2 async_raid6_recov,async_pq async_xor 2305 3 raid456,async_raid6_recov,async_pq xor 4228 1 async_xor async_memcpy 1222 2 raid456,async_raid6_recov async_tx 1950 5 raid456,async_raid6_recov,async_pq,async_xor,async_memcpy raid1 18177 0 raid0 7145 0 multipath 5745 0 linear 3399 0 md_mod 79839 6 raid10,raid456,raid1,raid0,multipath,linear dm_mirror 11770 0 dm_region_hash 6672 1 dm_mirror dm_log 7693 2 dm_mirror,dm_region_hash dm_mod 56131 3 dm_crypt,dm_mirror,dm_log btrfs 412190 0 zlib_deflate 17650 1 btrfs crc32c 2600 1 libcrc32c 1114 1 btrfs usbhid 30874 0 hid 65142 1 usbhid sg 19095 0 sd_mod 28370 5 sr_mod 12759 0 cdrom 29865 1 sr_mod crc_t10dif 1300 1 sd_mod uas 6917 0 usb_storage 39639 0 uhci_hcd 18426 0 ahci 19409 4 libahci 15973 1 ahci libata 143334 2 ahci,libahci ssb 37554 1 b43 ehci_hcd 31486 0 mmc_core 54857 2 b43,ssb sky2 39697 0 scsi_mod 154687 6 sg,sr_mod,sd_mod,uas,usb_storage,libata pcmcia 29451 2 b43,ssb usbcore 118919 8 btusb,uvcvideo,usbhid,uas,usb_storage,uhci_hcd,ehci_hcd pcmcia_core 10413 1 pcmcia thermal 7538 0 nls_base 6369 5 nls_utf8,nls_cp437,vfat,fat,usbcore thermal_sys 11764 3 video,processor,thermal I had 4 concurrent I/O tests running for one week now on my AMD machine that happened to crash reiserfs twice. The tests did lots of fopen, fclose, fgetc, gputc, chmod and stat. No crash. The system was loaded with I/O and CPU usage (with the testing processes summing up to nearly 200% (dual-core CPU)). The filesystem was dm-crypted and mounted "rw,relatime,acl,user_xattr", running with the openSuSE 11.4 kernel (2.6.37.1-1.2-desktop SMP 64bits). Another script randomly set different CPU clockspeeds (for whatever that might help, but for me the crashes had happend with ondemand CPU scaling governor). So, to me it seems there must be something else actually triggering the crash. Maybe some interfering CPU idling stuff or something like that. Or some very specific I/O I did not cover with my test. Don't know. Anyway I could not reproduce with "just" steady CPU and I/O. Someone else any news on this ? I can reproduce on 2.6.39. Could not save the trace, but by memory it is the same call trace. Could you help me and send testing patch ? I am trying to reproduce with 3.0 Can you still reproduce under a bound amount of time? Like two days or so? If so, as I remember you told me your mount options are: "rw,nosuid,nodev,relatime,user_xattr,acl", can you test without acl for several days, enough to usually reproduce it, and tell us if you can still see the bug? If so it may be nice to retry the same experience with user_xattr. Thanks. I could directly answer my / partition mounted with rw,nosuid,nodev,relatime,user_xattr does not crash. Definivly linked to acl bastien Reproductible with 3.0 see trace: Aug 22 12:05:21 portablebastien kernel: [53760.744138] INFO: task x-www-browser:3507 blocked for more than 120 seconds. Aug 22 12:05:21 portablebastien kernel: [53760.744144] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 22 12:05:21 portablebastien kernel: [53760.744149] x-www-browser D ffff8800cbd22830 0 3507 2908 0x00000000 Aug 22 12:05:21 portablebastien kernel: [53760.744157] ffff8800cbd22830 0000000000000082 ffff880117e0ce80 ffff880000000000 Aug 22 12:05:21 portablebastien kernel: [53760.744165] ffff88011af580c0 0000000000012800 ffff8800cbdaffd8 ffff8800cbdaffd8 Aug 22 12:05:21 portablebastien kernel: [53760.744172] 0000000000012800 ffff8800cbd22830 0000000000012800 0000000000012800 Aug 22 12:05:21 portablebastien kernel: [53760.744179] Call Trace: Aug 22 12:05:21 portablebastien kernel: [53760.744192] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Aug 22 12:05:21 portablebastien kernel: [53760.744200] [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179 Aug 22 12:05:21 portablebastien kernel: [53760.744206] [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d Aug 22 12:05:21 portablebastien kernel: [53760.744212] [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d Aug 22 12:05:21 portablebastien kernel: [53760.744218] [<ffffffff810fbc23>] ? vfs_read+0xb2/0xf2 Aug 22 12:05:21 portablebastien kernel: [53760.744223] [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b Aug 22 12:05:21 portablebastien kernel: [53760.744231] [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b Aug 22 12:05:21 portablebastien kernel: [53760.744236] INFO: task konqueror:3510 blocked for more than 120 seconds. Aug 22 12:05:21 portablebastien kernel: [53760.744240] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 22 12:05:21 portablebastien kernel: [53760.744244] konqueror D ffff8800cbe88870 0 3510 2908 0x00000000 Aug 22 12:05:21 portablebastien kernel: [53760.744250] ffff8800cbe88870 0000000000000086 ffff880117e0ce80 ffff880000000000 Aug 22 12:05:21 portablebastien kernel: [53760.744257] ffffffff8160b020 0000000000012800 ffff8800cd239fd8 ffff8800cd239fd8 Aug 22 12:05:21 portablebastien kernel: [53760.744264] 0000000000012800 ffff8800cbe88870 0000000000012800 0000000000012800 Aug 22 12:05:21 portablebastien kernel: [53760.744271] Call Trace: Aug 22 12:05:21 portablebastien kernel: [53760.744277] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Aug 22 12:05:21 portablebastien kernel: [53760.744283] [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179 Aug 22 12:05:21 portablebastien kernel: [53760.744290] [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d Aug 22 12:05:21 portablebastien kernel: [53760.744294] [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d Aug 22 12:05:21 portablebastien kernel: [53760.744300] [<ffffffff810fbc23>] ? vfs_read+0xb2/0xf2 Aug 22 12:05:21 portablebastien kernel: [53760.744304] [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b Aug 22 12:05:21 portablebastien kernel: [53760.744310] [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b Aug 22 12:05:21 portablebastien kernel: [53760.744315] INFO: task konqueror:3511 blocked for more than 120 seconds. Aug 22 12:05:21 portablebastien kernel: [53760.744318] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 22 12:05:21 portablebastien kernel: [53760.744322] konqueror D ffff8800cbe88180 0 3511 2908 0x00000000 Aug 22 12:05:21 portablebastien kernel: [53760.744328] ffff8800cbe88180 0000000000000082 ffff880117e0ce80 ffff8800d2b83080 Aug 22 12:05:21 portablebastien kernel: [53760.744335] ffff8800cbd22830 0000000000012800 ffff8800cbf2bfd8 ffff8800cbf2bfd8 Aug 22 12:05:21 portablebastien kernel: [53760.744342] 0000000000012800 ffff8800cbe88180 0000000000012800 0000000000012800 Aug 22 12:05:21 portablebastien kernel: [53760.744349] Call Trace: Aug 22 12:05:21 portablebastien kernel: [53760.744355] [<ffffffff810383fc>] ? need_resched+0x1a/0x23 Aug 22 12:05:21 portablebastien kernel: [53760.744360] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Aug 22 12:05:21 portablebastien kernel: [53760.744366] [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179 Aug 22 12:05:21 portablebastien kernel: [53760.744372] [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d Aug 22 12:05:21 portablebastien kernel: [53760.744377] [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d Aug 22 12:05:21 portablebastien kernel: [53760.744382] [<ffffffff810fbc23>] ? vfs_read+0xb2/0xf2 Aug 22 12:05:21 portablebastien kernel: [53760.744387] [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b Aug 22 12:05:21 portablebastien kernel: [53760.744392] [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b Aug 22 12:05:21 portablebastien kernel: [53760.744397] INFO: task konqueror:3512 blocked for more than 120 seconds. Aug 22 12:05:21 portablebastien kernel: [53760.744401] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 22 12:05:21 portablebastien kernel: [53760.744405] konqueror D ffff8800cbfbb690 0 3512 2908 0x00000000 Aug 22 12:05:21 portablebastien kernel: [53760.744411] ffff8800cbfbb690 0000000000000082 ffff880117e0ce80 ffff8800d2b83080 Aug 22 12:05:21 portablebastien kernel: [53760.744418] ffff8800cbe88870 0000000000012800 ffff8800cbfb7fd8 ffff8800cbfb7fd8 Aug 22 12:05:21 portablebastien kernel: [53760.744425] 0000000000012800 ffff8800cbfbb690 0000000000012800 0000000000012800 Aug 22 12:05:21 portablebastien kernel: [53760.744432] Call Trace: Aug 22 12:05:21 portablebastien kernel: [53760.744438] [<ffffffff810383fc>] ? need_resched+0x1a/0x23 Aug 22 12:05:21 portablebastien kernel: [53760.744443] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Aug 22 12:05:21 portablebastien kernel: [53760.744449] [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179 Aug 22 12:05:21 portablebastien kernel: [53760.744455] [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d Aug 22 12:05:21 portablebastien kernel: [53760.744460] [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d Aug 22 12:05:21 portablebastien kernel: [53760.744465] [<ffffffff810fbc23>] ? vfs_read+0xb2/0xf2 Aug 22 12:05:21 portablebastien kernel: [53760.744470] [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b Aug 22 12:05:21 portablebastien kernel: [53760.744475] [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b Aug 22 12:05:21 portablebastien kernel: [53760.744481] INFO: task konqueror:3513 blocked for more than 120 seconds. Aug 22 12:05:21 portablebastien kernel: [53760.744484] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 22 12:05:21 portablebastien kernel: [53760.744488] konqueror D ffff8800d1d97750 0 3513 2908 0x00000000 Aug 22 12:05:21 portablebastien kernel: [53760.744494] ffff8800d1d97750 0000000000000082 ffff880117e0ce80 ffff880000000000 Aug 22 12:05:21 portablebastien kernel: [53760.744501] ffffffff8160b020 0000000000012800 ffff8800c9471fd8 ffff8800c9471fd8 Aug 22 12:05:21 portablebastien kernel: [53760.744508] 0000000000012800 ffff8800d1d97750 0000000000012800 0000000000012800 Aug 22 12:05:21 portablebastien kernel: [53760.744515] Call Trace: Aug 22 12:05:21 portablebastien kernel: [53760.744521] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Aug 22 12:05:21 portablebastien kernel: [53760.744527] [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179 Aug 22 12:05:21 portablebastien kernel: [53760.744533] [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d Aug 22 12:05:21 portablebastien kernel: [53760.744538] [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d Aug 22 12:05:21 portablebastien kernel: [53760.744543] [<ffffffff810fbc23>] ? vfs_read+0xb2/0xf2 Aug 22 12:05:21 portablebastien kernel: [53760.744548] [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b Aug 22 12:05:21 portablebastien kernel: [53760.744553] [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b Aug 22 12:05:21 portablebastien kernel: [53760.744563] INFO: task konqueror:3602 blocked for more than 120 seconds. Aug 22 12:05:21 portablebastien kernel: [53760.744567] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 22 12:05:21 portablebastien kernel: [53760.744570] konqueror D ffff8800d8530fe0 0 3602 2908 0x00000000 Aug 22 12:05:21 portablebastien kernel: [53760.744577] ffff8800d8530fe0 0000000000000082 0000000000000000 0000000000000000 Aug 22 12:05:21 portablebastien kernel: [53760.744584] ffffffff8160b020 0000000000012800 ffff8800d87e7fd8 ffff8800d87e7fd8 Aug 22 12:05:21 portablebastien kernel: [53760.744591] 0000000000012800 ffff8800d8530fe0 0000000000012800 0000000000012800 Aug 22 12:05:21 portablebastien kernel: [53760.744598] Call Trace: Aug 22 12:05:21 portablebastien kernel: [53760.744604] [<ffffffff81109605>] ? poll_freewait+0x8c/0x8c Aug 22 12:05:21 portablebastien kernel: [53760.744640] [<ffffffffa029217b>] ? queue_log_writer+0x7e/0xac [reiserfs] Aug 22 12:05:21 portablebastien kernel: [53760.744647] [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199 Aug 22 12:05:21 portablebastien kernel: [53760.744663] [<ffffffffa0296e03>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs] Aug 22 12:05:21 portablebastien kernel: [53760.744672] [<ffffffff8113b53f>] ? dquot_active+0x19/0x3a Aug 22 12:05:21 portablebastien kernel: [53760.744688] [<ffffffffa0296f9d>] ? journal_begin+0xbb/0xf7 [reiserfs] Aug 22 12:05:21 portablebastien kernel: [53760.744702] [<ffffffffa027e1b8>] ? reiserfs_unlink+0x7d/0x279 [reiserfs] Aug 22 12:05:21 portablebastien kernel: [53760.744709] [<ffffffff81111b05>] ? mntput_no_expire+0x21/0xd5 Aug 22 12:05:21 portablebastien kernel: [53760.744715] [<ffffffff8110669e>] ? path_lookupat+0x31b/0x335 Aug 22 12:05:21 portablebastien kernel: [53760.744720] [<ffffffff810383fc>] ? need_resched+0x1a/0x23 Aug 22 12:05:21 portablebastien kernel: [53760.744725] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Aug 22 12:05:21 portablebastien kernel: [53760.744731] [<ffffffff8133565f>] ? _cond_resched+0x9/0x20 Aug 22 12:05:21 portablebastien kernel: [53760.744736] [<ffffffff81104523>] ? inode_permission+0x60/0xc6 Aug 22 12:05:21 portablebastien kernel: [53760.744741] [<ffffffff810383fc>] ? need_resched+0x1a/0x23 Aug 22 12:05:21 portablebastien kernel: [53760.744747] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Aug 22 12:05:21 portablebastien kernel: [53760.744752] [<ffffffff81104706>] ? vfs_unlink+0x65/0xbe Aug 22 12:05:21 portablebastien kernel: [53760.744756] [<ffffffff811068e3>] ? do_unlinkat+0xc6/0x14d Aug 22 12:05:21 portablebastien kernel: [53760.744762] [<ffffffff810fbc23>] ? vfs_read+0xb2/0xf2 Aug 22 12:05:21 portablebastien kernel: [53760.744766] [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b Aug 22 12:05:21 portablebastien kernel: [53760.744772] [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b Aug 22 12:05:21 portablebastien kernel: [53760.744785] INFO: task konqueror:6686 blocked for more than 120 seconds. Aug 22 12:05:21 portablebastien kernel: [53760.744788] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 22 12:05:21 portablebastien kernel: [53760.744792] konqueror D ffff8800c77929b0 0 6686 3437 0x00000000 Aug 22 12:05:21 portablebastien kernel: [53760.744799] ffff8800c77929b0 0000000000000082 ffff880117e0ce80 ffff880000000000 Aug 22 12:05:21 portablebastien kernel: [53760.744806] ffff88011af580c0 0000000000012800 ffff880089523fd8 ffff880089523fd8 Aug 22 12:05:21 portablebastien kernel: [53760.744813] 0000000000012800 ffff8800c77929b0 0000000000012800 0000000000012800 Aug 22 12:05:21 portablebastien kernel: [53760.744820] Call Trace: Aug 22 12:05:21 portablebastien kernel: [53760.744825] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Aug 22 12:05:21 portablebastien kernel: [53760.744832] [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179 Aug 22 12:05:21 portablebastien kernel: [53760.744838] [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d Aug 22 12:05:21 portablebastien kernel: [53760.744843] [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d Aug 22 12:05:21 portablebastien kernel: [53760.744848] [<ffffffff810fc8b0>] ? fput+0x1a/0x1a2 Aug 22 12:05:21 portablebastien kernel: [53760.744853] [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b Aug 22 12:05:21 portablebastien kernel: [53760.744858] [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b Aug 22 12:05:21 portablebastien kernel: [53760.744877] INFO: task konqueror:31954 blocked for more than 120 seconds. Aug 22 12:05:21 portablebastien kernel: [53760.744881] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 22 12:05:21 portablebastien kernel: [53760.744884] konqueror D ffff8800b128f610 0 31954 2908 0x00000000 Aug 22 12:05:21 portablebastien kernel: [53760.744893] ffff8800b128f610 0000000000000086 ffff880117e0ce80 ffff8800d2b83080 Aug 22 12:05:21 portablebastien kernel: [53760.744900] ffff8800cbe88180 0000000000012800 ffff88003e141fd8 ffff88003e141fd8 Aug 22 12:05:21 portablebastien kernel: [53760.744907] 0000000000012800 ffff8800b128f610 0000000000012800 0000000000012800 Aug 22 12:05:21 portablebastien kernel: [53760.744914] Call Trace: Aug 22 12:05:21 portablebastien kernel: [53760.744920] [<ffffffff810383fc>] ? need_resched+0x1a/0x23 Aug 22 12:05:21 portablebastien kernel: [53760.744925] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Aug 22 12:05:21 portablebastien kernel: [53760.744931] [<ffffffff81335e18>] ? __mutex_lock_common.clone.5+0x114/0x179 Aug 22 12:05:21 portablebastien kernel: [53760.744937] [<ffffffff81335cf1>] ? mutex_lock+0x1a/0x2d Aug 22 12:05:21 portablebastien kernel: [53760.744942] [<ffffffff8110686d>] ? do_unlinkat+0x50/0x14d Aug 22 12:05:21 portablebastien kernel: [53760.744947] [<ffffffff810fc8b0>] ? fput+0x1a/0x1a2 Aug 22 12:05:21 portablebastien kernel: [53760.744952] [<ffffffff810fbcc2>] ? sys_read+0x5f/0x6b Aug 22 12:05:21 portablebastien kernel: [53760.744958] [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b Aug 22 12:05:21 portablebastien kernel: [53760.744966] INFO: task cc1:18172 blocked for more than 120 seconds. Aug 22 12:05:21 portablebastien kernel: [53760.744970] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Aug 22 12:05:21 portablebastien kernel: [53760.744973] cc1 D ffff88011af29550 0 18172 18171 0x00000000 Aug 22 12:05:21 portablebastien kernel: [53760.744980] ffff88011af29550 0000000000000082 ffff88010047b9a8 0000000000000000 Aug 22 12:05:21 portablebastien kernel: [53760.744987] ffffffff8160b020 0000000000012800 ffff88010047bfd8 ffff88010047bfd8 Aug 22 12:05:21 portablebastien kernel: [53760.744994] 0000000000012800 ffff88011af29550 0000000000012800 0000000000012800 Aug 22 12:05:21 portablebastien kernel: [53760.745001] Call Trace: Aug 22 12:05:21 portablebastien kernel: [53760.745018] [<ffffffffa029217b>] ? queue_log_writer+0x7e/0xac [reiserfs] Aug 22 12:05:21 portablebastien kernel: [53760.745024] [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199 Aug 22 12:05:21 portablebastien kernel: [53760.745040] [<ffffffffa0296e03>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs] Aug 22 12:05:21 portablebastien kernel: [53760.745056] [<ffffffffa0296f9d>] ? journal_begin+0xbb/0xf7 [reiserfs] Aug 22 12:05:21 portablebastien kernel: [53760.745071] [<ffffffffa0280e1c>] ? reiserfs_truncate_file+0x16f/0x26e [reiserfs] Aug 22 12:05:21 portablebastien kernel: [53760.745077] [<ffffffff810383fc>] ? need_resched+0x1a/0x23 Aug 22 12:05:21 portablebastien kernel: [53760.745083] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Aug 22 12:05:21 portablebastien kernel: [53760.745097] [<ffffffffa0283dfa>] ? reiserfs_vfs_truncate_file+0x22/0x30 [reiserfs] Aug 22 12:05:21 portablebastien kernel: [53760.745104] [<ffffffff810bfda0>] ? vmtruncate+0x33/0x3b Aug 22 12:05:21 portablebastien kernel: [53760.745119] [<ffffffffa0283d6a>] ? reiserfs_setattr+0x253/0x2c1 [reiserfs] Aug 22 12:05:21 portablebastien kernel: [53760.745126] [<ffffffff810b54ad>] ? generic_file_buffered_write+0x1b8/0x219 Aug 22 12:05:21 portablebastien kernel: [53760.745133] [<ffffffff8110cb3c>] ? __d_lookup_rcu+0xb6/0xf2 Aug 22 12:05:21 portablebastien kernel: [53760.745139] [<ffffffff810ba536>] ? get_pageblock_flags_group+0x3f/0x76 Aug 22 12:05:21 portablebastien kernel: [53760.745145] [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24 Aug 22 12:05:21 portablebastien kernel: [53760.745150] [<ffffffff8110f6db>] ? notify_change+0x1a7/0x291 Aug 22 12:05:21 portablebastien kernel: [53760.745156] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Aug 22 12:05:21 portablebastien kernel: [53760.745163] [<ffffffff810fa6a9>] ? do_truncate+0x65/0x80 Aug 22 12:05:21 portablebastien kernel: [53760.745168] [<ffffffff810fa353>] ? __dentry_open+0x1a7/0x29c Aug 22 12:05:21 portablebastien kernel: [53760.745173] [<ffffffff811058d3>] ? do_last+0x4df/0x584 Aug 22 12:05:21 portablebastien kernel: [53760.745178] [<ffffffff81106bea>] ? path_openat+0xc7/0x349 Aug 22 12:05:21 portablebastien kernel: [53760.745184] [<ffffffff810d0312>] ? tlb_flush_mmu+0x37/0x50 Aug 22 12:05:21 portablebastien kernel: [53760.745190] [<ffffffff81106e98>] ? do_filp_open+0x2c/0x72 Aug 22 12:05:21 portablebastien kernel: [53760.745196] [<ffffffff8133565f>] ? _cond_resched+0x9/0x20 Aug 22 12:05:21 portablebastien kernel: [53760.745203] [<ffffffff811ac741>] ? __strncpy_from_user+0x19/0x4a Aug 22 12:05:21 portablebastien kernel: [53760.745208] [<ffffffff81110208>] ? alloc_fd+0x69/0x110 Aug 22 12:05:21 portablebastien kernel: [53760.745214] [<ffffffff810fb138>] ? do_sys_open+0x5f/0xe6 Aug 22 12:05:21 portablebastien kernel: [53760.745220] [<ffffffff8133ba92>] ? system_call_fastpath+0x16/0x1b This time I achieved to get an interesting trace, journal begin was interrupted by an IPI, and stuck What do you think about this ? regards Bastien Sep 8 10:18:25 portablebastien kernel: [177000.740195] INFO: task kded4:31863 blocked for more than 120 seconds. Sep 8 10:18:25 portablebastien kernel: [177000.740260] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Sep 8 10:18:25 portablebastien kernel: [177000.740326] kded4 D ffff880119d62830 0 31863 1 0x00000000 Sep 8 10:18:25 portablebastien kernel: [177000.740335] ffff880119d62830 0000000000000082 ffff880000000040 0000000100000000 Sep 8 10:18:25 portablebastien kernel: [177000.740343] ffffffff8160b020 0000000000012800 ffff8800cac65fd8 ffff8800cac65fd8 Sep 8 10:18:25 portablebastien kernel: [177000.740351] 0000000000012800 ffff880119d62830 0000000000012800 0000000000012800 Sep 8 10:18:25 portablebastien kernel: [177000.740358] Call Trace: Sep 8 10:18:25 portablebastien kernel: [177000.740371] [<ffffffff81336090>] ? __mutex_lock_common.clone.5+0x114/0x179 Sep 8 10:18:25 portablebastien kernel: [177000.740379] [<ffffffff81335f69>] ? mutex_lock+0x1a/0x2d Sep 8 10:18:25 portablebastien kernel: [177000.740386] [<ffffffff810b6dbc>] ? generic_file_aio_write+0x3b/0xb2 Sep 8 10:18:25 portablebastien kernel: [177000.740392] [<ffffffff810fb7eb>] ? do_sync_write+0xb1/0xea Sep 8 10:18:25 portablebastien kernel: [177000.740401] [<ffffffff811653e9>] ? security_file_permission+0x18/0x33 Sep 8 10:18:25 portablebastien kernel: [177000.740407] [<ffffffff810fbe02>] ? vfs_write+0xa6/0xf9 Sep 8 10:18:25 portablebastien kernel: [177000.740412] [<ffffffff810fbff7>] ? sys_write+0x45/0x6b Sep 8 10:18:25 portablebastien kernel: [177000.740418] [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b Sep 8 10:18:25 portablebastien kernel: [177000.740442] INFO: task krunner:31987 blocked for more than 120 seconds. Sep 8 10:18:25 portablebastien kernel: [177000.740498] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Sep 8 10:18:25 portablebastien kernel: [177000.740562] krunner D ffff8801192d4300 0 31987 1 0x00000000 Sep 8 10:18:25 portablebastien kernel: [177000.740569] ffff8801192d4300 0000000000000086 ffff880117744148 ffff8801181f2f40 Sep 8 10:18:25 portablebastien kernel: [177000.740577] ffff8800caef0e60 0000000000012800 ffff88001d0ebfd8 ffff88001d0ebfd8 Sep 8 10:18:25 portablebastien kernel: [177000.740584] 0000000000012800 ffff8801192d4300 0000000000012800 0000000000012800 Sep 8 10:18:25 portablebastien kernel: [177000.740591] Call Trace: Sep 8 10:18:25 portablebastien kernel: [177000.740598] [<ffffffff81071f28>] ? arch_local_irq_save+0x14/0x1d Sep 8 10:18:25 portablebastien kernel: [177000.740636] [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs] Sep 8 10:18:25 portablebastien kernel: [177000.740643] [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199 Sep 8 10:18:25 portablebastien kernel: [177000.740662] [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs] Sep 8 10:18:25 portablebastien kernel: [177000.740670] [<ffffffff81098a4a>] ? delayacct_end+0x72/0x7d Sep 8 10:18:25 portablebastien kernel: [177000.740677] [<ffffffff810b5ebc>] ? sleep_on_page+0x10/0x10 Sep 8 10:18:25 portablebastien kernel: [177000.740694] [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs] Sep 8 10:18:25 portablebastien kernel: [177000.740712] [<ffffffffa0290d35>] ? reiserfs_dirty_inode+0x53/0x8f [reiserfs] Sep 8 10:18:25 portablebastien kernel: [177000.740719] [<ffffffff810600ad>] ? autoremove_wake_function+0x2a/0x2a Sep 8 10:18:25 portablebastien kernel: [177000.740725] [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24 Sep 8 10:18:25 portablebastien kernel: [177000.740732] [<ffffffff8111846e>] ? __mark_inode_dirty+0x22/0x183 Sep 8 10:18:25 portablebastien kernel: [177000.740739] [<ffffffff8110e2b6>] ? file_update_time+0xea/0x115 Sep 8 10:18:25 portablebastien kernel: [177000.740745] [<ffffffff810b6c69>] ? __generic_file_aio_write+0x160/0x278 Sep 8 10:18:25 portablebastien kernel: [177000.740752] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Sep 8 10:18:25 portablebastien kernel: [177000.740758] [<ffffffff810b6ddb>] ? generic_file_aio_write+0x5a/0xb2 Sep 8 10:18:25 portablebastien kernel: [177000.740764] [<ffffffff810fb7eb>] ? do_sync_write+0xb1/0xea Sep 8 10:18:25 portablebastien kernel: [177000.740771] [<ffffffff811653e9>] ? security_file_permission+0x18/0x33 Sep 8 10:18:25 portablebastien kernel: [177000.740777] [<ffffffff810fbe02>] ? vfs_write+0xa6/0xf9 Sep 8 10:18:25 portablebastien kernel: [177000.740782] [<ffffffff810fbff7>] ? sys_write+0x45/0x6b Sep 8 10:18:25 portablebastien kernel: [177000.740788] [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b Sep 8 10:18:25 portablebastien kernel: [177000.740811] INFO: task okular:12053 blocked for more than 120 seconds. Sep 8 10:18:25 portablebastien kernel: [177000.740867] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Sep 8 10:18:25 portablebastien kernel: [177000.740931] okular D ffff8800c9c8d060 0 12053 32057 0x00000000 Sep 8 10:18:25 portablebastien kernel: [177000.740938] ffff8800c9c8d060 0000000000000086 ffff8800c9c8d0a8 ffff880000000000 Sep 8 10:18:25 portablebastien kernel: [177000.740946] ffff88011af780c0 0000000000012800 ffff8800ab7dbfd8 ffff8800ab7dbfd8 Sep 8 10:18:25 portablebastien kernel: [177000.740953] 0000000000012800 ffff8800c9c8d060 0000000000012800 0000000000012800 Sep 8 10:18:25 portablebastien kernel: [177000.740960] Call Trace: Sep 8 10:18:25 portablebastien kernel: [177000.740982] [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs] Sep 8 10:18:25 portablebastien kernel: [177000.740988] [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199 Sep 8 10:18:25 portablebastien kernel: [177000.741007] [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs] Sep 8 10:18:25 portablebastien kernel: [177000.741025] [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs] Sep 8 10:18:25 portablebastien kernel: [177000.741042] [<ffffffffa0289e1c>] ? reiserfs_truncate_file+0x16f/0x26e [reiserfs] Sep 8 10:18:25 portablebastien kernel: [177000.741048] [<ffffffff8110a7ba>] ? do_sys_poll+0x30d/0x37d Sep 8 10:18:25 portablebastien kernel: [177000.741055] [<ffffffff810383fc>] ? need_resched+0x1a/0x23 Sep 8 10:18:25 portablebastien kernel: [177000.741060] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Sep 8 10:18:25 portablebastien kernel: [177000.741077] [<ffffffffa028cdfa>] ? reiserfs_vfs_truncate_file+0x22/0x30 [reiserfs] Sep 8 10:18:25 portablebastien kernel: [177000.741084] [<ffffffff810bffe8>] ? vmtruncate+0x33/0x3b Sep 8 10:18:25 portablebastien kernel: [177000.741099] [<ffffffffa028cd6a>] ? reiserfs_setattr+0x253/0x2c1 [reiserfs] Sep 8 10:18:25 portablebastien kernel: [177000.741106] [<ffffffff8110ce20>] ? __d_lookup_rcu+0xb6/0xf2 Sep 8 10:18:25 portablebastien kernel: [177000.741112] [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24 Sep 8 10:18:25 portablebastien kernel: [177000.741118] [<ffffffff8110f9bf>] ? notify_change+0x1a7/0x291 Sep 8 10:18:25 portablebastien kernel: [177000.741124] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Sep 8 10:18:25 portablebastien kernel: [177000.741131] [<ffffffff810fa98d>] ? do_truncate+0x65/0x80 Sep 8 10:18:25 portablebastien kernel: [177000.741137] [<ffffffff810fa637>] ? __dentry_open+0x1a7/0x29c Sep 8 10:18:25 portablebastien kernel: [177000.741142] [<ffffffff81105bb7>] ? do_last+0x4df/0x584 Sep 8 10:18:25 portablebastien kernel: [177000.741148] [<ffffffff81106ece>] ? path_openat+0xc7/0x349 Sep 8 10:18:25 portablebastien kernel: [177000.741153] [<ffffffff810fb8d5>] ? do_sync_read+0xb1/0xea Sep 8 10:18:25 portablebastien kernel: [177000.741159] [<ffffffff8110717c>] ? do_filp_open+0x2c/0x72 Sep 8 10:18:25 portablebastien kernel: [177000.741166] [<ffffffff813358d7>] ? _cond_resched+0x9/0x20 Sep 8 10:18:25 portablebastien kernel: [177000.741172] [<ffffffff811aca91>] ? __strncpy_from_user+0x19/0x4a Sep 8 10:18:25 portablebastien kernel: [177000.741178] [<ffffffff811104ec>] ? alloc_fd+0x69/0x110 Sep 8 10:18:25 portablebastien kernel: [177000.741184] [<ffffffff810fb41c>] ? do_sys_open+0x5f/0xe6 Sep 8 10:18:25 portablebastien kernel: [177000.741191] [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b Sep 8 10:18:25 portablebastien kernel: [177000.741197] INFO: task firefox-bin:12794 blocked for more than 120 seconds. Sep 8 10:18:25 portablebastien kernel: [177000.741256] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Sep 8 10:18:25 portablebastien kernel: [177000.741320] firefox-bin D ffff8800c1e56400 0 12794 31987 0x00000000 Sep 8 10:18:25 portablebastien kernel: [177000.741326] ffff8800c1e56400 0000000000000082 0000000000000246 ffffffff00000000 Sep 8 10:18:25 portablebastien kernel: [177000.741334] ffff88011af780c0 0000000000012800 ffff880118589fd8 ffff880118589fd8 Sep 8 10:18:25 portablebastien kernel: [177000.741341] 0000000000012800 ffff8800c1e56400 0000000000012800 0000000000012800 Sep 8 10:18:25 portablebastien kernel: [177000.741349] Call Trace: Sep 8 10:18:25 portablebastien kernel: [177000.741368] [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs] Sep 8 10:18:25 portablebastien kernel: [177000.741374] [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199 Sep 8 10:18:25 portablebastien kernel: [177000.741392] [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.741398] [<ffffffff811098e9>] ? poll_freewait+0x8c/0x8c Sep 8 10:18:26 portablebastien kernel: [177000.741405] [<ffffffff810cb994>] ? __mod_zone_page_state+0x3c/0x45 Sep 8 10:18:26 portablebastien kernel: [177000.741413] [<ffffffff8100e28d>] ? paravirt_read_tsc+0x5/0x8 Sep 8 10:18:26 portablebastien kernel: [177000.741430] [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.741447] [<ffffffffa0290d35>] ? reiserfs_dirty_inode+0x53/0x8f [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.741454] [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24 Sep 8 10:18:26 portablebastien kernel: [177000.741460] [<ffffffff8111846e>] ? __mark_inode_dirty+0x22/0x183 Sep 8 10:18:26 portablebastien kernel: [177000.741466] [<ffffffff8110e3e4>] ? touch_atime+0x103/0x12c Sep 8 10:18:26 portablebastien kernel: [177000.741472] [<ffffffff810b7391>] ? generic_file_aio_read+0x55e/0x5c7 Sep 8 10:18:26 portablebastien kernel: [177000.741479] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Sep 8 10:18:26 portablebastien kernel: [177000.741485] [<ffffffff810fb8d5>] ? do_sync_read+0xb1/0xea Sep 8 10:18:26 portablebastien kernel: [177000.741491] [<ffffffff810fbef4>] ? vfs_read+0x9f/0xf2 Sep 8 10:18:26 portablebastien kernel: [177000.741496] [<ffffffff810fbf8c>] ? sys_read+0x45/0x6b Sep 8 10:18:26 portablebastien kernel: [177000.741503] [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b Sep 8 10:18:26 portablebastien kernel: [177000.741510] INFO: task firefox-bin:13107 blocked for more than 120 seconds. Sep 8 10:18:26 portablebastien kernel: [177000.741573] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Sep 8 10:18:26 portablebastien kernel: [177000.741639] firefox-bin D ffff880004d76e60 0 13107 31987 0x00000000 Sep 8 10:18:26 portablebastien kernel: [177000.741646] ffff880004d76e60 0000000000000082 0000000000000001 0000000000000000 Sep 8 10:18:26 portablebastien kernel: [177000.741653] ffffffff8160b020 0000000000012800 ffff8800cafd1fd8 ffff8800cafd1fd8 Sep 8 10:18:26 portablebastien kernel: [177000.741661] 0000000000012800 ffff880004d76e60 0000000000012800 0000000000012800 Sep 8 10:18:26 portablebastien kernel: [177000.741668] Call Trace: Sep 8 10:18:26 portablebastien kernel: [177000.741686] [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.741692] [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199 Sep 8 10:18:26 portablebastien kernel: [177000.741708] [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.741714] [<ffffffff8103aec8>] ? mmdrop+0xd/0x1c Sep 8 10:18:26 portablebastien kernel: [177000.741719] [<ffffffff8103b0a2>] ? finish_task_switch+0x84/0xaf Sep 8 10:18:26 portablebastien kernel: [177000.741725] [<ffffffff810383fc>] ? need_resched+0x1a/0x23 Sep 8 10:18:26 portablebastien kernel: [177000.741741] [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.741756] [<ffffffffa0290d35>] ? reiserfs_dirty_inode+0x53/0x8f [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.741762] [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24 Sep 8 10:18:26 portablebastien kernel: [177000.741768] [<ffffffff8111846e>] ? __mark_inode_dirty+0x22/0x183 Sep 8 10:18:26 portablebastien kernel: [177000.741775] [<ffffffff8110e2b6>] ? file_update_time+0xea/0x115 Sep 8 10:18:26 portablebastien kernel: [177000.741781] [<ffffffff810b6c69>] ? __generic_file_aio_write+0x160/0x278 Sep 8 10:18:26 portablebastien kernel: [177000.741787] [<ffffffff8106e09f>] ? get_futex_key+0x8d/0x27a Sep 8 10:18:26 portablebastien kernel: [177000.741793] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Sep 8 10:18:26 portablebastien kernel: [177000.741799] [<ffffffff810b6ddb>] ? generic_file_aio_write+0x5a/0xb2 Sep 8 10:18:26 portablebastien kernel: [177000.741804] [<ffffffff810fb7eb>] ? do_sync_write+0xb1/0xea Sep 8 10:18:26 portablebastien kernel: [177000.741812] [<ffffffff811653e9>] ? security_file_permission+0x18/0x33 Sep 8 10:18:26 portablebastien kernel: [177000.741818] [<ffffffff810fbe02>] ? vfs_write+0xa6/0xf9 Sep 8 10:18:26 portablebastien kernel: [177000.741823] [<ffffffff810fbff7>] ? sys_write+0x45/0x6b Sep 8 10:18:26 portablebastien kernel: [177000.741829] [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b Sep 8 10:18:26 portablebastien kernel: [177000.741835] INFO: task firefox-bin:14131 blocked for more than 120 seconds. Sep 8 10:18:26 portablebastien kernel: [177000.741894] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Sep 8 10:18:26 portablebastien kernel: [177000.741958] firefox-bin D ffff8800143e8080 0 14131 31987 0x00000000 Sep 8 10:18:26 portablebastien kernel: [177000.741965] ffff8800143e8080 0000000000000082 0000000000000292 ffffffff00000000 Sep 8 10:18:26 portablebastien kernel: [177000.741972] ffff88011af780c0 0000000000012800 ffff88011949bfd8 ffff88011949bfd8 Sep 8 10:18:26 portablebastien kernel: [177000.741979] 0000000000012800 ffff8800143e8080 0000000000012800 0000000000012800 Sep 8 10:18:26 portablebastien kernel: [177000.741986] Call Trace: Sep 8 10:18:26 portablebastien kernel: [177000.742003] [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.742009] [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199 Sep 8 10:18:26 portablebastien kernel: [177000.742026] [<ffffffffa02a039b>] ? reiserfs_commit_for_inode+0x96/0x1b5 [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.742032] [<ffffffff810383fc>] ? need_resched+0x1a/0x23 Sep 8 10:18:26 portablebastien kernel: [177000.742038] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Sep 8 10:18:26 portablebastien kernel: [177000.742044] [<ffffffff813358d7>] ? _cond_resched+0x9/0x20 Sep 8 10:18:26 portablebastien kernel: [177000.742050] [<ffffffff81335f5c>] ? mutex_lock+0xd/0x2d Sep 8 10:18:26 portablebastien kernel: [177000.742064] [<ffffffffa028ce6b>] ? reiserfs_sync_file+0x42/0x8b [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.742071] [<ffffffff8111bc56>] ? vfs_fsync_range+0x52/0x74 Sep 8 10:18:26 portablebastien kernel: [177000.742077] [<ffffffff8111bd00>] ? do_fsync+0x27/0x3d Sep 8 10:18:26 portablebastien kernel: [177000.742082] [<ffffffff8111bf1c>] ? sys_fsync+0xb/0x12 Sep 8 10:18:26 portablebastien kernel: [177000.742088] [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b Sep 8 10:18:26 portablebastien kernel: [177000.742098] INFO: task sync:14137 blocked for more than 120 seconds. Sep 8 10:18:26 portablebastien kernel: [177000.742151] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Sep 8 10:18:26 portablebastien kernel: [177000.742215] sync D ffff8800bfcf38d0 0 14137 3494 0x00000000 Sep 8 10:18:26 portablebastien kernel: [177000.742222] ffff8800bfcf38d0 0000000000000082 0000000000000000 ffffffff8103b0a2 Sep 8 10:18:26 portablebastien kernel: [177000.742229] ffffffff8160b020 0000000000012800 ffff880067405fd8 ffff880067405fd8 Sep 8 10:18:26 portablebastien kernel: [177000.742237] 0000000000012800 ffff8800bfcf38d0 0000000000012800 0000000000012800 Sep 8 10:18:26 portablebastien kernel: [177000.742244] Call Trace: Sep 8 10:18:26 portablebastien kernel: [177000.742249] [<ffffffff8103b0a2>] ? finish_task_switch+0x84/0xaf Sep 8 10:18:26 portablebastien kernel: [177000.742255] [<ffffffff81071f28>] ? arch_local_irq_save+0x14/0x1d Sep 8 10:18:26 portablebastien kernel: [177000.742272] [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.742278] [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199 Sep 8 10:18:26 portablebastien kernel: [177000.742294] [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.742301] [<ffffffff81023145>] ? _flat_send__mask+0x6a/0x7c Sep 8 10:18:26 portablebastien kernel: [177000.742307] [<ffffffff81336a8d>] ? _raw_spin_lock_irq+0xd/0x1a Sep 8 10:18:26 portablebastien kernel: [177000.742313] [<ffffffff8111bdd5>] ? __sync_filesystem+0x78/0x78 Sep 8 10:18:26 portablebastien kernel: [177000.742328] [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.742344] [<ffffffffa0290c9e>] ? reiserfs_sync_fs+0x1e/0x53 [reiserfs] Sep 8 10:18:26 portablebastien kernel: [177000.742350] [<ffffffff8111bdb8>] ? __sync_filesystem+0x5b/0x78 Sep 8 10:18:26 portablebastien kernel: [177000.742356] [<ffffffff810fe0ac>] ? iterate_supers+0x5e/0xab Sep 8 10:18:26 portablebastien kernel: [177000.742362] [<ffffffff8111bd2f>] ? sync_filesystems+0x19/0x1e Sep 8 10:18:26 portablebastien kernel: [177000.742367] [<ffffffff8111be43>] ? sys_sync+0x12/0x31 Sep 8 10:18:26 portablebastien kernel: [177000.742373] [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b Sep 8 10:20:25 portablebastien kernel: [177120.740213] INFO: task kded4:31863 blocked for more than 120 seconds. Sep 8 10:20:25 portablebastien kernel: [177120.742048] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Sep 8 10:20:25 portablebastien kernel: [177120.743918] kded4 D ffff880119d62830 0 31863 1 0x00000000 Sep 8 10:20:25 portablebastien kernel: [177120.743926] ffff880119d62830 0000000000000082 ffff880000000040 0000000100000000 Sep 8 10:20:25 portablebastien kernel: [177120.743935] ffffffff8160b020 0000000000012800 ffff8800cac65fd8 ffff8800cac65fd8 Sep 8 10:20:25 portablebastien kernel: [177120.743942] 0000000000012800 ffff880119d62830 0000000000012800 0000000000012800 Sep 8 10:20:25 portablebastien kernel: [177120.743952] Call Trace: Sep 8 10:20:25 portablebastien kernel: [177120.743965] [<ffffffff81336090>] ? __mutex_lock_common.clone.5+0x114/0x179 Sep 8 10:20:25 portablebastien kernel: [177120.743972] [<ffffffff81335f69>] ? mutex_lock+0x1a/0x2d Sep 8 10:20:25 portablebastien kernel: [177120.743979] [<ffffffff810b6dbc>] ? generic_file_aio_write+0x3b/0xb2 Sep 8 10:20:25 portablebastien kernel: [177120.743986] [<ffffffff810fb7eb>] ? do_sync_write+0xb1/0xea Sep 8 10:20:25 portablebastien kernel: [177120.743994] [<ffffffff811653e9>] ? security_file_permission+0x18/0x33 Sep 8 10:20:25 portablebastien kernel: [177120.744026] [<ffffffff810fbe02>] ? vfs_write+0xa6/0xf9 Sep 8 10:20:25 portablebastien kernel: [177120.744031] [<ffffffff810fbff7>] ? sys_write+0x45/0x6b Sep 8 10:20:25 portablebastien kernel: [177120.744038] [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b Sep 8 10:20:25 portablebastien kernel: [177120.744062] INFO: task krunner:31987 blocked for more than 120 seconds. Sep 8 10:20:25 portablebastien kernel: [177120.745956] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Sep 8 10:20:25 portablebastien kernel: [177120.747877] krunner D ffff8801192d4300 0 31987 1 0x00000000 Sep 8 10:20:25 portablebastien kernel: [177120.747884] ffff8801192d4300 0000000000000086 ffff880117744148 ffff8801181f2f40 Sep 8 10:20:25 portablebastien kernel: [177120.747891] ffff8800caef0e60 0000000000012800 ffff88001d0ebfd8 ffff88001d0ebfd8 Sep 8 10:20:25 portablebastien kernel: [177120.747898] 0000000000012800 ffff8801192d4300 0000000000012800 0000000000012800 Sep 8 10:20:25 portablebastien kernel: [177120.747906] Call Trace: Sep 8 10:20:25 portablebastien kernel: [177120.747913] [<ffffffff81071f28>] ? arch_local_irq_save+0x14/0x1d Sep 8 10:20:25 portablebastien kernel: [177120.747951] [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs] Sep 8 10:20:25 portablebastien kernel: [177120.747958] [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199 Sep 8 10:20:25 portablebastien kernel: [177120.747975] [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs] Sep 8 10:20:25 portablebastien kernel: [177120.747982] [<ffffffff81098a4a>] ? delayacct_end+0x72/0x7d Sep 8 10:20:25 portablebastien kernel: [177120.747989] [<ffffffff810b5ebc>] ? sleep_on_page+0x10/0x10 Sep 8 10:20:25 portablebastien kernel: [177120.748026] [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs] Sep 8 10:20:25 portablebastien kernel: [177120.748042] [<ffffffffa0290d35>] ? reiserfs_dirty_inode+0x53/0x8f [reiserfs] Sep 8 10:20:25 portablebastien kernel: [177120.748051] [<ffffffff810600ad>] ? autoremove_wake_function+0x2a/0x2a Sep 8 10:20:25 portablebastien kernel: [177120.748059] [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24 Sep 8 10:20:25 portablebastien kernel: [177120.748067] [<ffffffff8111846e>] ? __mark_inode_dirty+0x22/0x183 Sep 8 10:20:25 portablebastien kernel: [177120.748075] [<ffffffff8110e2b6>] ? file_update_time+0xea/0x115 Sep 8 10:20:25 portablebastien kernel: [177120.748083] [<ffffffff810b6c69>] ? __generic_file_aio_write+0x160/0x278 Sep 8 10:20:25 portablebastien kernel: [177120.748092] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Sep 8 10:20:25 portablebastien kernel: [177120.748098] [<ffffffff810b6ddb>] ? generic_file_aio_write+0x5a/0xb2 Sep 8 10:20:25 portablebastien kernel: [177120.748106] [<ffffffff810fb7eb>] ? do_sync_write+0xb1/0xea Sep 8 10:20:25 portablebastien kernel: [177120.748114] [<ffffffff811653e9>] ? security_file_permission+0x18/0x33 Sep 8 10:20:25 portablebastien kernel: [177120.748121] [<ffffffff810fbe02>] ? vfs_write+0xa6/0xf9 Sep 8 10:20:25 portablebastien kernel: [177120.748128] [<ffffffff810fbff7>] ? sys_write+0x45/0x6b Sep 8 10:20:25 portablebastien kernel: [177120.748136] [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b Sep 8 10:20:25 portablebastien kernel: [177120.748161] INFO: task okular:12053 blocked for more than 120 seconds. Sep 8 10:20:25 portablebastien kernel: [177120.750079] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Sep 8 10:20:25 portablebastien kernel: [177120.751982] okular D ffff8800c9c8d060 0 12053 32057 0x00000000 Sep 8 10:20:25 portablebastien kernel: [177120.751989] ffff8800c9c8d060 0000000000000086 ffff8800c9c8d0a8 ffff880000000000 Sep 8 10:20:25 portablebastien kernel: [177120.752022] ffff88011af780c0 0000000000012800 ffff8800ab7dbfd8 ffff8800ab7dbfd8 Sep 8 10:20:25 portablebastien kernel: [177120.752029] 0000000000012800 ffff8800c9c8d060 0000000000012800 0000000000012800 Sep 8 10:20:25 portablebastien kernel: [177120.752039] Call Trace: Sep 8 10:20:25 portablebastien kernel: [177120.752060] [<ffffffffa029b17f>] ? queue_log_writer+0x7e/0xac [reiserfs] Sep 8 10:20:25 portablebastien kernel: [177120.752068] [<ffffffff8103f0a4>] ? try_to_wake_up+0x199/0x199 Sep 8 10:20:25 portablebastien kernel: [177120.752085] [<ffffffffa029fe07>] ? do_journal_begin_r+0x1a1/0x280 [reiserfs] Sep 8 10:20:25 portablebastien kernel: [177120.752103] [<ffffffffa029ffa1>] ? journal_begin+0xbb/0xf7 [reiserfs] Sep 8 10:20:25 portablebastien kernel: [177120.752120] [<ffffffffa0289e1c>] ? reiserfs_truncate_file+0x16f/0x26e [reiserfs] Sep 8 10:20:25 portablebastien kernel: [177120.752127] [<ffffffff8110a7ba>] ? do_sys_poll+0x30d/0x37d Sep 8 10:20:25 portablebastien kernel: [177120.752135] [<ffffffff810383fc>] ? need_resched+0x1a/0x23 Sep 8 10:20:25 portablebastien kernel: [177120.752142] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Sep 8 10:20:25 portablebastien kernel: [177120.752158] [<ffffffffa028cdfa>] ? reiserfs_vfs_truncate_file+0x22/0x30 [reiserfs] Sep 8 10:20:25 portablebastien kernel: [177120.752166] [<ffffffff810bffe8>] ? vmtruncate+0x33/0x3b Sep 8 10:20:25 portablebastien kernel: [177120.752182] [<ffffffffa028cd6a>] ? reiserfs_setattr+0x253/0x2c1 [reiserfs] Sep 8 10:20:25 portablebastien kernel: [177120.752190] [<ffffffff8110ce20>] ? __d_lookup_rcu+0xb6/0xf2 Sep 8 10:20:25 portablebastien kernel: [177120.752197] [<ffffffff8104ad82>] ? current_fs_time+0x1e/0x24 Sep 8 10:20:25 portablebastien kernel: [177120.752203] [<ffffffff8110f9bf>] ? notify_change+0x1a7/0x291 Sep 8 10:20:25 portablebastien kernel: [177120.752210] [<ffffffff8103840a>] ? should_resched+0x5/0x24 Sep 8 10:20:25 portablebastien kernel: [177120.752219] [<ffffffff810fa98d>] ? do_truncate+0x65/0x80 Sep 8 10:20:25 portablebastien kernel: [177120.752226] [<ffffffff810fa637>] ? __dentry_open+0x1a7/0x29c Sep 8 10:20:25 portablebastien kernel: [177120.752234] [<ffffffff81105bb7>] ? do_last+0x4df/0x584 Sep 8 10:20:25 portablebastien kernel: [177120.752241] [<ffffffff81106ece>] ? path_openat+0xc7/0x349 Sep 8 10:20:25 portablebastien kernel: [177120.752249] [<ffffffff810fb8d5>] ? do_sync_read+0xb1/0xea Sep 8 10:20:25 portablebastien kernel: [177120.752256] [<ffffffff8110717c>] ? do_filp_open+0x2c/0x72 Sep 8 10:20:25 portablebastien kernel: [177120.752264] [<ffffffff813358d7>] ? _cond_resched+0x9/0x20 Sep 8 10:20:25 portablebastien kernel: [177120.752272] [<ffffffff811aca91>] ? __strncpy_from_user+0x19/0x4a Sep 8 10:20:25 portablebastien kernel: [177120.752279] [<ffffffff811104ec>] ? alloc_fd+0x69/0x110 Sep 8 10:20:25 portablebastien kernel: [177120.752287] [<ffffffff810fb41c>] ? do_sys_open+0x5f/0xe6 Sep 8 10:20:25 portablebastien kernel: [177120.752295] [<ffffffff8133bd12>] ? system_call_fastpath+0x16/0x1b hi all, I just wonder if there have been any news on this in the meanwhile... ? As far as I'm concerned the problem did not occur anymore after upgrading to openSuSE 12.1 (running kernel 3.1.x series) about half a year ago. I am still using the same reiserfs (3.6) partitions for crypted /home (no acl) as well as for a non-crypted /data (with acl). (in my case it was the non-acl mounted /home that happened to crash sporadically) - Maximilian I do experience the same issue every now and then, with Ubuntu 3.0.0-20 kernel. Will try to upgrade and see how it behaves. Hello, I have the same problem with my linux BackTrack/Ubuntu Full encrypted (/, /home and swap), with kernel 2.6.39.4, 3.2.6 and 3.0.0-23-pae: I have tried to disable swap, but same problem. I have tried to make swap not encrypted, but same problem. I have tried to disable my nvidia card module, but same problem. I have done fsck & badblock & memtest but no problem on disk & ram. I have tried to play with dirty_pages and other sysctl variables but same problem... Please, some news about??? thanks [ 6600.396116] gnome-power-man D 00000000 0 14398 14366 0x00000000 [ 6600.396128] f6c03cac 00200086 f6c03f98 00000000 09895418 00000008 c1148bb0 ffffffff [ 6600.396145] c18acd00 c18acd00 c18acd00 c18acd00 06fdfdab 000005d8 c18acd00 f7be4d00 [ 6600.396162] eed00cc0 f04af2c0 0000032a 00000000 000003fe 00000195 00000000 00000000 [ 6600.396178] Call Trace: [ 6600.396197] [<c1148bb0>] ? poll_freewait+0x80/0x80 [ 6600.396210] [<c100f928>] ? sched_clock+0x8/0x10 [ 6600.396222] [<c102eec8>] ? default_spin_lock_flags+0x8/0x10 [ 6600.396233] [<c155742f>] ? _raw_spin_lock_irqsave+0x2f/0x50 [ 6600.396271] [<c1555855>] schedule+0x35/0x50 [ 6600.396300] [<f86725ef>] queue_log_writer+0x6f/0xa0 [reiserfs] [ 6600.396314] [<c104a110>] ? try_to_wake_up+0x220/0x220 [ 6600.396343] [<f86774d8>] do_journal_begin_r+0x1d8/0x310 [reiserfs] [ 6600.396361] [<c104a0ae>] ? try_to_wake_up+0x1be/0x220 [ 6600.396387] [<f867768f>] journal_begin+0x7f/0x160 [reiserfs] [ 6600.396395] [<c1556249>] ? mutex_lock+0x19/0x40 [ 6600.396420] [<f8665868>] reiserfs_dirty_inode+0x38/0xc0 [reiserfs] [ 6600.396431] [<c103eb2c>] ? __wake_up_sync_key+0x4c/0x60 [ 6600.396442] [<c115a94f>] __mark_inode_dirty+0x2f/0x220 [ 6600.396451] [<c14f375b>] ? unix_stream_sendmsg+0x37b/0x390 [ 6600.396461] [<c114e9e1>] file_update_time+0xc1/0x140 [ 6600.396472] [<c10ec8e9>] __generic_file_aio_write+0x1b9/0x540 [ 6600.396481] [<c103f206>] ? update_cfs_load+0x136/0x300 [ 6600.396490] [<c10442d5>] ? update_curr+0x195/0x2c0 [ 6600.396500] [<c10eccda>] generic_file_aio_write+0x6a/0xd0 [ 6600.396514] [<c11381e4>] do_sync_write+0xa4/0xe0 [ 6600.396527] [<c12658b6>] ? apparmor_file_permission+0x16/0x20 [ 6600.396538] [<c123785e>] ? security_file_permission+0x1e/0xa0 [ 6600.396562] [<f86602f8>] reiserfs_file_write+0x88/0xa0 [reiserfs] [ 6600.396571] [<c1138792>] vfs_write+0xa2/0x170 [ 6600.396594] [<f8660270>] ? reiserfs_file_open+0x90/0x90 [reiserfs] [ 6600.396603] [<c1138932>] sys_write+0x42/0x70 [ 6600.396613] [<c155e49f>] sysenter_do_call+0x12/0x28 [ 6600.396630] INFO: task firefox-bin:16522 blocked for more than 120 seconds. [ 6600.396636] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 6600.396642] firefox-bin D e1b49c44 0 16522 1 0x00000000 [ 6600.396653] e1b49c54 00000086 00000002 e1b49c44 ffffffff 00000002 f7be5824 00000000 [ 6600.396670] c18acd00 c18acd00 c18acd00 c18acd00 00000000 00000000 c18acd00 f7be4d00 [ 6600.396686] ef8072c0 f74c0000 00000000 e1b49d18 f6940600 00000005 00000001 00000001 [ 6600.396702] Call Trace: [ 6600.396715] [<c102eec8>] ? default_spin_lock_flags+0x8/0x10 [ 6600.396724] [<c155742f>] ? _raw_spin_lock_irqsave+0x2f/0x50 [ 6600.396736] [<c1555855>] schedule+0x35/0x50 [ 6600.396761] [<f86725ef>] queue_log_writer+0x6f/0xa0 [reiserfs] [ 6600.396773] [<c104a110>] ? try_to_wake_up+0x220/0x220 [ 6600.396804] [<f86774d8>] do_journal_begin_r+0x1d8/0x310 [reiserfs] [ 6600.396837] [<f865c302>] ? reiserfs_read_locked_inode+0xc2/0x130 [reiserfs] [ 6600.396849] [<c10730ab>] ? hrtimer_forward+0x16b/0x1b0 [ 6600.396874] [<f867768f>] journal_begin+0x7f/0x160 [reiserfs] [ 6600.396883] [<c1556249>] ? mutex_lock+0x19/0x40 [ 6600.396906] [<f865b64d>] reiserfs_truncate_file+0x6d/0x230 [reiserfs] [ 6600.396916] [<c15573fd>] ? _raw_spin_lock+0xd/0x10 [ 6600.396924] [<c114a595>] ? __d_instantiate+0x95/0xd0 [ 6600.396960] [<f865fd4a>] reiserfs_vfs_truncate_file+0x2a/0x40 [reiserfs] [ 6600.396971] [<c10f5c71>] vmtruncate+0x51/0x60 [ 6600.396993] [<f865b007>] reiserfs_setattr+0x317/0x3a0 [reiserfs] [ 6600.397005] [<c117f18f>] ? __dquot_initialize+0x1f/0x140 [ 6600.397014] [<c1150320>] notify_change+0x180/0x2f0 [ 6600.397023] [<c1556249>] ? mutex_lock+0x19/0x40 [ 6600.397032] [<c1136f32>] do_truncate+0x62/0x90 [ 6600.397041] [<c113747a>] ? __dentry_open+0x22a/0x2c0 [ 6600.397067] [<f8679df0>] ? reiserfs_permission+0x50/0x50 [reiserfs] [ 6600.397077] [<c1144387>] do_last+0x557/0x730 [ 6600.397086] [<c1144e48>] path_openat+0x98/0x330 [ 6600.397095] [<c11451c5>] do_filp_open+0x35/0x80 [ 6600.397105] [<c115120d>] ? alloc_fd+0xbd/0xf0 [ 6600.397114] [<c11421ed>] ? getname_flags+0xcd/0x140 [ 6600.397123] [<c1137ace>] do_sys_open+0xee/0x1f0 [ 6600.397132] [<c1110532>] ? do_munmap+0x212/0x2a0 [ 6600.397141] [<c1137c3e>] sys_open+0x2e/0x40 [ 6600.397150] [<c155e49f>] sysenter_do_call+0x12/0x28 [ 6600.397161] [<c1550000>] ? wakeup_secondary_cpu_via_init+0xc3/0x1d9 [ 6720.396220] INFO: task gnome-power-man:14398 blocked for more than 120 seconds. [ 6720.396229] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 6720.396236] gnome-power-man D 00000000 0 14398 14366 0x00000000 [ 6720.396248] f6c03cac 00200086 f6c03f98 00000000 09895418 00000008 c1148bb0 ffffffff [ 6720.396266] c18acd00 c18acd00 c18acd00 c18acd00 06fdfdab 000005d8 c18acd00 f7be4d00 [ 6720.396283] eed00cc0 f04af2c0 0000032a 00000000 000003fe 00000195 00000000 00000000 [ 6720.396298] Call Trace: [ 6720.396317] [<c1148bb0>] ? poll_freewait+0x80/0x80 [ 6720.396330] [<c100f928>] ? sched_clock+0x8/0x10 [ 6720.396342] [<c102eec8>] ? default_spin_lock_flags+0x8/0x10 [ 6720.396353] [<c155742f>] ? _raw_spin_lock_irqsave+0x2f/0x50 [ 6720.396390] [<c1555855>] schedule+0x35/0x50 [ 6720.396418] [<f86725ef>] queue_log_writer+0x6f/0xa0 [reiserfs] [ 6720.396431] [<c104a110>] ? try_to_wake_up+0x220/0x220 [ 6720.396460] [<f86774d8>] do_journal_begin_r+0x1d8/0x310 [reiserfs] [ 6720.396478] [<c104a0ae>] ? try_to_wake_up+0x1be/0x220 [ 6720.396503] [<f867768f>] journal_begin+0x7f/0x160 [reiserfs] [ 6720.396512] [<c1556249>] ? mutex_lock+0x19/0x40 [ 6720.396536] [<f8665868>] reiserfs_dirty_inode+0x38/0xc0 [reiserfs] [ 6720.396546] [<c103eb2c>] ? __wake_up_sync_key+0x4c/0x60 [ 6720.396557] [<c115a94f>] __mark_inode_dirty+0x2f/0x220 [ 6720.396566] [<c14f375b>] ? unix_stream_sendmsg+0x37b/0x390 [ 6720.396576] [<c114e9e1>] file_update_time+0xc1/0x140 [ 6720.396586] [<c10ec8e9>] __generic_file_aio_write+0x1b9/0x540 [ 6720.396595] [<c103f206>] ? update_cfs_load+0x136/0x300 [ 6720.396604] [<c10442d5>] ? update_curr+0x195/0x2c0 [ 6720.396613] [<c10eccda>] generic_file_aio_write+0x6a/0xd0 [ 6720.396627] [<c11381e4>] do_sync_write+0xa4/0xe0 [ 6720.396640] [<c12658b6>] ? apparmor_file_permission+0x16/0x20 [ 6720.396651] [<c123785e>] ? security_file_permission+0x1e/0xa0 [ 6720.396675] [<f86602f8>] reiserfs_file_write+0x88/0xa0 [reiserfs] [ 6720.396685] [<c1138792>] vfs_write+0xa2/0x170 [ 6720.396707] [<f8660270>] ? reiserfs_file_open+0x90/0x90 [reiserfs] [ 6720.396716] [<c1138932>] sys_write+0x42/0x70 [ 6720.396727] [<c155e49f>] sysenter_do_call+0x12/0x28 hi, could you provide some step-by-step instruction on how to reliably reproduce the issue with current kernels ? I guess the main point of this bug being kind of stale is its hard-to-trigger nature. Well, and of course, decreasing developer interest as reiserfs3 is less often used in new installations. But IMHO still a good fs with nice feature set, would love to see it around in a working state again... - Maximilian Created attachment 94271 [details]
dmesg for the oops
Hi:
Unfortunately, I can't explain how to reliably reproduce this problem but this time it happenned quite soon as I upgraded to 3.8.0, exactly debian package linux-image-3.8-trunk-amd64 (3.8-1~experimental.1) The only thing I had to do was hibernate and after I resume the problem was already there.
All partitions, but /boot are crypted. My disk and partition layout is this:
# pvs
PV VG Fmt Attr PSize PFree
/dev/mapper/sda5_crypt portaka lvm2 a-- 186,07g 0
# vgs
VG #PV #LV #SN Attr VSize VFree
portaka 1 5 0 wz--n- 186,07g 0
# lvs
LV VG Attr LSize Pool Origin Data% Move Log Copy% Convert
home portaka -wi-ao-- 170,45g
root portaka -wi-ao-- 1,73g
swap portaka -wc-ao-- 2,00g
usr portaka -wi-ao-- 6,89g
var portaka -wi-ao-- 5,00g
# cat /proc/mounts
rootfs / rootfs rw 0 0
sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
udev /dev devtmpfs rw,relatime,size=10240k,nr_inodes=504930,mode=755 0 0
devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=405388k,mode=755 0 0
/dev/mapper/portaka-root / reiserfs rw,noatime 0 0
tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0
tmpfs /run/shm tmpfs rw,nosuid,nodev,noexec,relatime,size=810760k 0 0
fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0
tmpfs /tmp tmpfs rw,nosuid,nodev,noatime,size=2026936k 0 0
/dev/sda1 /boot ext3 rw,noatime,errors=continue,barrier=1,data=ordered 0 0
/dev/mapper/portaka-home /home reiserfs rw,noatime 0 0
/dev/mapper/portaka-usr /usr reiserfs rw,noatime 0 0
/dev/mapper/portaka-var /var reiserfs rw,noatime 0 0
rpc_pipefs /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0
binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0
I knew I triggered the problem when I tried to issue a "sync" command. But other options may be touching a file in a directory which is in the affected filesystem. I could recover from this situation doing a sysrq-E, which terminates all processes.
I assume the best way to help is giving exact instructions to reproduce the crash but till I could get that information let me know if I can be of help some other way.
This is an excerpt of the dmesg which I'm attaching:
[ 8400.524149] INFO: task flush-254:2:2147 blocked for more than 120 seconds.
[ 8400.524156] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524160] flush-254:2 D ffff88013fd13bc0 0 2147 2 0x00000000
[ 8400.524172] ffff880137dcc760 0000000000000046 ffff880035bb4910 ffff88009c0738a0
[ 8400.524178] 0000000000013bc0 ffff8801384a3fd8 ffff8801384a3fd8 ffff880137dcc760
[ 8400.524183] 0000000000000000 ffff88013fd13bc0 ffff880137dcc760 ffff8801384a3aa0
[ 8400.524188] Call Trace:
[ 8400.524200] [<ffffffff810c21e9>] ? __lock_page+0x66/0x66
[ 8400.524206] [<ffffffff813811d0>] ? io_schedule+0x56/0x6d
[ 8400.524210] [<ffffffff810c21f0>] ? sleep_on_page+0x7/0xc
[ 8400.524215] [<ffffffff81380232>] ? __wait_on_bit_lock+0x3c/0x85
[ 8400.524219] [<ffffffff810c279a>] ? find_get_pages_tag+0xe7/0x121
[ 8400.524223] [<ffffffff810c21e4>] ? __lock_page+0x61/0x66
[ 8400.524229] [<ffffffff81057b85>] ? autoremove_wake_function+0x2a/0x2a
[ 8400.524234] [<ffffffff810ca2be>] ? write_cache_pages+0x166/0x2e2
[ 8400.524239] [<ffffffff810c991b>] ? page_index+0x14/0x14
[ 8400.524244] [<ffffffff810ca472>] ? generic_writepages+0x38/0x54
[ 8400.524250] [<ffffffff81129c55>] ? __writeback_single_inode+0x3e/0x115
[ 8400.524255] [<ffffffff8112a9ac>] ? writeback_sb_inodes+0x1dd/0x30c
[ 8400.524260] [<ffffffff8112ab44>] ? __writeback_inodes_wb+0x69/0xab
[ 8400.524265] [<ffffffff8112acbd>] ? wb_writeback+0x137/0x28c
[ 8400.524269] [<ffffffff810ca71e>] ? bdi_dirty_limit+0x27/0x84
[ 8400.524273] [<ffffffff8112b0f4>] ? wb_do_writeback+0x186/0x1bb
[ 8400.524279] [<ffffffff81049538>] ? del_timer_sync+0x27/0x44
[ 8400.524283] [<ffffffff8112b129>] ? wb_do_writeback+0x1bb/0x1bb
[ 8400.524288] [<ffffffff8112b1d1>] ? bdi_writeback_thread+0xa8/0x1db
[ 8400.524293] [<ffffffff8112b129>] ? wb_do_writeback+0x1bb/0x1bb
[ 8400.524297] [<ffffffff8112b129>] ? wb_do_writeback+0x1bb/0x1bb
[ 8400.524301] [<ffffffff81057280>] ? kthread+0x81/0x89
[ 8400.524306] [<ffffffff8105fbd0>] ? mmdrop+0xd/0x1c
[ 8400.524310] [<ffffffff81061447>] ? finish_task_switch+0x83/0xb3
[ 8400.524315] [<ffffffff810571ff>] ? __kthread_parkme+0x5c/0x5c
[ 8400.524320] [<ffffffff81386cbc>] ? ret_from_fork+0x7c/0xb0
[ 8400.524324] [<ffffffff810571ff>] ? __kthread_parkme+0x5c/0x5c
[ 8400.524354] INFO: task klauncher:3794 blocked for more than 120 seconds.
[ 8400.524357] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524359] klauncher D ffff880139fce7e0 0 3794 3791 0x00000000
[ 8400.524364] ffff880139fce7e0 0000000000000082 0000000000000282 ffff880124ff4080
[ 8400.524369] 0000000000013bc0 ffff880139777fd8 ffff880139777fd8 ffff880139fce7e0
[ 8400.524373] ffffffff81381a6d ffffc900108ae000 ffff880139fce7e0 ffff880138793c00
[ 8400.524378] Call Trace:
[ 8400.524383] [<ffffffff81381a6d>] ? _raw_spin_lock_irqsave+0x14/0x35
[ 8400.524416] [<ffffffffa0242d48>] ? queue_log_writer+0x7d/0xad [reiserfs]
[ 8400.524421] [<ffffffff81064071>] ? try_to_wake_up+0x199/0x199
[ 8400.524433] [<ffffffffa02475e1>] ? do_journal_begin_r+0x177/0x23e [reiserfs]
[ 8400.524438] [<ffffffff81381a6d>] ? _raw_spin_lock_irqsave+0x14/0x35
[ 8400.524443] [<ffffffff811300b2>] ? create_page_buffers+0x42/0x51
[ 8400.524455] [<ffffffffa024775d>] ? journal_begin+0xb5/0xec [reiserfs]
[ 8400.524466] [<ffffffffa0232883>] ? reiserfs_write_end+0x10a/0x22b [reiserfs]
[ 8400.524477] [<ffffffffa0231c5c>] ? reiserfs_write_begin+0xcf/0x176 [reiserfs]
[ 8400.524481] [<ffffffff810c2dbf>] ? generic_file_buffered_write+0x17e/0x235
[ 8400.524488] [<ffffffff810c38c2>] ? __generic_file_aio_write+0x1cc/0x1fc
[ 8400.524493] [<ffffffff8110cc0c>] ? __sb_start_write+0xb6/0xe8
[ 8400.524498] [<ffffffff810613a6>] ? should_resched+0x5/0x23
[ 8400.524502] [<ffffffff810c395b>] ? generic_file_aio_write+0x69/0xc9
[ 8400.524507] [<ffffffff8110adcf>] ? do_sync_write+0x62/0x9b
[ 8400.524512] [<ffffffff8110b376>] ? vfs_write+0x96/0xf8
[ 8400.524517] [<ffffffff8110b59e>] ? sys_write+0x51/0x80
[ 8400.524522] [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.524525] INFO: task kded4:3796 blocked for more than 120 seconds.
[ 8400.524528] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524530] kded4 D ffff88013fd13bc0 0 3796 1 0x00000000
[ 8400.524534] ffff880137aea820 0000000000000082 0200000000020028 ffff88013aeb4180
[ 8400.524539] 0000000000013bc0 ffff880139c8bfd8 ffff880139c8bfd8 ffff880137aea820
[ 8400.524544] 00007fffcfc48d90 ffff8801392d4c60 ffff880137aea820 ffff8801392d4c64
[ 8400.524549] Call Trace:
[ 8400.524554] [<ffffffff813804f5>] ? __mutex_lock_common.isra.6+0x149/0x165
[ 8400.524559] [<ffffffff81380320>] ? mutex_lock+0x1a/0x2d
[ 8400.524563] [<ffffffff810c3947>] ? generic_file_aio_write+0x55/0xc9
[ 8400.524567] [<ffffffff8110adcf>] ? do_sync_write+0x62/0x9b
[ 8400.524572] [<ffffffff8110b376>] ? vfs_write+0x96/0xf8
[ 8400.524577] [<ffffffff8110b59e>] ? sys_write+0x51/0x80
[ 8400.524581] [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.524591] INFO: task plasma-desktop:4165 blocked for more than 120 seconds.
[ 8400.524594] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524596] plasma-desktop D ffff88013fc13bc0 0 4165 1 0x00000000
[ 8400.524600] ffff880138782100 0000000000000086 0200000000020028 ffffffff81614400
[ 8400.524605] 0000000000013bc0 ffff880139d4dfd8 ffff880139d4dfd8 ffff880138782100
[ 8400.524610] 00000000fffffffd ffff8801392d4c60 ffff880138782100 ffff8801392d4c64
[ 8400.524615] Call Trace:
[ 8400.524620] [<ffffffff813804f5>] ? __mutex_lock_common.isra.6+0x149/0x165
[ 8400.524625] [<ffffffff81380320>] ? mutex_lock+0x1a/0x2d
[ 8400.524629] [<ffffffff810c3947>] ? generic_file_aio_write+0x55/0xc9
[ 8400.524633] [<ffffffff8110adcf>] ? do_sync_write+0x62/0x9b
[ 8400.524638] [<ffffffff8110b376>] ? vfs_write+0x96/0xf8
[ 8400.524642] [<ffffffff8110b59e>] ? sys_write+0x51/0x80
[ 8400.524647] [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.524659] INFO: task nepomukservices:4232 blocked for more than 120 seconds.
[ 8400.524661] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524664] nepomukservices D ffff88013fd13bc0 0 4232 4227 0x00000000
[ 8400.524668] ffff880108a92140 0000000000000082 ffff88013abcea00 ffff88013aeb4180
[ 8400.524673] 0000000000013bc0 ffff880104c37fd8 ffff880104c37fd8 ffff880108a92140
[ 8400.524677] ffffffff81381a6d ffffc900108ae000 ffff880108a92140 ffff880138793c00
[ 8400.524682] Call Trace:
[ 8400.524687] [<ffffffff81381a6d>] ? _raw_spin_lock_irqsave+0x14/0x35
[ 8400.524699] [<ffffffffa0242d48>] ? queue_log_writer+0x7d/0xad [reiserfs]
[ 8400.524704] [<ffffffff81064071>] ? try_to_wake_up+0x199/0x199
[ 8400.524716] [<ffffffffa02475e1>] ? do_journal_begin_r+0x177/0x23e [reiserfs]
[ 8400.524728] [<ffffffffa024775d>] ? journal_begin+0xb5/0xec [reiserfs]
[ 8400.524740] [<ffffffffa02313a3>] ? reiserfs_evict_inode+0x9a/0x137 [reiserfs]
[ 8400.524747] [<ffffffff8111d937>] ? evict+0xa3/0x153
[ 8400.524752] [<ffffffff8111aed7>] ? dentry_kill+0x10a/0x12b
[ 8400.524756] [<ffffffff8111b349>] ? dput+0xe6/0xf3
[ 8400.524760] [<ffffffff81112778>] ? path_put+0xd/0x16
[ 8400.524765] [<ffffffff811392e3>] ? fsnotify_put_event+0x23/0x53
[ 8400.524770] [<ffffffff8113b5fd>] ? inotify_read+0x209/0x290
[ 8400.524775] [<ffffffff81057b5b>] ? abort_exclusive_wait+0x79/0x79
[ 8400.524779] [<ffffffff8110b46b>] ? vfs_read+0x93/0xf5
[ 8400.524784] [<ffffffff81118a73>] ? set_restore_sigmask+0x2d/0x2d
[ 8400.524788] [<ffffffff8110b51e>] ? sys_read+0x51/0x80
[ 8400.524793] [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.524800] INFO: task dolphin:4256 blocked for more than 120 seconds.
[ 8400.524803] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524805] dolphin D ffff88013fd13bc0 0 4256 3791 0x00000000
[ 8400.524809] ffff880124ff4080 0000000000000082 020000000002006c ffff88013aeb4180
[ 8400.524814] 0000000000013bc0 ffff880104cddfd8 ffff880104cddfd8 ffff880124ff4080
[ 8400.524819] 0000000000000023 ffff8801392d4c60 ffff880124ff4080 ffff8801392d4c64
[ 8400.524823] Call Trace:
[ 8400.524829] [<ffffffff813804f5>] ? __mutex_lock_common.isra.6+0x149/0x165
[ 8400.524834] [<ffffffff81380320>] ? mutex_lock+0x1a/0x2d
[ 8400.524838] [<ffffffff810c3947>] ? generic_file_aio_write+0x55/0xc9
[ 8400.524842] [<ffffffff8110adcf>] ? do_sync_write+0x62/0x9b
[ 8400.524847] [<ffffffff8110b376>] ? vfs_write+0x96/0xf8
[ 8400.524851] [<ffffffff8110b59e>] ? sys_write+0x51/0x80
[ 8400.524856] [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.524870] INFO: task virtuoso-t:4572 blocked for more than 120 seconds.
[ 8400.524873] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524875] virtuoso-t D ffff88013fd13bc0 0 4572 4232 0x00000000
[ 8400.524879] ffff8800ae54d0c0 0000000000000086 0000000000000000 ffff88013aeb4180
[ 8400.524884] 0000000000013bc0 ffff8800ae6c5fd8 ffff8800ae6c5fd8 ffff8800ae54d0c0
[ 8400.524889] ffffffff81381a6d ffffc900108ae000 ffff8800ae54d0c0 ffff880138793c00
[ 8400.524893] Call Trace:
[ 8400.524898] [<ffffffff81381a6d>] ? _raw_spin_lock_irqsave+0x14/0x35
[ 8400.524910] [<ffffffffa0242d48>] ? queue_log_writer+0x7d/0xad [reiserfs]
[ 8400.524915] [<ffffffff81064071>] ? try_to_wake_up+0x199/0x199
[ 8400.524927] [<ffffffffa02475e1>] ? do_journal_begin_r+0x177/0x23e [reiserfs]
[ 8400.524939] [<ffffffffa024775d>] ? journal_begin+0xb5/0xec [reiserfs]
[ 8400.524949] [<ffffffffa0230120>] ? reiserfs_create+0xcf/0x1eb [reiserfs]
[ 8400.524954] [<ffffffff81114cf7>] ? vfs_create+0x62/0x8b
[ 8400.524958] [<ffffffff811129f3>] ? lookup_dcache+0x22/0x95
[ 8400.524963] [<ffffffff81115c39>] ? do_last+0x591/0xa0f
[ 8400.524968] [<ffffffff81116178>] ? path_openat+0xc1/0x33b
[ 8400.524972] [<ffffffff811166a9>] ? do_filp_open+0x2a/0x6e
[ 8400.524977] [<ffffffff8111fc35>] ? __alloc_fd+0xdc/0xed
[ 8400.524981] [<ffffffff8110aba4>] ? do_sys_open+0x5c/0xe0
[ 8400.524986] [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.524994] INFO: task konqueror:14018 blocked for more than 120 seconds.
[ 8400.524996] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.524999] konqueror D ffff88013fd13bc0 0 14018 3791 0x00000000
[ 8400.525003] ffff8801378aa180 0000000000000086 ffff8800aef4bc58 ffff88013aeb4180
[ 8400.525008] 0000000000013bc0 ffff8800aef4bfd8 ffff8800aef4bfd8 ffff8801378aa180
[ 8400.525012] ffffffff81381a6d ffffc900108ae000 ffff8801378aa180 ffff880138793c00
[ 8400.525017] Call Trace:
[ 8400.525022] [<ffffffff81381a6d>] ? _raw_spin_lock_irqsave+0x14/0x35
[ 8400.525034] [<ffffffffa0242d48>] ? queue_log_writer+0x7d/0xad [reiserfs]
[ 8400.525039] [<ffffffff81064071>] ? try_to_wake_up+0x199/0x199
[ 8400.525051] [<ffffffffa02475e1>] ? do_journal_begin_r+0x177/0x23e [reiserfs]
[ 8400.525055] [<ffffffff81113447>] ? lookup_fast+0x39/0x211
[ 8400.525060] [<ffffffff8114ed87>] ? dquot_active+0x28/0x50
[ 8400.525072] [<ffffffffa024775d>] ? journal_begin+0xb5/0xec [reiserfs]
[ 8400.525082] [<ffffffffa022f26a>] ? reiserfs_unlink+0x7c/0x24c [reiserfs]
[ 8400.525087] [<ffffffff811208b0>] ? mntget+0x17/0x1c
[ 8400.525091] [<ffffffff8111324e>] ? complete_walk+0x89/0xda
[ 8400.525096] [<ffffffff81114424>] ? path_lookupat+0x6a/0x2b1
[ 8400.525100] [<ffffffff810613a6>] ? should_resched+0x5/0x23
[ 8400.525104] [<ffffffff81114e81>] ? vfs_unlink+0x63/0xbc
[ 8400.525109] [<ffffffff81114fbc>] ? do_unlinkat+0xe2/0x18c
[ 8400.525113] [<ffffffff8110edd9>] ? sys_newstat+0x25/0x2d
[ 8400.525118] [<ffffffff81380ef1>] ? __schedule+0x4b2/0x4e0
[ 8400.525123] [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
[ 8400.525131] INFO: task kworker/0:4:17879 blocked for more than 120 seconds.
[ 8400.525133] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.525135] kworker/0:4 D ffff88013fc13bc0 0 17879 2 0x00000000
[ 8400.525140] ffff8800af5fb040 0000000000000046 ffff880139434584 ffff88013692f0c0
[ 8400.525145] 0000000000013bc0 ffff88009c389fd8 ffff88009c389fd8 ffff8800af5fb040
[ 8400.525149] ffffffff81381a6d ffffc900108ae000 ffff8800af5fb040 ffff880138793c00
[ 8400.525154] Call Trace:
[ 8400.525158] [<ffffffff81381a6d>] ? _raw_spin_lock_irqsave+0x14/0x35
[ 8400.525171] [<ffffffffa0242d48>] ? queue_log_writer+0x7d/0xad [reiserfs]
[ 8400.525175] [<ffffffff81064071>] ? try_to_wake_up+0x199/0x199
[ 8400.525187] [<ffffffffa0246a55>] ? do_journal_end.isra.23+0x1ba/0xbcf [reiserfs]
[ 8400.525199] [<ffffffffa0238cd3>] ? reiserfs_sync_fs+0x40/0x5c [reiserfs]
[ 8400.525210] [<ffffffffa0239de0>] ? flush_old_commits+0x1d/0x39 [reiserfs]
[ 8400.525216] [<ffffffff810536ad>] ? process_one_work+0x16d/0x2c5
[ 8400.525220] [<ffffffff813819f8>] ? _raw_spin_lock_irq+0xb/0x15
[ 8400.525232] [<ffffffffa0239dc3>] ? reiserfs_freeze+0xc5/0xc5 [reiserfs]
[ 8400.525237] [<ffffffff8105381d>] ? process_scheduled_works+0x18/0x25
[ 8400.525241] [<ffffffff81053ae2>] ? worker_thread+0x131/0x1b1
[ 8400.525246] [<ffffffff810539b1>] ? rescuer_thread+0x187/0x187
[ 8400.525250] [<ffffffff81057280>] ? kthread+0x81/0x89
[ 8400.525255] [<ffffffff810571ff>] ? __kthread_parkme+0x5c/0x5c
[ 8400.525259] [<ffffffff81386cbc>] ? ret_from_fork+0x7c/0xb0
[ 8400.525264] [<ffffffff810571ff>] ? __kthread_parkme+0x5c/0x5c
[ 8400.525272] INFO: task kscreenlocker:19028 blocked for more than 120 seconds.
[ 8400.525274] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 8400.525277] kscreenlocker D ffff88013fd13bc0 0 19028 4230 0x00000000
[ 8400.525281] ffff88013a3df8a0 0000000000000086 0200000000020028 ffff88013aeb4180
[ 8400.525286] 0000000000013bc0 ffff88012fc8dfd8 ffff88012fc8dfd8 ffff88013a3df8a0
[ 8400.525291] 0000000000000117 ffff8801392d4c60 ffff88013a3df8a0 ffff8801392d4c64
[ 8400.525295] Call Trace:
[ 8400.525301] [<ffffffff813804f5>] ? __mutex_lock_common.isra.6+0x149/0x165
[ 8400.525306] [<ffffffff81380320>] ? mutex_lock+0x1a/0x2d
[ 8400.525310] [<ffffffff810c3947>] ? generic_file_aio_write+0x55/0xc9
[ 8400.525315] [<ffffffff8110adcf>] ? do_sync_write+0x62/0x9b
[ 8400.525320] [<ffffffff8110b376>] ? vfs_write+0x96/0xf8
[ 8400.525324] [<ffffffff810613a6>] ? should_resched+0x5/0x23
[ 8400.525328] [<ffffffff8110b59e>] ? sys_write+0x51/0x80
[ 8400.525332] [<ffffffff81386d69>] ? system_call_fastpath+0x16/0x1b
Hi: I've run into a series of locks of this kind. I can't add much more to what I've already reported. I haven't found a method of reliably reproduce this lock, my impression so far is that this one is related to: a) wake up from suspend to ram (maybe also to disk) and b) certain /corruption/ layout in disk Latest locks happened after I resume from ram. Disk was not much loaded at the lock moment, there was a high user activity though: like running and closing apps, email and an important amount of download threads in the background. I had the lock there. As usual, the cleanest way to get out of this was alt-sysrq-E that terms all processes. Then three finger salute. On a fresh boot, I tried the same usage pattern, soon after I had the lock again. In this case STR or STD (Suspend to Disk) weren't involved. I decided to go into a reiserfsck --rebuild-tree in my home partition. This is a log excerpt: """ Replaying journal: Done. Reiserfs journal '/dev/mapper/portaka-home' in blocks [18..8211]: 0 transactions replayed ########### reiserfsck --rebuild-tree started at Fri May 10 11:04:30 2013 ########### Pass 0: ####### Pass 0 ####### Loading on-disk bitmap .. ok, 43532529 blocks marked used Skipping 9574 blocks (super block, journal, bitmaps) 43522955 blocks will be read 0%...block 6328224: The number of items (34381) is incorrect, should be (1) - corrected block 6328224: The free space (15751) is incorrect, should be (2256) - corrected pass0: vpf-10110: block 6328224, item (0): Unknown item type found [2130706432 1023807744 0x3d970000 ??? (13)] - deleted block 6343857: The number of items (34381) is incorrect, should be (1) - corrected block 6343857: The free space (15751) is incorrect, should be (2256) - corrected pass0: vpf-10110: block 6343857, item (0): Unknown item type found [2130706432 1023807744 0x3d970000 ??? (13)] - deleted .20%...block 15040910: The number of items (34826) is incorrect, should be (1) - corrected block 15040910: The free space (2) is incorrect, should be (4048) - corrected pass0: vpf-10110: block 15040910, item (0): Unknown item type found [3506543104 3523215796 0xa3000784 ??? (15)] - deleted .block 16215906: The number of items (287) is incorrect, should be (1) - corrected block 16215906: The free space (0) is incorrect, should be (4048) - corrected pass0: vpf-10200: block 16215906, item 0: The item [218104576 203714 0x790e01 IND (1)] with wrong offset is deleted block 17156098: The number of items (12648) is incorrect, should be (1) - corrected block 17156098: The free space (0) is incorrect, should be (4048) - corrected 40%block 18917377: The number of items (6) is incorrect, should be (0) - corrected block 18917377: The free space (15481) is incorrect, should be (4072) - corrected block 19611181: The number of items (6) is incorrect, should be (0) - corrected block 19611181: The free space (15481) is incorrect, should be (4072) - corrected .block 20333852: The number of items (15) is incorrect, should be (1) - corrected block 20333852: The free space (0) is incorrect, should be (3792) - corrected pass0: vpf-10210: block 20333852, item 0: The item with wrong offset or length found [4608 16778752 0x63030000 DRCT (2)], len 256 - deleted ..block 25257511: The number of items (287) is incorrect, should be (1) - corrected block 25257511: The free space (29793) is incorrect, should be (4048) - corrected pass0: vpf-10200: block 25257511, item 0: The item [218103998 65810 0x6e0e01 IND (1)] with wrong offset is deleted .60%block 28012850: The number of items (41488) is incorrect, should be (1) - corrected block 28012850: The free space (24) is incorrect, should be (4048) - corrected pass0: vpf-10110: block 28012850, item (0): Unknown item type found [38049792 1032720128 0x10010002 ??? (15)] - deleted .block 30356195: The number of items (282) is incorrect, should be (1) - corrected block 30356195: The free space (0) is incorrect, should be (2256) - corrected pass0: vpf-10110: block 30356195, item (0): Unknown item type found [205917185 285212679 0x1 ??? (15)] - deleted .block 30911284: The number of items (12648) is incorrect, should be (1) - corrected block 30911284: The free space (0) is incorrect, should be (4048) - corrected block 31013511: The number of items (6) is incorrect, should be (0) - corrected block 31013511: The free space (1472) is incorrect, should be (4072) - corrected block 31038991: The number of items (6) is incorrect, should be (0) - corrected block 31038991: The free space (1472) is incorrect, should be (4072) - corrected .block 33620308: The number of items (15) is incorrect, should be (1) - corrected block 33620308: The free space (0) is incorrect, should be (3792) - corrected pass0: vpf-10210: block 33620308, item 0: The item with wrong offset or length found [4608 16778752 0x63030000 DRCT (2)], len 256 - deleted .block 34356027: The number of items (282) is incorrect, should be (1) - corrected block 34356027: The free space (0) is incorrect, should be (2256) - corrected pass0: vpf-10110: block 34356027, item (0): Unknown item type found [205917185 285212679 0x1 ??? (15)] - deleted block 34621658: The number of items (4352) is incorrect, should be (1) - corrected block 34621658: The free space (39937) is incorrect, should be (207) - corrected pass0: vpf-10110: block 34621658, item (0): Unknown item type found [218169345 114 0x1180001 ??? (15)] - deleted """ I wonder if those "Unknown item type found" or several of those poiting to same block, e.g.: 205917185 mean anything or could trigger the unexpected lock. HTH, (In reply to comment #45) > I've run into a series of locks of this kind. I can't add much more to what > I've already reported. I haven't found a method of reliably reproduce this > lock, my impression so far is that this one is related to: > a) wake up from suspend to ram (maybe also to disk) and As for me, I've never used suspend on the PC where the problem is present. > b) certain /corruption/ layout in disk Yep, this is quite interesting, because usual startup file-system check doesn't report anything. Did the problem disappear after the file system had been repaired? However, yet I've bought new hard drive for that PC, and installed new OS and ext4, I still have old hard drive with the vulnerable reiserfs partition. I think it will be useful if I reach it and run --rebuild-tree in order to see my output. I think rebuild-tree is more comprehensive than an usual --check or --fix-fixable and therefore is able to find (and fix) hidden (yet usable) problems. Regarding definte repair, I wouldn't know yet. Lock could trigger after 5' or maybe after months, depeding on my usage pattern. I'll report back if the lock happens or after a reasonable time. Regards, There are few misconceptions here about reiserfsck. 1) --rebuild-tree will not detect more problems than a --check will. It is the biggest, heaviest hammer we have in order to recover a file system and should not be used unless it absolutely must. 2) Only use --fix-fixable if you run into problems on the file system after mounting. The reason is that reiserfsck --check doesn't handle save links, which are placed in the file system when a file is truncated or removed while the file is still open. A file system with unhandled save links will have stat data that doesn't make sense right away and reiserfsck --check will suggest --fix-fixable as a result. I spent some time yesterday looking into how to fix this, but I'm not sure how to handle it gracefully WRT the system/disk/reiserfsck crashing mid-execution since it will essentially be operating directly on the file system without a journal for some fairly involved operations. So, for now, try to mount first. It'll replay the journal and clear the save links out. --- I suspect that the root cause of these hangs is the reiserfs write lock not being dropped completely across schedules the way Frederic expected. I have a patch that makes the distinction between "dropping because we're done using it" and "dropping because we're scheduling" but I need to clean it up. I'll post it here tomorrow or Monday for testing. Created attachment 103031 [details]
[PATCHSET] reiserfs locking fixes
Here's a tarball containing patches and a series file that should fix quota/write lock deadlocks as well as several other potential problem sites.
It's against mainline git @ commit dcdbe33a. Anyone who has experienced this problem should re-test with 3.12-rc1 or later. It has the locking fixes that should address the issue. On Fri, Sep 20, 2013 at 07:23:48PM +0000, bugzilla-daemon@bugzilla.kernel.org wrote: > https://bugzilla.kernel.org/show_bug.cgi?id=29162 > > --- Comment #51 from Jeff Mahoney <jeffm@suse.com> --- > Anyone who has experienced this problem should re-test with 3.12-rc1 or > later. > It has the locking fixes that should address the issue. Thanks a lot for fixing all these, Jeff! I'm uncertain if the problem I'm encountering is the same problem or not, but it appears extremely similar. Forgive me if I'm not contributing properly. I've got a Xen VM that is exhibiting the locking symptoms, but not the corruption symptoms. A reiserfsck only replays journal entries and does not find any corruptions. This is the only VM that does this out of about 14 VMs. I see no error messages in the dom0 dmesg. This is an ArchLinux distro Kernel 3.12.5-1-ARCH. it'll block anything that wants to do IO, the kworker here, and dropbox as well. Eventually it gets to the point that the system wedges and dies. I can Emergency Sync it via xl sysrq, but it won't shut down cleanly. I have to xl destroy it. My other VMs, some with higher IO loads are on 3.11.6-1-ARCH and have no problems. [138600.507760] INFO: task kworker/0:1:3397 blocked for more than 120 seconds. [138600.507775] Not tainted 3.12.5-1-ARCH #1 [138600.507785] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [138600.507800] kworker/0:1 D 0000000000000000 0 3397 2 0x00000000 [138600.507818] Workqueue: events_long flush_old_commits [reiserfs] [138600.507822] ffff88002ea3bc78 0000000000000246 00000000000144c0 ffff88002ea3bfd8 [138600.507830] ffff88002ea3bfd8 00000000000144c0 ffff88003b85a2c0 0000000000000000 [138600.507837] 0000000000000000 0000000000000000 0000000000000000 0000000000000000 [138600.507843] Call Trace: [138600.507854] [<ffffffff814f2109>] ? __mutex_unlock_slowpath+0xa9/0x170 [138600.507861] [<ffffffff814f3a69>] schedule+0x29/0x70 [138600.507875] [<ffffffffa004d5e5>] queue_log_writer+0x85/0xc0 [reiserfs] [138600.507883] [<ffffffff810952a0>] ? wake_up_process+0x40/0x40 [138600.507897] [<ffffffffa005243c>] do_journal_end.isra.21+0x1cc/0xe60 [reiserfs] [138600.507911] [<ffffffffa0053244>] ? do_journal_begin_r+0x174/0x410 [reiserfs] [138600.507925] [<ffffffffa0053b59>] journal_end_sync+0x69/0x80 [reiserfs] [138600.507939] [<ffffffffa003f071>] reiserfs_sync_fs+0x61/0x80 [reiserfs] [138600.507953] [<ffffffffa003f0da>] flush_old_commits+0x4a/0x60 [reiserfs] [138600.507961] [<ffffffff8107dbc7>] process_one_work+0x167/0x450 [138600.507969] [<ffffffff8107e5d1>] worker_thread+0x121/0x3a0 [138600.507977] [<ffffffff8107e4b0>] ? manage_workers.isra.23+0x2b0/0x2b0 [138600.507986] [<ffffffff81084fe0>] kthread+0xc0/0xd0 [138600.507995] [<ffffffff814f0000>] ? inet6_set_link_af.part.39+0x3/0xb [138600.508004] [<ffffffff81084f20>] ? kthread_create_on_node+0x120/0x120 [138600.508010] [<ffffffff814fcf3c>] ret_from_fork+0x7c/0xb0 [138600.508019] [<ffffffff81084f20>] ? kthread_create_on_node+0x120/0x120 (In reply to David Kowis from comment #53) > I'm uncertain if the problem I'm encountering is the same problem or not, > but it appears extremely similar. Forgive me if I'm not contributing > properly. Forgive me, I'm not using any quotas at least I don't have quotas enabled for mounting: $ mount /dev/xvda1 on / type reiserfs (rw,relatime) $ dmesg | grep quota [ 0.378754] VFS: Disk quotas dquot_6.5.2 That does show up, but I believe that's simply because it's builtin. I am also seeing what I believe to be an identical issue ( although it may not be ). In an attempt to make it reproducible I have written a C++ program to abuse a filesystem. I have been able to make the filesystem lock up after running the program for a few hours. I should be able to reproduce this fairly consistently so if there is some kind of information that will help in the troubleshooting process for other please let me know and I can try to get it for you. I am attaching my test program. The partition that is hanging is a PCI based SSD, but I have also seen this problem on a RAID array on Spinning circular media and on a VM mounted on a SAN. I have testing this with Kernel 3.2.28 and 3.12.2. I am currently compiling 3.12.5 and the tip of 3.12.y Created attachment 119181 [details]
Program to deadlock reiserfs
Compiled with gcc 4.7.1, glibc 2.15
g++ torture.cpp -o torture -lpthread -lrt -std=c++11 -O2
Created attachment 121041 [details]
dmesg for the oops (3.12.6)
I got this same hang on my laptop running Debian sid 3.12.6. Provided how unrepeatable this bug is I can't tell if this is happenning more or less often than before Jeff's changes.
I have run the proposed torture tests (thanks D.K.), but I think short shoots are not enough. I'll try overnight when I'm able to.
Regards,
I just pulled git from torvalds tree and the changes listed by Jeff Mahoney are not in there. Also the patches do not apply cleanly. (In reply to D.K. from comment #58) > I just pulled git from torvalds tree and the changes listed by Jeff Mahoney > are not in there. Also the patches do not apply cleanly. Yeah they are: d2d0395fd1778d4bf714adc5bfd23a5d748d7802 reiserfs: locking, release lock around quota operations 278f6679f454bf185a07d9a4ca355b153482d17a reiserfs: locking, handle nested locks properly 4c05141df57f4ffc1a9a28f1925434924179bfe4 reiserfs: locking, push write lock out of xattr code a1457c0ce976bad1356b9b0437f2a5c3ab8a9cfc reiserfs: fix deadlock with nfs racing on create/lookup (In reply to Raúl from comment #57) > Created attachment 121041 [details] > dmesg for the oops (3.12.6) > > I got this same hang on my laptop running Debian sid 3.12.6. Provided how > unrepeatable this bug is I can't tell if this is happenning more or less > often than before Jeff's changes. > > I have run the proposed torture tests (thanks D.K.), but I think short > shoots are not enough. I'll try overnight when I'm able to. Thanks. The trace shows that we: 1) Have threads queued up on i_mutex 2) Have threads queued up on queue_log_writer holding i_mutex 3) Have a thread queued up on queue_log_writer holding i_mutex and the page lock 4) Have a thread queued up on the page lock Now to figure out what is causing the queue_log_writer condition to not continue. So I see the changes in the kernel tree are slightly different from the ones in the patch. I imagine that was the result of review and testing so adding them back in won't change too much. Turning off the journal ( via nolog ) does not appear to alter this behavior, and I have not been able to get this to be reproduced when turning on LOCKDEP. Attached are two logs one is the output from LOCKDEP showing all locks held on a system. The second is the log showing all running tasks on the system when it locked up. Created attachment 124491 [details]
Output of LOCKDEP on a locked system
Created attachment 124511 [details]
All Blocked processes when system locked up
Hi, After some research there is a scenario which triggered my suspicion (ref http://lxr.free-electrons.com/source/fs/reiserfs/journal.c?v=3.3): 1) several threads call `queue_log_writer` and are put to sleep 2) J_WRITERS_QUEUED bit is set 3) `check_journal_end` returns nonzero value and the `do_journal_end` continues it's execution 4) at line 4252 it clears the bit and wakes 1 thread 5) no other thread enters `queue_log_writer` due to some unknown reason and the bit is not set again 5) the awaken thread ends up with `if (!check_journal_end(th, sb, nblocks, flags)` returning 0 which triggers the awakening of another thread 6) No one will be awaken since there is no bit set on `if (test_and_clear_bit(J_WRITERS_QUEUED, &journal->j_state))`, except when the execution reaches line 4253 One ugly workaround for testing purposes at line 4253: 4253 wake_up(&(journal->j_join_wait)); replaced with 4253 wake_up_all(&(journal->j_join_wait)); There must be a reason for this to happen on high loads only so any help and/or suggestions is more that welcome ! |