Created attachment 181891 [details] kernel config I have some PPPoE BRAS servers witn linux-3.14 kernel, and noticed random crashes (BRAS uptime from some days to some weeks). BRAS remains accessible by ssh, but any shell command that interacts with network subsystem (for ex., obtaining list of interfaces, or removing shaper rules) will hang till it killed from other ssh session. I have crashes on 2 BRAS, with 3.14.42 and 3.14.44 kernels, with igb-5.2.5 and igb 5.2.18. There's HTB shaper on PPP ingress, and IFB egress redirect. Almost same BRAS with same shaper works pretty stable on 3.2.28 (uptime is ~2 years). I'll try to rollback to 3.10 kernel - possibly bug isn't present on it. Here's bug message: [639661.740225] BUG: unable to handle kernel paging request at 05040214 [639661.740235] IP: [<c115c121>] unregister_sysctl_table+0x11/0x70 [639661.740243] *pdpt = 00000000350e0001 *pde = 0000000000000000 [639661.740248] Oops: 0000 [#1] SMP [639661.740251] Modules linked in: act_mirred pppoe pppox ppp_generic slhc iptable_filter xt_length xt_TCPMSS xt_tcpudp xt_mark xt_dscp iptable_mangle ip_tables x_tables ipv6 sch_sfq sch_htb cls_u32 sch_ingress sch_prio sch_tbf cls_flow cls_fw act_police ifb 8021q mrp garp stp llc softdog acpi_cpufreq processor thermal fan thermal_sys asus_atk0110 parport_pc parport igb(O) k10temp hwmon dca ptp pps_core i2c_nforce2 i2c_core ohci_pci ohci_hcd nv_tco sd_mod crc_t10dif crct10dif_common pata_acpi pcspkr pata_amd sata_nv ehci_pci ehci_hcd ata_generic libata usbcore scsi_mod usb_common ext4 mbcache jbd2 crc16 vfat fat isofs [639661.740318] CPU: 1 PID: 10673 Comm: accel-pppd Tainted: G O 3.14.44-i686 #1 [639661.740322] Hardware name: System manufacturer System Product Name/M2N-SLI DELUXE, BIOS ASUS M2N-SLI DELUXE ACPI BIOS Revision 5001 02/04/2010 [639661.740327] task: f53238e0 ti: e1f86000 task.ti: e1f86000 [639661.740331] EIP: 0060:[<c115c121>] EFLAGS: 00210206 CPU: 1 [639661.740334] EIP is at unregister_sysctl_table+0x11/0x70 [639661.740337] EAX: 05040200 EBX: 05040200 ECX: 8010000a EDX: 8010000b [639661.740340] ESI: e0faf80c EDI: e0faf800 EBP: e1f87e58 ESP: e1f87e4c [639661.740343] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 [639661.740346] CR0: 8005003b CR2: 05040214 CR3: 3469f000 CR4: 000007f0 [639661.740349] Stack: [639661.740351] d3fc8c00 e0faf80c e0faf800 e1f87e64 c12ab02e d3ef0800 e1f87eac c12fff3b [639661.740357] c10818b0 e1f87ea8 c1099fe0 e1f87e80 00000000 00000000 00000001 00000000 [639661.740363] d3ef0800 c12ba78d e1f87e94 e1f87e94 00000000 c1494c98 c1494ee4 00000000 [639661.740369] Call Trace: [639661.740375] [<c12ab02e>] ? neigh_sysctl_unregister+0x1e/0x30 [639661.740380] [<c12fff3b>] ? inetdev_event+0x17b/0x490 [639661.740386] [<c10818b0>] ? dyntick_save_progress_counter+0x20/0x20 [639661.740390] [<c1099fe0>] ? __stop_cpus+0x40/0x60 [639661.740395] [<c12ba78d>] ? fib_rules_event+0x1d/0x190 [639661.740399] [<c105fb61>] ? notifier_call_chain+0x41/0x60 [639661.740403] [<c105fc9f>] ? raw_notifier_call_chain+0x1f/0x30 [639661.740408] [<c12a11ae>] ? rollback_registered_many+0x12e/0x240 [639661.740412] [<c12a12e4>] ? rollback_registered+0x24/0x40 [639661.740415] [<c12a2a4f>] ? unregister_netdevice_queue+0x4f/0xb0 [639661.740419] [<c12a2ac9>] ? unregister_netdev+0x19/0x20 [639661.740424] [<f8e3a5ab>] ? ppp_shutdown_interface+0xdb/0xf0 [ppp_generic] [639661.740428] [<f8e3bf04>] ? ppp_release+0x54/0x70 [ppp_generic] [639661.740433] [<c110c7a7>] ? __fput+0x87/0x1e0 [639661.740437] [<c10593e9>] ? task_work_run+0x79/0xb0 [639661.740442] [<c133e5c5>] ? work_notifysig+0x16/0x1d [639661.740444] Code: 96 04 1e 00 b8 ec 97 57 c1 e8 ec 1f 1e 00 eb a6 8d 76 00 8d bc 27 00 00 00 00 55 89 e5 57 56 53 3e 8d 74 26 00 85 c0 89 c3 74 25 <8b> 40 14 e8 47 f8 ff ff 83 f8 01 7f 1d b8 ec 97 57 c1 e8 b8 1f [639661.740469] EIP: [<c115c121>] unregister_sysctl_table+0x11/0x70 SS:ESP 0068:e1f87e4c [639661.740474] CR2: 0000000005040214 [639661.740530] ---[ end trace 6c00a3dbe41f0937 ]--- What additional info is needed? Kernel config is attched. Also I can send unstripped vmlinux or modules is this helps in some way.
Switched to 4.1.2 kernel, after some uptime (>1month on one BRAS, 2 weeks on other) - bug appears again: [1999656.852859] BUG: unable to handle kernel paging request at 05040214 [1999656.852941] IP: [<c11707d1>] unregister_sysctl_table+0x11/0x70 [1999656.852989] *pdpt = 0000000034984001 *pde = 0000000000000000 [1999656.853033] Oops: 0000 [#1] SMP [1999656.853072] Modules linked in: act_mirred pppoe pppox ppp_generic slhc iptable_filter xt_length xt_TCPMSS xt_tcpudp xt_mark xt_dscp iptable_mangle ip_tables x_tables ipv6 sch_sfq sch_htb cls_u32 sch_ingress sch_prio sch_tbf cls_flow cls_fw act_police ifb 8021q mrp garp stp llc softdog thermal parport_pc parport fan iTCO_wdt iTCO_vendor_support processor thermal_sys i2c_i801 i2c_core lpc_ich igb(O) hwmon dca ptp pps_core sd_mod usb_storage pata_acpi pcspkr ata_piix ata_generic libata ehci_pci ehci_hcd usbcore scsi_mod usb_common ext4 mbcache jbd2 crc16 vfat fat isofs [1999656.853462] CPU: 1 PID: 11422 Comm: accel-pppd Tainted: G O 4.1.2-i686 #1 [1999656.853539] Hardware name: MSI MS-7788/H61M-P20 (G3) (MS-7788), BIOS V1.6 04/17/2012 [1999656.853616] task: f4d4a910 ti: d50f8000 task.ti: d50f8000 [1999656.853658] EIP: 0060:[<c11707d1>] EFLAGS: 00210206 CPU: 1 [1999656.853701] EIP is at unregister_sysctl_table+0x11/0x70 [1999656.853742] EAX: 05040200 EBX: 05040200 ECX: 0010000b EDX: 0010000c [1999656.853785] ESI: de2d000c EDI: de2d0000 EBP: d50f9e58 ESP: d50f9e4c [1999656.853827] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 [1999656.853868] CR0: 80050033 CR2: 05040214 CR3: 1779b6a0 CR4: 000407f0 [1999656.853911] Stack: [1999656.853946] d58db400 de2d000c de2d0000 d50f9e64 c12db8fe d5732800 d50f9eac c13356db [1999656.854027] d50f9ea4 c10a5450 d50f9e7c 00000000 00000000 00000001 00000000 00000000 [1999656.854109] d5732800 c12ec52d d50f9e90 0000fe96 d50f9ec8 c14ddeb8 c14de124 00000000 [1999656.854191] Call Trace: [1999656.854232] [<c12db8fe>] ? neigh_sysctl_unregister+0x1e/0x30 [1999656.854275] [<c13356db>] ? inetdev_event+0x17b/0x4b0 [1999656.854317] [<c10a5450>] ? __stop_cpus+0x40/0x60 [1999656.854358] [<c12ec52d>] ? fib_rules_event+0x1d/0x190 [1999656.854402] [<c105f286>] ? notifier_call_chain+0x46/0x60 [1999656.854444] [<c105f3bf>] ? raw_notifier_call_chain+0x1f/0x30 [1999656.854487] [<c12d151e>] ? rollback_registered_many+0x12e/0x260 [1999656.854530] [<c12d1674>] ? rollback_registered+0x24/0x40 [1999656.854571] [<c12d27bf>] ? unregister_netdevice_queue+0x4f/0xb0 [1999656.854614] [<c12d2839>] ? unregister_netdev+0x19/0x20 [1999656.854658] [<f932859b>] ? ppp_shutdown_interface+0xcb/0xe0 [ppp_generic] [1999656.854703] [<f9329f8f>] ? ppp_release+0x5f/0x70 [ppp_generic] [1999656.854747] [<f9329f84>] ? ppp_release+0x54/0x70 [ppp_generic] [1999656.854790] [<c11226f7>] ? __fput+0x87/0x1a0 [1999656.854833] [<c105d189>] ? task_work_run+0x99/0xd0 [1999656.854876] [<c13746d5>] ? work_notifysig+0x16/0x1d [1999656.854917] [<c1370000>] ? __slab_free+0x23d/0x28c [1999656.854958] Code: a6 1c 20 00 b8 90 bf 5a c1 e8 7c 38 20 00 eb a6 8d 76 00 8d bc 27 00 00 00 00 55 89 e5 57 56 53 66 66 66 66 90 85 c0 89 c3 74 25 <8b> 40 14 e8 47 f8 ff ff 83 f8 01 7f 1d b8 90 bf 5a c1 e8 48 38 [1999656.855129] EIP: [<c11707d1>] unregister_sysctl_table+0x11/0x70 SS:ESP 0068:d50f9e4c [1999656.855207] CR2: 0000000005040214 [1999656.855466] ---[ end trace 9a3ff6f87bc3819d ]--- I suspect that shaper de-configuring on interface when it goes down causes race condition that causes this bug. I'll try to remove ip-down shaper shutdown.
And some more backtraces (after first - server works ok, and after last - net subsystem hungs): [279091.753975] BUG: unable to handle kernel NULL pointer dereference at 00000280 [279091.754072] IP: [<f9a423ee>] pppoe_release+0x11e/0x150 [pppoe] [279091.754128] *pdpt = 00000000345a6001 *pde = 0000000000000000 [279091.754178] Oops: 0000 [#1] SMP [279091.754223] Modules linked in: act_mirred pppoe pppox ppp_generic slhc iptable_filter xt_length xt_TCPMSS xt_tcpudp xt_mark xt_dscp iptable_mangle ip_tables x_tables ipv6 sch_sfq sch_htb cls_u32 sch_ingress sch_prio sch_tbf cls_flow cls_fw act_police ifb 8021q mrp garp stp llc softdog parport_pc parport acpi_cpufreq processor thermal_sys k10temp igb(O) i2c_piix4 i2c_core ohci_pci ohci_hcd sp5100_tco hwmon dca ptp pps_core sd_mod pata_acpi pcspkr pata_atiixp ahci libahci ata_generic libata ehci_pci ehci_hcd usbcore scsi_mod usb_common ext4 mbcache jbd2 crc16 vfat fat isofs [279091.754700] CPU: 0 PID: 2869 Comm: accel-pppd Tainted: G O 4.1.2-i686 #1 [279091.754785] Hardware name: MICRO-STAR INTERNATIONAL CO.,LTD MS-7596/760GM-E51(MS-7596), BIOS V3.3 01/12/2012 [279091.754871] task: f4985b40 ti: dcaa4000 task.ti: dcaa4000 [279091.754917] EIP: 0060:[<f9a423ee>] EFLAGS: 00210202 CPU: 0 [279091.754965] EIP is at pppoe_release+0x11e/0x150 [pppoe] [279091.755010] EAX: 00000000 EBX: d4e59000 ECX: 0000000d EDX: fffffe01 [279091.755056] ESI: f1e86a80 EDI: f1e86a9c EBP: dcaa5f4c ESP: dcaa5f30 [279091.755102] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 [279091.755147] CR0: 8005003b CR2: 00000280 CR3: 34bc8e60 CR4: 000007f0 [279091.755192] Stack: [279091.755233] d5e80480 00000008 f1e86a9c dcaa5f60 f1e86a80 f9a42b20 f1e86a9c dcaa5f64 [279091.755349] c12bbbbc f52e3190 00000000 d5e80000 00000008 dcaa5f6c c12bbc30 dcaa5f98 [279091.755443] c11226f7 00000001 00000000 00000000 d5e80008 f1f43600 f52e3190 f4985f00 [279091.755537] Call Trace: [279091.755587] [<c12bbbbc>] ? sock_release+0x1c/0x80 [279091.755634] [<c12bbc30>] ? sock_close+0x10/0x20 [279091.755682] [<c11226f7>] ? __fput+0x87/0x1a0 [279091.755731] [<c105d189>] ? task_work_run+0x99/0xd0 [279091.755778] [<c13746d5>] ? work_notifysig+0x16/0x1d [279091.755822] Code: 83 c4 10 31 c0 5b 5e 5f 5d c3 8d 76 00 89 d8 e8 c9 db 87 c7 31 c0 83 c4 10 5b 5e 5f 5d c3 8d b4 26 00 00 00 00 8b 83 f8 01 00 00 <8b> 80 80 02 00 00 64 ff 08 c7 83 f8 01 00 00 00 00 00 00 e9 08 [279091.756088] EIP: [<f9a423ee>] pppoe_release+0x11e/0x150 [pppoe] SS:ESP 0068:dcaa5f30 [279091.756175] CR2: 0000000000000280 [279091.756869] ---[ end trace b2923f6d704d29b8 ]--- [1213682.490566] BUG: unable to handle kernel paging request at 05040279 [1213682.490609] IP: [<c1340713>] leaf_walk_rcu+0xc3/0x100 [1213682.490650] *pdpt = 0000000029eee001 *pde = 0000000000000000 [1213682.490686] Oops: 0000 [#2] SMP [1213682.490722] Modules linked in: act_mirred pppoe pppox ppp_generic slhc iptable_filter xt_length xt_TCPMSS xt_tcpudp xt_mark xt_dscp iptable_mangle ip_tables x_tables ipv6 sch_sfq sch_htb cls_u32 sch_ingress sch_prio sch_tbf cls_flow cls_fw act_police ifb 8021q mrp garp stp llc softdog parport_pc parport acpi_cpufreq processor thermal_sys k10temp igb(O) i2c_piix4 i2c_core ohci_pci ohci_hcd sp5100_tco hwmon dca ptp pps_core sd_mod pata_acpi pcspkr pata_atiixp ahci libahci ata_generic libata ehci_pci ehci_hcd usbcore scsi_mod usb_common ext4 mbcache jbd2 crc16 vfat fat isofs [1213682.491057] CPU: 0 PID: 10870 Comm: bird Tainted: G D O 4.1.2-i686 #1 [1213682.491124] Hardware name: MICRO-STAR INTERNATIONAL CO.,LTD MS-7596/760GM-E51(MS-7596), BIOS V3.3 01/12/2012 [1213682.491192] task: f53ac470 ti: e3c48000 task.ti: e3c48000 [1213682.491227] EIP: 0060:[<c1340713>] EFLAGS: 00010206 CPU: 0 [1213682.491263] EIP is at leaf_walk_rcu+0xc3/0x100 [1213682.491297] EAX: 00000007 EBX: d60fa594 ECX: 05040274 EDX: 00000001 [1213682.491332] ESI: 00000004 EDI: 00000003 EBP: e3c49d04 ESP: e3c49cf4 [1213682.491366] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 [1213682.491401] CR0: 8005003b CR2: 05040279 CR3: 340ca1e0 CR4: 000007f0 [1213682.491435] Stack: [1213682.491541] 00000001 003a1cc2 00000018 00000000 d6045680 00000002 0005bed1 c21c3a01 [1213682.491613] 003a1cc2 e009a780 ffffefff 00137043 d8cac1f4 f304ba0c f3ed5500 c21c3a00 [1213682.491686] Call Trace: [1213682.491722] [<c1342bdb>] ? fib_table_dump+0x3b/0x180 [1213682.491758] [<c133cdad>] ? inet_dump_fib+0x7d/0x100 [1213682.491794] [<c12f8746>] ? netlink_dump+0xb6/0x260 [1213682.491828] [<c12f8b04>] ? netlink_recvmsg+0x214/0x300 [1213682.491865] [<c12bab79>] ? sock_recvmsg+0x19/0x20 [1213682.491900] [<c12bab60>] ? sock_recvmsg_nosec+0x20/0x20 [1213682.491935] [<c12bc50d>] ? ___sys_recvmsg+0x9d/0x130 [1213682.491972] [<c106c4c8>] ? update_curr+0x88/0x160 [1213682.492007] [<c106c10c>] ? update_cfs_rq_blocked_load+0xbc/0x120 [1213682.492044] [<c108a89b>] ? hrtimer_forward+0xab/0x1a0 [1213682.492079] [<c12bb6e4>] ? sockfd_lookup_light+0x14/0x70 [1213682.492114] [<c12bd3d8>] ? __sys_recvmsg+0x38/0x70 [1213682.492149] [<c12bd771>] ? SyS_socketcall+0xb1/0x2a0 [1213682.492184] [<c107d333>] ? handle_irq_event+0x33/0x50 [1213682.492220] [<c1375768>] ? smp_apic_timer_interrupt+0x38/0x50 [1213682.492256] [<c137463e>] ? syscall_call+0x7/0x7 [1213682.492289] Code: cf 89 c1 d3 ef 83 c7 01 3c 1f 76 d8 8d 74 26 00 8b 45 f0 89 18 83 c4 04 31 c0 5b 5e 5f 5d c3 90 8b 4c bb 08 83 c7 01 85 c9 74 b5 <80> 79 05 00 74 13 0f b6 41 04 89 cb 31 ff eb a5 90 8d 74 26 00 [1213682.492458] EIP: [<c1340713>] leaf_walk_rcu+0xc3/0x100 SS:ESP 0068:e3c49cf4 [1213682.492495] CR2: 0000000005040279 [1213682.492940] ---[ end trace b2923f6d704d29b9 ]--- [1213682.515744] ------------[ cut here ]------------ [1213682.515812] WARNING: CPU: 0 PID: 0 at /var/testpoint/LEAF-new/source/i486-unknown-linux-uclibc/linux/linux-4.1/net/netlink/af_netlink.c:913 netlink_sock_destruct+0xa8/0xc0() [1213682.515938] Modules linked in: act_mirred pppoe pppox ppp_generic slhc iptable_filter xt_length xt_TCPMSS xt_tcpudp xt_mark xt_dscp iptable_mangle ip_tables x_tables ipv6 sch_sfq sch_htb cls_u32 sch_ingress sch_prio sch_tbf cls_flow cls_fw act_police ifb 8021q mrp garp stp llc softdog parport_pc parport acpi_cpufreq processor thermal_sys k10temp igb(O) i2c_piix4 i2c_core ohci_pci ohci_hcd sp5100_tco hwmon dca ptp pps_core sd_mod pata_acpi pcspkr pata_atiixp ahci libahci ata_generic libata ehci_pci ehci_hcd usbcore scsi_mod usb_common ext4 mbcache jbd2 crc16 vfat fat isofs [1213682.519004] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D O 4.1.2-i686 #1 [1213682.519096] Hardware name: MICRO-STAR INTERNATIONAL CO.,LTD MS-7596/760GM-E51(MS-7596), BIOS V3.3 01/12/2012 [1213682.519189] c1469780 f5021f40 c137049d 00000000 c104675d c142ecdc 00000000 00000000 [1213682.519496] c1469780 00000391 c12f8608 00000009 c12f8608 f304b800 0000000a 0000000a [1213682.519807] f5021f50 c1046832 00000009 00000000 f5021f64 c12f8608 c1085a47 c1085a47 [1213682.520114] Call Trace: [1213682.520176] [<c137049d>] ? dump_stack+0x3e/0x4e [1213682.520238] [<c104675d>] ? warn_slowpath_common+0x8d/0xc0 [1213682.520299] [<c12f8608>] ? netlink_sock_destruct+0xa8/0xc0 [1213682.520360] [<c12f8608>] ? netlink_sock_destruct+0xa8/0xc0 [1213682.520422] [<c1046832>] ? warn_slowpath_null+0x22/0x30 [1213682.520483] [<c12f8608>] ? netlink_sock_destruct+0xa8/0xc0 [1213682.520544] [<c1085a47>] ? rcu_process_callbacks+0x1b7/0x4c0 [1213682.520605] [<c1085a47>] ? rcu_process_callbacks+0x1b7/0x4c0 [1213682.520666] [<c12bfed8>] ? __sk_free+0x18/0xe0 [1213682.520727] [<c1085a86>] ? rcu_process_callbacks+0x1f6/0x4c0 [1213682.520790] [<c104961b>] ? __do_softirq+0xbb/0x220 [1213682.520851] [<c137555c>] ? nmi_stack_correct+0x28/0x2d [1213682.520912] [<c1049560>] ? __tasklet_hrtimer_trampoline+0x40/0x40 [1213682.520974] [<c1049560>] ? __tasklet_hrtimer_trampoline+0x40/0x40 [1213682.521036] [<c1004462>] ? do_softirq_own_stack+0x22/0x30 [1213682.521097] <IRQ> [<c104993e>] ? irq_exit+0x6e/0x90 [1213682.521187] [<c1375768>] ? smp_apic_timer_interrupt+0x38/0x50 [1213682.521248] [<c1375059>] ? apic_timer_interrupt+0x2d/0x34 [1213682.521310] [<c100b179>] ? default_idle+0x19/0xa0 [1213682.521371] [<c100b9ae>] ? arch_cpu_idle+0xe/0x10 [1213682.521433] [<c1076615>] ? cpu_startup_entry+0x1f5/0x2f0 [1213682.521494] [<c14edba4>] ? start_kernel+0x3fe/0x403 [1213682.521555] [<c14ed5da>] ? set_init_arg+0x45/0x45 [1213682.521615] ---[ end trace b2923f6d704d29ba ]---
Hm, again crash, slightly different: [1746376.217573] BUG: unable to handle kernel paging request at 0504028c [1746376.217616] IP: [<c1174408>] __kernfs_remove+0x38/0x1a0 [1746376.217656] *pdpt = 00000000333bc001 *pde = 0000000000000000 [1746376.217694] Oops: 0000 [#3] SMP [1746376.217730] Modules linked in: act_mirred pppoe pppox ppp_generic slhc iptable_filter xt_length xt_TCPMSS xt_tcpudp xt_mark xt_dscp iptable_mangle ip_tables x_tables ipv6 sch_sfq sch_htb cls_u32 sch_ingress sch_prio sch_tbf cls_flow cls_fw act_police ifb 8021q mrp garp stp llc softdog parport_pc parport acpi_cpufreq processor thermal_sys i2c_piix4 i2c_core sp5100_tco igb(O) dca k10temp ohci_pci hwmon ohci_hcd ptp pps_core sd_mod pata_acpi pcspkr pata_atiixp ahci libahci ata_generic libata ehci_pci ehci_hcd scsi_mod usbcore usb_common ext4 mbcache jbd2 crc16 vfat fat isofs [1746376.218071] CPU: 3 PID: 10923 Comm: accel-pppd Tainted: G D O 4.1.2-i686 #1 [1746376.219058] Hardware name: MICRO-STAR INTERNATIONAL CO.,LTD MS-7596/760GM-E51(MS-7596), BIOS V3.3 01/12/2012 [1746376.219126] task: f3ee2480 ti: e0478000 task.ti: e0478000 [1746376.219162] EIP: 0060:[<c1174408>] EFLAGS: 00210206 CPU: 3 [1746376.219198] EIP is at __kernfs_remove+0x38/0x1a0 [1746376.219232] EAX: 05040288 EBX: de040288 ECX: 00000000 EDX: 00000001 [1746376.219267] ESI: de040288 EDI: 00000000 EBP: e0479e88 ESP: e0479e68 [1746376.219302] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 [1746376.219338] CR0: 8005003b CR2: 0504028c CR3: 340e6fa0 CR4: 000007f0 [1746376.219373] Stack: [1746376.219406] c11c615d 000000d0 00000000 c11c5f30 f2519000 de040288 de040288 00000000 [1746376.219479] e0479e94 c1174f0c d3030ab8 e0479ed8 c11c53c0 d3030ab8 d3030ab0 c1276fef [1746376.219552] d5e3d18c d3030ab0 e0479ec4 c1280a10 d3030ab8 d3030ab0 00000001 e0479ed8 [1746376.219625] Call Trace: [1746376.219663] [<c11c615d>] ? kobject_uevent_env+0xed/0x4e0 [1746376.219699] [<c11c5f30>] ? kobj_ns_drop+0x40/0x40 [1746376.219735] [<c1174f0c>] ? kernfs_remove+0x1c/0x30 [1746376.219770] [<c11c53c0>] ? kobject_del+0x10/0x40 [1746376.219806] [<c1276fef>] ? device_del+0x14f/0x1d0 [1746376.219842] [<c1280a10>] ? pm_runtime_set_memalloc_noio+0x30/0x90 [1746376.219880] [<c12ea252>] ? netdev_unregister_kobject+0x52/0x60 [1746376.219916] [<c12d1597>] ? rollback_registered_many+0x1a7/0x260 [1746376.219953] [<c109cb0a>] ? do_futex+0xea/0x840 [1746376.219989] [<c12d1674>] ? rollback_registered+0x24/0x40 [1746376.220024] [<c12d27bf>] ? unregister_netdevice_queue+0x4f/0xb0 [1746376.220060] [<c12d2839>] ? unregister_netdev+0x19/0x20 [1746376.220096] [<f99bb59b>] ? ppp_shutdown_interface+0xcb/0xe0 [ppp_generic] [1746376.220134] [<f99bcf8f>] ? ppp_release+0x5f/0x70 [ppp_generic] [1746376.220170] [<f99bcf84>] ? ppp_release+0x54/0x70 [ppp_generic] [1746376.220206] [<c11226f7>] ? __fput+0x87/0x1a0 [1746376.220242] [<c105d189>] ? task_work_run+0x99/0xd0 [1746376.220278] [<c13746d5>] ? work_notifysig+0x16/0x1d [1746376.220313] Code: 00 85 c0 89 c6 0f 84 30 01 00 00 8b 50 08 85 d2 74 0c 8d 40 10 39 46 10 0f 84 1d 01 00 00 31 c0 89 f2 e8 ac f9 ff ff 85 c0 74 7a <8b> 50 04 85 d2 78 ee f0 81 40 04 01 00 00 80 89 f2 e8 92 f9 ff [1746376.220482] EIP: [<c1174408>] __kernfs_remove+0x38/0x1a0 SS:ESP 0068:e0479e68 [1746376.220551] CR2: 000000000504028c [1746376.220886] ---[ end trace 30406156849fb8d0 ]---