Bug 203607
| Summary: | AMD IOMMU BCM 5762 watchdog timeout under heavy traffic | ||
|---|---|---|---|
| Product: | Platform Specific/Hardware | Reporter: | Elmar Melcher (elmar) |
| Component: | x86-64 | Assignee: | platform_x86_64 (platform_x86_64) |
| Status: | NEW --- | ||
| Severity: | high | CC: | adrielk, ajb, bp, dominik, dvr72, elmar, marcan, toracat |
| Priority: | P1 | ||
| Hardware: | All | ||
| OS: | Linux | ||
| Kernel Version: | starting 4.8-rc1 up to including 5.1.1 | Subsystem: | |
| Regression: | No | Bisected commit-id: | |
| Attachments: | /var/log/messages running checkout 256e4621c21aa1bf704e1a12e643923fdb732d04 | ||
probably related to https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1447664 Trying to revert commit 256e4621c21aa1bf704e1a12e643923fdb732d04 in version 4.8-rc1 crashed during boot with DMA error at tg3 startup (tg3 is the driver for BCM5762). Until somebody gives me some useful input I will give up on this and use 4.4 longterm, which is not affected by this bug. Same issue, similar hardware (HP EliteDesk 705 G1 SFF) running Fedora 33 kernel 5.9.12-200.fc33.x86_64 . 03:00.0 Ethernet controller [0200]: Broadcom Inc. and subsidiaries NetXtreme BCM5762 Gigabit Ethernet PCIe [14e4:1687] (rev 10) DeviceName: Onboard LAN Subsystem: Hewlett-Packard Company Device [103c:2215] Flags: bus master, fast devsel, latency 0, IRQ 18 Memory at e0020000 (64-bit, prefetchable) [size=64K] Memory at e0010000 (64-bit, prefetchable) [size=64K] Memory at e0000000 (64-bit, prefetchable) [size=64K] Capabilities: [48] Power Management version 3 Capabilities: [50] Vital Product Data Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+ Capabilities: [a0] MSI-X: Enable+ Count=6 Masked- Capabilities: [ac] Express Endpoint, MSI 00 Capabilities: [100] Advanced Error Reporting Capabilities: [13c] Device Serial Number 00-00-c4-34-6b-6b-c2-33 Capabilities: [150] Power Budgeting <?> Capabilities: [160] Virtual Channel Capabilities: [1b0] Latency Tolerance Reporting Capabilities: [230] Transaction Processing Hints Kernel driver in use: tg3 Kernel modules: tg3 Possibly a duplicate of a very old one: https://bugzilla.kernel.org/show_bug.cgi?id=12877 . Most likely the same problem. Happens ~once a day, with very moderate traffic. HW: HP EliteDesk 705 G3 Desktop Mini/8266, BIOS P26 Ver. 02.37 10/20/2020 Trace: Dec 30 18:02:32 hp-linux2 kernel: ------------[ cut here ]------------ Dec 30 18:02:32 hp-linux2 kernel: NETDEV WATCHDOG: enp1s0 (tg3): transmit queue 0 timed out Dec 30 18:02:35 hp-linux2 kernel: WARNING: CPU: 3 PID: 2140815 at net/sched/sch_generic.c:447 dev_watchdog+0x258/0x260 Dec 30 18:02:35 hp-linux2 kernel: Modules linked in: ccm xt_CHECKSUM xt_MASQUERADE xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_mangle ip6table_nat iptable_mangle iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter bpfilter bridge stp llc nls_iso8859_1 snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep snd_pcm snd_seq_midi mt7601u edac_mce_amd snd_seq_midi_event mac80211 kvm_amd ccp snd_rawmidi kvm snd_seq input_leds cfg80211 hp_wmi snd_seq_device libarc4 snd_timer sparse_keymap wmi_bmof snd fam15h_power k10temp soundcore mac_hid tpm_infineon sch_fq_codel parport_pc ppdev lp parport ip_tables x_tables autofs4 btrfs zstd_compress dm_crypt raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear hid_generic usbhid hid amdgpu amd_iommu_v2 gpu_sched i2c_algo_bit Dec 30 18:02:35 hp-linux2 kernel: crct10dif_pclmul ttm crc32_pclmul ghash_clmulni_intel drm_kms_helper aesni_intel syscopyarea crypto_simd sysfillrect sysimgblt cryptd glue_helper fb_sys_fops drm tg3 ahci i2c_piix4 libahci wmi video Dec 30 18:02:35 hp-linux2 kernel: CPU: 3 PID: 2140815 Comm: Worker (Fakeroo Not tainted 5.4.0-58-generic #64-Ubuntu Dec 30 18:02:35 hp-linux2 kernel: Hardware name: HP HP EliteDesk 705 G3 Desktop Mini/8266, BIOS P26 Ver. 02.37 10/20/2020 Dec 30 18:02:35 hp-linux2 kernel: RIP: 0010:dev_watchdog+0x258/0x260 Dec 30 18:02:35 hp-linux2 kernel: Code: 85 c0 75 e5 eb 9f 4c 89 ff c6 05 2d 1b e8 00 01 e8 0d b4 fa ff 44 89 e9 4c 89 fe 48 c7 c7 c8 2b c3 93 48 89 c2 e8 a3 e6 70 ff <0f> 0b eb 80 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 41 57 49 89 d7 Dec 30 18:02:35 hp-linux2 kernel: RSP: 0000:ffffaeaf801f0e30 EFLAGS: 00010286 Dec 30 18:02:35 hp-linux2 kernel: RAX: 0000000000000000 RBX: ffff8b9aa4051d00 RCX: 0000000000000006 Dec 30 18:02:35 hp-linux2 kernel: RDX: 0000000000000007 RSI: 0000000000000096 RDI: ffff8b9ab73978c0 Dec 30 18:02:35 hp-linux2 kernel: RBP: ffffaeaf801f0e60 R08: 0000000000000437 R09: 0000000000000004 Dec 30 18:02:35 hp-linux2 kernel: R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000005 Dec 30 18:02:35 hp-linux2 kernel: R13: 0000000000000000 R14: ffff8b9ab3ade480 R15: ffff8b9ab3ade000 Dec 30 18:02:35 hp-linux2 kernel: FS: 00007f038d06bc00(0000) GS:ffff8b9ab7380000(0000) knlGS:0000000000000000 Dec 30 18:02:35 hp-linux2 kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Dec 30 18:02:35 hp-linux2 kernel: CR2: 00007f038525dc90 CR3: 00000001594de000 CR4: 00000000001406e0 Dec 30 18:02:35 hp-linux2 kernel: Call Trace: Dec 30 18:02:35 hp-linux2 kernel: Call Trace: Dec 30 18:02:35 hp-linux2 kernel: <IRQ> Dec 30 18:02:35 hp-linux2 kernel: ? pfifo_fast_enqueue+0x150/0x150 Dec 30 18:02:35 hp-linux2 kernel: call_timer_fn+0x32/0x130 Dec 30 18:02:35 hp-linux2 kernel: __run_timers.part.0+0x180/0x280 Dec 30 18:02:35 hp-linux2 kernel: ? enqueue_hrtimer+0x3d/0x90 Dec 30 18:02:35 hp-linux2 kernel: ? ktime_get+0x3e/0xa0 Dec 30 18:02:35 hp-linux2 kernel: run_timer_softirq+0x2a/0x50 Dec 30 18:02:35 hp-linux2 kernel: __do_softirq+0xe1/0x2d6 Dec 30 18:02:35 hp-linux2 kernel: ? hrtimer_interrupt+0x13b/0x220 Dec 30 18:02:35 hp-linux2 kernel: irq_exit+0xae/0xb0 Dec 30 18:02:35 hp-linux2 kernel: smp_apic_timer_interrupt+0x7b/0x140 Dec 30 18:02:35 hp-linux2 kernel: apic_timer_interrupt+0xf/0x20 Dec 30 18:02:35 hp-linux2 kernel: </IRQ> Dec 30 18:02:35 hp-linux2 kernel: RIP: 0010:do_user_addr_fault+0x156/0x450 Dec 30 18:02:35 hp-linux2 kernel: Code: 20 74 7d 48 89 f9 4c 89 f2 4c 89 e6 4c 89 ef e8 60 fc ff ff 48 83 c4 30 5b 41 5c 41 5d 41 5e 41 5f 5d c3 fb 66 0f 1f 44 00 00 <bb> 54 00 00 00 e9 47 ff ff ff 65 48 8b 05 20 67 79 6d 48 85 c0 0f Dec 30 18:02:35 hp-linux2 kernel: RSP: 0000:ffffaeaf8a98fe98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13 Dec 30 18:02:35 hp-linux2 kernel: RAX: 0000000080000000 RBX: 0000000000000000 RCX: 0000000000000000 Dec 30 18:02:35 hp-linux2 kernel: RDX: 00007f038525dc90 RSI: 0000000000000007 RDI: ffffaeaf8a98ff58 Dec 30 18:02:35 hp-linux2 kernel: RBP: ffffaeaf8a98fef0 R08: 0000000000000000 R09: 0000000000000000 Dec 30 18:02:35 hp-linux2 kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000007 Dec 30 18:02:35 hp-linux2 kernel: R13: ffffaeaf8a98ff58 R14: 00007f038525dc90 R15: ffff8b9aa9bda640 Dec 30 18:02:35 hp-linux2 kernel: ? do_user_addr_fault+0x216/0x450 Dec 30 18:02:35 hp-linux2 kernel: __do_page_fault+0x58/0x90 Dec 30 18:02:35 hp-linux2 kernel: do_page_fault+0x2c/0xe0 Dec 30 18:02:35 hp-linux2 kernel: page_fault+0x34/0x40 Dec 30 18:02:35 hp-linux2 kernel: RIP: 0033:0x7f038cdc4d00 Dec 30 18:02:35 hp-linux2 kernel: Code: 24 20 48 8d 4c 24 18 48 89 ee 4c 89 e7 ff 50 10 48 83 f8 fd 0f 84 aa 00 00 00 48 83 f8 ff 74 1a 48 8b 44 24 18 48 85 c0 74 10 <48> 83 00 01 48 83 c4 28 5d 41 5c c3 0f 1f 40 00 48 8b 05 11 80 1b Dec 30 18:02:35 hp-linux2 kernel: RSP: 002b:00007ffd8f32ba80 EFLAGS: 00010206 Dec 30 18:02:35 hp-linux2 kernel: RAX: 00007f038525dc90 RBX: 000055b0647fa098 RCX: 00007ffd8f32ba98 Dec 30 18:02:35 hp-linux2 kernel: RDX: 00007f038525daa8 RSI: 0000000000000000 RDI: 00007f038cfa5640 Dec 30 18:02:35 hp-linux2 kernel: RBP: 00007f0385db2470 R08: c32f0ef0f0de473d R09: 0000000000000008 Dec 30 18:02:35 hp-linux2 kernel: R10: 0000000000000007 R11: 00007f038525daa8 R12: 00007f0385261a00 Dec 30 18:02:35 hp-linux2 kernel: R13: 000055b0647fa0a8 R14: 000055b0647f9e50 R15: 00007f0385db2470 Dec 30 18:02:35 hp-linux2 kernel: ---[ end trace 79205d2543ede076 ]--- Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: transmit timed out, resetting Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 0: Host status block [00000001:000000e9:(0000:0679:0000):(0000:00f6)] Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 0: NAPI info [000000e9:000000e9:(0168:00f6:01ff):0000:(0743:0000:0000:0000)] Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 1: Host status block [00000001:000000cc:(0000:0000:0000):(0fe9:0000)] Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 1: NAPI info [000000cc:000000cc:(0000:0000:01ff):0fe9:(07e9:07e9:0000:0000)] Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 2: Host status block [00000001:00000027:(0e8e:0000:0000):(0000:0000)] Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 2: NAPI info [00000027:00000027:(0000:0000:01ff):0e8e:(068e:068e:0000:0000)] Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 3: Host status block [00000001:00000005:(0000:0000:0000):(0000:0000)] Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 3: NAPI info [00000005:00000005:(0000:0000:01ff):0004:(0004:0004:0000:0000)] Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 4: Host status block [00000001:00000074:(0000:0000:0800):(0000:0000)] Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 4: NAPI info [00000074:00000074:(0000:0000:01ff):0800:(0000:0000:0000:0000)] Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: Link is down Dec 30 18:02:38 hp-linux2 NetworkManager[893]: <info> [1609369358.7959] device (enp1s0): carrier: link connected Dec 30 18:02:38 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: Link is up at 1000 Mbps, full duplex Dec 30 18:02:38 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: Flow control is off for TX and off for RX Dec 30 18:02:38 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: EEE is disabled Dec 30 18:02:38 hp-linux2 NetworkManager[893]: <info> [1609369358.7961] device (enp1s0): DHCPv4 lease renewal requested user@hp-linux2:~$ sudo lspci -v 00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Root Complex DeviceName: Onboard LAN Subsystem: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Root Complex Flags: bus master, fast devsel, latency 0 00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) I/O Memory Management Unit Subsystem: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) I/O Memory Management Unit Flags: fast devsel, IRQ 24 Capabilities: [40] Secure device <?> Capabilities: [64] MSI: Enable+ Count=1/4 Maskable- 64bit+ Capabilities: [74] HyperTransport: MSI Mapping Enable+ Fixed+ 00:01.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Wani [Radeon R5/R6/R7 Graphics] (rev e4) (prog-if 00 [VGA controller]) DeviceName: Onboard IGD Subsystem: Hewlett-Packard Company Wani [Radeon R5/R6/R7 Graphics] Flags: bus master, fast devsel, latency 0, IRQ 34 Memory at e0000000 (64-bit, prefetchable) [size=256M] Memory at f0000000 (64-bit, prefetchable) [size=8M] I/O ports at 2000 [size=256] Memory at f0b00000 (32-bit, non-prefetchable) [size=256K] Expansion ROM at 000c0000 [disabled] [size=128K] Capabilities: [48] Vendor Specific Information: Len=08 <?> Capabilities: [50] Power Management version 3 Capabilities: [58] Express Root Complex Integrated Endpoint, MSI 00 Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+ Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?> Capabilities: [270] Secondary PCI Express Capabilities: [2b0] Address Translation Service (ATS) Capabilities: [2c0] Page Request Interface (PRI) Capabilities: [2d0] Process Address Space ID (PASID) Kernel driver in use: amdgpu Kernel modules: amdgpu 00:01.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Kabini HDMI/DP Audio Subsystem: Hewlett-Packard Company Kabini HDMI/DP Audio Flags: bus master, fast devsel, latency 0, IRQ 36 Memory at f0b60000 (64-bit, non-prefetchable) [size=16K] Capabilities: [48] Vendor Specific Information: Len=08 <?> Capabilities: [50] Power Management version 3 Capabilities: [58] Express Root Complex Integrated Endpoint, MSI 00 Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+ Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?> Kernel driver in use: snd_hda_intel Kernel modules: snd_hda_intel 00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Host Bridge Flags: fast devsel 00:02.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Root Port (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0, IRQ 26 Bus: primary=00, secondary=01, subordinate=01, sec-latency=0 I/O behind bridge: [disabled] Memory behind bridge: [disabled] Prefetchable memory behind bridge: 00000000f0800000-00000000f08fffff [size=1M] Capabilities: [50] Power Management version 3 Capabilities: [58] Express Root Port (Slot+), MSI 00 Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+ Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Root Port Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+ Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?> Capabilities: [270] Secondary PCI Express Kernel driver in use: pcieport 00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Host Bridge Flags: fast devsel 00:08.0 Encryption controller: Advanced Micro Devices, Inc. [AMD] Carrizo Platform Security Processor Subsystem: Hewlett-Packard Company Carrizo Platform Security Processor Flags: bus master, fast devsel, latency 0, IRQ 255 Memory at f0b40000 (64-bit, prefetchable) [size=128K] Memory at f0a00000 (32-bit, non-prefetchable) [size=1M] Memory at f0b6f000 (32-bit, non-prefetchable) [size=4K] Memory at f0b6a000 (32-bit, non-prefetchable) [size=8K] Capabilities: [50] MSI-X: Enable- Count=2 Masked- Capabilities: [5c] HyperTransport: MSI Mapping Enable+ Fixed+ Capabilities: [60] Power Management version 3 Capabilities: [a4] PCI Advanced Features 00:09.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Carrizo Audio Dummy Host Bridge Flags: fast devsel 00:09.2 Audio device: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Audio Controller Subsystem: Hewlett-Packard Company Family 15h (Models 60h-6fh) Audio Controller Flags: bus master, fast devsel, latency 0, IRQ 37 Memory at f0b64000 (32-bit, non-prefetchable) [size=16K] Capabilities: [60] Power Management version 3 Capabilities: [a4] PCI Advanced Features Kernel driver in use: snd_hda_intel Kernel modules: snd_hda_intel 00:10.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller (rev 20) (prog-if 30 [XHCI]) Subsystem: Hewlett-Packard Company FCH USB XHCI Controller Flags: bus master, fast devsel, latency 0, IRQ 18 Memory at f0b68000 (64-bit, non-prefetchable) [size=8K] Capabilities: [50] Power Management version 3 Capabilities: [70] MSI: Enable- Count=1/8 Maskable- 64bit+ Capabilities: [90] MSI-X: Enable+ Count=8 Masked- Capabilities: [a0] Express Root Complex Integrated Endpoint, MSI 00 Capabilities: [100] Latency Tolerance Reporting Kernel driver in use: xhci_hcd 00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 49) (prog-if 01 [AHCI 1.0]) Subsystem: Hewlett-Packard Company FCH SATA Controller [AHCI mode] Flags: bus master, 66MHz, medium devsel, latency 64, IRQ 19 I/O ports at 2118 [size=8] I/O ports at 2124 [size=4] I/O ports at 2110 [size=8] I/O ports at 2120 [size=4] I/O ports at 2100 [size=16] Memory at f0b6c000 (32-bit, non-prefetchable) [size=1K] Capabilities: [60] Power Management version 3 Capabilities: [70] SATA HBA v1.0 Kernel driver in use: ahci Kernel modules: ahci 00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller (rev 49) (prog-if 20 [EHCI]) Subsystem: Hewlett-Packard Company FCH USB EHCI Controller Flags: bus master, 66MHz, medium devsel, latency 64, IRQ 18 Memory at f0b6d000 (32-bit, non-prefetchable) [size=256] Capabilities: [c0] Power Management version 2 Capabilities: [e4] Debug port: BAR=1 offset=00e0 Kernel driver in use: ehci-pci 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 4a) Subsystem: Hewlett-Packard Company FCH SMBus Controller Flags: 66MHz, medium devsel Kernel modules: i2c_piix4, sp5100_tco 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 11) Subsystem: Hewlett-Packard Company FCH LPC Bridge Flags: bus master, 66MHz, medium devsel, latency 0 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Function 0 Flags: fast devsel 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Function 1 Flags: fast devsel 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Function 2 Flags: fast devsel 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Function 3 Flags: fast devsel Capabilities: [f0] Secure device <?> Kernel driver in use: k10temp Kernel modules: k10temp 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Function 4 Flags: fast devsel Kernel driver in use: fam15h_power Kernel modules: fam15h_power 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Function 5 Flags: fast devsel 01:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5762 Gigabit Ethernet PCIe (rev 10) Subsystem: Hewlett-Packard Company NetXtreme BCM5762 Gigabit Ethernet PCIe Flags: bus master, fast devsel, latency 0, IRQ 32 Memory at f0820000 (64-bit, prefetchable) [size=64K] Memory at f0810000 (64-bit, prefetchable) [size=64K] Memory at f0800000 (64-bit, prefetchable) [size=64K] Capabilities: [48] Power Management version 3 Capabilities: [50] Vital Product Data Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+ Capabilities: [a0] MSI-X: Enable+ Count=6 Masked- Capabilities: [ac] Express Endpoint, MSI 00 Capabilities: [100] Advanced Error Reporting Capabilities: [13c] Device Serial Number 00-00-c8-d3-ff-9b-21-c3 Capabilities: [150] Power Budgeting <?> Capabilities: [160] Virtual Channel Capabilities: [1b0] Latency Tolerance Reporting Capabilities: [230] Transaction Processing Hints Kernel driver in use: tg3 Kernel modules: tg3 user@hp-linux2:~$ In addition to my previous comment: 1. Adding iommu=pt to GRUB_CMDLINE_LINUX_DEFAULT seems to solve the problem on ElitDesk computer. 2. I have Virtualization enabled in BIOS (not sure if it contrubutes to the problem). (In reply to David Rokhvarg from comment #5) > In addition to my previous comment: > > 1. Adding iommu=pt to GRUB_CMDLINE_LINUX_DEFAULT seems to solve the problem > on ElitDesk computer. Thanks for the tip, I'll try if that works around the problem for me. Those look like AMD stoneyridges and that rings a bell: https://bugzilla.kernel.org/show_bug.cgi?id=212133 Can you folks try kernel 5.11.9 and newer which have those three iommu fixes: https://bugzilla.kernel.org/show_bug.cgi?id=212133#c49 Thx. I'm getting a very similar problem with BCM57766 on a Skylake system (iMac Late 2015) with intel_iommu. There are no DMAR errors from the IOMMU subsystem, but tg3 quickly dies with heavy traffic, with the same logs as the reporter here. I can attach the full syslog if the complete register dump would be helpful. The problem goes away with iommu.passthrough=1. If it's the same problem, then this doesn't sound like an AMD issue. Same same, I've also got a BCM57766, but in the Macmini7,1 (Late 2014), also Intel system, not AMD, issue is also fixed when adding iommu.passthrough=1 to GRUB (after reboot). For pros/cons on IOMMU Passthrough https://wiki.ubuntu.com/ARM64/performance#IOMMU_Passthrough This is a fresh install of Debian 11/bullseye (install via UEFI, not BIOS). Same issues with and without firmware-misc-nonfree. Also tried bookworm firmware-misc-nonfree (20210818-1), same network drop outs. Kernel: Linux mini 5.10.0-8-amd64 #1 SMP Debian 5.10.46-4 (2021-08-03) x86_64 GNU/Linux CPU: Intel(R) Core(TM) i5-4278U CPU @ 2.60GHz No GPU, only integrated via Intel CPU. dmesg logs I used to get before passthrough. Any time there was heavy network load. Usually recovered on it's on in a few seconds, but, maybe daily would not recover till a restart. [ +0.027451] tg3 0000:03:00.0 enp3s0f0: Link is down [ +2.944393] tg3 0000:03:00.0 enp3s0f0: Link is up at 1000 Mbps, full duplex [ +0.000005] tg3 0000:03:00.0 enp3s0f0: Flow control is on for TX and on for RX [ +0.000003] tg3 0000:03:00.0 enp3s0f0: EEE is disabled [Sep25 14:23] tg3 0000:03:00.0 enp3s0f0: transmit timed out, resetting [Sep25 14:24] tg3 0000:03:00.0 enp3s0f0: 0x00000000: 0x168614e4, 0x00100406, 0x02000001, 0x00800040 [ +0.000008] tg3 0000:03:00.0 enp3s0f0: 0x00000010: 0xa070000c, 0x00000000, 0xa071000c, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000020: 0x00000000, 0x00000000, 0x00000000, 0x168614e4 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000030: 0x00000000, 0x00000048, 0x00000000, 0x00000100 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000040: 0x00000000, 0xe5000000, 0xc8035001, 0x16002008 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000050: 0x80fc5803, 0x78000000, 0x0086a005, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000060: 0x00000000, 0x00000000, 0xf0010298, 0x761b000f [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000070: 0x00001090, 0xfa0337ee, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000080: 0x168614e4, 0x40000014, 0x00000000, 0x0000000e [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000090: 0x00000000, 0x0000009a, 0x00000000, 0x000001c3 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000000a0: 0x8005ac11, 0x00000002, 0x00000122, 0x00020010 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000000b0: 0x05908d80, 0x00105400, 0x00475c11, 0x10110142 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000000d0: 0x0000081f, 0x00000400, 0x00000000, 0x00010001 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000000f0: 0x00000000, 0x00000000, 0x00000000, 0x57766001 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000100: 0x13c10001, 0x00000000, 0x00000000, 0x00062030 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000110: 0x00002000, 0x00002000, 0x000000a0, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000130: 0x00000000, 0x00000000, 0x00000000, 0x15010003 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000140: 0xe9c9a932, 0x00000c4d, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000150: 0x16010004, 0x00000000, 0x00078116, 0x00000001 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000160: 0x1b010002, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000170: 0x00000000, 0x800000ff, 0x00000000, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000001b0: 0x00010018, 0x10031003, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000200: 0x00000000, 0xe5000000, 0x00000000, 0x0f000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000210: 0x00000000, 0x6c000000, 0x00000000, 0x05000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000220: 0x00000000, 0xda000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000260: 0x00000000, 0x00000000, 0x00000000, 0x000001c3 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000280: 0x00000000, 0x0000000e, 0x00000000, 0x000003ff [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000290: 0x00000000, 0x00000004, 0x00000000, 0x000000ea [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000300: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000310: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000320: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000330: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000340: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000350: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000360: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000370: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000380: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000390: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000003a0: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000003b0: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000003c0: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000003d0: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000003e0: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000003f0: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000400: 0x00e04808, 0x02400000, 0x00001000, 0x00000880 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000410: 0x00000c4d, 0xe9c9a932, 0x00000c4d, 0xe9c9a932 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000420: 0x00000c4d, 0xe9c9a932, 0x00000c4d, 0xe9c9a932 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000430: 0x00000000, 0x00000000, 0x00000024, 0x000005f2 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000440: 0x00000000, 0x00000000, 0x00000000, 0x04384400 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000450: 0x00000001, 0x00008000, 0x00000000, 0x00000112 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000460: 0x00000018, 0x00002620, 0x01ff0006, 0x00000006 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000470: 0x80800000, 0x00000000, 0x00000000, 0x40000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000480: 0x42000000, 0x7fffffff, 0x06000004, 0x7fffffff [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000500: 0x00000008, 0x00000001, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000590: 0x00900111, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000005c0: 0x887cdb38, 0x000010f8, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000600: 0xffffffff, 0x00f80011, 0x00000000, 0x00001f04 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000610: 0xffffffff, 0x00000000, 0x07c00004, 0x30000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000620: 0x00000040, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000630: 0x01230123, 0x01230123, 0x01230123, 0x01230123 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000640: 0x01230123, 0x01230123, 0x01230123, 0x01230123 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000650: 0x01230123, 0x01230123, 0x01230123, 0x01230123 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000660: 0x01230123, 0x01230123, 0x01230123, 0x01230123 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000670: 0xdb2fd7b9, 0x22bb369a, 0xc4369941, 0x8ea542d7 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000680: 0xa709811a, 0x68cc3c21, 0xe432c1df, 0x367ff7de [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000690: 0xdd3bf2ab, 0x34d1ab8e, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000800: 0x00000000, 0xffffffff, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000810: 0x00000000, 0xffffffff, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000820: 0x00000000, 0x00000000, 0xffffffff, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000830: 0x00000000, 0xffffffff, 0xffffffff, 0xffffffff [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000840: 0xffffffff, 0xffffffff, 0xffffffff, 0xffffffff [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000850: 0xffffffff, 0xffffffff, 0xffffffff, 0xffffffff [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000860: 0xffffffff, 0xffffffff, 0xffffffff, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000880: 0x00000040, 0x0000aab4, 0x00000000, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000890: 0x00000000, 0x00000001, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000008f0: 0x007c0001, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000c00: 0x0000000a, 0x00000000, 0x00000003, 0x00000001 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000c10: 0x00000000, 0x00000000, 0x00000000, 0x05a80000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000c80: 0x0001cf15, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000ce0: 0xfe29f4a8, 0x00000000, 0x000005a8, 0x00041028 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000cf0: 0x00000000, 0x5000001a, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001000: 0x00000002, 0x00000000, 0xa0006975, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001010: 0x009a09a1, 0x00006975, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001400: 0x00000006, 0x00000000, 0x00000000, 0x00000005 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00001440: 0x0000009a, 0x0000009a, 0x0000009a, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001450: 0x0000009a, 0x0000009a, 0x0000009a, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001460: 0x0000009a, 0x0000009a, 0x0000009a, 0x0000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001470: 0x0000009a, 0x0000009a, 0x0000009a, 0x0000009a [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00001800: 0x00000016, 0x00000000, 0x0000009a, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001840: 0x00000000, 0x00000000, 0x00000200, 0x00000010 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001850: 0x0000001f, 0x00000000, 0x00004180, 0x009a009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001860: 0x02000000, 0x00000000, 0x00000000, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00001c00: 0x00000002, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002000: 0x00000002, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002010: 0x00000181, 0x00000001, 0x007bffff, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002100: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00002110: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002120: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002130: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002140: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00002150: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002160: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002170: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00002180: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002190: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000021a0: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000021b0: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000021c0: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000021d0: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000021e0: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000021f0: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002200: 0x00258cef, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002400: 0x00000012, 0x00000000, 0x00000000, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00002440: 0x00000000, 0x00000000, 0x00000002, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002450: 0x00000000, 0xffff0000, 0x02001800, 0x00006000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002470: 0x00000000, 0x00000101, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000024c0: 0x00815101, 0x00000000, 0x00000000, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00002800: 0x00000006, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002c00: 0x00000006, 0x00000000, 0x00000000, 0x00000164 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002c10: 0x00000000, 0x00000000, 0x00000019, 0x0000000c [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002c20: 0x00000002, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003000: 0x00000006, 0x00000000, 0x00000000, 0x00000164 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003600: 0x00137400, 0x00130000, 0x00110000, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003610: 0x00170000, 0x00130000, 0x00150000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003620: 0x00000000, 0x00000000, 0x00000000, 0x00022080 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003630: 0x00000000, 0x80008000, 0x00001080, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003640: 0x0000000a, 0x00400000, 0x00000020, 0x00000019 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003650: 0x00000171, 0x00000bff, 0x57766001, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003660: 0x00000000, 0x00000000, 0x010400a7, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003670: 0x0000002a, 0xfeffffe7, 0x0000000a, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003690: 0x80157766, 0x00000000, 0x00000000, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000036a0: 0x00000000, 0x00000000, 0x00000000, 0x00000044 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000036b0: 0x00100348, 0x07ff07ff, 0x07ff07ff, 0x0100000d [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000036c0: 0xfffffffe, 0x0000000b, 0x00000000, 0x00000088 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000036d0: 0x0000019d, 0x00000000, 0x00000000, 0x00001296 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000036e0: 0x00000b19, 0x20800799, 0x00500799, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003c00: 0x00000302, 0x00000000, 0x00000000, 0x00000048 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003c10: 0x00000000, 0x00000035, 0x00000000, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003c20: 0x00000000, 0x00000005, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003c30: 0x00000000, 0x00000000, 0x00000000, 0xffffa000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003c40: 0x00000000, 0x00000b00, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003c50: 0x00000000, 0x000000fc, 0x00000000, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003c80: 0x0000000e, 0x00000000, 0x00000004, 0x000000ea [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003cc0: 0x0000009a, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003cd0: 0x00000000, 0x0000000f, 0x00000000, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003d00: 0x00000000, 0xffff9000, 0x00000000, 0xffff8000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003d10: 0x00000000, 0xffff7000, 0x00000000, 0xffff6000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003d80: 0x00000014, 0x00000000, 0x00000005, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003d90: 0x00000005, 0x00000000, 0x00000014, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003da0: 0x00000005, 0x00000000, 0x00000005, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003db0: 0x00000014, 0x00000000, 0x00000005, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003dc0: 0x00000005, 0x00000000, 0x00000014, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003dd0: 0x00000005, 0x00000000, 0x00000005, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004000: 0x00000002, 0x00000000, 0x00184677, 0x000fa43d [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004010: 0x00475880, 0x002d0012, 0x00800440, 0x01003442 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004020: 0x00018510, 0x00000010, 0x00000010, 0x00000050 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004030: 0x00000000, 0x01083220, 0x00259010, 0x00456002 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004040: 0x00462000, 0x02a3af00, 0x00000010, 0x00469062 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004400: 0x00000006, 0x00000000, 0x00010000, 0x0000a000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004410: 0x00000000, 0x0000002a, 0x000000a0, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004420: 0x0000003d, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004440: 0x00000000, 0x00000000, 0x00000000, 0x0691d477 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004450: 0x00f004c8, 0x005a00d2, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004700: 0x00030002, 0x00600000, 0x00200020, 0xe13c0000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004710: 0xffff4900, 0x000c0904, 0x00600010, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004720: 0x00000000, 0x00000000, 0xf02c0000, 0xffff49a0 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004770: 0x000c0404, 0x00000042, 0x00000018, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004800: 0x188303fe, 0x00000000, 0x00000000, 0x00000120 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004810: 0x00000000, 0x0000000b, 0x05a89578, 0x00002a28 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004820: 0x00000062, 0x00000000, 0xf0310000, 0xfe5cc4f0 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004840: 0x0046e82a, 0x0046e82a, 0x000e2200, 0x62422986 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004850: 0x1f57a929, 0x14c705ea, 0x56555655, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004860: 0x00000062, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004870: 0x00000000, 0x003e1820, 0x003e1820, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004890: 0x28090404, 0x00305400, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000048a0: 0x000f0010, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004900: 0x18030006, 0x00000003, 0x30000000, 0x00000120 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004910: 0x00000040, 0x00000002, 0x0000d570, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004920: 0x00000076, 0x02348000, 0xffdb0cf9, 0x0f000048 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004930: 0xffadb001, 0x0f0002d8, 0xfe7cf8f9, 0x0f000048 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004940: 0xfe29f4a9, 0x0f0005a8, 0xe4e47373, 0xb6b6bcbc [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004950: 0xf0320000, 0xffdb0d40, 0xef000000, 0x76690075 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004960: 0x00000000, 0xffadb2d8, 0x8f000000, 0x4000009a [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004970: 0x00028203, 0x00205400, 0x0000001c, 0x000000ff [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004980: 0x00000076, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004990: 0x00000000, 0x00000000, 0xfe7cf940, 0xef000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000049a0: 0x00f00024, 0x00000076, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000049b0: 0xffe484f9, 0xffcf8001, 0xfccf68f9, 0xffd14001 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000049c0: 0xffdb0cfe, 0xffadb000, 0xfe7cf8fe, 0xfe29f4a8 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000049d0: 0xffe484fe, 0xffcf8000, 0xfccf68fe, 0xffd14000 [ +0.000004] tg3 0000:03:00.0 enp3s0f0: 0x000049f0: 0xf0310000, 0xfe29fa50, 0x8f000000, 0x000055aa [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004c00: 0x200003fe, 0x00000020, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004c10: 0x0000003f, 0x00000000, 0x00000006, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004c20: 0x00000000, 0x00000000, 0x00000000, 0x00000006 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004c30: 0x00000000, 0x00038000, 0x000000d5, 0x000000d5 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004c40: 0x00000000, 0xfffcffe0, 0x00010020, 0x00140020 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004c50: 0x003ffc0d, 0x0fcffce9, 0x4ea01000, 0x557ce5e5 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004c60: 0x00000020, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005000: 0x00009800, 0x80004000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005010: 0x00000000, 0x00000000, 0x00000000, 0x08000a90 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005020: 0xafa20014, 0x00000000, 0x00000000, 0x40000020 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005030: 0x00000000, 0x0000001d, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005040: 0x00000000, 0x00000000, 0x08000a80, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005080: 0x00009800, 0x80004000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005090: 0x00000000, 0x00000000, 0x00000000, 0x08000898 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000050a0: 0x03601021, 0x00000000, 0x00000000, 0x40000020 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000050b0: 0x00000000, 0x0000001d, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000050c0: 0x00000000, 0x00000000, 0x08000cc8, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005100: 0x00009800, 0x80004000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005110: 0x00000000, 0x00000000, 0x00000000, 0x08001240 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005120: 0x30420080, 0x00000000, 0x00000000, 0x40000020 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005130: 0x00000000, 0x0000001d, 0x00000000, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005140: 0x00000000, 0x00000000, 0x080008be, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005180: 0x00009800, 0x80000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005190: 0x00000000, 0x00000000, 0x00000000, 0x08000898 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000051a0: 0x10a00008, 0x00000000, 0x00000000, 0x40000020 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000051b0: 0x00000000, 0x0000001d, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000051c0: 0x00000000, 0x00000000, 0x080009ea, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005200: 0x00000000, 0x0800ff98, 0x00000000, 0x08000cc0 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005210: 0x10400004, 0x00000000, 0x0800ff98, 0x40000014 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005220: 0x0800ff98, 0x00000000, 0x00000b50, 0x10400004 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005230: 0x00000000, 0x0800ff98, 0x0200000e, 0x0800ff98 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005240: 0x00000000, 0x00000b50, 0x10400004, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005250: 0x0800ff98, 0x40000014, 0x0800ff98, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005260: 0x00000b50, 0x10400004, 0x00000000, 0x0800ff98 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005270: 0x0200000e, 0x0800ff98, 0x00000000, 0x00000b50 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005280: 0x00009800, 0x80004000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005290: 0x00000000, 0x00000000, 0x00000000, 0x08000898 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000052a0: 0x00641824, 0x00000000, 0x00000000, 0x40000020 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000052b0: 0x00000000, 0x0000001d, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000052c0: 0x00000000, 0x00000000, 0x08000cc8, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005300: 0x00009800, 0x80004000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005310: 0x00000000, 0x00000000, 0x00000000, 0x08001240 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005320: 0x30420080, 0x00000000, 0x00000000, 0x40000020 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005330: 0x00000000, 0x0000001d, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005340: 0x00000000, 0x00000000, 0x0800095c, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005380: 0x00009800, 0x80008000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005390: 0x00000000, 0x00000000, 0x00000000, 0x08000898 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000053a0: 0x3c101000, 0x00000000, 0x00000000, 0x40000020 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000053b0: 0x00000000, 0x0000001d, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000053c0: 0x00000000, 0x00000000, 0x080009ea, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005800: 0x00000000, 0xe5000000, 0x00000000, 0x0f000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005810: 0x00000000, 0x6c000000, 0x00000000, 0x05000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005820: 0x00000000, 0xda000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005860: 0x00000000, 0x00000000, 0x00000000, 0x000001c3 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005880: 0x00000000, 0x0000000e, 0x00000000, 0x000003ff [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005890: 0x00000000, 0x00000004, 0x00000000, 0x000000ea [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005900: 0x00000000, 0x0000009a, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005980: 0x0000009a, 0x00000000, 0x00000000, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005a00: 0x000f601f, 0x00000000, 0x00010000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006000: 0x20000082, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006400: 0x00000000, 0x00000000, 0x00010091, 0xc0000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006410: 0x05000016, 0x05000016, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006420: 0x00000000, 0x00000000, 0x00000000, 0x80fc0000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00006430: 0x78000000, 0x14e41686, 0x168614e4, 0x01020000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006440: 0x0000304f, 0x000002e4, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000064c0: 0x00000005, 0x00000002, 0x00000122, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000064d0: 0x00000040, 0x00008d80, 0x00000000, 0x00d75e11 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000064e0: 0x00000031, 0x0000001f, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000064f0: 0x00000002, 0x00000030, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006500: 0x03e10003, 0xe9c9a932, 0x00000c4d, 0x00000003 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00006510: 0x00078116, 0x0005810b, 0x00046105, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006550: 0x00000001, 0x02800000, 0x0000000f, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006560: 0x0000000f, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006800: 0x04130034, 0x20081082, 0x01009618, 0x0f132ad8 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00006810: 0x01122010, 0xffffffff, 0x00000000, 0x00000040 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006880: 0x77fff020, 0x00000040, 0x80011686, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006890: 0x00800000, 0x88008000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000068a0: 0x00000000, 0x00010001, 0x00000000, 0x00000000 [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000068b0: 0x00040000, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006900: 0xd54959c8, 0x00000000, 0x00000000, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006920: 0x00000000, 0x00000000, 0x00000001, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00007000: 0x00000188, 0x00000000, 0x00000000, 0x000001fc [ +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00007010: 0x00000078, 0x02408200, 0x000500db, 0x03000a00 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00007020: 0x00000000, 0x00000000, 0x00000406, 0x10004000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00007030: 0x00010000, 0x00000200, 0x000c0030, 0x00000000 [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00007500: 0x00000000, 0x00000000, 0x00000080, 0x00000000 [ +0.000005] tg3 0000:03:00.0 enp3s0f0: 0: Host status block [00000001:000000e5:(0000:00fc:0000):(0000:0052)] [ +0.000004] tg3 0000:03:00.0 enp3s0f0: 0: NAPI info [000000e5:000000e5:(009a:0052:01ff):0000:(01c3:0000:0000:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 1: Host status block [00000001:0000000f:(0000:0000:0000):(000e:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 1: NAPI info [0000000f:0000000f:(0000:0000:01ff):000e:(000e:000e:0000:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 2: Host status block [00000001:0000006c:(03ff:0000:0000):(0000:0000)] [ +0.000004] tg3 0000:03:00.0 enp3s0f0: 2: NAPI info [0000006c:0000006c:(0000:0000:01ff):03ff:(01ff:01ff:0000:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 3: Host status block [00000001:00000005:(0000:0000:0000):(0000:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 3: NAPI info [00000005:00000005:(0000:0000:01ff):0004:(0004:0004:0000:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 4: Host status block [00000001:000000da:(0000:0000:00ea):(0000:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 4: NAPI info [000000da:000000da:(0000:0000:01ff):00ea:(00ea:00ea:0000:0000)] [ +0.129710] tg3 0000:03:00.0: tg3_stop_block timed out, ofs=1400 enable_bit=2 [ +0.027456] tg3 0000:03:00.0 enp3s0f0: Link is down [ +2.950584] tg3 0000:03:00.0 enp3s0f0: Link is up at 1000 Mbps, full duplex [ +0.000007] tg3 0000:03:00.0 enp3s0f0: Flow control is on for TX and on for RX [ +0.000003] tg3 0000:03:00.0 enp3s0f0: EEE is disabled I've seen talk about newer kernels working, so tried the sid version on Debian. Linux mini 5.14.0-1-amd64 #1 SMP Debian 5.14.6-2 (2021-09-19) x86_64 GNU/Linux Now I get allot of Buffer overflow detected errors, and the occasional link down, but it's much much less frequent. like 1 every 3-4 mins and seems to recover faster, vs before, within seconds of high network traffic. [Sep25 15:35] ------------[ cut here ]------------ [ +0.000005] Buffer overflow detected (8 < 192)! [ +0.000018] WARNING: CPU: 2 PID: 600 at include/linux/thread_info.h:200 ethtool_rxnfc_copy_to_user+0x2b/0xb0 [ +0.000012] Modules linked in: xt_conntrack nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 xfrm_user xfrm_algo nft_counter xt_addrtype nft_compat nf_tables libcrc32c nfnetlink br_netfilter bridge stp llc intel_rapl_msr b43 intel_rapl_common cordic overlay x86_pkg_temp_thermal intel_powerclamp coretemp mac80211 btusb btrtl btbcm kvm_intel snd_hda_codec_hdmi btintel bluetooth cfg80211 kvm irqbypass ssb pcmcia ghash_clmulni_intel hid_appleir jitterentropy_rng pcmcia_core snd_hda_codec_cirrus libarc4 aesni_intel nls_ascii snd_hda_codec_generic sha512_ssse3 ledtrig_audio nls_cp437 rng_core mei_hdcp hid_generic crypto_simd cryptd vfat fat rapl snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi i915 sha512_generic evdev snd_hda_codec applesmc iTCO_wdt intel_cstate ctr snd_hda_core intel_pmc_bxt ttm iTCO_vendor_support drbg snd_hwdep intel_uncore sg watchdog ansi_cprng drm_kms_helper snd_pcm usbhid mei_me ecdh_generic snd_timer hid uas cec [ +0.000069] rfkill ecc rc_core usb_storage snd apple_mfi_fastcharge soundcore mei bcma i2c_algo_bit pcspkr efi_pstore button drm fuse configfs efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic sd_mod t10_pi crc_t10dif crct10dif_generic ahci libahci xhci_pci libata xhci_hcd crct10dif_pclmul crct10dif_common crc32_pclmul crc32c_intel scsi_mod i2c_i801 i2c_smbus lpc_ich tg3 usbcore sdhci_pci thunderbolt cqhci libphy sdhci mmc_core ptp pps_core usb_common video [ +0.000031] CPU: 2 PID: 600 Comm: nmbd Tainted: G W 5.14.0-1-amd64 #1 Debian 5.14.6-2 [ +0.000003] Hardware name: Apple Inc. Macmini7,1/Mac-35C5E08120C7EEAF, BIOS 431.140.6.0.0 06/13/2021 [ +0.000001] RIP: 0010:ethtool_rxnfc_copy_to_user+0x2b/0xb0 [ +0.000005] Code: 1f 44 00 00 41 55 65 48 8b 04 25 c0 7b 01 00 41 54 55 53 f6 40 10 02 75 23 be 08 00 00 00 48 c7 c7 28 16 30 a0 e8 64 4c 14 00 <0f> 0b 41 bc f2 ff ff ff 5b 44 89 e0 5d 41 5c 41 5d c3 48 89 fb 49 [ +0.000002] RSP: 0018:ffffa126007e3bf8 EFLAGS: 00010282 [ +0.000002] RAX: 0000000000000000 RBX: ffffffffc02a3200 RCX: ffff8fff27318888 [ +0.000001] RDX: 00000000ffffffd8 RSI: 0000000000000027 RDI: ffff8fff27318880 [ +0.000002] RBP: ffff8ffdc0c62000 R08: 0000000000000000 R09: ffffa126007e3a20 [ +0.000001] R10: ffffa126007e3a18 R11: ffffffffa08d3588 R12: 0000000000000000 [ +0.000001] R13: 00007ffdb6490750 R14: 0000000000000000 R15: ffffa126007e3c28 [ +0.000001] FS: 00007fa500f2da40(0000) GS:ffff8fff27300000(0000) knlGS:0000000000000000 [ +0.000002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ +0.000001] CR2: 00007f3ecc19a000 CR3: 0000000104c8a002 CR4: 00000000001706e0 [ +0.000002] Call Trace: [ +0.000004] ethtool_get_rxnfc+0xcb/0x1b0 [ +0.000005] dev_ethtool+0xb4b/0x28f0 [ +0.000005] ? bpf_prog_79b52d7b53f3270b_netdata_close+0xfb/0x1bc [ +0.000002] ? tomoyo_init_request_info+0x8f/0xb0 [ +0.000005] ? tomoyo_path_number_perm+0x66/0x1d0 [ +0.000003] dev_ioctl+0x156/0x480 [ +0.000004] sock_do_ioctl+0x9b/0x130 [ +0.000003] sock_ioctl+0x23a/0x320 [ +0.000002] __x64_sys_ioctl+0x83/0xb0 [ +0.000004] do_syscall_64+0x3b/0xc0 [ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae [ +0.000004] RIP: 0033:0x7fa504899cc7 [ +0.000004] Code: 00 00 00 48 8b 05 c9 91 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 99 91 0c 00 f7 d8 64 89 01 48 [ +0.000002] RSP: 002b:00007ffdb64906e8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [ +0.000002] RAX: ffffffffffffffda RBX: 00005626d2dc1fb0 RCX: 00007fa504899cc7 [ +0.000001] RDX: 00007ffdb6490720 RSI: 0000000000008946 RDI: 0000000000000018 [ +0.000002] RBP: 0000000000000018 R08: 0000000000000000 R09: 003066307333706e [ +0.000001] R10: 000000000000000d R11: 0000000000000246 R12: 00005626d2dc2160 [ +0.000001] R13: 00007ffdb6490720 R14: 00005626d2dc2ed0 R15: 00005626d2dc2f74 [ +0.000003] ---[ end trace a73cf734fa1709c2 ]--- [Sep25 15:34] ------------[ cut here ]------------ [ +0.000005] NETDEV WATCHDOG: enp3s0f0 (tg3): transmit queue 0 timed out [ +0.000014] WARNING: CPU: 0 PID: 0 at net/sched/sch_generic.c:477 dev_watchdog+0x24a/0x250 [ +0.000008] Modules linked in: xt_conntrack nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 xfrm_user xfrm_algo nft_counter xt_addrtype nft_compat nf_tables libcrc32c nfnetlink br_netfilter bridge stp llc intel_rapl_msr b43 intel_rapl_common cordic overlay x86_pkg_temp_thermal intel_powerclamp coretemp mac80211 btusb btrtl btbcm kvm_intel snd_hda_codec_hdmi btintel bluetooth cfg80211 kvm irqbypass ssb pcmcia ghash_clmulni_intel hid_appleir jitterentropy_rng pcmcia_core snd_hda_codec_cirrus libarc4 aesni_intel nls_ascii snd_hda_codec_generic sha512_ssse3 ledtrig_audio nls_cp437 rng_core mei_hdcp hid_generic crypto_simd cryptd vfat fat rapl snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi i915 sha512_generic evdev snd_hda_codec applesmc iTCO_wdt intel_cstate ctr snd_hda_core intel_pmc_bxt ttm iTCO_vendor_support drbg snd_hwdep intel_uncore sg watchdog ansi_cprng drm_kms_helper snd_pcm usbhid mei_me ecdh_generic snd_timer hid uas cec [ +0.000065] rfkill ecc rc_core usb_storage snd apple_mfi_fastcharge soundcore mei bcma i2c_algo_bit pcspkr efi_pstore button drm fuse configfs efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic sd_mod t10_pi crc_t10dif crct10dif_generic ahci libahci xhci_pci libata xhci_hcd crct10dif_pclmul crct10dif_common crc32_pclmul crc32c_intel scsi_mod i2c_i801 i2c_smbus lpc_ich tg3 usbcore sdhci_pci thunderbolt cqhci libphy sdhci mmc_core ptp pps_core usb_common video [ +0.000048] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G W 5.14.0-1-amd64 #1 Debian 5.14.6-2 [ +0.000004] Hardware name: Apple Inc. Macmini7,1/Mac-35C5E08120C7EEAF, BIOS 431.140.6.0.0 06/13/2021 [ +0.000002] RIP: 0010:dev_watchdog+0x24a/0x250 [ +0.000005] Code: 4c 52 fd ff eb a9 4c 89 f7 c6 05 f3 6e 0f 01 01 e8 eb 2d fa ff 44 89 e9 4c 89 f6 48 c7 c7 48 64 3a a0 48 89 c2 e8 55 34 16 00 <0f> 0b eb 8a 66 90 0f 1f 44 00 00 41 57 41 56 49 89 d6 41 55 4d 89 [ +0.000003] RSP: 0018:ffffa12600003eb0 EFLAGS: 00010282 [ +0.000004] RAX: 0000000000000000 RBX: ffff8ffdd16dc500 RCX: ffff8fff27218888 [ +0.000002] RDX: 00000000ffffffd8 RSI: 0000000000000027 RDI: ffff8fff27218880 [ +0.000002] RBP: ffff8ffdc0c623dc R08: 0000000000000000 R09: ffffa12600003cd8 [ +0.000002] R10: ffffa12600003cd0 R11: ffffffffa08d3588 R12: ffff8ffdc0c62480 [ +0.000002] R13: 0000000000000000 R14: ffff8ffdc0c62000 R15: ffff8ffdd16dc580 [ +0.000002] FS: 0000000000000000(0000) GS:ffff8fff27200000(0000) knlGS:0000000000000000 [ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ +0.000003] CR2: 00007f3ecc129000 CR3: 0000000103dc6002 CR4: 00000000001706f0 [ +0.000003] Call Trace: [ +0.000003] <IRQ> [ +0.000004] ? pfifo_fast_enqueue+0x150/0x150 [ +0.000004] call_timer_fn+0x26/0xf0 [ +0.000006] __run_timers.part.0+0x1ca/0x230 [ +0.000006] ? perf_trace_softirq+0x9d/0xd0 [ +0.000007] run_timer_softirq+0x26/0x50 [ +0.000005] __do_softirq+0xc5/0x268 [ +0.000008] irq_exit_rcu+0x99/0xb0 [ +0.000003] sysvec_apic_timer_interrupt+0x72/0x90 [ +0.000006] </IRQ> [ +0.000001] asm_sysvec_apic_timer_interrupt+0x12/0x20 [ +0.000005] RIP: 0010:cpuidle_enter_state+0xc7/0x350 [ +0.000006] Code: 8b 3d c5 4e 75 60 e8 18 ba a0 ff 49 89 c5 0f 1f 44 00 00 31 ff e8 99 c4 a0 ff 45 84 ff 0f 85 fa 00 00 00 fb 66 0f 1f 44 00 00 <45> 85 f6 0f 88 06 01 00 00 49 63 c6 4c 2b 2c 24 48 8d 14 40 48 8d [ +0.000002] RSP: 0018:ffffffffa0803e60 EFLAGS: 00000246 [ +0.000002] RAX: ffff8fff2722ca80 RBX: 0000000000000001 RCX: 000000000000001f [ +0.000002] RDX: 0000000000000000 RSI: 00000000313b14ef RDI: 0000000000000000 [ +0.000001] RBP: ffffc125ffc24a00 R08: 0000005bcd195955 R09: 0000000000000008 [ +0.000001] R10: 0000000000000043 R11: 0000000000000030 R12: ffffffffa09b9960 [ +0.000002] R13: 0000005bcd195955 R14: 0000000000000001 R15: 0000000000000000 [ +0.000005] cpuidle_enter+0x29/0x40 [ +0.000005] do_idle+0x1f6/0x2b0 [ +0.000005] cpu_startup_entry+0x19/0x20 [ +0.000003] start_kernel+0x6cf/0x6f4 [ +0.000007] secondary_startup_64_no_verify+0xb0/0xbb [ +0.000007] ---[ end trace a73cf734fa1709c1 ]--- [ +0.000006] tg3 0000:03:00.0 enp3s0f0: transmit timed out, resetting [ +3.145384] tg3 0000:03:00.0 enp3s0f0: 0x00000000: 0x168614e4, 0x00100406, 0x02000001, 0x00800040 [ +0.000011] tg3 0000:03:00.0 enp3s0f0: 0x00000010: 0xa070000c, 0x00000000, 0xa071000c, 0x00000000 [ +0.000004] tg3 0000:03:00.0 enp3s0f0: 0x00000020: 0x00000000, 0x00000000, 0x00000000, 0x168614e4 --- removed similar lines --- [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00007500: 0x00000000, 0x00000000, 0x00000080, 0x00000000 [ +0.000004] tg3 0000:03:00.0 enp3s0f0: 0: Host status block [00000001:000000b8:(0000:0192:0000):(0000:01b8)] [ +0.000004] tg3 0000:03:00.0 enp3s0f0: 0: NAPI info [000000b8:000000b8:(001e:01b8:01ff):0000:(005a:0000:0000:0000)] [ +0.000004] tg3 0000:03:00.0 enp3s0f0: 1: Host status block [00000001:00000054:(0000:0000:0000):(004e:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 1: NAPI info [00000054:00000054:(0000:0000:01ff):004e:(004e:004e:0000:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 2: Host status block [00000001:00000089:(0000:0000:0000):(0000:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 2: NAPI info [00000089:00000089:(0000:0000:01ff):0000:(0000:0000:0000:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 3: Host status block [00000001:0000002d:(0000:0000:0000):(0000:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 3: NAPI info [0000002d:0000002d:(0000:0000:01ff):002c:(002c:002c:0000:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 4: Host status block [00000001:000000fb:(0000:0000:0118):(0000:0000)] [ +0.000003] tg3 0000:03:00.0 enp3s0f0: 4: NAPI info [000000fb:000000fb:(0000:0000:01ff):0118:(0118:0118:0000:0000)] [ +0.129648] tg3 0000:03:00.0: tg3_stop_block timed out, ofs=1400 enable_bit=2 [ +0.027452] tg3 0000:03:00.0 enp3s0f0: Link is down [ +2.944530] tg3 0000:03:00.0 enp3s0f0: Link is up at 1000 Mbps, full duplex [ +0.000004] tg3 0000:03:00.0 enp3s0f0: Flow control is on for TX and on for RX [ +0.000001] tg3 0000:03:00.0 enp3s0f0: EEE is disabled Edit, seems the Buffer overflow detected errors will be fixed in 5.14.7, so probably unrelated to the network issue (especially since I still get the errors without network traffic). https://lkml.org/lkml/2021/9/22/279 (In reply to Dominik Mierzejewski from comment #6) > (In reply to David Rokhvarg from comment #5) > > In addition to my previous comment: > > > > 1. Adding iommu=pt to GRUB_CMDLINE_LINUX_DEFAULT seems to solve the problem > > on ElitDesk computer. > > Thanks for the tip, I'll try if that works around the problem for me. And, unfortunately, it doesn't. I'm still getting these despite setting iommu=pt. |
Created attachment 282761 [details] /var/log/messages running checkout 256e4621c21aa1bf704e1a12e643923fdb732d04 Copying a big file (300MB) over ethernet to the computer causes loss of connection for more than 8 seconds. computer: HP EliteDesk 705 G3 (AMD cpu) Ethernet controller: Broadcom Limited NetXtreme BCM5762 Gigabit Ethernet PCIe (rev 10) 14e4:1687 running at 1000Mb/s Kernel bisect leads to [256e4621c21aa1bf704e1a12e643923fdb732d04] iommu/amd: Make use of the generic IOVA allocator as cause. Attached /var/log/messages running checkout 256e4621c21aa1bf704e1a12e643923fdb732d04. Problem occurs on all subsequent kernel versions tested, including 5.1.1