Bug 203607 - AMD IOMMU BCM 5762 watchdog timeout under heavy traffic
Summary: AMD IOMMU BCM 5762 watchdog timeout under heavy traffic
Status: NEW
Alias: None
Product: Platform Specific/Hardware
Classification: Unclassified
Component: x86-64 (show other bugs)
Hardware: All Linux
: P1 high
Assignee: platform_x86_64@kernel-bugs.osdl.org
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2019-05-14 20:17 UTC by Elmar Melcher
Modified: 2021-10-29 12:43 UTC (History)
8 users (show)

See Also:
Kernel Version: starting 4.8-rc1 up to including 5.1.1
Subsystem:
Regression: No
Bisected commit-id:


Attachments
/var/log/messages running checkout 256e4621c21aa1bf704e1a12e643923fdb732d04 (42.60 KB, text/plain)
2019-05-14 20:17 UTC, Elmar Melcher
Details

Description Elmar Melcher 2019-05-14 20:17:10 UTC
Created attachment 282761 [details]
/var/log/messages running checkout 256e4621c21aa1bf704e1a12e643923fdb732d04

Copying a big file (300MB) over ethernet to the computer causes loss of connection for more than 8 seconds.
computer: HP EliteDesk 705 G3 (AMD cpu)
Ethernet controller: Broadcom Limited NetXtreme BCM5762 Gigabit Ethernet PCIe (rev 10) 14e4:1687 running at 1000Mb/s
Kernel bisect leads to
[256e4621c21aa1bf704e1a12e643923fdb732d04] iommu/amd: Make use of the generic IOVA allocator
as cause.
Attached /var/log/messages running checkout 256e4621c21aa1bf704e1a12e643923fdb732d04.
Problem occurs on all subsequent kernel versions tested, including 5.1.1
Comment 1 Elmar Melcher 2019-05-14 20:26:47 UTC
probably related to
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1447664
Comment 2 Elmar Melcher 2019-05-17 21:26:51 UTC
Trying to revert commit 256e4621c21aa1bf704e1a12e643923fdb732d04 in version 4.8-rc1 crashed during boot with DMA error at tg3 startup (tg3 is the driver for BCM5762).
Until somebody gives me some useful input I will give up on this and use 4.4 longterm, which is not affected by this bug.
Comment 3 Dominik Mierzejewski 2020-12-11 11:43:17 UTC
Same issue, similar hardware (HP EliteDesk 705 G1 SFF) running Fedora 33 kernel 5.9.12-200.fc33.x86_64 .

03:00.0 Ethernet controller [0200]: Broadcom Inc. and subsidiaries NetXtreme BCM5762 Gigabit Ethernet PCIe [14e4:1687] (rev 10)
	DeviceName:  Onboard LAN
	Subsystem: Hewlett-Packard Company Device [103c:2215]
	Flags: bus master, fast devsel, latency 0, IRQ 18
	Memory at e0020000 (64-bit, prefetchable) [size=64K]
	Memory at e0010000 (64-bit, prefetchable) [size=64K]
	Memory at e0000000 (64-bit, prefetchable) [size=64K]
	Capabilities: [48] Power Management version 3
	Capabilities: [50] Vital Product Data
	Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [a0] MSI-X: Enable+ Count=6 Masked-
	Capabilities: [ac] Express Endpoint, MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [13c] Device Serial Number 00-00-c4-34-6b-6b-c2-33
	Capabilities: [150] Power Budgeting <?>
	Capabilities: [160] Virtual Channel
	Capabilities: [1b0] Latency Tolerance Reporting
	Capabilities: [230] Transaction Processing Hints
	Kernel driver in use: tg3
	Kernel modules: tg3

Possibly a duplicate of a very old one: https://bugzilla.kernel.org/show_bug.cgi?id=12877 .
Comment 4 David Rokhvarg 2020-12-31 14:41:51 UTC
Most likely the same problem.

Happens ~once a day, with very moderate traffic.

HW:

HP EliteDesk 705 G3 Desktop Mini/8266, BIOS P26 Ver. 02.37 10/20/2020

Trace:

Dec 30 18:02:32 hp-linux2 kernel: ------------[ cut here ]------------
Dec 30 18:02:32 hp-linux2 kernel: NETDEV WATCHDOG: enp1s0 (tg3): transmit queue 0 timed out
Dec 30 18:02:35 hp-linux2 kernel: WARNING: CPU: 3 PID: 2140815 at net/sched/sch_generic.c:447 dev_watchdog+0x258/0x260
Dec 30 18:02:35 hp-linux2 kernel: Modules linked in: ccm xt_CHECKSUM xt_MASQUERADE xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_mangle ip6table_nat iptable_mangle iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter bpfilter bridge stp llc nls_iso8859_1 snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_hda_core snd_hwdep snd_pcm snd_seq_midi mt7601u edac_mce_amd snd_seq_midi_event mac80211 kvm_amd ccp snd_rawmidi kvm snd_seq input_leds cfg80211 hp_wmi snd_seq_device libarc4 snd_timer sparse_keymap wmi_bmof snd fam15h_power k10temp soundcore mac_hid tpm_infineon sch_fq_codel parport_pc ppdev lp parport ip_tables x_tables autofs4 btrfs zstd_compress dm_crypt raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear hid_generic usbhid hid amdgpu amd_iommu_v2 gpu_sched i2c_algo_bit
Dec 30 18:02:35 hp-linux2 kernel:  crct10dif_pclmul ttm crc32_pclmul ghash_clmulni_intel drm_kms_helper aesni_intel syscopyarea crypto_simd sysfillrect sysimgblt cryptd glue_helper fb_sys_fops drm tg3 ahci i2c_piix4 libahci wmi video
Dec 30 18:02:35 hp-linux2 kernel: CPU: 3 PID: 2140815 Comm: Worker (Fakeroo Not tainted 5.4.0-58-generic #64-Ubuntu
Dec 30 18:02:35 hp-linux2 kernel: Hardware name: HP HP EliteDesk 705 G3 Desktop Mini/8266, BIOS P26 Ver. 02.37 10/20/2020
Dec 30 18:02:35 hp-linux2 kernel: RIP: 0010:dev_watchdog+0x258/0x260
Dec 30 18:02:35 hp-linux2 kernel: Code: 85 c0 75 e5 eb 9f 4c 89 ff c6 05 2d 1b e8 00 01 e8 0d b4 fa ff 44 89 e9 4c 89 fe 48 c7 c7 c8 2b c3 93 48 89 c2 e8 a3 e6 70 ff <0f> 0b eb 80 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 41 57 49 89 d7
Dec 30 18:02:35 hp-linux2 kernel: RSP: 0000:ffffaeaf801f0e30 EFLAGS: 00010286
Dec 30 18:02:35 hp-linux2 kernel: RAX: 0000000000000000 RBX: ffff8b9aa4051d00 RCX: 0000000000000006
Dec 30 18:02:35 hp-linux2 kernel: RDX: 0000000000000007 RSI: 0000000000000096 RDI: ffff8b9ab73978c0
Dec 30 18:02:35 hp-linux2 kernel: RBP: ffffaeaf801f0e60 R08: 0000000000000437 R09: 0000000000000004
Dec 30 18:02:35 hp-linux2 kernel: R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000005
Dec 30 18:02:35 hp-linux2 kernel: R13: 0000000000000000 R14: ffff8b9ab3ade480 R15: ffff8b9ab3ade000
Dec 30 18:02:35 hp-linux2 kernel: FS:  00007f038d06bc00(0000) GS:ffff8b9ab7380000(0000) knlGS:0000000000000000
Dec 30 18:02:35 hp-linux2 kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 30 18:02:35 hp-linux2 kernel: CR2: 00007f038525dc90 CR3: 00000001594de000 CR4: 00000000001406e0
Dec 30 18:02:35 hp-linux2 kernel: Call Trace:
Dec 30 18:02:35 hp-linux2 kernel: Call Trace:
Dec 30 18:02:35 hp-linux2 kernel:  <IRQ>
Dec 30 18:02:35 hp-linux2 kernel:  ? pfifo_fast_enqueue+0x150/0x150
Dec 30 18:02:35 hp-linux2 kernel:  call_timer_fn+0x32/0x130
Dec 30 18:02:35 hp-linux2 kernel:  __run_timers.part.0+0x180/0x280
Dec 30 18:02:35 hp-linux2 kernel:  ? enqueue_hrtimer+0x3d/0x90
Dec 30 18:02:35 hp-linux2 kernel:  ? ktime_get+0x3e/0xa0
Dec 30 18:02:35 hp-linux2 kernel:  run_timer_softirq+0x2a/0x50
Dec 30 18:02:35 hp-linux2 kernel:  __do_softirq+0xe1/0x2d6
Dec 30 18:02:35 hp-linux2 kernel:  ? hrtimer_interrupt+0x13b/0x220
Dec 30 18:02:35 hp-linux2 kernel:  irq_exit+0xae/0xb0
Dec 30 18:02:35 hp-linux2 kernel:  smp_apic_timer_interrupt+0x7b/0x140
Dec 30 18:02:35 hp-linux2 kernel:  apic_timer_interrupt+0xf/0x20
Dec 30 18:02:35 hp-linux2 kernel:  </IRQ>
Dec 30 18:02:35 hp-linux2 kernel: RIP: 0010:do_user_addr_fault+0x156/0x450
Dec 30 18:02:35 hp-linux2 kernel: Code: 20 74 7d 48 89 f9 4c 89 f2 4c 89 e6 4c 89 ef e8 60 fc ff ff 48 83 c4 30 5b 41 5c 41 5d 41 5e 41 5f 5d c3 fb 66 0f 1f 44 00 00 <bb> 54 00 00 00 e9 47 ff ff ff 65 48 8b 05 20 67 79 6d 48 85 c0 0f
Dec 30 18:02:35 hp-linux2 kernel: RSP: 0000:ffffaeaf8a98fe98 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff13
Dec 30 18:02:35 hp-linux2 kernel: RAX: 0000000080000000 RBX: 0000000000000000 RCX: 0000000000000000
Dec 30 18:02:35 hp-linux2 kernel: RDX: 00007f038525dc90 RSI: 0000000000000007 RDI: ffffaeaf8a98ff58
Dec 30 18:02:35 hp-linux2 kernel: RBP: ffffaeaf8a98fef0 R08: 0000000000000000 R09: 0000000000000000
Dec 30 18:02:35 hp-linux2 kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000007
Dec 30 18:02:35 hp-linux2 kernel: R13: ffffaeaf8a98ff58 R14: 00007f038525dc90 R15: ffff8b9aa9bda640
Dec 30 18:02:35 hp-linux2 kernel:  ? do_user_addr_fault+0x216/0x450
Dec 30 18:02:35 hp-linux2 kernel:  __do_page_fault+0x58/0x90
Dec 30 18:02:35 hp-linux2 kernel:  do_page_fault+0x2c/0xe0
Dec 30 18:02:35 hp-linux2 kernel:  page_fault+0x34/0x40
Dec 30 18:02:35 hp-linux2 kernel: RIP: 0033:0x7f038cdc4d00
Dec 30 18:02:35 hp-linux2 kernel: Code: 24 20 48 8d 4c 24 18 48 89 ee 4c 89 e7 ff 50 10 48 83 f8 fd 0f 84 aa 00 00 00 48 83 f8 ff 74 1a 48 8b 44 24 18 48 85 c0 74 10 <48> 83 00 01 48 83 c4 28 5d 41 5c c3 0f 1f 40 00 48 8b 05 11 80 1b
Dec 30 18:02:35 hp-linux2 kernel: RSP: 002b:00007ffd8f32ba80 EFLAGS: 00010206
Dec 30 18:02:35 hp-linux2 kernel: RAX: 00007f038525dc90 RBX: 000055b0647fa098 RCX: 00007ffd8f32ba98
Dec 30 18:02:35 hp-linux2 kernel: RDX: 00007f038525daa8 RSI: 0000000000000000 RDI: 00007f038cfa5640
Dec 30 18:02:35 hp-linux2 kernel: RBP: 00007f0385db2470 R08: c32f0ef0f0de473d R09: 0000000000000008
Dec 30 18:02:35 hp-linux2 kernel: R10: 0000000000000007 R11: 00007f038525daa8 R12: 00007f0385261a00
Dec 30 18:02:35 hp-linux2 kernel: R13: 000055b0647fa0a8 R14: 000055b0647f9e50 R15: 00007f0385db2470
Dec 30 18:02:35 hp-linux2 kernel: ---[ end trace 79205d2543ede076 ]---
Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: transmit timed out, resetting
Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 0: Host status block [00000001:000000e9:(0000:0679:0000):(0000:00f6)]
Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 0: NAPI info [000000e9:000000e9:(0168:00f6:01ff):0000:(0743:0000:0000:0000)]
Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 1: Host status block [00000001:000000cc:(0000:0000:0000):(0fe9:0000)]
Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 1: NAPI info [000000cc:000000cc:(0000:0000:01ff):0fe9:(07e9:07e9:0000:0000)]
Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 2: Host status block [00000001:00000027:(0e8e:0000:0000):(0000:0000)]
Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 2: NAPI info [00000027:00000027:(0000:0000:01ff):0e8e:(068e:068e:0000:0000)]
Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 3: Host status block [00000001:00000005:(0000:0000:0000):(0000:0000)]
Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 3: NAPI info [00000005:00000005:(0000:0000:01ff):0004:(0004:0004:0000:0000)]
Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 4: Host status block [00000001:00000074:(0000:0000:0800):(0000:0000)]
Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: 4: NAPI info [00000074:00000074:(0000:0000:01ff):0800:(0000:0000:0000:0000)]
Dec 30 18:02:35 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: Link is down
Dec 30 18:02:38 hp-linux2 NetworkManager[893]: <info>  [1609369358.7959] device (enp1s0): carrier: link connected
Dec 30 18:02:38 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: Link is up at 1000 Mbps, full duplex
Dec 30 18:02:38 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: Flow control is off for TX and off for RX
Dec 30 18:02:38 hp-linux2 kernel: tg3 0000:01:00.0 enp1s0: EEE is disabled
Dec 30 18:02:38 hp-linux2 NetworkManager[893]: <info>  [1609369358.7961] device (enp1s0): DHCPv4 lease renewal requested



user@hp-linux2:~$ sudo lspci -v
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Root Complex
	DeviceName: Onboard LAN
	Subsystem: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Root Complex
	Flags: bus master, fast devsel, latency 0

00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) I/O Memory Management Unit
	Subsystem: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) I/O Memory Management Unit
	Flags: fast devsel, IRQ 24
	Capabilities: [40] Secure device <?>
	Capabilities: [64] MSI: Enable+ Count=1/4 Maskable- 64bit+
	Capabilities: [74] HyperTransport: MSI Mapping Enable+ Fixed+

00:01.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Wani [Radeon R5/R6/R7 Graphics] (rev e4) (prog-if 00 [VGA controller])
	DeviceName: Onboard IGD
	Subsystem: Hewlett-Packard Company Wani [Radeon R5/R6/R7 Graphics]
	Flags: bus master, fast devsel, latency 0, IRQ 34
	Memory at e0000000 (64-bit, prefetchable) [size=256M]
	Memory at f0000000 (64-bit, prefetchable) [size=8M]
	I/O ports at 2000 [size=256]
	Memory at f0b00000 (32-bit, non-prefetchable) [size=256K]
	Expansion ROM at 000c0000 [disabled] [size=128K]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [270] Secondary PCI Express
	Capabilities: [2b0] Address Translation Service (ATS)
	Capabilities: [2c0] Page Request Interface (PRI)
	Capabilities: [2d0] Process Address Space ID (PASID)
	Kernel driver in use: amdgpu
	Kernel modules: amdgpu

00:01.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Kabini HDMI/DP Audio
	Subsystem: Hewlett-Packard Company Kabini HDMI/DP Audio
	Flags: bus master, fast devsel, latency 0, IRQ 36
	Memory at f0b60000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Kernel driver in use: snd_hda_intel
	Kernel modules: snd_hda_intel

00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Host Bridge
	Flags: fast devsel

00:02.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Root Port (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 26
	Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: [disabled]
	Prefetchable memory behind bridge: 00000000f0800000-00000000f08fffff [size=1M]
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot+), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Root Port
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [270] Secondary PCI Express
	Kernel driver in use: pcieport

00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Host Bridge
	Flags: fast devsel

00:08.0 Encryption controller: Advanced Micro Devices, Inc. [AMD] Carrizo Platform Security Processor
	Subsystem: Hewlett-Packard Company Carrizo Platform Security Processor
	Flags: bus master, fast devsel, latency 0, IRQ 255
	Memory at f0b40000 (64-bit, prefetchable) [size=128K]
	Memory at f0a00000 (32-bit, non-prefetchable) [size=1M]
	Memory at f0b6f000 (32-bit, non-prefetchable) [size=4K]
	Memory at f0b6a000 (32-bit, non-prefetchable) [size=8K]
	Capabilities: [50] MSI-X: Enable- Count=2 Masked-
	Capabilities: [5c] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [60] Power Management version 3
	Capabilities: [a4] PCI Advanced Features

00:09.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Carrizo Audio Dummy Host Bridge
	Flags: fast devsel

00:09.2 Audio device: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Audio Controller
	Subsystem: Hewlett-Packard Company Family 15h (Models 60h-6fh) Audio Controller
	Flags: bus master, fast devsel, latency 0, IRQ 37
	Memory at f0b64000 (32-bit, non-prefetchable) [size=16K]
	Capabilities: [60] Power Management version 3
	Capabilities: [a4] PCI Advanced Features
	Kernel driver in use: snd_hda_intel
	Kernel modules: snd_hda_intel

00:10.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller (rev 20) (prog-if 30 [XHCI])
	Subsystem: Hewlett-Packard Company FCH USB XHCI Controller
	Flags: bus master, fast devsel, latency 0, IRQ 18
	Memory at f0b68000 (64-bit, non-prefetchable) [size=8K]
	Capabilities: [50] Power Management version 3
	Capabilities: [70] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [90] MSI-X: Enable+ Count=8 Masked-
	Capabilities: [a0] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [100] Latency Tolerance Reporting
	Kernel driver in use: xhci_hcd

00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 49) (prog-if 01 [AHCI 1.0])
	Subsystem: Hewlett-Packard Company FCH SATA Controller [AHCI mode]
	Flags: bus master, 66MHz, medium devsel, latency 64, IRQ 19
	I/O ports at 2118 [size=8]
	I/O ports at 2124 [size=4]
	I/O ports at 2110 [size=8]
	I/O ports at 2120 [size=4]
	I/O ports at 2100 [size=16]
	Memory at f0b6c000 (32-bit, non-prefetchable) [size=1K]
	Capabilities: [60] Power Management version 3
	Capabilities: [70] SATA HBA v1.0
	Kernel driver in use: ahci
	Kernel modules: ahci

00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller (rev 49) (prog-if 20 [EHCI])
	Subsystem: Hewlett-Packard Company FCH USB EHCI Controller
	Flags: bus master, 66MHz, medium devsel, latency 64, IRQ 18
	Memory at f0b6d000 (32-bit, non-prefetchable) [size=256]
	Capabilities: [c0] Power Management version 2
	Capabilities: [e4] Debug port: BAR=1 offset=00e0
	Kernel driver in use: ehci-pci

00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 4a)
	Subsystem: Hewlett-Packard Company FCH SMBus Controller
	Flags: 66MHz, medium devsel
	Kernel modules: i2c_piix4, sp5100_tco

00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 11)
	Subsystem: Hewlett-Packard Company FCH LPC Bridge
	Flags: bus master, 66MHz, medium devsel, latency 0

00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Function 0
	Flags: fast devsel

00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Function 1
	Flags: fast devsel

00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Function 2
	Flags: fast devsel

00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Function 3
	Flags: fast devsel
	Capabilities: [f0] Secure device <?>
	Kernel driver in use: k10temp
	Kernel modules: k10temp

00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Function 4
	Flags: fast devsel
	Kernel driver in use: fam15h_power
	Kernel modules: fam15h_power

00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 60h-6fh) Processor Function 5
	Flags: fast devsel

01:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5762 Gigabit Ethernet PCIe (rev 10)
	Subsystem: Hewlett-Packard Company NetXtreme BCM5762 Gigabit Ethernet PCIe
	Flags: bus master, fast devsel, latency 0, IRQ 32
	Memory at f0820000 (64-bit, prefetchable) [size=64K]
	Memory at f0810000 (64-bit, prefetchable) [size=64K]
	Memory at f0800000 (64-bit, prefetchable) [size=64K]
	Capabilities: [48] Power Management version 3
	Capabilities: [50] Vital Product Data
	Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [a0] MSI-X: Enable+ Count=6 Masked-
	Capabilities: [ac] Express Endpoint, MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [13c] Device Serial Number 00-00-c8-d3-ff-9b-21-c3
	Capabilities: [150] Power Budgeting <?>
	Capabilities: [160] Virtual Channel
	Capabilities: [1b0] Latency Tolerance Reporting
	Capabilities: [230] Transaction Processing Hints
	Kernel driver in use: tg3
	Kernel modules: tg3

user@hp-linux2:~$
Comment 5 David Rokhvarg 2021-01-06 14:12:20 UTC
In addition to my previous comment:

1. Adding iommu=pt to GRUB_CMDLINE_LINUX_DEFAULT seems to solve the problem on ElitDesk computer.

2. I have Virtualization enabled in BIOS (not sure if it contrubutes to the problem).
Comment 6 Dominik Mierzejewski 2021-01-11 17:33:41 UTC
(In reply to David Rokhvarg from comment #5)
> In addition to my previous comment:
> 
> 1. Adding iommu=pt to GRUB_CMDLINE_LINUX_DEFAULT seems to solve the problem
> on ElitDesk computer.

Thanks for the tip, I'll try if that works around the problem for me.
Comment 7 Borislav Petkov 2021-04-10 18:40:40 UTC
Those look like AMD stoneyridges and that rings a bell:

https://bugzilla.kernel.org/show_bug.cgi?id=212133

Can you folks try kernel 5.11.9 and newer which have those three iommu fixes:

https://bugzilla.kernel.org/show_bug.cgi?id=212133#c49

Thx.
Comment 8 Hector Martin 2021-07-02 09:08:22 UTC
I'm getting a very similar problem with BCM57766 on a Skylake system (iMac Late 2015) with intel_iommu. There are no DMAR errors from the IOMMU subsystem, but tg3 quickly dies with heavy traffic, with the same logs as the reporter here. I can attach the full syslog if the complete register dump would be helpful. The problem goes away with iommu.passthrough=1.

If it's the same problem, then this doesn't sound like an AMD issue.
Comment 9 Adriel 2021-09-25 03:12:57 UTC
Same same, I've also got a BCM57766, but in the Macmini7,1 (Late 2014), also Intel system, not AMD, issue is also fixed when adding iommu.passthrough=1 to GRUB (after reboot). 
For pros/cons on IOMMU Passthrough https://wiki.ubuntu.com/ARM64/performance#IOMMU_Passthrough

This is a fresh install of Debian 11/bullseye (install via UEFI, not BIOS). Same issues with and without firmware-misc-nonfree. Also tried bookworm   firmware-misc-nonfree (20210818-1), same network drop outs.

Kernel: Linux mini 5.10.0-8-amd64 #1 SMP Debian 5.10.46-4 (2021-08-03) x86_64 GNU/Linux
CPU: Intel(R) Core(TM) i5-4278U CPU @ 2.60GHz
No GPU, only integrated via Intel CPU.

dmesg logs I used to get before passthrough. Any time there was heavy network load. Usually recovered on it's on in a few seconds, but, maybe daily would not recover till a restart.

[  +0.027451] tg3 0000:03:00.0 enp3s0f0: Link is down
[  +2.944393] tg3 0000:03:00.0 enp3s0f0: Link is up at 1000 Mbps, full duplex
[  +0.000005] tg3 0000:03:00.0 enp3s0f0: Flow control is on for TX and on for RX
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: EEE is disabled
[Sep25 14:23] tg3 0000:03:00.0 enp3s0f0: transmit timed out, resetting
[Sep25 14:24] tg3 0000:03:00.0 enp3s0f0: 0x00000000: 0x168614e4, 0x00100406, 0x02000001, 0x00800040
[  +0.000008] tg3 0000:03:00.0 enp3s0f0: 0x00000010: 0xa070000c, 0x00000000, 0xa071000c, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000020: 0x00000000, 0x00000000, 0x00000000, 0x168614e4
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000030: 0x00000000, 0x00000048, 0x00000000, 0x00000100
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000040: 0x00000000, 0xe5000000, 0xc8035001, 0x16002008
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000050: 0x80fc5803, 0x78000000, 0x0086a005, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000060: 0x00000000, 0x00000000, 0xf0010298, 0x761b000f
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000070: 0x00001090, 0xfa0337ee, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000080: 0x168614e4, 0x40000014, 0x00000000, 0x0000000e
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000090: 0x00000000, 0x0000009a, 0x00000000, 0x000001c3
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000000a0: 0x8005ac11, 0x00000002, 0x00000122, 0x00020010
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000000b0: 0x05908d80, 0x00105400, 0x00475c11, 0x10110142
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000000d0: 0x0000081f, 0x00000400, 0x00000000, 0x00010001
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000000f0: 0x00000000, 0x00000000, 0x00000000, 0x57766001
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000100: 0x13c10001, 0x00000000, 0x00000000, 0x00062030
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000110: 0x00002000, 0x00002000, 0x000000a0, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000130: 0x00000000, 0x00000000, 0x00000000, 0x15010003
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000140: 0xe9c9a932, 0x00000c4d, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000150: 0x16010004, 0x00000000, 0x00078116, 0x00000001
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000160: 0x1b010002, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000170: 0x00000000, 0x800000ff, 0x00000000, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000001b0: 0x00010018, 0x10031003, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000200: 0x00000000, 0xe5000000, 0x00000000, 0x0f000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000210: 0x00000000, 0x6c000000, 0x00000000, 0x05000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000220: 0x00000000, 0xda000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000260: 0x00000000, 0x00000000, 0x00000000, 0x000001c3
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000280: 0x00000000, 0x0000000e, 0x00000000, 0x000003ff
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000290: 0x00000000, 0x00000004, 0x00000000, 0x000000ea
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000300: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000310: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000320: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000330: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000340: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000350: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000360: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000370: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000380: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000390: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000003a0: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000003b0: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000003c0: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000003d0: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000003e0: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000003f0: 0x00000000, 0x0000009a, 0x00000000, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000400: 0x00e04808, 0x02400000, 0x00001000, 0x00000880
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000410: 0x00000c4d, 0xe9c9a932, 0x00000c4d, 0xe9c9a932
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000420: 0x00000c4d, 0xe9c9a932, 0x00000c4d, 0xe9c9a932
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000430: 0x00000000, 0x00000000, 0x00000024, 0x000005f2
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000440: 0x00000000, 0x00000000, 0x00000000, 0x04384400
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000450: 0x00000001, 0x00008000, 0x00000000, 0x00000112
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000460: 0x00000018, 0x00002620, 0x01ff0006, 0x00000006
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000470: 0x80800000, 0x00000000, 0x00000000, 0x40000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000480: 0x42000000, 0x7fffffff, 0x06000004, 0x7fffffff
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000500: 0x00000008, 0x00000001, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000590: 0x00900111, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000005c0: 0x887cdb38, 0x000010f8, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000600: 0xffffffff, 0x00f80011, 0x00000000, 0x00001f04
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000610: 0xffffffff, 0x00000000, 0x07c00004, 0x30000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000620: 0x00000040, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000630: 0x01230123, 0x01230123, 0x01230123, 0x01230123
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000640: 0x01230123, 0x01230123, 0x01230123, 0x01230123
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000650: 0x01230123, 0x01230123, 0x01230123, 0x01230123
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000660: 0x01230123, 0x01230123, 0x01230123, 0x01230123
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000670: 0xdb2fd7b9, 0x22bb369a, 0xc4369941, 0x8ea542d7
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000680: 0xa709811a, 0x68cc3c21, 0xe432c1df, 0x367ff7de
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000690: 0xdd3bf2ab, 0x34d1ab8e, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000800: 0x00000000, 0xffffffff, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000810: 0x00000000, 0xffffffff, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000820: 0x00000000, 0x00000000, 0xffffffff, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000830: 0x00000000, 0xffffffff, 0xffffffff, 0xffffffff
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000840: 0xffffffff, 0xffffffff, 0xffffffff, 0xffffffff
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000850: 0xffffffff, 0xffffffff, 0xffffffff, 0xffffffff
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000860: 0xffffffff, 0xffffffff, 0xffffffff, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000880: 0x00000040, 0x0000aab4, 0x00000000, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000890: 0x00000000, 0x00000001, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000008f0: 0x007c0001, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000c00: 0x0000000a, 0x00000000, 0x00000003, 0x00000001
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000c10: 0x00000000, 0x00000000, 0x00000000, 0x05a80000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00000c80: 0x0001cf15, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000ce0: 0xfe29f4a8, 0x00000000, 0x000005a8, 0x00041028
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00000cf0: 0x00000000, 0x5000001a, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001000: 0x00000002, 0x00000000, 0xa0006975, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001010: 0x009a09a1, 0x00006975, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001400: 0x00000006, 0x00000000, 0x00000000, 0x00000005
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00001440: 0x0000009a, 0x0000009a, 0x0000009a, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001450: 0x0000009a, 0x0000009a, 0x0000009a, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001460: 0x0000009a, 0x0000009a, 0x0000009a, 0x0000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001470: 0x0000009a, 0x0000009a, 0x0000009a, 0x0000009a
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00001800: 0x00000016, 0x00000000, 0x0000009a, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001840: 0x00000000, 0x00000000, 0x00000200, 0x00000010
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001850: 0x0000001f, 0x00000000, 0x00004180, 0x009a009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00001860: 0x02000000, 0x00000000, 0x00000000, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00001c00: 0x00000002, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002000: 0x00000002, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002010: 0x00000181, 0x00000001, 0x007bffff, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002100: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00002110: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002120: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002130: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002140: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00002150: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002160: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002170: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00002180: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002190: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000021a0: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000021b0: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000021c0: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000021d0: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000021e0: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000021f0: 0x000cd068, 0x000d94ca, 0x00000053, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002200: 0x00258cef, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002400: 0x00000012, 0x00000000, 0x00000000, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00002440: 0x00000000, 0x00000000, 0x00000002, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002450: 0x00000000, 0xffff0000, 0x02001800, 0x00006000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002470: 0x00000000, 0x00000101, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000024c0: 0x00815101, 0x00000000, 0x00000000, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00002800: 0x00000006, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002c00: 0x00000006, 0x00000000, 0x00000000, 0x00000164
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002c10: 0x00000000, 0x00000000, 0x00000019, 0x0000000c
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00002c20: 0x00000002, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003000: 0x00000006, 0x00000000, 0x00000000, 0x00000164
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003600: 0x00137400, 0x00130000, 0x00110000, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003610: 0x00170000, 0x00130000, 0x00150000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003620: 0x00000000, 0x00000000, 0x00000000, 0x00022080
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003630: 0x00000000, 0x80008000, 0x00001080, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003640: 0x0000000a, 0x00400000, 0x00000020, 0x00000019
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003650: 0x00000171, 0x00000bff, 0x57766001, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003660: 0x00000000, 0x00000000, 0x010400a7, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003670: 0x0000002a, 0xfeffffe7, 0x0000000a, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003690: 0x80157766, 0x00000000, 0x00000000, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000036a0: 0x00000000, 0x00000000, 0x00000000, 0x00000044
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000036b0: 0x00100348, 0x07ff07ff, 0x07ff07ff, 0x0100000d
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000036c0: 0xfffffffe, 0x0000000b, 0x00000000, 0x00000088
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000036d0: 0x0000019d, 0x00000000, 0x00000000, 0x00001296
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000036e0: 0x00000b19, 0x20800799, 0x00500799, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003c00: 0x00000302, 0x00000000, 0x00000000, 0x00000048
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003c10: 0x00000000, 0x00000035, 0x00000000, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003c20: 0x00000000, 0x00000005, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003c30: 0x00000000, 0x00000000, 0x00000000, 0xffffa000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003c40: 0x00000000, 0x00000b00, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003c50: 0x00000000, 0x000000fc, 0x00000000, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003c80: 0x0000000e, 0x00000000, 0x00000004, 0x000000ea
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003cc0: 0x0000009a, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003cd0: 0x00000000, 0x0000000f, 0x00000000, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003d00: 0x00000000, 0xffff9000, 0x00000000, 0xffff8000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003d10: 0x00000000, 0xffff7000, 0x00000000, 0xffff6000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003d80: 0x00000014, 0x00000000, 0x00000005, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003d90: 0x00000005, 0x00000000, 0x00000014, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003da0: 0x00000005, 0x00000000, 0x00000005, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003db0: 0x00000014, 0x00000000, 0x00000005, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00003dc0: 0x00000005, 0x00000000, 0x00000014, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00003dd0: 0x00000005, 0x00000000, 0x00000005, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004000: 0x00000002, 0x00000000, 0x00184677, 0x000fa43d
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004010: 0x00475880, 0x002d0012, 0x00800440, 0x01003442
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004020: 0x00018510, 0x00000010, 0x00000010, 0x00000050
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004030: 0x00000000, 0x01083220, 0x00259010, 0x00456002
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004040: 0x00462000, 0x02a3af00, 0x00000010, 0x00469062
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004400: 0x00000006, 0x00000000, 0x00010000, 0x0000a000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004410: 0x00000000, 0x0000002a, 0x000000a0, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004420: 0x0000003d, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004440: 0x00000000, 0x00000000, 0x00000000, 0x0691d477
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004450: 0x00f004c8, 0x005a00d2, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004700: 0x00030002, 0x00600000, 0x00200020, 0xe13c0000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004710: 0xffff4900, 0x000c0904, 0x00600010, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004720: 0x00000000, 0x00000000, 0xf02c0000, 0xffff49a0
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004770: 0x000c0404, 0x00000042, 0x00000018, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004800: 0x188303fe, 0x00000000, 0x00000000, 0x00000120
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004810: 0x00000000, 0x0000000b, 0x05a89578, 0x00002a28
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004820: 0x00000062, 0x00000000, 0xf0310000, 0xfe5cc4f0
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004840: 0x0046e82a, 0x0046e82a, 0x000e2200, 0x62422986
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004850: 0x1f57a929, 0x14c705ea, 0x56555655, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004860: 0x00000062, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004870: 0x00000000, 0x003e1820, 0x003e1820, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004890: 0x28090404, 0x00305400, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000048a0: 0x000f0010, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004900: 0x18030006, 0x00000003, 0x30000000, 0x00000120
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004910: 0x00000040, 0x00000002, 0x0000d570, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004920: 0x00000076, 0x02348000, 0xffdb0cf9, 0x0f000048
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004930: 0xffadb001, 0x0f0002d8, 0xfe7cf8f9, 0x0f000048
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004940: 0xfe29f4a9, 0x0f0005a8, 0xe4e47373, 0xb6b6bcbc
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004950: 0xf0320000, 0xffdb0d40, 0xef000000, 0x76690075
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004960: 0x00000000, 0xffadb2d8, 0x8f000000, 0x4000009a
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004970: 0x00028203, 0x00205400, 0x0000001c, 0x000000ff
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004980: 0x00000076, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004990: 0x00000000, 0x00000000, 0xfe7cf940, 0xef000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000049a0: 0x00f00024, 0x00000076, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000049b0: 0xffe484f9, 0xffcf8001, 0xfccf68f9, 0xffd14001
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000049c0: 0xffdb0cfe, 0xffadb000, 0xfe7cf8fe, 0xfe29f4a8
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000049d0: 0xffe484fe, 0xffcf8000, 0xfccf68fe, 0xffd14000
[  +0.000004] tg3 0000:03:00.0 enp3s0f0: 0x000049f0: 0xf0310000, 0xfe29fa50, 0x8f000000, 0x000055aa
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004c00: 0x200003fe, 0x00000020, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004c10: 0x0000003f, 0x00000000, 0x00000006, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004c20: 0x00000000, 0x00000000, 0x00000000, 0x00000006
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004c30: 0x00000000, 0x00038000, 0x000000d5, 0x000000d5
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004c40: 0x00000000, 0xfffcffe0, 0x00010020, 0x00140020
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00004c50: 0x003ffc0d, 0x0fcffce9, 0x4ea01000, 0x557ce5e5
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00004c60: 0x00000020, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005000: 0x00009800, 0x80004000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005010: 0x00000000, 0x00000000, 0x00000000, 0x08000a90
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005020: 0xafa20014, 0x00000000, 0x00000000, 0x40000020
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005030: 0x00000000, 0x0000001d, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005040: 0x00000000, 0x00000000, 0x08000a80, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005080: 0x00009800, 0x80004000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005090: 0x00000000, 0x00000000, 0x00000000, 0x08000898
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000050a0: 0x03601021, 0x00000000, 0x00000000, 0x40000020
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000050b0: 0x00000000, 0x0000001d, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000050c0: 0x00000000, 0x00000000, 0x08000cc8, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005100: 0x00009800, 0x80004000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005110: 0x00000000, 0x00000000, 0x00000000, 0x08001240
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005120: 0x30420080, 0x00000000, 0x00000000, 0x40000020
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005130: 0x00000000, 0x0000001d, 0x00000000, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005140: 0x00000000, 0x00000000, 0x080008be, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005180: 0x00009800, 0x80000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005190: 0x00000000, 0x00000000, 0x00000000, 0x08000898
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000051a0: 0x10a00008, 0x00000000, 0x00000000, 0x40000020
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000051b0: 0x00000000, 0x0000001d, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000051c0: 0x00000000, 0x00000000, 0x080009ea, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005200: 0x00000000, 0x0800ff98, 0x00000000, 0x08000cc0
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005210: 0x10400004, 0x00000000, 0x0800ff98, 0x40000014
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005220: 0x0800ff98, 0x00000000, 0x00000b50, 0x10400004
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005230: 0x00000000, 0x0800ff98, 0x0200000e, 0x0800ff98
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005240: 0x00000000, 0x00000b50, 0x10400004, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005250: 0x0800ff98, 0x40000014, 0x0800ff98, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005260: 0x00000b50, 0x10400004, 0x00000000, 0x0800ff98
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005270: 0x0200000e, 0x0800ff98, 0x00000000, 0x00000b50
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005280: 0x00009800, 0x80004000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005290: 0x00000000, 0x00000000, 0x00000000, 0x08000898
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000052a0: 0x00641824, 0x00000000, 0x00000000, 0x40000020
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000052b0: 0x00000000, 0x0000001d, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000052c0: 0x00000000, 0x00000000, 0x08000cc8, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005300: 0x00009800, 0x80004000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005310: 0x00000000, 0x00000000, 0x00000000, 0x08001240
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005320: 0x30420080, 0x00000000, 0x00000000, 0x40000020
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005330: 0x00000000, 0x0000001d, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005340: 0x00000000, 0x00000000, 0x0800095c, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005380: 0x00009800, 0x80008000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005390: 0x00000000, 0x00000000, 0x00000000, 0x08000898
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000053a0: 0x3c101000, 0x00000000, 0x00000000, 0x40000020
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000053b0: 0x00000000, 0x0000001d, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000053c0: 0x00000000, 0x00000000, 0x080009ea, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005800: 0x00000000, 0xe5000000, 0x00000000, 0x0f000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005810: 0x00000000, 0x6c000000, 0x00000000, 0x05000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005820: 0x00000000, 0xda000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005860: 0x00000000, 0x00000000, 0x00000000, 0x000001c3
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005880: 0x00000000, 0x0000000e, 0x00000000, 0x000003ff
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005890: 0x00000000, 0x00000004, 0x00000000, 0x000000ea
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005900: 0x00000000, 0x0000009a, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00005980: 0x0000009a, 0x00000000, 0x00000000, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00005a00: 0x000f601f, 0x00000000, 0x00010000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006000: 0x20000082, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006400: 0x00000000, 0x00000000, 0x00010091, 0xc0000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006410: 0x05000016, 0x05000016, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006420: 0x00000000, 0x00000000, 0x00000000, 0x80fc0000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00006430: 0x78000000, 0x14e41686, 0x168614e4, 0x01020000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006440: 0x0000304f, 0x000002e4, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000064c0: 0x00000005, 0x00000002, 0x00000122, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000064d0: 0x00000040, 0x00008d80, 0x00000000, 0x00d75e11
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000064e0: 0x00000031, 0x0000001f, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000064f0: 0x00000002, 0x00000030, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006500: 0x03e10003, 0xe9c9a932, 0x00000c4d, 0x00000003
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00006510: 0x00078116, 0x0005810b, 0x00046105, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006550: 0x00000001, 0x02800000, 0x0000000f, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006560: 0x0000000f, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006800: 0x04130034, 0x20081082, 0x01009618, 0x0f132ad8
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00006810: 0x01122010, 0xffffffff, 0x00000000, 0x00000040
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006880: 0x77fff020, 0x00000040, 0x80011686, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006890: 0x00800000, 0x88008000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x000068a0: 0x00000000, 0x00010001, 0x00000000, 0x00000000
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x000068b0: 0x00040000, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006900: 0xd54959c8, 0x00000000, 0x00000000, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00006920: 0x00000000, 0x00000000, 0x00000001, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00007000: 0x00000188, 0x00000000, 0x00000000, 0x000001fc
[  +0.000002] tg3 0000:03:00.0 enp3s0f0: 0x00007010: 0x00000078, 0x02408200, 0x000500db, 0x03000a00
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00007020: 0x00000000, 0x00000000, 0x00000406, 0x10004000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00007030: 0x00010000, 0x00000200, 0x000c0030, 0x00000000
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00007500: 0x00000000, 0x00000000, 0x00000080, 0x00000000
[  +0.000005] tg3 0000:03:00.0 enp3s0f0: 0: Host status block [00000001:000000e5:(0000:00fc:0000):(0000:0052)]
[  +0.000004] tg3 0000:03:00.0 enp3s0f0: 0: NAPI info [000000e5:000000e5:(009a:0052:01ff):0000:(01c3:0000:0000:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 1: Host status block [00000001:0000000f:(0000:0000:0000):(000e:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 1: NAPI info [0000000f:0000000f:(0000:0000:01ff):000e:(000e:000e:0000:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 2: Host status block [00000001:0000006c:(03ff:0000:0000):(0000:0000)]
[  +0.000004] tg3 0000:03:00.0 enp3s0f0: 2: NAPI info [0000006c:0000006c:(0000:0000:01ff):03ff:(01ff:01ff:0000:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 3: Host status block [00000001:00000005:(0000:0000:0000):(0000:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 3: NAPI info [00000005:00000005:(0000:0000:01ff):0004:(0004:0004:0000:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 4: Host status block [00000001:000000da:(0000:0000:00ea):(0000:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 4: NAPI info [000000da:000000da:(0000:0000:01ff):00ea:(00ea:00ea:0000:0000)]
[  +0.129710] tg3 0000:03:00.0: tg3_stop_block timed out, ofs=1400 enable_bit=2
[  +0.027456] tg3 0000:03:00.0 enp3s0f0: Link is down
[  +2.950584] tg3 0000:03:00.0 enp3s0f0: Link is up at 1000 Mbps, full duplex
[  +0.000007] tg3 0000:03:00.0 enp3s0f0: Flow control is on for TX and on for RX
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: EEE is disabled
Comment 10 Adriel 2021-09-25 03:39:42 UTC
I've seen talk about newer kernels working, so tried the sid version on Debian.
Linux mini 5.14.0-1-amd64 #1 SMP Debian 5.14.6-2 (2021-09-19) x86_64 GNU/Linux

Now I get allot of Buffer overflow detected errors, and the occasional link down, but it's much much less frequent. like 1 every 3-4 mins and seems to recover faster, vs before, within seconds of high network traffic.



[Sep25 15:35] ------------[ cut here ]------------
[  +0.000005] Buffer overflow detected (8 < 192)!
[  +0.000018] WARNING: CPU: 2 PID: 600 at include/linux/thread_info.h:200 ethtool_rxnfc_copy_to_user+0x2b/0xb0
[  +0.000012] Modules linked in: xt_conntrack nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 xfrm_user xfrm_algo nft_counter xt_addrtype nft_compat nf_tables libcrc32c nfnetlink br_netfilter bridge stp llc intel_rapl_msr b43 intel_rapl_common cordic overlay x86_pkg_temp_thermal intel_powerclamp coretemp mac80211 btusb btrtl btbcm kvm_intel snd_hda_codec_hdmi btintel bluetooth cfg80211 kvm irqbypass ssb pcmcia ghash_clmulni_intel hid_appleir jitterentropy_rng pcmcia_core snd_hda_codec_cirrus libarc4 aesni_intel nls_ascii snd_hda_codec_generic sha512_ssse3 ledtrig_audio nls_cp437 rng_core mei_hdcp hid_generic crypto_simd cryptd vfat fat rapl snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi i915 sha512_generic evdev snd_hda_codec applesmc iTCO_wdt intel_cstate ctr snd_hda_core intel_pmc_bxt ttm iTCO_vendor_support drbg snd_hwdep intel_uncore sg watchdog ansi_cprng drm_kms_helper snd_pcm usbhid mei_me ecdh_generic snd_timer hid uas cec
[  +0.000069]  rfkill ecc rc_core usb_storage snd apple_mfi_fastcharge soundcore mei bcma i2c_algo_bit pcspkr efi_pstore button drm fuse configfs efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic sd_mod t10_pi crc_t10dif crct10dif_generic ahci libahci xhci_pci libata xhci_hcd crct10dif_pclmul crct10dif_common crc32_pclmul crc32c_intel scsi_mod i2c_i801 i2c_smbus lpc_ich tg3 usbcore sdhci_pci thunderbolt cqhci libphy sdhci mmc_core ptp pps_core usb_common video
[  +0.000031] CPU: 2 PID: 600 Comm: nmbd Tainted: G        W         5.14.0-1-amd64 #1  Debian 5.14.6-2
[  +0.000003] Hardware name: Apple Inc. Macmini7,1/Mac-35C5E08120C7EEAF, BIOS 431.140.6.0.0 06/13/2021
[  +0.000001] RIP: 0010:ethtool_rxnfc_copy_to_user+0x2b/0xb0
[  +0.000005] Code: 1f 44 00 00 41 55 65 48 8b 04 25 c0 7b 01 00 41 54 55 53 f6 40 10 02 75 23 be 08 00 00 00 48 c7 c7 28 16 30 a0 e8 64 4c 14 00 <0f> 0b 41 bc f2 ff ff ff 5b 44 89 e0 5d 41 5c 41 5d c3 48 89 fb 49
[  +0.000002] RSP: 0018:ffffa126007e3bf8 EFLAGS: 00010282
[  +0.000002] RAX: 0000000000000000 RBX: ffffffffc02a3200 RCX: ffff8fff27318888
[  +0.000001] RDX: 00000000ffffffd8 RSI: 0000000000000027 RDI: ffff8fff27318880
[  +0.000002] RBP: ffff8ffdc0c62000 R08: 0000000000000000 R09: ffffa126007e3a20
[  +0.000001] R10: ffffa126007e3a18 R11: ffffffffa08d3588 R12: 0000000000000000
[  +0.000001] R13: 00007ffdb6490750 R14: 0000000000000000 R15: ffffa126007e3c28
[  +0.000001] FS:  00007fa500f2da40(0000) GS:ffff8fff27300000(0000) knlGS:0000000000000000
[  +0.000002] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  +0.000001] CR2: 00007f3ecc19a000 CR3: 0000000104c8a002 CR4: 00000000001706e0
[  +0.000002] Call Trace:
[  +0.000004]  ethtool_get_rxnfc+0xcb/0x1b0
[  +0.000005]  dev_ethtool+0xb4b/0x28f0
[  +0.000005]  ? bpf_prog_79b52d7b53f3270b_netdata_close+0xfb/0x1bc
[  +0.000002]  ? tomoyo_init_request_info+0x8f/0xb0
[  +0.000005]  ? tomoyo_path_number_perm+0x66/0x1d0
[  +0.000003]  dev_ioctl+0x156/0x480
[  +0.000004]  sock_do_ioctl+0x9b/0x130
[  +0.000003]  sock_ioctl+0x23a/0x320
[  +0.000002]  __x64_sys_ioctl+0x83/0xb0
[  +0.000004]  do_syscall_64+0x3b/0xc0
[  +0.000005]  entry_SYSCALL_64_after_hwframe+0x44/0xae
[  +0.000004] RIP: 0033:0x7fa504899cc7
[  +0.000004] Code: 00 00 00 48 8b 05 c9 91 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 99 91 0c 00 f7 d8 64 89 01 48
[  +0.000002] RSP: 002b:00007ffdb64906e8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[  +0.000002] RAX: ffffffffffffffda RBX: 00005626d2dc1fb0 RCX: 00007fa504899cc7
[  +0.000001] RDX: 00007ffdb6490720 RSI: 0000000000008946 RDI: 0000000000000018
[  +0.000002] RBP: 0000000000000018 R08: 0000000000000000 R09: 003066307333706e
[  +0.000001] R10: 000000000000000d R11: 0000000000000246 R12: 00005626d2dc2160
[  +0.000001] R13: 00007ffdb6490720 R14: 00005626d2dc2ed0 R15: 00005626d2dc2f74
[  +0.000003] ---[ end trace a73cf734fa1709c2 ]---



[Sep25 15:34] ------------[ cut here ]------------
[  +0.000005] NETDEV WATCHDOG: enp3s0f0 (tg3): transmit queue 0 timed out
[  +0.000014] WARNING: CPU: 0 PID: 0 at net/sched/sch_generic.c:477 dev_watchdog+0x24a/0x250
[  +0.000008] Modules linked in: xt_conntrack nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 xfrm_user xfrm_algo nft_counter xt_addrtype nft_compat nf_tables libcrc32c nfnetlink br_netfilter bridge stp llc intel_rapl_msr b43 intel_rapl_common cordic overlay x86_pkg_temp_thermal intel_powerclamp coretemp mac80211 btusb btrtl btbcm kvm_intel snd_hda_codec_hdmi btintel bluetooth cfg80211 kvm irqbypass ssb pcmcia ghash_clmulni_intel hid_appleir jitterentropy_rng pcmcia_core snd_hda_codec_cirrus libarc4 aesni_intel nls_ascii snd_hda_codec_generic sha512_ssse3 ledtrig_audio nls_cp437 rng_core mei_hdcp hid_generic crypto_simd cryptd vfat fat rapl snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi i915 sha512_generic evdev snd_hda_codec applesmc iTCO_wdt intel_cstate ctr snd_hda_core intel_pmc_bxt ttm iTCO_vendor_support drbg snd_hwdep intel_uncore sg watchdog ansi_cprng drm_kms_helper snd_pcm usbhid mei_me ecdh_generic snd_timer hid uas cec
[  +0.000065]  rfkill ecc rc_core usb_storage snd apple_mfi_fastcharge soundcore mei bcma i2c_algo_bit pcspkr efi_pstore button drm fuse configfs efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 crc32c_generic sd_mod t10_pi crc_t10dif crct10dif_generic ahci libahci xhci_pci libata xhci_hcd crct10dif_pclmul crct10dif_common crc32_pclmul crc32c_intel scsi_mod i2c_i801 i2c_smbus lpc_ich tg3 usbcore sdhci_pci thunderbolt cqhci libphy sdhci mmc_core ptp pps_core usb_common video
[  +0.000048] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G        W         5.14.0-1-amd64 #1  Debian 5.14.6-2
[  +0.000004] Hardware name: Apple Inc. Macmini7,1/Mac-35C5E08120C7EEAF, BIOS 431.140.6.0.0 06/13/2021
[  +0.000002] RIP: 0010:dev_watchdog+0x24a/0x250
[  +0.000005] Code: 4c 52 fd ff eb a9 4c 89 f7 c6 05 f3 6e 0f 01 01 e8 eb 2d fa ff 44 89 e9 4c 89 f6 48 c7 c7 48 64 3a a0 48 89 c2 e8 55 34 16 00 <0f> 0b eb 8a 66 90 0f 1f 44 00 00 41 57 41 56 49 89 d6 41 55 4d 89
[  +0.000003] RSP: 0018:ffffa12600003eb0 EFLAGS: 00010282
[  +0.000004] RAX: 0000000000000000 RBX: ffff8ffdd16dc500 RCX: ffff8fff27218888
[  +0.000002] RDX: 00000000ffffffd8 RSI: 0000000000000027 RDI: ffff8fff27218880
[  +0.000002] RBP: ffff8ffdc0c623dc R08: 0000000000000000 R09: ffffa12600003cd8
[  +0.000002] R10: ffffa12600003cd0 R11: ffffffffa08d3588 R12: ffff8ffdc0c62480
[  +0.000002] R13: 0000000000000000 R14: ffff8ffdc0c62000 R15: ffff8ffdd16dc580
[  +0.000002] FS:  0000000000000000(0000) GS:ffff8fff27200000(0000) knlGS:0000000000000000
[  +0.000003] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  +0.000003] CR2: 00007f3ecc129000 CR3: 0000000103dc6002 CR4: 00000000001706f0
[  +0.000003] Call Trace:
[  +0.000003]  <IRQ>
[  +0.000004]  ? pfifo_fast_enqueue+0x150/0x150
[  +0.000004]  call_timer_fn+0x26/0xf0
[  +0.000006]  __run_timers.part.0+0x1ca/0x230
[  +0.000006]  ? perf_trace_softirq+0x9d/0xd0
[  +0.000007]  run_timer_softirq+0x26/0x50
[  +0.000005]  __do_softirq+0xc5/0x268
[  +0.000008]  irq_exit_rcu+0x99/0xb0
[  +0.000003]  sysvec_apic_timer_interrupt+0x72/0x90
[  +0.000006]  </IRQ>
[  +0.000001]  asm_sysvec_apic_timer_interrupt+0x12/0x20
[  +0.000005] RIP: 0010:cpuidle_enter_state+0xc7/0x350
[  +0.000006] Code: 8b 3d c5 4e 75 60 e8 18 ba a0 ff 49 89 c5 0f 1f 44 00 00 31 ff e8 99 c4 a0 ff 45 84 ff 0f 85 fa 00 00 00 fb 66 0f 1f 44 00 00 <45> 85 f6 0f 88 06 01 00 00 49 63 c6 4c 2b 2c 24 48 8d 14 40 48 8d
[  +0.000002] RSP: 0018:ffffffffa0803e60 EFLAGS: 00000246
[  +0.000002] RAX: ffff8fff2722ca80 RBX: 0000000000000001 RCX: 000000000000001f
[  +0.000002] RDX: 0000000000000000 RSI: 00000000313b14ef RDI: 0000000000000000
[  +0.000001] RBP: ffffc125ffc24a00 R08: 0000005bcd195955 R09: 0000000000000008
[  +0.000001] R10: 0000000000000043 R11: 0000000000000030 R12: ffffffffa09b9960
[  +0.000002] R13: 0000005bcd195955 R14: 0000000000000001 R15: 0000000000000000
[  +0.000005]  cpuidle_enter+0x29/0x40
[  +0.000005]  do_idle+0x1f6/0x2b0
[  +0.000005]  cpu_startup_entry+0x19/0x20
[  +0.000003]  start_kernel+0x6cf/0x6f4
[  +0.000007]  secondary_startup_64_no_verify+0xb0/0xbb
[  +0.000007] ---[ end trace a73cf734fa1709c1 ]---
[  +0.000006] tg3 0000:03:00.0 enp3s0f0: transmit timed out, resetting
[  +3.145384] tg3 0000:03:00.0 enp3s0f0: 0x00000000: 0x168614e4, 0x00100406, 0x02000001, 0x00800040
[  +0.000011] tg3 0000:03:00.0 enp3s0f0: 0x00000010: 0xa070000c, 0x00000000, 0xa071000c, 0x00000000
[  +0.000004] tg3 0000:03:00.0 enp3s0f0: 0x00000020: 0x00000000, 0x00000000, 0x00000000, 0x168614e4

--- removed similar lines ---

[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 0x00007500: 0x00000000, 0x00000000, 0x00000080, 0x00000000
[  +0.000004] tg3 0000:03:00.0 enp3s0f0: 0: Host status block [00000001:000000b8:(0000:0192:0000):(0000:01b8)]
[  +0.000004] tg3 0000:03:00.0 enp3s0f0: 0: NAPI info [000000b8:000000b8:(001e:01b8:01ff):0000:(005a:0000:0000:0000)]
[  +0.000004] tg3 0000:03:00.0 enp3s0f0: 1: Host status block [00000001:00000054:(0000:0000:0000):(004e:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 1: NAPI info [00000054:00000054:(0000:0000:01ff):004e:(004e:004e:0000:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 2: Host status block [00000001:00000089:(0000:0000:0000):(0000:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 2: NAPI info [00000089:00000089:(0000:0000:01ff):0000:(0000:0000:0000:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 3: Host status block [00000001:0000002d:(0000:0000:0000):(0000:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 3: NAPI info [0000002d:0000002d:(0000:0000:01ff):002c:(002c:002c:0000:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 4: Host status block [00000001:000000fb:(0000:0000:0118):(0000:0000)]
[  +0.000003] tg3 0000:03:00.0 enp3s0f0: 4: NAPI info [000000fb:000000fb:(0000:0000:01ff):0118:(0118:0118:0000:0000)]
[  +0.129648] tg3 0000:03:00.0: tg3_stop_block timed out, ofs=1400 enable_bit=2
[  +0.027452] tg3 0000:03:00.0 enp3s0f0: Link is down
[  +2.944530] tg3 0000:03:00.0 enp3s0f0: Link is up at 1000 Mbps, full duplex
[  +0.000004] tg3 0000:03:00.0 enp3s0f0: Flow control is on for TX and on for RX
[  +0.000001] tg3 0000:03:00.0 enp3s0f0: EEE is disabled
Comment 11 Adriel 2021-09-25 03:41:48 UTC
Edit, seems the Buffer overflow detected errors will be fixed in 5.14.7, so probably unrelated to the network issue (especially since I still get the errors without network traffic). https://lkml.org/lkml/2021/9/22/279
Comment 12 Dominik Mierzejewski 2021-10-29 12:43:58 UTC
(In reply to Dominik Mierzejewski from comment #6)
> (In reply to David Rokhvarg from comment #5)
> > In addition to my previous comment:
> > 
> > 1. Adding iommu=pt to GRUB_CMDLINE_LINUX_DEFAULT seems to solve the problem
> > on ElitDesk computer.
> 
> Thanks for the tip, I'll try if that works around the problem for me.

And, unfortunately, it doesn't. I'm still getting these despite setting iommu=pt.

Note You need to log in before you can comment on or make changes to this bug.