Bug 183851

Summary: pci(e) ethernet nonworking when without acpi=off when using pcie-switch based eth card - Asus A88XM-PLUS/AMD
Product: ACPI Reporter: abittner (abittner)
Component: OtherAssignee: acpi_other
Status: NEW ---    
Severity: normal CC: crysmi, joseluismantilla, lenb, pstaszewski, tiwai
Priority: P1    
Hardware: x86-64   
OS: Linux   
Kernel Version: opensuse 4.9.0-rc2-1.g436f01e-vanilla (geeko@buildhost) (gcc version 6.2.1 20160830 [gcc-6-branch revision 239856] (SUSE Linux) ) #1 SMP Subsystem:
Regression: No Bisected commit-id:

Description abittner 2016-10-27 08:18:14 UTC 
I have two long standing bugs with opensuse at:

<https://bugzilla.opensuse.org/show_bug.cgi?id=1006696>
and the older version of the same (with older bios on the amd mainboard and older opensuse kernel)
<https://bugzilla.opensuse.org/show_bug.cgi?id=851175>

To make a long story short:

I have multiple ethernet cards (pcie) in pcie slots on an asus amd x64 board (A88XM-PLUS, latest bios from 2016) and one onboard ethernet chip as well.

Without adding acpi=off as kernel boot parameter (via grub2), the machine can not work with any of the pcie or onboard realtek based ethernet cards. Watchdog timeouts and stacktraces appear in the logs, I have it all documented on the two opensuse bugreports already and have been asked to file it here as well as its even happening with current vanilla kernel.

This all happens only because I have added two more dual ethernet cards into additional pcie slots of the boards. Using the motherboard with only the single onboard ethernet realtek chip works fine with the opensuse kernels, but as this machine is doing routing and multiple networks it was fitted with multiple ethernet cards.

When using any of these, as far as I understand pcie-switch based, pcie cards, the problems started and all I was able to do is, to resort to setting acpi=off. Only then can I use (ping, traffic, etc.) the various ethernet cards normally and multiple of them.

Leap 42.1 kernel:
Linux version 4.1.31-30-default (geeko@buildhost) (gcc version 4.8.5 (SUSE Linux) ) #1 SMP PREEMPT Wed Aug 24 06:20:09 UTC 2016 (de9ddf8)

Newer vanilla kernel:
Linux version 4.9.0-rc2-1.g436f01e-vanilla (geeko@buildhost) (gcc version 6.2.1 20160830 [gcc-6-branch revision 239856] (SUSE Linux) ) #1 SMP

------------------


dmesg output when using without acpi=off:


[    0.000000] Linux version 4.9.0-rc2-1.g436f01e-vanilla (geeko@buildhost) (gcc version 6.2.1 20160830 [gcc-6-branch revision 239856] (SUSE Linux) ) #1 SMP PREEMPT Mon Oct 24 14:25:56 UTC 2016 (436f01e)
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-vanilla root=UUID=80557e25-508f-476e-a3cb-b75da8878d32 resume=/dev/disk/by-id/ata-WDC_WD40EFRX-68WT0N0_WD-WCC4E0287517-part1 splash=silent quiet showopts

[    0.000000] DMI: System manufacturer System Product Name/A88XM-PLUS, BIOS 2903 03/10/2016

[    0.249540] smpboot: CPU0: AMD A10-6800K APU with Radeon(tm) HD Graphics (family: 0x15, model: 0x13, stepping: 0x1)


[   48.016478] ------------[ cut here ]------------
[   48.016503] WARNING: CPU: 2 PID: 0 at ../net/sched/sch_generic.c:316 dev_watchdog+0x228/0x230
[   48.016506] NETDEV WATCHDOG: eth3 (r8169): transmit queue 0 timed out
[   48.016508] Modules linked in: nf_log_ipv6 ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_pkttype xt_TCPMSS nf_log_ipv4 nf_log_common xt_LOG xt_limit iptable_nat nf_nat_ipv4 nf_nat af_packet iscsi_ibft iscsi_boot_sysfs ip6t_REJECT nf_reject_ipv6 xt_tcpudp nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_raw ipt_REJECT nf_reject_ipv4 iptable_raw xt_CT iptable_filter ip6table_mangle nf_conntrack_netbios_ns nf_conntrack_broadcast nf_conntrack_ipv4 nf_defrag_ipv4 ip_tables xt_conntrack nf_conntrack ip6table_filter ip6_tables x_tables joydev hid_generic snd_hda_codec_realtek usbhid dm_mod edac_mce_amd edac_core snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_hda_codec snd_hda_core kvm_amd kvm uas usb_storage snd_hwdep snd_pcm snd_seq snd_seq_device snd_timer sp5100_tco i2c_piix4 k10temp irqbypass snd tpm_infineon
[   48.016553]  acpi_cpufreq tpm_tis fjes tpm_tis_core ppdev r8169 mii soundcore shpchp crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel eeepc_wmi asus_wmi sparse_keymap rfkill wmi parport_pc parport video button tpm pcspkr aes_x86_64 lrw glue_helper serio_raw ablk_helper cryptd ohci_pci sr_mod cdrom ehci_pci ohci_hcd ehci_hcd xhci_pci xhci_hcd usbcore radeon i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm sg
[   48.016591] CPU: 2 PID: 0 Comm: swapper/2 Not tainted 4.9.0-rc2-1.g436f01e-vanilla #1
[   48.016592] Hardware name: System manufacturer System Product Name/A88XM-PLUS, BIOS 2903 03/10/2016
[   48.016595]  ffff91beded03db0 ffffffffb73c31a0 ffff91beded03e00 0000000000000000
[   48.016598]  ffff91beded03df0 ffffffffb7083ccb 0000013c00000246 0000000000000000
[   48.016601]  ffff91becb578480 0000000000000002 ffff91becd0fc000 0000000000000001
[   48.016605] Call Trace:
[   48.016606]  <IRQ>
[   48.016611]  [<ffffffffb73c31a0>] dump_stack+0x63/0x83
[   48.016614]  [<ffffffffb7083ccb>] __warn+0xcb/0xf0
[   48.016617]  [<ffffffffb7083d3f>] warn_slowpath_fmt+0x4f/0x60
[   48.016620]  [<ffffffffb70b73fd>] ? cpu_load_update+0xdd/0x150
[   48.016623]  [<ffffffffb76361d8>] dev_watchdog+0x228/0x230
[   48.016625]  [<ffffffffb7635fb0>] ? qdisc_rcu_free+0x40/0x40
[   48.016628]  [<ffffffffb70f4ba5>] call_timer_fn+0x35/0x150
[   48.016630]  [<ffffffffb7635fb0>] ? qdisc_rcu_free+0x40/0x40
[   48.016633]  [<ffffffffb70f5330>] run_timer_softirq+0x220/0x4b0
[   48.016635]  [<ffffffffb70fd4d1>] ? ktime_get+0x41/0xb0
[   48.016638]  [<ffffffffb705291d>] ? lapic_next_event+0x1d/0x30
[   48.016641]  [<ffffffffb7103d1f>] ? clockevents_program_event+0x7f/0x120
[   48.016644]  [<ffffffffb771b454>] __do_softirq+0x104/0x2c1
[   48.016646]  [<ffffffffb708a086>] irq_exit+0xb6/0xc0
[   48.016648]  [<ffffffffb771b232>] smp_apic_timer_interrupt+0x42/0x50
[   48.016649]  [<ffffffffb771a542>] apic_timer_interrupt+0x82/0x90
[   48.016650]  <EOI>
[   48.016654]  [<ffffffffb75ca502>] ? cpuidle_enter_state+0x122/0x300
[   48.016657]  [<ffffffffb75ca717>] cpuidle_enter+0x17/0x20
[   48.016659]  [<ffffffffb70c7f63>] call_cpuidle+0x23/0x40
[   48.016661]  [<ffffffffb70c81cc>] cpu_startup_entry+0x14c/0x230
[   48.016664]  [<ffffffffb7051469>] start_secondary+0x149/0x170
[   48.016667] ---[ end trace 1541ed3f835f552d ]---


Some hardware information:

lspci -t
-[0000:00]-+-00.0
           +-00.2
           +-01.0
           +-01.1
           +-04.0-[01-05]----00.0-[02-05]--+-01.0-[03]----00.0
           |                               +-02.0-[04]--
           |                               \-03.0-[05]----00.0
           +-10.0
           +-10.1
           +-11.0
           +-12.0
           +-12.2
           +-13.0
           +-13.2
           +-14.0
           +-14.2
           +-14.3
           +-14.4-[06]--
           +-15.0-[07-0b]----00.0-[08-0b]--+-01.0-[09]----00.0
           |                               +-02.0-[0a]--
           |                               \-03.0-[0b]----00.0
           +-15.1-[0c]----00.0
           +-18.0
           +-18.1
           +-18.2
           +-18.3
           +-18.4
           \-18.5


lspci
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Root Complex
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) I/O Memory Management Unit
00:01.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Richland [Radeon HD 8670D]
00:01.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Trinity HDMI Audio Controller
00:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Root Port
00:10.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller (rev 09)
00:10.1 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller (rev 09)
00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 40)
00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller (rev 11)
00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller (rev 11)
00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller (rev 11)
00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller (rev 11)
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 16)
00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD] FCH Azalia Controller (rev 01)
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 11)
00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD] FCH PCI Bridge (rev 40)
00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge (PCIE port 0)
00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge (PCIE port 1)
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 3
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 5
01:00.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
02:01.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
02:02.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
02:03.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06)
05:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06)
07:00.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
08:01.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
08:02.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
08:03.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
09:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06)
0b:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06)
0c:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 0c)



dmesg | grep -i rtl
[    7.022582] r8169 0000:03:00.0 eth0: RTL8168evl/8111evl at 0xffffc90001b34000, 00:13:3b:0e:50:7c, XID 0c900800 IRQ 45
[    7.023079] r8169 0000:05:00.0 eth1: RTL8168evl/8111evl at 0xffffc90001b36000, 00:13:3b:0e:50:7b, XID 0c900800 IRQ 46
[    7.023576] r8169 0000:09:00.0 eth2: RTL8168evl/8111evl at 0xffffc90001b38000, 00:13:3b:0e:50:77, XID 0c900800 IRQ 47
[    7.024050] r8169 0000:0b:00.0 eth3: RTL8168evl/8111evl at 0xffffc90001b3a000, 00:13:3b:0e:50:78, XID 0c900800 IRQ 48
[    7.033062] r8169 0000:0c:00.0 eth4: RTL8168g/8111g at 0xffffc90001b56000, d8:50:e6:4c:08:d4, XID 0c000800 IRQ 49



 lspci -t -v
-[0000:00]-+-00.0  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Root Complex
           +-00.2  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) I/O Memory Management Unit
           +-01.0  Advanced Micro Devices, Inc. [AMD/ATI] Richland [Radeon HD 8670D]
           +-01.1  Advanced Micro Devices, Inc. [AMD/ATI] Trinity HDMI Audio Controller
           +-04.0-[01-05]----00.0-[02-05]--+-01.0-[03]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
           |                               +-02.0-[04]--
           |                               \-03.0-[05]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
           +-10.0  Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller
           +-10.1  Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller
           +-11.0  Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
           +-12.0  Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller
           +-12.2  Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller
           +-13.0  Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller
           +-13.2  Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller
           +-14.0  Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller
           +-14.2  Advanced Micro Devices, Inc. [AMD] FCH Azalia Controller
           +-14.3  Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge
           +-14.4-[06]--
           +-15.0-[07-0b]----00.0-[08-0b]--+-01.0-[09]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
           |                               +-02.0-[0a]--
           |                               \-03.0-[0b]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
           +-15.1-[0c]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
           +-18.0  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 0
           +-18.1  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 1
           +-18.2  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 2
           +-18.3  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 3
           +-18.4  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 4
           \-18.5  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 5




-------------

Additional note: I have these very same pcie dual-port ethernet cards on a different, older generation amd x64 mainboard as well, and opensuse kernel does not have any trouble running there, so I dont have to use acpi=off on that machine. I can add its technical configuration and some messages from that as well if needed.
Comment 1 abittner 2016-11-03 11:58:51 UTC 
Maybe I have more hints or an idea, that it is about pcie devices with own pcie buses via pcie-bridges/pcie-switches coming on their pcbs plugged into a pcie socket that is directly originating from modern amd apu/cpu instead of pcie bus that originates from the motherboard chipset itself.
Actually a mix of pcie slots coming from the cpu itself and pcie bus coming from the chipset (amd hudson d4)

Some block diagram of certain amd chipsets and so on could maybe help or maybe I am completely wrong.

I have built and reproduced with another spare test device here.

Asus Amd board: F2A85-M PRO
AMD A85X FCH(Hudson D4) chipset
<https://www.asus.com/Motherboards/F2A85M_PRO/specifications/>

latest bios:
    Vendor: "American Megatrends Inc."
    Version: "6601"
    Date: "11/25/2014"

With apu processor:
[    0.405093] smpboot: CPU0: AMD A10-5700 APU with Radeon(tm) HD Graphics (fam: 15, model: 10, stepping: 01)


Tested on older OpenSuSE 42.1 leap x64
Linux linux 4.1.34-33-default #1 SMP PREEMPT Thu Oct 20 08:03:29 UTC 2016 (fe18aba) x86_64 x86_64 x86_64 GNU/Linux


Putting in the same pericom pcie switch (or bridge?) based dual ethernet port pcie network card

lspci
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Root Complex
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) I/O Memory Management Unit
00:01.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Trinity [Radeon HD 7660D]
00:01.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Trinity HDMI Audio Controller
00:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Root Port
00:10.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller (rev 03)
00:10.1 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller (rev 03)
00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 40)
00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller (rev 11)
00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller (rev 11)
00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller (rev 11)
00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller (rev 11)
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 14)
00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD] FCH Azalia Controller (rev 01)
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 11)
00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD] FCH PCI Bridge (rev 40)
00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge (PCIE port 0)
00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge (PCIE port 1)
00:15.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge (PCIE port 2)
00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge (PCIE port 3)
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 3
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 5
01:00.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
02:01.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
02:02.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
02:03.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06)
05:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06)
08:00.0 USB controller: ASMedia Technology Inc. ASM1042 SuperSpeed USB Host Controller
09:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 09)
0a:00.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
0b:01.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
0b:02.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
0b:03.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
0c:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06)
0e:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06)



lspci -tv
-[0000:00]-+-00.0  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Root Complex
           +-00.2  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) I/O Memory Management Unit
           +-01.0  Advanced Micro Devices, Inc. [AMD/ATI] Trinity [Radeon HD 7660D]
           +-01.1  Advanced Micro Devices, Inc. [AMD/ATI] Trinity HDMI Audio Controller
           +-02.0-[01-05]----00.0-[02-05]--+-01.0-[03]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
           |                               +-02.0-[04]--
           |                               \-03.0-[05]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
           +-10.0  Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller
           +-10.1  Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller
           +-11.0  Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
           +-12.0  Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller
           +-12.2  Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller
           +-13.0  Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller
           +-13.2  Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller
           +-14.0  Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller
           +-14.2  Advanced Micro Devices, Inc. [AMD] FCH Azalia Controller
           +-14.3  Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge
           +-14.4-[06]--
           +-15.0-[07]--
           +-15.1-[08]----00.0  ASMedia Technology Inc. ASM1042 SuperSpeed USB Host Controller
           +-15.2-[09]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
           +-15.3-[0a-0e]----00.0-[0b-0e]--+-01.0-[0c]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
           |                               +-02.0-[0d]--
           |                               \-03.0-[0e]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
           +-18.0  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 0
           +-18.1  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 1
           +-18.2  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 2
           +-18.3  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 3
           +-18.4  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 4
           \-18.5  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 5




The one dual port ethernet card is attached in an x16 pcie slot, that sits right next to the cpu socket, and if i understand lspci correctly and identify those devices and components the one dual ethernet nic is connected to: +-02.0
Which would be: 00:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Root Port

The other dual port ethernet card is attached to an x1 pcie slot further away and apparently attached to: +-15.3-
00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge (PCIE port 3)

I am attaching a simple ethernet switch to this second dual ethernet card sitting in 15.3 and simply seeing an established link (eth4) in kernel messages. The other three ports (one from this same dual ethernet and both of the first dual ethernet) are down and unconnected to anything. Then there is an onboard pcie ethernet port of the mainboard itself that I am mainly using on the lan and to access ip internet.

Apparently only when I at least connect a simple ethernet switch via rj45 cable to one of the ports of this e.g. second dual ethernet pcie card (15.3) , and the link becomming active (nic and switch leds show link established), but not even binding ip or addresses to it and letting it only stay idle but up, I get kernel (dmesg) messages of the same kind as above from my original production affected system:



[   95.796297] r8169 0000:0e:00.0 eth4: link up
[  198.044202] ------------[ cut here ]------------
[  198.044232] WARNING: CPU: 0 PID: 0 at ../net/sched/sch_generic.c:308 dev_watchdog+0x22e/0x240()
[  198.044235] NETDEV WATCHDOG: eth4 (r8169): transmit queue 0 timed out
[  198.044237] Modules linked in: fuse bnep bluetooth af_packet iscsi_ibft iscsi_boot_sysfs joydev hid_generic snd_hda_codec_realtek snd_hda_codec_generic snd_hda_codec_hdmi dm_mod snd_hda_intel snd_hda_controller snd_hda_codec snd_hda_core snd_hwdep usbhid snd_pcm_oss snd_pcm snd_seq snd_seq_device snd_timer snd_mixer_oss snd r8169 mii soundcore i2c_piix4 shpchp k10temp kvm_amd kvm crct10dif_pclmul eeepc_wmi asus_wmi sparse_keymap rfkill crc32_pclmul video crc32c_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd pcspkr serio_raw 8250_fintek tpm_infineon tpm_tis wmi tpm acpi_cpufreq button processor ohci_pci ehci_pci ohci_hcd ehci_hcd radeon xhci_pci xhci_hcd sr_mod cdrom usbcore usb_common i2c_algo_bit drm_kms_helper ttm drm sg
[  198.044287] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 4.1.34-33-default #1
[  198.044289] Hardware name: System manufacturer System Product Name/F2A85-M PRO, BIOS 6601 11/25/2014
[  198.044291]  0000000000000286 0000000000000000 ffffffff8165f7d1 00000000000400f6
[  198.044294]  ffff88083ec03de8 ffffffff81aa162c ffffffff81068961 0000000000000000
[  198.044297]  ffff880819dfe000 0000000000000001 ffff880819dfe3e0 0000000000000000
[  198.044299] Call Trace:
[  198.044312]  [<ffffffff810055cc>] dump_trace+0x8c/0x340
[  198.044316]  [<ffffffff8100597c>] show_stack_log_lvl+0xfc/0x1a0
[  198.044320]  [<ffffffff81006ec1>] show_stack+0x21/0x50
[  198.044325]  [<ffffffff8165f7d1>] dump_stack+0x5d/0x79
[  198.044330]  [<ffffffff81068961>] warn_slowpath_common+0x81/0xb0
[  198.044334]  [<ffffffff810689da>] warn_slowpath_fmt+0x4a/0x50
[  198.044337]  [<ffffffff8158acee>] dev_watchdog+0x22e/0x240
[  198.044343]  [<ffffffff810d16c0>] call_timer_fn+0x30/0x170
[  198.044347]  [<ffffffff810d1b4b>] run_timer_softirq+0x25b/0x310
[  198.044353]  [<ffffffff8106cef1>] __do_softirq+0xf1/0x300
[  198.044358]  [<ffffffff8106d345>] irq_exit+0x95/0xa0
[  198.044362]  [<ffffffff81668c6e>] smp_apic_timer_interrupt+0x3e/0x50
[  198.044367]  [<ffffffff81666ede>] apic_timer_interrupt+0x6e/0x80
[  198.044373]  [<ffffffff81525da8>] cpuidle_enter_state+0xc8/0x260
[  198.044378]  [<ffffffff810aa959>] cpu_idle_loop+0x379/0x410
[  198.044388]  [<ffffffff810aaa49>] cpu_startup_entry+0x59/0x60
[  198.044393]  [<ffffffff81f2a083>] start_kernel+0x4a3/0x4ae
[  198.044397]  [<ffffffff81f296f9>] x86_64_start_kernel+0x149/0x158
[  198.044401] ---[ end trace 62a15a291aecf7fc ]---
[  198.054577] r8169 0000:0e:00.0 eth4: link up
[  264.018923] r8169 0000:0e:00.0 eth4: link up



And it often seems to "reestablish" its link, and the OpenSuSE Network manager or some popup from the tray area of KDE keeps popping up and telling me eth4 would be up or down or not configured and that kind of stuff.

I dont seem to notice a flickering led on neither the ethernet switch nor on the nic itself though.

Maybe the software paths in the driver and kernel only become crowded or struggling with that bug when there is actually software only even slightly using it e.g. link established and so on.

I can shuffle the pcie dual ethernet cards around abit more and maybe move then away from the apu/cpu pcie bus all to the chipset pcie bus, and try again? Anything else needed?
Comment 2 abittner 2016-11-03 12:16:20 UTC 
Removed the one dualport pcie card from the x16 slot but still getting same watchdog errors:


[   39.407042] r8169 0000:09:00.0 eth4: link up
[  106.058374] ------------[ cut here ]------------
[  106.058384] WARNING: CPU: 3 PID: 2421 at ../net/sched/sch_generic.c:308 dev_watchdog+0x22e/0x240()
[  106.058387] NETDEV WATCHDOG: eth4 (r8169): transmit queue 0 timed out
[  106.058388] Modules linked in: bnep bluetooth fuse af_packet iscsi_ibft iscsi_boot_sysfs joydev hid_generic usbhid snd_hda_codec_realtek snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_hda_controller snd_hda_codec snd_hda_core snd_hwdep snd_pcm_oss snd_pcm snd_seq snd_seq_device snd_timer snd_mixer_oss dm_mod snd eeepc_wmi asus_wmi sparse_keymap rfkill video r8169 mii soundcore i2c_piix4 k10temp shpchp kvm_amd kvm crct10dif_pclmul crc32_pclmul crc32c_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd pcspkr serio_raw wmi 8250_fintek tpm_infineon tpm_tis tpm acpi_cpufreq button processor ohci_pci ehci_pci ohci_hcd ehci_hcd sr_mod cdrom xhci_pci xhci_hcd usbcore usb_common radeon i2c_algo_bit drm_kms_helper ttm drm sg
[  106.058430] CPU: 3 PID: 2421 Comm: zypper Not tainted 4.1.34-33-default #1
[  106.058432] Hardware name: System manufacturer System Product Name/F2A85-M PRO, BIOS 6601 11/25/2014
[  106.058434]  0000000000000286 0000000000000000 ffffffff8165f7d1 0000000000000000
[  106.058436]  ffff88083ed83de8 ffffffff81aa162c ffffffff81068961 0000000000000000
[  106.058439]  ffff880818c16000 0000000000000001 ffff880818c163e0 0000000000000003
[  106.058441] Call Trace:
[  106.058452]  [<ffffffff810055cc>] dump_trace+0x8c/0x340
[  106.058456]  [<ffffffff8100597c>] show_stack_log_lvl+0xfc/0x1a0
[  106.058459]  [<ffffffff81006ec1>] show_stack+0x21/0x50
[  106.058466]  [<ffffffff8165f7d1>] dump_stack+0x5d/0x79
[  106.058470]  [<ffffffff81068961>] warn_slowpath_common+0x81/0xb0
[  106.058474]  [<ffffffff810689da>] warn_slowpath_fmt+0x4a/0x50
[  106.058476]  [<ffffffff8158acee>] dev_watchdog+0x22e/0x240
[  106.058481]  [<ffffffff810d16c0>] call_timer_fn+0x30/0x170
[  106.058484]  [<ffffffff810d1b4b>] run_timer_softirq+0x25b/0x310
[  106.058489]  [<ffffffff8106cef1>] __do_softirq+0xf1/0x300
[  106.058492]  [<ffffffff8106d345>] irq_exit+0x95/0xa0
[  106.058496]  [<ffffffff81668c6e>] smp_apic_timer_interrupt+0x3e/0x50
[  106.058500]  [<ffffffff81666ede>] apic_timer_interrupt+0x6e/0x80
[  106.058506]  [<00007f99bdac8d23>] 0x7f99bdac8d23
[  106.058507] ---[ end trace 09802ad09b12a2d5 ]---
[  106.068708] r8169 0000:09:00.0 eth4: link up
[  184.026800] r8169 0000:09:00.0 eth4: link up


ifconfig eth4
eth4      Link encap:Ethernet  HWaddr 00:13:3B:0F:42:9B  
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:94 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)



lspci
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Root Complex
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) I/O Memory Management Unit
00:01.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Trinity [Radeon HD 7660D]
00:01.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Trinity HDMI Audio Controller
00:10.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller (rev 03)
00:10.1 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller (rev 03)
00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 40)
00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller (rev 11)
00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller (rev 11)
00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller (rev 11)
00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller (rev 11)
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 14)
00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD] FCH Azalia Controller (rev 01)
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 11)
00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD] FCH PCI Bridge (rev 40)
00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge (PCIE port 0)
00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge (PCIE port 1)
00:15.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge (PCIE port 2)
00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Hudson PCI to PCI bridge (PCIE port 3)
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 3
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 5
03:00.0 USB controller: ASMedia Technology Inc. ASM1042 SuperSpeed USB Host Controller
04:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 09)
05:00.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
06:01.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
06:02.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
06:03.0 PCI bridge: Pericom Semiconductor Device 2404 (rev 05)
07:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06)
09:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06)



lspci -tv
-[0000:00]-+-00.0  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Root Complex
           +-00.2  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) I/O Memory Management Unit
           +-01.0  Advanced Micro Devices, Inc. [AMD/ATI] Trinity [Radeon HD 7660D]
           +-01.1  Advanced Micro Devices, Inc. [AMD/ATI] Trinity HDMI Audio Controller
           +-10.0  Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller
           +-10.1  Advanced Micro Devices, Inc. [AMD] FCH USB XHCI Controller
           +-11.0  Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
           +-12.0  Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller
           +-12.2  Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller
           +-13.0  Advanced Micro Devices, Inc. [AMD] FCH USB OHCI Controller
           +-13.2  Advanced Micro Devices, Inc. [AMD] FCH USB EHCI Controller
           +-14.0  Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller
           +-14.2  Advanced Micro Devices, Inc. [AMD] FCH Azalia Controller
           +-14.3  Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge
           +-14.4-[01]--
           +-15.0-[02]--
           +-15.1-[03]----00.0  ASMedia Technology Inc. ASM1042 SuperSpeed USB Host Controller
           +-15.2-[04]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
           +-15.3-[05-09]----00.0-[06-09]--+-01.0-[07]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
           |                               +-02.0-[08]--
           |                               \-03.0-[09]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
           +-18.0  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 0
           +-18.1  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 1
           +-18.2  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 2
           +-18.3  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 3
           +-18.4  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 4
           \-18.5  Advanced Micro Devices, Inc. [AMD] Family 15h (Models 10h-1fh) Processor Function 5
Comment 3 Jose Luis Mantilla 2017-01-31 05:25:11 UTC 
I have the same issue. The possible fix right now is booting from whatever kernel 4.8.x or < 4.9.x. -- The kernel 4.9 includes something strange and I have the last bios firmware.
Comment 4 Pawel Staszewski 2017-08-22 07:14:19 UTC 
I found similar problem with ixgbe driver 
02:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

So it looks like it is not related only to realtek driver.

Have installed 4x (2x10G) network controllers:
02:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
02:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
03:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
03:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
81:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
81:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
82:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
82:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

and on the latest kernel 4.12.8
[ 2452.163445] NETDEV WATCHDOG: eth0 (ixgbe): transmit queue 0 timed out
[ 2452.163467] ------------[ cut here ]------------
[ 2452.163475] WARNING: CPU: 11 PID: 0 at net/sched/sch_generic.c:316 dev_watchdog+0xc5/0x122
[ 2452.163476] Modules linked in: ipmi_si x86_pkg_temp_thermal
[ 2452.163482] CPU: 11 PID: 0 Comm: swapper/11 Tainted: G          I     4.12.8 #1
[ 2452.163483] task: ffff88086d8fe200 task.stack: ffffc90003214000
[ 2452.163485] RIP: 0010:dev_watchdog+0xc5/0x122
[ 2452.163485] RSP: 0018:ffff88087f843ea0 EFLAGS: 00010286
[ 2452.163486] RAX: 0000000000000039 RBX: ffff88046ca78000 RCX: 0000000000000000
[ 2452.163487] RDX: ffff88087f853310 RSI: ffff88087f84caa8 RDI: ffff88087f84caa8
[ 2452.163487] RBP: ffff88087f843eb0 R08: 0000000000000000 R09: 0000000000000000
[ 2452.163488] R10: 00000000003d0900 R11: ffff88087ff9194c R12: 0000000000000000
[ 2452.163489] R13: ffffffff815a37a2 R14: ffff88046ca78438 R15: ffff88046ca78000
[ 2452.163490] FS:  0000000000000000(0000) GS:ffff88087f840000(0000) knlGS:0000000000000000
[ 2452.163490] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 2452.163491] CR2: 00000000006b2008 CR3: 0000000001c09000 CR4: 00000000001406e0
[ 2452.163492] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 2452.163492] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 2452.163493] Call Trace:
[ 2452.163494]  <IRQ>
[ 2452.163500]  call_timer_fn+0x5b/0x123
[ 2452.163501]  run_timer_softirq+0x137/0x15a
[ 2452.163503]  ? tk_clock_read+0xc/0xe
[ 2452.163505]  ? timekeeping_get_ns+0x1d/0x31
[ 2452.163506]  ? ktime_get+0x2d/0x3e
[ 2452.163508]  __do_softirq+0xe4/0x23a
[ 2452.163512]  ? tick_program_event+0x5d/0x64
[ 2452.163513]  irq_exit+0x4d/0x5b
[ 2452.163518]  smp_apic_timer_interrupt+0x29/0x34
[ 2452.163520]  apic_timer_interrupt+0x86/0x90
[ 2452.163524] RIP: 0010:cpuidle_enter_state+0x12f/0x184
[ 2452.163525] RSP: 0018:ffffc90003217ea0 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10
[ 2452.163526] RAX: 0000023af054988b RBX: 0000000000000002 RCX: 000000000000001f
[ 2452.163527] RDX: 0000000000000000 RSI: 000000000000000b RDI: 0000000000000000
[ 2452.163527] RBP: ffffc90003217ed0 R08: 00000000ffffffe3 R09: 000000003ff003ff
[ 2452.163528] R10: ffffc90003217e70 R11: 0000000000000004 R12: ffff88086c10d400
[ 2452.163528] R13: 0000023af054988b R14: 0000000000000002 R15: 0000023af0528d14
[ 2452.163529]  </IRQ>
[ 2452.163531]  cpuidle_enter+0x12/0x14
[ 2452.163534]  do_idle+0x10e/0x166
[ 2452.163535]  cpu_startup_entry+0x1a/0x1c
[ 2452.163537]  start_secondary+0xd0/0xd3
[ 2452.163540]  secondary_startup_64+0x9f/0x9f
[ 2452.163541] Code: 70 15 73 00 00 75 38 48 89 df c6 05 64 15 73 00 01 e8 1d 4a fe ff 44 89 e1 48 89 de 48 c7 c7 eb 8f a9 81 48 89 c2 e8 b4 ab b3 ff <0f> ff eb 10 41 ff c4 48 05 40 01 00 00 41 39 f4 75 9a eb 0d 48
[ 2452.163559] ---[ end trace e35aaedfdb6bf6da ]---
[ 2452.163562] ixgbe 0000:02:00.0 eth0: initiating reset due to tx timeout
[ 2452.163579] ixgbe 0000:02:00.0 eth0: Reset adapter
[ 2473.173038] ixgbe 0000:02:00.0 eth0: detected SFP+: 5
[ 2473.325081] ixgbe 0000:02:00.0 eth0: NIC Link is Up 10 Gbps, Flow Control: None
[ 2473.450701] ixgbe 0000:02:00.0 eth0: NIC Link is Down
[ 2473.450784] ixgbe 0000:02:00.0 eth0: initiating reset to clear Tx work after link loss
[ 2473.537116] ixgbe 0000:02:00.0 eth0: Reset adapter
Comment 5 abittner 2022-05-10 12:40:12 UTC 
after many years I have made some progress in researching this piece of hardware and finding a kernel (opensuse leap 15.4 with KOTD from today, kernel-default-5.18~rc6-lp153.2.1.ged50f8f.x86_64  ) which renders this hardware at last fully functional. at least I was able to use the two LAN ports of this dualported NIC for networking.

my current bugreport over there with the finding:
<https://bugzilla.opensuse.org/show_bug.cgi?id=1199390>

I dont know what changes and patches of what kernel fixed this exactly, but I have written a small bugreport for original opensuse leap 15.4 (still beta/RC level, with kernel kernel-default-5.14.21-150400.19.1.x86_64 ) today where it still does not work, still produces watchdog errors and all.

So somewhere between kernel-default-5.14.21-150400.19.1.x86_64  and  5.18~rc6-lp153.2.1.ged50f8f.x86_64  seems to have brought in the fix for this pericom pcie switch hardware.

Thank you lots.