Bug 218412 - Low throughput in WireGuard VPN
Summary: Low throughput in WireGuard VPN
Status: NEW
Alias: None
Product: Networking
Classification: Unclassified
Component: Other (show other bugs)
Hardware: Intel Linux
: P3 normal
Assignee: Stephen Hemminger
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2024-01-23 15:07 UTC by Aleksei Zuev
Modified: 2024-01-26 00:30 UTC (History)
0 users

See Also:
Kernel Version: 6.8.0-1rc
Subsystem:
Regression: No
Bisected commit-id:


Attachments
kernel config (203.71 KB, text/plain)
2024-01-23 15:07 UTC, Aleksei Zuev
Details
lshw on server with updated kernel 6.8.0-1rc (121.34 KB, text/plain)
2024-01-23 15:08 UTC, Aleksei Zuev
Details
lspci on server (23.00 KB, text/plain)
2024-01-23 15:09 UTC, Aleksei Zuev
Details
wireguard config server (714 bytes, text/plain)
2024-01-23 15:09 UTC, Aleksei Zuev
Details
wireguard client 1 (236 bytes, text/plain)
2024-01-23 15:10 UTC, Aleksei Zuev
Details
wireguard client 2 (236 bytes, text/plain)
2024-01-23 15:10 UTC, Aleksei Zuev
Details
wireguard client 3 (236 bytes, text/plain)
2024-01-23 15:12 UTC, Aleksei Zuev
Details
wireguard client 4 (236 bytes, text/plain)
2024-01-23 15:12 UTC, Aleksei Zuev
Details
wireguard client 5 (236 bytes, text/plain)
2024-01-23 15:12 UTC, Aleksei Zuev
Details
network graph (44.25 KB, image/png)
2024-01-23 15:13 UTC, Aleksei Zuev
Details

Description Aleksei Zuev 2024-01-23 15:07:14 UTC
Created attachment 305758 [details]
kernel config

Issue: iperf3 shows low throughput using WireGuard VPN
Host hardware: Intel(R) Xeon(R) Gold 6226R (64 cores), 700GB RAM.
VM configurations: OpenWRT latest stable release, 2 cores from Intel(R) Xeon(R) Gold 6226R, 128MB RAM.
Network config: Two physical host (same hardware on both, configs in attachment) connected via Ethernet switch. On host A (IP ends with 33.101)I run few VMs via libvirt, every VM is endpoint of one of VPN tunnels. On host B (IP ends with 33.102) I run VPN server, 1 interface with many VPN endpoint peers.
Throughput between A & B is 10Gb/s, the same between VMs and host B (non-VPN connection).
Detail description: I run different test configurations, for better understanding I attached all configs and simple  network graph. 
Test 1: I run "iperf3 -s" on host B and run one iperf3 client on VM using as address destination VPN server IP address "iperf3 -c 10.10.10.56 -b 0 -t 0". Result: about 3Gb/s.
Test 2: I run two iperf3 servers with different ports "iperf3 -s -p *port number*" on host B and two iperf3 clients on VM using as address destination VPN server IP address, but for every client is different port "iperf3 -c 10.10.10.56 -b 0 -t 0 -p *port number*". Result: summary throughput about 3Gb/s and about 1.5Gb/s
Other tests: Same as Test 2, but with 3,4 and 5 clients. Result: summary throughput about 3Gb/s and throughput for every client is evenly dividing by clients' amount.
On B host I use kernel version 6.8.0-1rc compiled from scratch by myself (kernel config is also attached), on host A is usual Debian 12. Before updating kernel on host B there also was Debian 12 and here's Debian bug report link for the same config: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1060912
Comment 1 Aleksei Zuev 2024-01-23 15:08:56 UTC
Created attachment 305759 [details]
lshw on server with updated kernel 6.8.0-1rc
Comment 2 Aleksei Zuev 2024-01-23 15:09:32 UTC
Created attachment 305760 [details]
lspci on server
Comment 3 Aleksei Zuev 2024-01-23 15:09:59 UTC
Created attachment 305761 [details]
wireguard config server
Comment 4 Aleksei Zuev 2024-01-23 15:10:36 UTC
Created attachment 305762 [details]
wireguard client 1
Comment 5 Aleksei Zuev 2024-01-23 15:10:58 UTC
Created attachment 305763 [details]
wireguard client 2
Comment 6 Aleksei Zuev 2024-01-23 15:12:08 UTC
Created attachment 305764 [details]
wireguard client 3
Comment 7 Aleksei Zuev 2024-01-23 15:12:30 UTC
Created attachment 305765 [details]
wireguard client 4
Comment 8 Aleksei Zuev 2024-01-23 15:12:54 UTC
Created attachment 305766 [details]
wireguard client 5
Comment 9 Aleksei Zuev 2024-01-23 15:13:57 UTC
Created attachment 305767 [details]
network graph
Comment 10 Aleksei Zuev 2024-01-23 19:51:36 UTC
Throughput for 64 cores is very low

Note You need to log in before you can comment on or make changes to this bug.