Bug 194241 - LXC - setns() performance issue with more than 1vCPU
Summary: LXC - setns() performance issue with more than 1vCPU
Status: NEW
Alias: None
Product: Networking
Classification: Unclassified
Component: Other (show other bugs)
Hardware: All Linux
: P1 normal
Assignee: Stephen Hemminger
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2017-02-07 02:18 UTC by SUYASH KARMARKAR
Modified: 2017-02-07 02:22 UTC (History)
1 user (show)

See Also:
Kernel Version: 3.6.57 , 3.16.7
Subsystem:
Regression: No
Bisected commit-id:


Attachments
sample program to reproduce the issue (3.29 KB, text/plain)
2017-02-07 02:18 UTC, SUYASH KARMARKAR
Details

Description SUYASH KARMARKAR 2017-02-07 02:18:18 UTC
Created attachment 254411 [details]
sample program to reproduce the issue

Description of problem:
Facing a peculiar problem with setns () call. 
Trying to test the network namespace basic functionality and performance tests. The basic test is to create two network namespaces (nstest1, and nstest2) and enabled the loopback interfaces in them.
Then the test program called setns () function (Re-associate thread with a namespace) to switch from namespace to nstest1, then from nstest1 to nstest2, from nstest2 to ntest1 etc. (round-robin).


Version-Release number of selected component (if applicable):

As part of the tests tried on kernel 3.6.57 and kernel 3.16.7, and ran the same setns() tests with only one CPU, and observed system call rates of several million calls per second. The results were incredibly different - for kernel 3.6.57 it was 0.22 micro second per setns() call vs. 2.1 milli second (10,000 times faster; for kernel 3.16.7 it was 0.16 micro second per setns() call vs. 31 milli second (200,000 times faster).
  
1.       On kernel 3.6.57, the same test run on 1-CPU VM executed 100,000,000 setns () calls in 22 seconds (4,545,454 calls per second; 0.22 micro second per call). 
2.       On kernel 3.6.57, the same test run on 2-CPU or 4-CPU VM executed 10000 setns() calls in 21 seconds (476 calls per second; 2.1 milli second per call)


How reproducible:
easily and always reproducible

Steps to Reproduce:

Attached test program

Details on the program below-
test_netns.c – (attached).
 
  - Based on http://linux.die.net/man/2/setns
Build:
  $ gcc -g -o test_netns test_netns.c
 
Test setup:
  1. Create network namespaces nstest1 and nstest2, and bring up loopback (lo) 
     # ip netns add nstest1
     # ip netns add nstest2
     # ip netns exec nstest1 ip link set dev lo up
     # ip netns exec nstest2 ip link set dev lo up
  2. Make sure that the namespaces are seen.
     # ip netns
     nstest1
     nstest2
     # ls /var/run/netns/
nstest1  nstest2
  3. Get the PID of the current process. This PID is to be used in the test command.
     # echo $$
     24821
     #
  4. Run the test. Need to replace [PID] from the Step 3; replace [ITERS] with number of desired
     setns() calls.
     # ./test_netns /var/run/netns/nstest1 /var/run/netns/nstest2 /proc/[PID]/ns/net [ITERS] "/sbin/ip link"
  4.A Example for running the test for 1000 iterations for PID=24821 for three namespaces: 
     two namespaces and process's own:
     # ./test_netns /var/run/netns/nstest1 /var/run/netns/nstest2 /proc/24821/ns/net 1000 "/sbin/ip link"

Actual results:


Expected results:


Additional info:

Note You need to log in before you can comment on or make changes to this bug.