Bug 205701 - Can't access RAM from PCIe
Summary: Can't access RAM from PCIe
Status: NEW
Alias: None
Product: Drivers
Classification: Unclassified
Component: PCI (show other bugs)
Hardware: Intel Linux
: P1 normal
Assignee: drivers_pci@kernel-bugs.osdl.org
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2019-11-29 06:59 UTC by ranran
Modified: 2019-12-06 14:03 UTC (History)
1 user (show)

See Also:
Kernel Version: 4.18.0
Subsystem:
Regression: No
Bisected commit-id:


Attachments
dmesg v4.18.0 (92.34 KB, text/plain)
2019-11-29 18:22 UTC, Bjorn Helgaas
Details
dmesg v4.18.0 intel_iommu=off (92.96 KB, text/plain)
2019-11-29 18:23 UTC, Bjorn Helgaas
Details
lspci (126.66 KB, text/plain)
2019-12-06 14:02 UTC, Bjorn Helgaas
Details
test_module.c (5.98 KB, text/plain)
2019-12-06 14:03 UTC, Bjorn Helgaas
Details

Description ranran 2019-11-29 06:59:48 UTC
Using Intel Xeon computer with linux kernel 4.18.0 centos8.
Trying to access RAM (with DMA) using FPGA  fails in this computer.

1. I tried to add intel_iommu=off - it did not help.

2. Installing windows on same PC - FPGA can access RAM using DMA without issues.

3. using another PC (Intel Duo) with same linux and OS - FPGA access works.  

FPGA access the RAM using a physical address provided by a kernel module which allocates physical continuous memory in PC. (the module works perfectly with Intel Duo on exactly same OS and kernel).
Comment 1 Bjorn Helgaas 2019-11-29 18:22:57 UTC
Created attachment 286117 [details]
dmesg v4.18.0

dmesg.log from Ranran
Comment 2 Bjorn Helgaas 2019-11-29 18:23:56 UTC
Created attachment 286119 [details]
dmesg v4.18.0 intel_iommu=off

dmesg_intel_iommu_off.log from Ranran
Comment 3 ranran 2019-11-29 21:37:15 UTC
please see module driver  here:
https://docs.google.com/document/d/1LlqTnfoqdmwABrR6xOAPlQOzDw1aGjS5hhNI61IwULw/edit?usp=sharing

Thanks
Comment 4 ranran 2019-12-01 12:38:32 UTC
Hi,

1. Trying to disable Virtualization did not help....

2. result for lspci :
https://docs.google.com/document/d/1gE4Ba4UmuVJRVRVl4JvsDUy8gXJYtPKuUOpC2eUL14M/edit?usp=sharing


Thanks
Comment 5 ranran 2019-12-06 06:10:16 UTC
Hello,
I have tried to upgrade to latest kernel 5.4 (elrepo in centos), but with this processor/board (system x3650, Xeon), it get hang during kernel boot, without any error in dmesg, just keeps waiting for nothing for couple of minutes and than drops to dracut.


I am really stuck with this, is there any way to get progress with this bug ?

 Please help,
Ran
Comment 6 Bjorn Helgaas 2019-12-06 14:02:26 UTC
Created attachment 286201 [details]
lspci

The lspci mentioned in comment #4.  Attached in bugzilla to prevent the link in comment #4 from becoming stale, e.g., if the owner deletes the Google Document, the link will no longer work.
Comment 7 Bjorn Helgaas 2019-12-06 14:03:22 UTC
Created attachment 286203 [details]
test_module.c

This is the module mentioned in comment #3.

Note You need to log in before you can comment on or make changes to this bug.