Skip to content

efa: Enable creation of CQs with external memory #1608

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

mrgolin
Copy link
Contributor

@mrgolin mrgolin commented May 15, 2025

Add an option to create CQs through EFA direct verbs with pre-allocated memory, by passing dmabuf fd and offset, and additionally expose SQ, RQ and CQ alignment and mappings. This together allows passing data path handling to accelerator threads.

mrgolin added 3 commits May 15, 2025 16:20
To commit: ?? ("RDMA/efa: Add CQ with external memory support").

Signed-off-by: Michael Margolin <mrgolin@amazon.com>
Extend EFA direct verbs to allow querying of QP and CQ parameters. At
first stage those new verbs enable getting queues' virtual addresses
as well as their structure what can be used for accelerator driven
datapath.

Reviewed-by: Daniel Kranzdorf <dkkranzd@amazon.com>
Reviewed-by: Yonatan Nachum <ynachum@amazon.com>
Signed-off-by: Michael Margolin <mrgolin@amazon.com>
Extend the EFA direct verbs interface to enable creation of CQs on top
of pre-allocated memory buffers. The memory can be passed by supplying
a dmabuf fd and offset.

Reviewed-by: Daniel Kranzdorf <dkkranzd@amazon.com>
Reviewed-by: Yonatan Nachum <ynachum@amazon.com>
Signed-off-by: Michael Margolin <mrgolin@amazon.com>
@mrgolin mrgolin force-pushed the cq-with-ext-mem branch from b12e189 to 7e8fed3 Compare May 15, 2025 16:21
@mrgolin
Copy link
Contributor Author

mrgolin commented May 15, 2025

The related kernel patch is here.

# for free to join this conversation on GitHub. Already have an account? # to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants