New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How to choose Infiniband device? #114

Open

Eren121 opened this issue May 11, 2024 · 1 comment

Contributor

Eren121 commented May 11, 2024 •

edited

Loading

If there are multiple Infiniband NICs (mlx5_0, mlx5_1, etc...), is it possible to specify which one to use?

Based on the function common_resolve_phy_port() in src/transport_impl/verbs_common.h, I think it always uses the first device seen...

The text was updated successfully, but these errors were encountered:

ankalia commented May 12, 2024

Yes, this is possible. Most of the IB testing was done on servers with multiple IB ports, so this should work.

The Rpc constructor takes phy_port as an argument, which IIRC is the index of the desired port as listed by ibv_devinfo. See: https://github.com/erpc-io/eRPC/blob/de83dab3eab4a0fb19bfc4881c11d4a6b89ff17d/src/transport_impl/verbs_common.h#L138C1-L139C1

common_resolve_phy_port() uses this when choosing which port to use.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment