How could I use IB in container
When I execute show_gids in container, it shows the IB info, like the following. [root@1fdf9c840916 ~]# /opt/user/sbin/show_gids DEV PORT INDEX GID IPv4 VER DEV --- ---- ----- --- ------------ --- --- mlx5_0 1 0 fe80:0000:0000:0000:e007:1bff:ff7f:2250 v1 n_gids_found=1 But when I execute ibv_rc_pingpong in container, it shows error. [root@1fdf9c840916 ~]# /opt/user/bin/ibv_rc_pingpong No IB devices found When I execute ibv_rc_pingpong in host, it runs right, like the following. [rhost@N0505 ~]$ ibv_rc_pingpong local address: LID 0x00b4, QPN 0x015384, PSN 0xb8046a, GID ::
On 8/1/22 01:50, None via Podman wrote:
When I execute show_gids in container, it shows the IB info, like the following. [root@1fdf9c840916 ~]# /opt/user/sbin/show_gids DEV PORT INDEX GID IPv4 VER DEV --- ---- ----- --- ------------ --- --- mlx5_0 1 0 fe80:0000:0000:0000:e007:1bff:ff7f:2250 v1 n_gids_found=1
But when I execute ibv_rc_pingpong in container, it shows error. [root@1fdf9c840916 ~]# /opt/user/bin/ibv_rc_pingpong No IB devices found
When I execute ibv_rc_pingpong in host, it runs right, like the following. [rhost@N0505 ~]$ ibv_rc_pingpong local address: LID 0x00b4, QPN 0x015384, PSN 0xb8046a, GID :: _______________________________________________ Podman mailing list -- podman@lists.podman.io To unsubscribe send an email to podman-leave@lists.podman.io
Could you try running as a --privileged container to see if this is a security issue, or us masking over something to block the command.
On Mon, Aug 01, 2022 at 08:50:33AM -0000, None via Podman wrote:
When I execute show_gids in container, it shows the IB info, like the following. [root@1fdf9c840916 ~]# /opt/user/sbin/show_gids DEV PORT INDEX GID IPv4 VER DEV --- ---- ----- --- ------------ --- --- mlx5_0 1 0 fe80:0000:0000:0000:e007:1bff:ff7f:2250 v1 n_gids_found=1
But when I execute ibv_rc_pingpong in container, it shows error. [root@1fdf9c840916 ~]# /opt/user/bin/ibv_rc_pingpong No IB devices found
When I execute ibv_rc_pingpong in host, it runs right, like the following. [rhost@N0505 ~]$ ibv_rc_pingpong local address: LID 0x00b4, QPN 0x015384, PSN 0xb8046a, GID ::
How do you map your InfiniBand devices into the container? I tried it once with '-v /dev/infiniband:/dev/infiniband' and that used to work. Please also take a look at: https://vhpc.org/static/PapersPresentations2020/iscworkshops2020_paper_12.pd... Adrian
I add "-v /dev/infiniband:/dev/infiniband", and it runs right. Thanks for your help.
I add "-v /dev/infiniband:/dev/infiniband", and it runs right. Thanks for your help.
participants (3)
-
Adrian Reber -
Daniel Walsh -
ugiwgh＠qq.com