Hi GHui, Thanks for reaching out. On Thu, Jun 16, 2022 at 11:12 AM None via Podman <podman(a)lists.podman.io&gt; wrote: Can you retry using `--userns=keep-id`? The following article elaborates on the details: https://podman.io/blogs/2019/09/26/podman-in-hpc.html Kind regards, Valentin

It looks like mpirun executes podman with extra open file descriptor(s) but they are not available to the container. In this Podman GitHub discussion thread https://github.com/containers/podman/discussions/13254 it was discussed if the option --preserve-fds could be used to pass in extra file descriptors from mpirun to the container. A showstopper was that the file descriptor(s) passed in were not continuous (sequential). On Fri, Jun 17, 2022 at 4:37 AM None via Podman <podman(a)lists.podman.io&gt; wrote: > > There is also failed. > > $ mpirun -np 2 podman run --env-host --env-file envfile --userns=keep-id --network=host --pid=host --ipc=host -w /exports -v .:/exports:z centos/vasp:5.4.4 /exports/mpitest > [cli_1]: write_line error; fd=10 buf=:cmd=init pmi_version=1 pmi_subversion=1 > : > system msg for write_line failure : Bad file descriptor > [cli_1]: Unable to write to PMI_fd > [cli_1]: write_line error; fd=10 buf=:cmd=get_appnum > : > system msg for write_line failure : Bad file descriptor > Abort(1090575) on node 0 (rank 0 in comm 0): Fatal error in PMPI_Init: Other MPI error, error stack: > MPIR_Init_thread(143): > MPID_Init(1221)......: > MPIR_pmi_init(130)...: PMI_Get_appnum returned -1 > [cli_1]: write_line error; fd=10 buf=:cmd=abort exitcode=1090575 > : > system msg for write_line failure : Bad file descriptor > Attempting to use an MPI routine before initializing MPICH > [cli_0]: write_line error; fd=9 buf=:cmd=init pmi_version=1 pmi_subversion=1 > : > system msg for write_line failure : Bad file descriptor > [cli_0]: Unable to write to PMI_fd > [cli_0]: write_line error; fd=9 buf=:cmd=get_appnum > : > system msg for write_line failure : Bad file descriptor > Abort(1090575) on node 0 (rank 0 in comm 0): Fatal error in PMPI_Init: Other MPI error, error stack: > MPIR_Init_thread(143): > MPID_Init(1221)......: > MPIR_pmi_init(130)...: PMI_Get_appnum returned -1 > [cli_0]: write_line error; fd=9 buf=:cmd=abort exitcode=1090575 > : > system msg for write_line failure : Bad file descriptor > Attempting to use an MPI routine before initializing MPICH > _______________________________________________ > Podman mailing list -- podman(a)lists.podman.io > To unsubscribe send an email to podman-leave(a)lists.podman.io