Same for me on Fedora 31. Authentication via podman doesn't work for container-registry.oracle.com. With docker - works via sudo only. Without sudo I get 
"open /etc/docker/certs.d/container-registry.oracle.com: permission denied" error