A feature request - You should setup your dockers with everything needed to run on GPUs - today we have to install the libraries ourselves once the docker is running, then restart etc.
Could be as simple as including one of those (
nvidia/cuda - Docker Image | Docker Hub) into your docker build process.