Docker Compose GPU Access and Reservation

Docker containers are an important part of infrastructure development. With the advancement in machine learning development and deployment operations, docker services have gained popularity recently. The complex machine learning-based models need GPU for optimal runtime and computational time. Therefore, Docker Compose services provide GPU access if there are devices in the Docker host that utilize GPU. The sections of this blog focus specifically on providing service containers access to GPU devices with Docker Compose (docker-compose or docker compose)

Docker GPU Pass Through

The versions (v1.27.0+) of docker-compose are the combination of all properties from 2.x and 3.x versions. This schema has re-enabled the use of runtime to provide GPU access to the service containers.

For detailed blog and code examples, visit here