Do you have a sample hardware configuration to run the docker

Hardware Requirements:

GPU Memory: 8GB , 1 Nvidia Tesla GPU
CPU Memory: 12-24GB, 4-8 CPU

The response time with this configuration will be 3-5s

If you need an only CPU setup the setup needed is:
4CPU, 16GB RAM
The average response time will be 40s

AWS GPU instance

g4dn.xlarge

Azure GPU Instance

Standard_NC4as_T4_v3


Software Requirements:

Ubuntu - 18.04

Docker Compose - 1.28.5

Docker - 20.10.5

Cuda - 10.0

Was this article helpful?