Do you have a sample hardware configuration to run the docker
Hardware Requirements:
GPU Memory: 8GB , 1 Nvidia Tesla GPU
CPU Memory: 12-24GB, 4-8 CPU
The response time with this configuration will be 3-5s
If you need an only CPU setup the setup needed is:
4CPU, 16GB RAM
The average response time will be 40s
AWS GPU instance
| g4dn.xlarge |
Azure GPU Instance
| Standard_NC4as_T4_v3 |
Software Requirements:
Ubuntu - 18.04
Docker Compose - 1.28.5
Docker - 20.10.5
Cuda - 10.0