Advantages and disadvantages of using GPU deployment
Advantages
- Training engines can be considerably faster (up to 10x speed-up).
Disadvantages
- The Kubernetes cluster requires nodes with GPU support.
- More complex to deploy.
- Auto-scaling translation engines is not yet supported for GPU.
- The hardware cost of performing translations is usually comparable with CPU deployment.