Model Serving Tools

Model serving tool enable model usage. Typic features include model loading, unloading, inference, model management and security. Model inference is key capability of model serving tools. Read examples of model serving tool in industry e.g. Tensorflow serving, Pytorch etc.
SLIDE 1
SLIDE 1
        
SLIDE 2
SLIDE 2
        
SLIDE 3
SLIDE 3
        


Model Serving Tools
  • Tensorflow Serving
    •
  • Pytorch Serving
    •
  • ONYX Serving
    •
  • Nvidia Inference server
    •