Pinned Loading

1. pytorch/serve pytorch/serve Public

   Serve, optimize and scale PyTorch models in production

   Java 4.2k 866

2. deepjavalibrary/djl-serving deepjavalibrary/djl-serving Public

   A universal scalable machine learning model deployment solution

   Java 203 68

3. triton-inference-server/server triton-inference-server/server Public

   The Triton Inference Server provides an optimized cloud and edge inferencing solution.

   Python 8.5k 1.5k

4. awslabs/multi-model-server awslabs/multi-model-server Public

   Multi Model Server is a tool for serving neural net models for inference

   Java 1k 231

5. aws/deep-learning-containers aws/deep-learning-containers Public

   AWS Deep Learning Containers are pre-built Docker images that make it easier to run popular deep learning frameworks and tools on AWS.

   Python 1k 467

6. aws/sagemaker-inference-toolkit aws/sagemaker-inference-toolkit Public

   Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.

   Python 392 81