modelasservice

Here are 3 public repositories matching this topic...

OutofAi / ChitChat

Modal LLM LLama.cpp based model deployment as part of series of Model as a Service (MaaS)

machine-learning serverless mistral modelasservice llm llamacpp llm-inference modeldeployment openhermes mistral-7b

Updated Mar 23, 2026
Python

JAiRouter is a Spring Boot based model service routing and load balancing gateway used for unified management and routing of various AI model services (such as Chat, Embedding, Rerank, TTS, etc.), supporting multiple load balancing strategies.

java router ai springboot maas modelasservice llm

Updated May 21, 2026
Java

rehmanzafar / DeployModelAsService

Star

Deploy TensorFlow model as a service at Microsoft Azure by using Azure Container Instances (ACI).

machine-learning deployment azure model deploy azurecontainerinstance azure-devops modelasservice

Updated Jun 21, 2021
Python

Improve this page

Add a description, image, and links to the modelasservice topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the modelasservice topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly