Inference APIs & AI Clouds in AI & Machine Learning


1	Amazon BedrockPopular AWS managed service for Claude, Llama, Nova, Mistral and other models with agents, guardrails and knowledge bases.	No public repository or package of its own to measure
2	Microsoft FoundryPopular Azure's AI platform (formerly Azure AI Foundry) for OpenAI and open models, agents and evaluation at enterprise scale.	No public repository or package of its own to measure
3	Google Vertex AIPopular Google Cloud's ML and generative AI platform for Gemini, open models, tuning, pipelines and model serving.	No public repository or package of its own to measure
4	Together AI GPU cloud with fast serverless inference and fine-tuning for open-weight models like Llama, Qwen and DeepSeek.	No public repository or package of its own to measure
5	Fireworks AI Low-latency inference platform for open models with fine-tuning and structured output support.	No public repository or package of its own to measure
6	Groq Inference API running open models on custom LPU hardware, known for very high tokens-per-second.	No public repository or package of its own to measure
7	Replicate Run and deploy open-source image, video, audio and language models through a simple API; now part of Cloudflare.	No public repository or package of its own to measure
8	falTrending Serverless generative media platform with fast APIs for image, video and audio models.	No public repository or package of its own to measure
9	ModalRising Serverless Python cloud for GPUs: deploy inference, fine-tuning and batch jobs straight from decorated functions.	536	12M	-3%	1d ago	70

1

Amazon BedrockPopular

AWS managed service for Claude, Llama, Nova, Mistral and other models with agents, guardrails and knowledge bases.