From $0.01 usage-based · Free trial🇺🇸
US inference platform for open, fine-tuned and custom models on autoscaling GPUs, with Model APIs, training and self-hosting.
Model deployment: AI tools compared (October 2026)
16tools in this category
4countries with local strength
2can host data in the EU
How results are ranked: How we review
Results
From $6.50 usage-based🇺🇸
GPU cloud for training and serving large AI models, with a managed Kubernetes service, Slurm integration and managed inference.
From $250 per month · Free plan🇺🇸
Serverless Python platform for AI inference, training, batch jobs and sandboxes with per-second GPU billing.
From $20 per month · Free plan🇺🇸
Fully managed vector database with integrated embedding models, full-text search and an assistant component for RAG applications.
Usage-based · Free plan🇩🇪
Open-source vector database from Berlin, available as managed cloud, hybrid cloud in your own infrastructure or private cloud.
From $8 usage-based · Free trial🇺🇸
Inference platform for open models with per-token serverless billing, dedicated GPU deployments and fine-tuning including RFT.
From $0.03 usage-based🇺🇸
Managed Hugging Face service that deploys Hub models on dedicated, autoscaling infrastructure on AWS, Google Cloud or Azure.
Contact for pricing · Free plan🇺🇸
Prebuilt NVIDIA inference microservices that package models, optimized engines and standard APIs in containers for your own GPUs.
From $0.09 usage-based🇺🇸
AI cloud for serverless inference of open models, dedicated endpoints, fine-tuning and GPU clusters.
Free🇺🇸
Open source library from Intel's Open Edge Platform for visual anomaly detection, with OpenVINO export.
Free🇸🇬
Open-source platform from Xorbits that serves language, embedding, rerank, image and audio models behind an OpenAI-compatible API.
Research paper🇺🇸
2022 paper introducing exact, memory-efficient attention on GPUs, now used in many training and inference stacks.
Free🇨🇳
Open-source framework from the ModelScope community for fine-tuning, evaluating and deploying 600+ language models.
FreeAvailable internationally
Open-source serving framework for language and multimodal models with prefix caching and fast structured output.
Research paperAvailable internationally
SOSP 2023 paper introducing PagedAttention and the vLLM serving system for running large language models.
FreeAvailable internationally
Open-source library for fast inference and serving of language models with an OpenAI-compatible server and broad hardware support.
Last updated: