EU sovereign cloud & data residency
Where can you run these models on European-hosted, GDPR-compliant infrastructure — and is that even possible for the models that matter?
The catch: only a handful of open models are SOTA-competitive on coding
Only the newest large open-weight models — the families in the table below — come close to the leading closed models on coding. Much of what EU hosts typically offer — gpt-oss-120b, Llama 3.x, Mistral, smaller Qwen models — is a clear step below on the coding benchmarks tracked in this app. So the relevant question isn't “is there an EU inference provider?” (there are many) but “is there an EU provider that hosts the SOTA models?”
✅ EU-hosted and company-approved equivalent offers for SOTA models
Loading eu hosting table…
- • TensorX — Ireland, three EU data-centre regions isolated from US hyperscalers, zero data retention; the broadest in-EU catalog of open models.
- • Inceptron — Swedish company, Finnish datacenter, zero retention.
- • Scaleway — serves from Paris, zero data retention by default.
- • Nebius — Netherlands, Finland/France infrastructure, opt-in zero retention and no training; its catalog mixes EU, US and UK regions, so each model's offer is checked separately.
- • NextBit — Spain, EU-hosted endpoints on OpenRouter.
- • Policy exceptions — the native Azure Direct Global offers for DeepSeek V4 Pro and Kimi K2.7 Code count as company-approved EU-hosted equivalents. That is a business classification for this application, not an EU-residency guarantee: those deployments may process inference outside the EU. Azure's Fireworks-hosted alternatives stay US-served and excluded.
🟡 Coming soon
TrustedRouter (api.trustedrouter.eu) — an EU-based, security-focused router. Still being launched / not production-ready yet; tracked here so it shows up once it goes live.
EU-sovereign per-token providers and their catalogs
These sovereign clouds expose proper per-token APIs with strong residency and certifications. Most catalogs center on Western open models (gpt-oss / Llama / Mistral / Qwen), while Scaleway now also hosts GLM 5.2in Paris. Their current model listings:
| Provider | Residency / notes | Models offered | Listing |
|---|---|---|---|
| STACKIT AI Model Serving Schwarz Group (DE) | BSI C5, ISO 27001 | gpt-oss-120b/20b, Qwen3-VL-235B, Llama 3.3 70B, Gemma 3 | models ↗ |
| T-Systems LLMHub (Telekom) Deutsche Telekom (DE) | sovereign T-Cloud · €1,000/mo min | gpt-oss-120b, Llama 3.3, Mistral, Qwen3 | models ↗ |
| IONOS AI Model Hub IONOS (DE) | BSI C5, Gaia-X | gpt-oss-120b, Llama 3.1/3.3, Mistral, Qwen3-Coder-Next-80B | models ↗ |
| OVHcloud AI Endpoints OVHcloud (FR) | SecNumCloud/ANSSI, ZDR | gpt-oss-120b, Llama 3.3, Qwen3.x, Mistral | models ↗ |
| Scaleway Generative APIs Scaleway (FR) | GDPR, ZDR by default | GLM 5.2, Qwen3.x, Mistral, Llama, Gemma, gpt-oss-120b, Holo2 | models ↗ |
| TrustedTokens TNG Technology Consulting (DE) | TNG GPUs at Noris Aschheim/Munich · no logging beyond the API call · B2B plan-credit | GLM 5.3/5.2/5.3-Flash, DeepSeek V4.x, Qwen3.x, gpt-oss-120b, DeepSeek-TNG-R1T2-Chimera, Gemma | models ↗ |
| SAP Generative AI Hub SAP (DE) | enterprise · opaque CU billing | mostly proprietary frontier; open weights deprecated/BYOM | models ↗ |
⛔ Proprietary-only & GPU-rental EU providers (not in the comparison)
These EU vendors appear in residency trackers but are excluded from the price comparison: they either serve only their own proprietary models that aren't in any public benchmark (e.g. Aleph Alpha's Pharia, IBM Granite), or they only rent GPUs/VMs with no managed per-token API.
| Provider | Where | Why it's not listed |
|---|---|---|
| Aleph Alpha | DE | Own proprietary Pharia models only — not in public benchmarks; sovereign on-prem/Gaia-X focus. |
| IBM watsonx | US/EU regions | Pushes own Granite models; not benchmark-competitive for SOTA coding. |
| GPU / dedicated rental only | Hetzner, OVHcloud (bare GPU), Open Telekom Cloud, Exoscale, Scaleway GPU, IONOS GPU, CoreWeave EU, Aruba, elastx, Genesis, gridscale, Seeweb, UpCloud, Cloudiax | Rent GPUs / VMs and self-host any model — no managed per-token API, so no comparable price. |
| US-law platforms (EU region only) | Hugging Face, Together AI | EU data residency only via enterprise/dedicated; operating company under US law. |
📊 For a continuously-maintained map of which LLMs actually run on EU soil (and which providers are under the US CLOUD Act), see the community EU LLM Hosting Tracker (llm-tracker.eu) ↗.
Hyperscaler EU regions & confidentiality
- • AWS Bedrock (EU Geo profile) — strongest turnkey EU posture: EU cross-region inference + zero-data-retention by default. Western open models only (Llama/Mistral/DeepSeek V3.2/Nova/gpt-oss).
- • Azure AI Foundry EU Data Zone — documented EU routes remain the technical residency standard. Separately, this company treats only the native Azure Direct Global offers for DeepSeek V4 Pro and Kimi K2.7 Code as EU-hosted equivalents for filtering; inference may still occur outside the EU. Fireworks-hosted alternatives remain outside the EU boundary.
- • Google Vertex AI europe-west / EU multi-region — Model-Garden open models (Llama/Gemma/DeepSeek V3.2); never use the global endpoint.
- • Confidentiality (TEE) for GLM/Kimi/MiniMax: Chutes (Intel TDX + NVIDIA CC, 14 TEE models) gives confidentiality but no EU pinning; Privatemode (Edgeless Systems, Germany) is EU-pinned + confidential but narrow.
- • “EU available” but dedicated/enterprise only — not self-serve serverless (so excluded as price sources): Together AI (Sweden GPU clusters / dedicated endpoints, Sep 2025), Fireworks (Frankfurt/Iceland dedicated/BYOC), Cloudflare (Data Localization Suite, Enterprise add-on), AtlasCloud (eu-west dedicated). Their public per-token APIs have no EU region selector and run from US capacity. DigitalOcean has EU serverless on its roadmap only. All are US-HQ (CLOUD Act).
Use the global “EU-hosted / approved equivalent only” and “Non-US provider only” filters (top bar) to restrict the interactive comparison views and linked model details to matching offers. Full research with sources lives in data/research/ in the repository.