Skip to content

Independent company · we are not affiliated with, sponsored by, or endorsed by the Swiss AI Initiative (EPFL, ETH Zurich, CSCS), the developers of the Apertus model · Official site: apertus-ai.org

Local AI hardware

Local AI, deliveredready to runand maintained.

AI Box and AI Powerhouse bring open-weight models, your apertus.ai gateway and Open WebUI into your building: delivered preconfigured, maintained by us. Your data and databases stay inside your network.

Request an AI Boxfrom €5,900 · depending on configuration, excl. VAT

Jump to AI Box & AI Powerhouse ↓ Benchmarks ↓ Databases ↓

Engraving: the AI Box, a compact cube with an orange light band, on a wooden desk by a window.

AI Box · NVIDIA GB10 · 128 GB

01 Two sizes

From one team to the whole company.

Both systems ship with the gateway, Open WebUI and selected models preinstalled. You plug them in, we take care of updates, monitoring and maintenance.

Engraving: a tower server with four bays and an orange light strip in a server room, next to the smaller AI Box.

For teams

Nº 01

AI Box

Compact, quiet and ready to run.

  • NVIDIA GB10 Grace Blackwell Superchip
  • 128 GB unified memory shared by CPU and GPU
  • Up to 1 petaFLOP of AI performance (FP4)
  • Models up to around 200B parameters
  • Desktop format, fits in any office

from€5,900

depending on configuration, excl. VAT

Request an AI Box

For departments & companies

Nº 02

AI Powerhouse

More users, larger models, on-premise.

  • 1 to 4× NVIDIA RTX PRO 6000 Blackwell
  • 96 to 384 GB GPU memory (GDDR7)
  • Large models like GLM-5.3-Flash or several models side by side
  • As a tower or 19-inch server
  • On-site installation and maintenance

On request

depending on GPU count and build

Request an AI Powerhouse

02 Benchmarks

How fast does what run?

Indicative vLLM figures for current open-weight models: the speed of a single request, how many requests run smoothly in parallel and how many employees a system realistically serves day to day.

Reading speed ≈ 6 tokens/s

AI Box · NVIDIA GB10 · 128 GB

Gemma 4 26B-A4B FP8 + MTP

100 tokens/s

Smooth in parallel8 requests at 80 tokens/s

Servesup to ~25 employees

Qwen3.8 27B NVFP4 + MTP

22 tokens/s

Smooth in parallel10 requests at 10 tokens/s

Servesup to ~10 employees

Powerhouse 1× · 1× RTX PRO 6000 · 96 GB

Qwen3.8 27B FP8 + MTP

60 tokens/s

Smooth in parallel32 requests at 30 tokens/s

Servesup to ~60 employees

Gemma 4 31B NVFP4

40 tokens/s

Smooth in parallel4 requests at 23 tokens/s

Servesup to ~30 employees

Qwen3.8 27B FP8 + MTP · coding agents, 32k context

60 tokens/s

Smooth in parallel6 requests at 30 tokens/s

Serves~6 devs with coding agents

Powerhouse 2× · 2× RTX PRO 6000 · 192 GB

Qwen3.8 Flash-Next FP8

80 tokens/s

Smooth in parallel32 requests at 23 tokens/s

Servesup to ~100 employees

Qwen3.8 27B FP8 + MTP · 2 replicas

60 tokens/s

Smooth in parallel64 requests at 30 tokens/s

Servesup to ~120 employees

Powerhouse 4× · 4× RTX PRO 6000 · 384 GB

GLM-5.3-Flash NVFP4 + MTP

250 tokens/s

Smooth in parallel8 requests at 110 tokens/s

Servesup to ~150 employees

Qwen3.8 Flash-Next FP8 + MTP

85 tokens/s

Smooth in parallel32 requests at 20 tokens/s

Servesup to ~120 employees

Qwen3.8 27B FP8 + MTP · 4 replicas

60 tokens/s

Smooth in parallel128 requests at 30 tokens/s

Servesup to ~200 employees

Employees per system

Per system, the model from the table that serves the most employees · one dot = 20 employees

  • AI Box up to ~25
  • Powerhouse 1× up to ~60
  • Powerhouse 2× up to ~120
  • Powerhouse 4× up to ~200

Indicative figures as of October 2026 from public vLLM benchmarks by independent labs and the community on the same hardware, rounded down. MTP means the model writes several tokens per step with its own prediction head, without losing quality. Smooth in parallel: measured concurrent requests with the speed each of them gets, mostly with short prompts; long documents lower the figures. Employees: a cautious estimate with 10–15% of the staff active at the same time and a quarter of the capacity kept free for agents and long documents. Before delivery we measure with your workloads.

03 On-premise

Models and your databases: securely connected, inside your network.

When apertus.ai runs on your premises, the MCP gateway connects local models directly to your internal databases, ERP, DMS and file shares. Every access goes through permissions and the audit log, and no request ever leaves your network.

  • Models, gateway and data in the same network: nothing leaves
  • Permissions per data source, tool and team
  • Every access traceable in the audit log

Your network

Employees, apps & agents

Your data sources

  • SQL databases
  • ERP & CRM
  • DMS & file shares
  • Wikis & tickets

apertus.ai gateway

AI & MCP, on-premise

Local modelson AI Box, AI Powerhouse or your hardware

04 Always included

Unbox, plug in, get going.

Preconfigured

Gateway, Open WebUI and your models are set up when the system arrives.

The right models

We choose models for your use cases, user numbers and languages and keep them up to date.

Operations & maintenance

We handle monitoring, security and model updates, on site for the AI Powerhouse.

Hybrid with the cloud

Through the gateway you combine local models with EU cloud models, for example for peak load.

Your data connected

The MCP gateway connects the models securely to your databases, ERP and DMS.

One single partner

Hardware, software and models from one provider, with a named contact on our side.

FAQ Questions about local AI

Before the box arrives.

01Which models run on the AI Box?

Open-weight models up to around 200B parameters. The fast MoE model Gemma 4 26B-A4B suits several users at once; Qwen3.8 27B handles demanding tasks and coding. We choose the models that fit your use cases together with you.

02AI Box or AI Powerhouse: which do we need?

The AI Box is enough for teams of up to around 25 people in everyday chat. For whole departments, coding agents or very large models, the AI Powerhouse is the right choice. We work it out with your numbers.

03Can local models be combined with cloud models?

Yes. In the gateway you decide which requests stay local and which may use cloud models in the EU, for example for peak load or very large models.

04How do updates and maintenance work?

We monitor the systems and roll out security and model updates through a secured access you control. For the AI Powerhouse we also come on site for installation and maintenance.

05Where does the hardware go?

The AI Box is compact and runs in the office or a server cabinet. The AI Powerhouse belongs in a server room or your data centre, as a tower or 19-inch server.

Contact 20 minutes, an honest assessment

Roll out AI without giving up control.

Book a short call. We look at your situation and tell you honestly whether and how apertus.ai can help.

What happens in the call

  1. 1You briefly describe where you use AI today.
  2. 2Using your case, we show what a dedicated gateway, apps and operations look like.
  3. 3You get an estimate of effort and cost.
  4. 4Then you decide, not us.