Skip to content
DynaforgeDynaforgeDEBook a call
Back to overviewPractice

Which hardware do I need?
Realistic scales.

The hardware question often fails due to data sheets. Here is the honest version: three typical scenarios, clearly assigned to business size and use case.

The question “what hardware do I need for local AI” cannot be answered generally — but it can be greatly simplified. Three factors determine everything: how large the model is, how many people use it simultaneously, how fast responses should arrive.

Three typical scenarios

1 to 3 users, simple tasks — Mini-PC

A modern mini-PC with an Apple M-chip (M3 Pro or M4) or an Intel NUC with 64 GB RAM is sufficient for models up to about eight billion parameters — these are models like Mistral 7B or Llama 3.1 8B. Sufficient for dictation, mail triage, simple summaries, smaller RAG applications.

Investment: approx. 2,000 to 4,000 euros. Power consumption like an office computer. Silent. Sits on the desk or in the server cabinet.

5 to 15 users, demanding — Workstation

A workstation with a professional GPU — such as NVIDIA RTX 6000 Ada or an Apple Mac Studio Ultra — handles language models up to 70 billion parameters (Llama 3.1 70B, Qwen 2.5 72B). For most office tasks, these models achieve quality close to cloud services. The sweet spot for many SMEs.

Investment: approx. 8,000 to 15,000 euros. Noise level like a quiet server, location ideally in the server cabinet or an adjacent room. Power consumption under full load 300 to 500 watts.

25+ users, high load — Server

A server with multiple GPUs (two to four RTX 4090 or one NVIDIA H100) allows parallel requests with large models and fast response times even under load. Makes sense if AI is built into multiple workflows and used continuously throughout the day.

Investment: from 15,000 euros, often 25,000 to 35,000. Air-conditioned server room or cabinet recommended. Power consumption under full load 600 to 1,500 watts.

What is not enough

A standard NAS has no GPU and no fast memory for models. It can hold the RAG index — the AI itself needs suitable hardware. An older office computer without a dedicated graphics card is also usually too slow for a satisfactory response time.

What else you should consider

  • Power: 200 to 800 watts under full load, significantly less in standby. Roughly 200 to 1,500 euros in electricity costs per year.
  • Noise: Workstation quiet, server audible. Consider location.
  • Heat: For server setups, plan for an air-conditioned room.
  • Maintenance: Updates, backups, monitoring — included with us.
  • Future-proof: GPUs can be upgraded in many setups later — investment grows with demand.
Rule of thumb

For most SMEs with five to twenty employees, a workstation with a professional GPU is the right way. Eligible for funding via DigitalInvest KMU up to 50 percent — see our funding page.

What we recommend

You do not need to study data sheets. We look at your specific use cases, model expected load for the next two to three years, and suggest hardware that has enough reserve — without being excessive.

Which hardware fits your needs?

We model expected load and suggest suitable hardware — eligible for funding via DigitalInvest KMU.

Schedule an initial consultation

Frequently asked questions

Is a mini-PC sufficient for one to three users?
A modern mini-PC with an Apple M-chip (M3 Pro or M4) or an Intel NUC with 64 GB RAM is sufficient for models up to about eight billion parameters — these are models like Mistral 7B or Llama 3.1 8B.
What can a workstation do for five to fifteen users?
A workstation with a professional GPU — such as NVIDIA RTX 6000 Ada or an Apple Mac Studio Ultra — handles language models up to 70 billion parameters (Llama 3.1 70B, Qwen 2.5 72B).
Is a standard NAS sufficient for local AI?
A standard NAS has no GPU and no fast storage for models. It can hold the RAG index — the AI itself requires suitable hardware.