Startup moving off OpenAI API: used dual RTX 3090 build
A small startup asked for the cheapest way to self-host; a top suggestion was to buy used and build around 2x 24GB RTX 3090s for a 32B model.
2-10 peopleCustomer supportWriting assistant$1k-3kSensitivity: High (client/confidential)
Hardware
| Item | Approx. price (as of 2026-10-16) |
|---|---|
| 2x used NVIDIA GeForce RTX 3090 (24GB each) system | ~$2,500-3,000 USD full system (as stated in a reply) |
Source prices are as stated by the source. Retailer offers: prices checked 2026-10-16, may change. Some links may be affiliate links; we may earn a commission at no extra cost to you. This never changes what we list.
Software stack
- Ollama
Models used
- 32B-class models (fits on one card, better on two per reply)
Good at
- Data privacy
- Cheaper than paying per-hour cloud long term (per reply)
Weak at
- Context needs extra VRAM
- Cash tied up in depreciating hardware; power costs (per reply)
Rough total cost
~$2,500-3,000 (reply figure; retrieved 2026-10-16).
Getting started
- Size VRAM for model + context (use a VRAM calculator).
- Source two used 3090s and a PSU/board that fits them.
- Install Linux, NVIDIA drivers and Ollama.
- Point your app at Ollama's OpenAI-compatible API.
Source & credit
Cheapest way to host local model — r/ollama
Summarized from the source; quotes are the source author's words. Check the original before buying.