40-person company: 2x RTX PRO 6000 Blackwell server as an internal ChatGPT replacement
A commenter describes their 40-user company setup: a Gigabyte 2U server with two RTX 6000 Blackwell cards running Qwen 3.6 27B behind Open WebUI connected to Active Directory, plus coding, meeting-transcription and contract-RAG add-ons.
11-50 peopleWriting assistantCodingTranscriptionDocument search / chat with files$3k+Sensitivity: High (client/confidential)
Hardware
| Item | Approx. price (as of 2026-10-16) |
|---|---|
| Gigabyte 2U server with 2x NVIDIA RTX PRO 6000 Blackwell (space for two more) | Not stated in source |
Source prices are as stated by the source. Retailer offers: prices checked 2026-10-16, may change. Some links may be affiliate links; we may earn a commission at no extra cost to you. This never changes what we list.
Software stack
- Open WebUI (connected to Active Directory)
- Serply API (web search)
- Continue.dev (VS Code)
- Vexa + Whisper + n8n (Teams meeting bot)
- ComfyUI
- Hermes Agent
Models used
- Qwen 3.6 27B (FP16, full context)
- Qwen 2.5 Coder 7B (FIM for developers)
Good at
- Used for 'research, rewriting of emails, asking about minor technical stuff'
- Meeting bot: invite an address, it transcribes and sends extracted info back
- Sales can chat with contracts via RAG
Weak at
- Web search uses an external API (Serply), so search queries leave the network
- Source is a single Reddit comment; costs and performance not given
Rough total cost
Not stated in source.
Getting started
- Install a multi-GPU server and an inference backend for a ~27B model.
- Deploy Open WebUI and connect it to Active Directory for logins.
- Add a small coder model for IDE autocomplete via Continue.dev.
- Optionally add Whisper + n8n for meeting transcription and a RAG collection for contracts.
Source & credit
Reddit thread 'What are companies actually using for self-hosted AI right now, and why?' (comment describing a 40-user company) — r/LocalLLaMA
Summarized from the source; quotes are the source author's words. Check the original before buying.