From Dorbit
Blog
Notes on GPUs, inference, and building Dorbit.
Local LLMs: GPU speed and cost
Comparing response times, generation speed, and hourly prices for a dense Qwen model and a large quantized MoE.
Read articleThe challenges of renting cheap GPUs
What our Vast evaluation revealed about startup, transfers, and getting a GPU ready for useful work.
Read article