Tracking models and VRAM across several machines
A user running local LLMs on three machines plus a laptop keeps losing track of which model is loaded where and how much VRAM is free. The thread discusses collecting GPU, model and free-memory status into one dashboard instead of SSH-ing into each box, using the metrics endpoints that runners like vLLM and Ollama already expose.