AiAnyTool - Best AI Tools Directory and Artificial Intelligence Software Hub Logo
Loading theme toggle

Running a 35B LLM at 128K Context, Full Speed, on €870 of Used Hardware

HnrssLLMs1 min read
Share:

Article URL: https://medium.com/ai-advances/running-a-35b-llm-at-128k-context-full-speed-on-870-of-used-hardware-no-cloud-required-c4f7629810b8 Comments URL: https://news.ycombinator.com/item?id=49142301 Points: 1 # Comments: 0

Story Overview

Article URL: https://medium.com/ai-advances/running-a-35b-llm-at-128k-context-full-speed-on-870-of-used-hardware-no-cloud-required-c4f7629810b8 Comments URL: https://news.ycombinator.com/item?id=49142301 Points: 1 # Comments: 0