π οΈ TOOLS
From the creator of Redis; run LLM locally with ds4
π¬ HackerNews Buzz: 61 comments
π BUZZING
π― Local inference optimization β’ Consumer hardware viability β’ Model-agnostic deployment tools
π¬ "Local is really becoming viable, especially considering that GPT 6.1 has been running at 20ish tps"
β’ "speed increase they have for the v0.7.0 release is amazeballs"