🛠️ TOOLS
"I just added support for cross-client streaming
ArchGW 0.3.13, which lets you call Ollama compatible models through the Anthropic-clients (via the`/v1/messages` API).
With Anthropic becoming popular (and a default) for many developers now this gives them n..."
⚖️ ETHICS
🎯 Vibing vs. traditional coding • AI-assisted coding challenges • Impact on learning and education
💬 "This opens up coding to non devs, e.g. product managers."
• "AI is going to end up doing 95% of our work for us."
🔒 SECURITY
">In case you missed it: ever since about \~56 hours ago, ChatGPT has been rerouting conversations in 4o, 4.5, and 5 Instant through safety models. This resulted in being unable to work with ChatGPT at all, not just for people who tried to discuss sensitive topics. As of \~10 hours ago, OpenAI pre..."
🎯 Distrust in OpenAI • Lack of transparency • User rights and expectations
💬 "We paid for a specific product, not for a black-box lottery with random personality changes and surprise safety interventions."
• "They're gaslighting their own community, treating us like we can't see the difference."
🔧 INFRASTRUCTURE
"In 2023 I implemented llama.cpp/ggml CUDA support specifically for NVIDIA P40s since they were one of the cheapest options for GPUs with 24 GB VRAM. Recently AMD MI50s became very cheap options for GPUs with 32 GB VRAM, selling for well below $150 if you order multiple of them off of Alibaba. Howeve..."
🎯 Sponsorship & Funding • GPU Optimization • Community Engagement
💬 "Congrats on the sponsorship, well deserved!"
• "I'm sure I'm not the only guy who would happily sponsor a few bucks a month for your work on amd platforms"
🔧 INFRASTRUCTURE
🎯 OpenTelemetry Compatibility • LLM Observability Vendors • Observability Challenges
💬 "Saying OpenInference is not otel compatible does not make any sense."
• "We've invested heavily in observability having quickly found that observability + evals are the cornerstone to a successful agent."
🛠️ TOOLS
"I just ran gpt oss 20b on my mi50 32gb and im getting 90tkps !?!?!? before it was around 40 .
./llama-bench -m /home/server/.lmstudio/models/lmstudio-community/gpt-oss-20b-GGUF/gpt-oss-20b-MXFP4.gguf -ngl 999 -fa on -mg 1 -dev Vulkan1
load\_backend: loaded RPC backend from /home/server/Desktop/L..."
🎯 GPU Performance • LLaMA Model Efficiency • Upgrade Debate
💬 "insane boost... looks like they squeezed every drop out of vulkan"
• "Comparing thousands of dollars worth of mac vs $200 server grade gpu"
🛡️ SAFETY
"External link discussion - see full content at original source."
🔬 RESEARCH
"Imagine you're someone who is attempting to dip a toe into ML research in 2025. Say, a new graduate student.
You say to yourself "I want to do some research today". Very quickly you realize the following:
**Who's my competition?**
Just a handful of billion-dollar tech giants, backed by some of th..."
🌐 POLICY
🎯 Drone warfare expertise • US military contracts • Weapon technology advancement
💬 "Ukraine's homegrown drones have become increasingly lethal"
• "The US needs Ukraine to exist and not be annexed by Russia"
🔮 FUTURE
🎯 AI industry economics • Impact of AI bubble burst • Organizing against AI proliferation
💬 "Why would you, when investors continue to throw money at you to scale?"
• "If job numbers started suddenly improving and the unemployment rate dropping, it could be taken to mean that AI is not going to replace everyone after all."
🔒 SECURITY
"What I really just can’t get over, now that we know OpenAI developed a secret internal AI model (GPT-5-Safety) to live-psychoanalyze and judge its 700M+ users on a message-by-message basis…is the fact that OpenAI LITERALLY developed a secret internal model to live-psychoanalyze all of us in realtime..."
🎯 AI user rights • Psychological profiling • Corporate data monetization
💬 "The difference isn't that OpenAI is doing psychological analysis, it's that someone finally called it what it is"
• "If we're going to demand AI user rights (which we should), let's demand them from ALL the companies"
💰 FUNDING
🎯 AI infrastructure costs • AI bubble and impact • Varying perspectives on AI bubble
💬 "the infrastructure is not going away"
• "the actual value creation from railroads was in the land itself"
🤖 AI MODELS
"Not everyone seems to notice because they 'gave us back' 4o, but it's a watered down version.
They must have seen the backlash online and decide to give us back some scraps, hoping we wouldn't notice.
It is absolutely not like the old 4o.
It also doesn't seem to carry cross chat memory anymore.
I ..."
🔒 SECURITY
" Tibor the same engineer who leaked earlier today that OpenAI had already built a parental control and an ads UI and were just waiting for rollout has just confirmed:
Yes, both 4 and 5 models are being routed to TWO secret backend models if it judges anything is remotely sensitive or emotional, or..."
🔧 INFRASTRUCTURE
"Hey r/LocalLLaMA,
Inspired by Adrian Cable's awesome qwen3.c project (that simple, educational C inference engine for Qwen3 models – check out the original post here: [
https://www.reddit.com/r/LocalLLaMA/comments/1lpejnj/qwen3\_inference\_engine\_in\_c\_simple\_educational\_fun/](
https://www.reddit..."
🎯 New architecture • Performance comparison • Project complexity
💬 "Why not trying to pull req llamacpp if you have something faster/better?"
• "A C++ project is always a bit complex, I can certainly think about it."
🛠️ TOOLS
"Yo! I was messing around with my configs etc and noticed it was a massive pain to keep it all in one place... So I vibecoded this thing.
https://github.com/IgorWarzocha/llama\_cpp\_manager
A zero-bs configuration tool for llama.cpp that runs in y..."
🎯 Llama-swap usage • Docker setup • CLI tool features
💬 "llama-swap doesnt swap ports though, it just handles model loads/unloads automatically"
• "You know what, I just had a brilliant idea. Since the tool already grabs the output of -h command and saves it to an .md file..."
💰 FUNDING
🎯 AI's impact on productivity • AI bubble and market dynamics • Skepticism towards AI hype
💬 "We expect productivity gains from artificial intelligence (AI) to boost GDP"
• "AI bubble is the only thing keeping the US [stock market from crashing]"
🛡️ SAFETY
"When someone says a global AGI ban would be impossible to enforce, they sometimes seem to be imagining that states:
1. Won't believe theoretical arguments about extreme, unprecedented *risks*
2. But *will* believe theoretical arguments about extreme, unprecedented *benefits*
Intelligence is dual u..."
🎯 Pandemic Creation Capabilities • Technological Duality • Responsibility of Technology
💬 "if it could cure cancer it could create pandemics"
• "We can definitely create pandemics"