if you haven't seen it yet, shrike labs just came out with a DC based power supply system for home / dev labs. Extremely cool stuff. youtube.com/watch?v=Ig7oZpuj…
anyone else's isp getting salty about the amount of 600gb downloads and uploads we have to do for large models? i'm at 10tb for the month and climbing.
everyone should have their own local AI setup with multiple models for various things. Dense and thinking models and 400gb sizes are best. MOE models with huge training sets are great too. Lastly, don't forget to have vision and listening models.
Session based auth is safer and easier than JWT for auth that doesn't need SSO. The server side db cache lift is minimal compared to the safety and simplicity benefit. Change my mind.
maybe the best model isn't a mixture of experts but rather a mixture of competing / contrarian experts? but how do you get to intellectual honesty / integrity for a solution? MOE depends on a supposed expert choice. @xai
I just tried mint linux and must say I'm pretty impressed. I've been a linux hater for a long time but this might actually get me to use it more for a desktop.
Programmed a c# class without any AI code gen yet again. Only asking AI questions. Infinitely faster than trying to #vibecode some abomination from scratch.
most don't realize how much overhead LLM APIs like OpenAI's have in streaming mode—95% of the traffic is just JSON wrappers around each tiny token. Experimenting with direct gRPC binary comms on my setup to slash that inefficiency.
vibe coding is such a joke. Even having AI write a lot of code for you just makes it all take longer. Ask AI questions instead of having to google for it and you'll have much better results.
oh wow, #youtube just made 3x and 4x available for speed up after I got used to using 2x for everything except music videos #mtv. I think my productivity just went up. :P
NNs graphrag context are instance dungeons in WoW. It all comes together but you still need facts / crystalized knowledge lookup. This is not a math problem, its a logic problem.