During a home lab set up, ArRENCE even gives you the raw code to run the LLM from. It's a small, simple, light weight, no frills llama.cpp|fastapi build; but it will get you up and running and then you can easily expand off that code to customize/optimize/further secure it :)
What is ArRENCE?
ArRENCE is what happens when an indie dev makes an AI that remembers you, but keeps all your information private like a good friend would.
Local chat storage
encryption on anything saved remotely
zero data harvesting for training
Your thoughts belong to you!
Apparently if you shove data from interviews of Terrance Mckenna, Richard Feynman and @officialmcafee into an llm filled with cooking, cyber security, quantum physics, antigravity theory, 2024-present pop culture and refined data from the full collection of Nikola Tesla....u get @grok's personality lmfao
We updated the personality model in ArRENCE. Also, the limit on free questions per day has been shifted from 8 to 3, but we're offering anyone that hits that cap the first month of our L1T3 tier service (our $5 a month option) free with sign up :)
The ArRENCE Home Brew LLM Lab expert includes a super basic llama.cpp|fastapi script as a part of it's help for folks setting up a new lab/server from scratch :)
Cheers! 🥂