Since MetalRT support is coming soon by @RunAnywhereAI (@ycombinator, W'26)
In the meantime, here's what's already running fully on-device in RCLI: full voice-to-action RAG on my own documents.
No cloud, no data leaving the machine. Your files stay yours.
Running @liquidai LFM models Piper TTS locally - blazing fast voice.
#MetalRT #LocalRAG #YCW26 #OnDeviceAI
#runanywhere
Mar 7
We built the future of voice AI on your Mac. RCLI is here @RunAnywhereAI!
Our optimized end-to-end voice RAG pipeline: talk → instant control doc answers, ~131ms latency,
- all LOCAL
- all OPEN SOURCE
- all FREE.
43 actions, no cloud, your data forever private.
Siri: “Let me think about that…”
RCLI: 131 ms voice-to-action. Done. Next.
Experience it—install & command your machine:
curl -fsSL raw.githubusercontent.com/Ru… | bash
Next level incoming: MetalRT support (fastest Apple Silicon inference 658 tok/s decode, blazing ASR and TTS).
Your Mac's about to hit warp speed!
#OnDevice #MetalRT #YCW26 #NoMoreWaiting
4
4
15
2,287
7 Feb 2024
For me a big thing is RAG is so overly complicated
Just looking through the "Quickstart" there are 5 steps you need to do create all of this abstractions (e.g StrOutputParser , RunnablePassthrough)
I created a library to do RAG in 4 lines of code because I didn't want to deal with the hassle of setting up an entire RAG pipeline with Langchain each time.
Langchain RAG "Quickstart"
python.langchain.com/docs/us…
localrag library:
github.com/banjtheman/localr…
1
3
1,137
15 Jan 2022
Quick catch up in the local villages magazine. #woodhallspa #bikehire #homeandgardenmagazine #advert #home #garden #magazine #localrag
1
2
12 Oct 2021
Emperor McGowan would have everyone in WA believe we are free. Must be on the same meds as Biden. Too busy having more me time on the front of his personal newsletter The West Australian #localrag
1
3
10 Sep 2021
1
2
9 Apr 2021
As Blackpool Gazette, could you not have found a picture of Blackpool to use? #LocalRag #StayLocal
2
2 Nov 2020
2 Nov 2020
Keep in touch with HAG via our newly launched Haggler!
3
5 May 2020
"As an opinions editor, I was unfettered by facts." - @M_T_Eley, Reminiscence on a Local Rag
#Kenyon #KenyonCollege #Paper #Newspaper #LocalRag #ThinkLocal #ReadLocal #CollegePaper #SmallTown #GambierOhio #Gambier
theeastbywest.com/home/a-rem…
1
1
16 Nov 2019
Who in the right mind would buy a hull daily mail?
#localrag
"Who in their right mind would buy it?" hulldailymail.co.uk/news/uk-…
4
3 Oct 2019
We made the local mag again! Cheesy grins! #howlingwolfcoffee #honiton #honitonmarket #streettrading #devon #southwest #localrag #localmag
1
4
27 Jul 2019
Local press coverage of last weekend’s matches, including wins for 1s & 3s, courtesy of @coynejames 🤹♂️🎳🤹♂️✍🏻
#localrag 🏏
2
31 Mar 2019
1
5
18 Nov 2018
Rags to Riches to Rags- Donald Height , never thought that one would be on the radio.
Given away in numbers to staff at The Northern Echo Dept. In Darlington many years ago.One found its way to me.#Strangeworldofnorthernsoul #Localrag
1
2
4 Aug 2018
So I’m ‘oop north’ visiting family and Mum buys the local paper today. Look what we found inside... #localrag #presscoverage #supportlocal #authornews #timeschool #newbook ift.tt/2ndLWVI
1