Yeah, onexip-Hakathon success story!
Last weekend we've managed to get the Stanford alpaca 7B model running on an iOS device. Here is the Branch in alpaca.cpp: github.com/onexip/alpaca.cpp…@miolini it's indeed a bit faster than on Raspi. @simonw@heiseonline