Filter
Exclude
Time range
-
Near
#NewListing on #bblist"Clearcom HBP-2x HelixNet Beltpack" - ift.tt/8xw9RIt
6
THIS. HelixNet: a cutting-edge Deep Learning structure with 3 Mistral-7B LLMs. Modeled after actor-critic methods in Reinforcement Learning, its DNA-inspired design reflects three networks collaborating seamlessly. (its components can be seamlessly transferred to other LLMs) 🔗: huggingface.co/migtissera/He…

Reposting this since there's a lot of talk about "Reflection" right now. HelixNet was built with a similar insight. The difference here is that it consists of 3 separate LLMs: an actor, a critic and a regenerator. At that time I didn't know how to evaluate this, but I have now figured out a way. Will evaluate in the next few days and share the results with you.
2
410
Reposting this since there's a lot of talk about "Reflection" right now. HelixNet was built with a similar insight. The difference here is that it consists of 3 separate LLMs: an actor, a critic and a regenerator. At that time I didn't know how to evaluate this, but I have now figured out a way. Will evaluate in the next few days and share the results with you.
It's been a big week for Open Source AI, and here's one more to cap the week off! Introducing HelixNet. HelixNet is a novel Deep Learning architecture consisting of 3 x Mistral-7B LLMs. It has an actor, a critic, and a regenerator. HelixNet is insprired from an actor-critic architecture most prominent in Reinforcement Learning algorithms. The name derives from Helix, referring to the spiral structure of a DNA molecule. It symbolizes the intertwined nature of the three networks, working in tandem, much like the strands of a DNA molecule. HelixNet regenerates very pleasing and accurate responses, due to the entropy preservation of the regenerator. Further, in testing, the critic and the regenerator seems readily transferrable to other LLMs. Here's the link to the model: huggingface.co/migtissera/He… Information on how to run it is provided on the readme file. Have a great weekend everyone!
1
1
20
1,584
Replying to @noot_ippi
Yeah! It also reminded me that HelixNet is due for an update 😁
1
2
187
Super interesting work! Congratulations to all involved. The approach however is very similar to HelixNet, that I released about a year ago. In HelixNet, the “thinker”, “critic” and “regenerator” was 3 separate 7B networks. Either way, super cool work and we’re absolutely destroying closed model moats! 👏🏾👏🏾👏🏾
I'm excited to announce Reflection 70B, the world’s top open-source model. Trained using Reflection-Tuning, a technique developed to enable LLMs to fix their own mistakes. 405B coming next week - we expect it to be the best model in the world. Built w/ @GlaiveAI. Read on ⬇️:
2
3
27
10,458
Well we’ve got to change that! Sorry that you guys didn’t get the recognition as well. If I knew I would’ve made some noise then too. AI is moving so fast, and some of us folks hate writing and publishing. (I hated it during my PhD!). If anyone copies HelixNet and publishes without giving any credit, I’d love for folks to speak up as well.
1
2
67
Introducing Sensei (先生): A simple, powerful, minimal codebase to generate synthetic data using OpenAI. github.com/migtissera/Sensei This has been my framework for generating synthetic data using GPT-4. It includes Orca system contexts, as well as 10 new system contexts that I've designed for creating my models: Synthia, Tess and HelixNet. You have full control over the topics. The best part is that the prompt itself is generated using GPT-4, so there's minimal refusals. I hope you benefit from this as much as I have. Feel free to open PRs for other APIs, such as Mistral's.
13
44
238
32,699
Our latest training video is now live! A quick overview of how to integrate HelixNet to the Arcadia Central Station. Watch now: youtu.be/vA0kNhW0l5Q #ClearComTraining
1
3
158
Tune in to #NBC tonight for the annual Rockefeller Center Christmas Tree Lighting. Clear-Com’s Eclipse, FS Edge, FS II, Arcadia & Helixnet are supporting the event's communications for the event. Shout-out to #JetwaveWireless for their incredible support of this event!
1
3
229
Not your weights, not your AI! Tess-v1.1 is out, deprecating Tess-v1.0 models that had a few instruction following issues. Tess, short for Tessoro, is available in two sizes: Tess-M is trained on the Yi-34B with 200K context length, and Tess-XS is trained on the Mistral-7B with 8K context length. Tess-XS-v1.1: huggingface.co/migtissera/Te… Tess-M-v1.1: huggingface.co/migtissera/Te… This is my flagship series. SynthIA and HelixNet were just teasers. Enjoy!
5
7
42
2,648
Wow! I did a quick version of HelixNet based on a single quantised instance of @MistralAI's amazing 7B model and an actor/critic/re-generator prompting strategy. It works surprisingly well. And it can run on a Raspberry Pi!
2
127
You can now run full HelixNet (all 3 models) on a single 4090! Great work!
I've quantized using exllama v2 and it's very coherent down to 4.0bpw. According to exl2 author Turboderp, 6.0bpw should have almost no loss from fp16; at 6.0bpw I can fit all three models on a single 4090. avoid 3.0bpw often needs multiple tries to generate coherent response.
9
747
GPT-3.5 vs HelixNet (original response and the critique is not printed, as it's optional).
1
9
852
Folks have asked for an Open Source Mixture Of Experts platform for private local use. IT IS HERE! HelixNet. Just like ChatGPT-4 Mixture Of Experts “secret” technology. HelixNet is a novel Deep Learning architecture consisting of 3 x Mistral-7B LLMs. It has an actor, a critic, and a regenerator. HelixNet is insprired from an actor-critic architecture most prominent in Reinforcement Learning algorithms. The name Helix is referring to the spiral structure of a DNA molecule and it symbolizes the intertwined nature of the three networks, working in tandem, much like the strands of a DNA molecule. HelixNet regenerates very pleasing and accurate responses, due to the entropy preservation of the regenerator. The regenerator was only trained on a dataset of 1000 samples, similar to Meta's LIMA. The actor network here was trained on about 250K very high-quality samples, and the critic network was trained on further 10K samples. Helix is astounding! I will write a detailed ReadMultiplex.con article soon. Link: huggingface.co/migtissera/He…
5
25
9,317
It's been a big week for Open Source AI, and here's one more to cap the week off! Introducing HelixNet. HelixNet is a novel Deep Learning architecture consisting of 3 x Mistral-7B LLMs. It has an actor, a critic, and a regenerator. HelixNet is insprired from an actor-critic architecture most prominent in Reinforcement Learning algorithms. The name derives from Helix, referring to the spiral structure of a DNA molecule. It symbolizes the intertwined nature of the three networks, working in tandem, much like the strands of a DNA molecule. HelixNet regenerates very pleasing and accurate responses, due to the entropy preservation of the regenerator. Further, in testing, the critic and the regenerator seems readily transferrable to other LLMs. Here's the link to the model: huggingface.co/migtissera/He… Information on how to run it is provided on the readme file. Have a great weekend everyone!
27
89
558
192,894
5 Apr 2023
.@Solotech_Inc deploys an extensive system featuring Clear-Com’s Eclipse HX Digital Matrix, HelixNet Digital Partyline, and FreeSpeak II for Resorts World Theatre 📶 mondodr.com/resorts-world-th…

4
99
We are excited to be a finalist in the @AVNews Project of the Year Awards for our @NatGeo Awards Ceremony project with FreeSpeak II and HelixNet beltpacks last summer! Winners will be announced at #ISE2023. #NatGeo story: clearcom.me/natgeo | #AVAwards #AVtweeps

152
9 Dec 2022
.@clearcomsystem FreeSpeak, Dante and HelixNet integration offers the ideal combination of features for River Oak Church ⛪️ mondodr.com/clear-coms-arcad…

1
2
“Honestly, I feel like every church needs to know about Arcadia." @RiverOakChurch finds the perfect intercom solution for #HousesofWorship. Read the full story: clearcom.me/3PbN5te #FSII #HelixNet #Arcadia #ClearComStories #AVtweeps

2
5
German speakers: tune in to @AudioTechnicaUK's training on the #Arcadia with HelixNet Integration this Thurs. at 10:00 AM CET! Register here: attendee.gotowebinar.com/reg… | #audiotechnica #techtraining #avtweeps
2