Happy to share that the new Haskell Meetup will be hosted at @GroqInc in their Mountain View HQ, this Friday 5:30pm partiful.com/e/McHtTURDtf4kL… @csTimSears will share how Groq uses Haskell and @avi_press (founder @scarf_oss) will talk about his experience on running a startup with haskell

With over 284K developers using GroqCloud™, the Groq Speed Read focuses on developers and highlights new features, great apps, and what’s coming up. Sign up for the Speed Read here so you don't miss out - hubs.la/Q02GqlrH0 -

Who wants to go all in on an LPU cluster with me?

I’m sorry to all the engineers at @GroqInc I should’ve waited till tomorrow to post about you… Hopefully the servers stay online till the morning!

Try groq.com now Hyperfast LLM running on custom built GPUs Answers in miliseconds, not seconds How? 🤯

The first public demo using Groq: a lightning-fast AI Answers Engine. It writes factual, cited answers with hundreds of words in less than a second. More than 3/4 of the time is spent searching, not generating! The LLM runs in a fraction of a second. 6de65e58-cada-45e9-bf39-a6c8…

Good guess, but nope. Completely original hardware / software solution built from the ground up. We say it's "sand to sky" because it's our custom silicon GroqChip, an LPU provided as a system via our cloud solution. We haven't even started with tricks used by others yet. :D

oi, m8. @GroqInc fastest resp alive

I tried this with summarize book text with cross questioning and summary. It's faster and more accurate than big techs llms.

Wild tech you have to try: groq.com They are serving Mixtral at nearly 500 tok/s. Answers are pretty much instantaneous. Opens up new use-cases, and completely changes the UX possibilities of existing ones.

The response time from groq feels like magic!

Groq is serving the fastest responses I've ever seen. We're talking almost 500 T/s! I did some research on how they're able to do it. Turns out they developed their own hardware that utilize LPUs instead of GPUs. Here's the skinny: Groq created a novel processing unit known as the Tensor Streaming Processor (TSP) which they categorize as a Linear Processor Unit (LPU). Unlike traditional GPUs that are parallel processors with hundreds of cores designed for graphics rendering, LPUs are architected to deliver deterministic performance for AI computations. The LPU's architecture is a departure from the SIMD (Single Instruction, Multiple Data) model used by GPUs and favor a more streamlined approach that eliminate the need for complex scheduling hardware. This design allows every clock cycle to be utilized effectively, ensuring consistent latency and throughput. For developers, this means that performance can be precisely predicted and optimized which is critical in real-time AI applications. Energy efficiency is another area where LPUs shine. By reducing the overhead of managing multiple threads and avoiding the underutilization of cores, LPUs can deliver more computations per watt. Groq's innovative chip design allows multiple TSPs to be linked together without the traditional bottlenecks found in GPU clusters making them extremely scalable. This enables linear scaling of performance as more LPUs are added simplifying the hardware requirements for large-scale AI models and making it easier for developers to scale their applications without rearchitecting their systems. So what does this all mean? LPUs could provide a massive improvement compared to GPUs for serving AI applications in the future! If anything it will be great to have alternative high performing hardware since A100s and H100s are so in demand

Math. We have no moat around it. How do we build one?

Truly

FP folks -- if you or one of your students recently completed a PhD in functional programming, please submit the abstract for publication in JFP. Simple process, no refereeing, open access, 200 published to date, deadline 30th June 2023. Please share! tinyurl.com/jfp-phd-abstract…

My crew for @GroqInc web-stream event today, GroqDay. Register and watch at groq.link/groqday4 we'll be sharing demos and presentations on #AI #LLMs, #GNNs, and more! Proud of these folks.

Hurry up folks, not all functions are continuous.

California roofs are just for show.

10/10: Suti. What my mother calls me 10/10: Satan. Local Starbucks 9/10: Satunaham. Punjabi's that know how to pronounce my name. 8/10: Sat-nam. What UK/American people call me 2/10: Santa. Piss takers 1/10: Satnav / Batman. Friends' kids. 0/10: Sadam. US immigration officials

everything you thought you knew about tidal waves is wrong "oh but i know the moon doesn't pull anything, it's actually a pinch effect" yeah yeah sure but get a load of this. new zealand has high tide on one side of the island, and low tide on the other lol