🔎🤖LangSmith Insights Agent
Really excited to launch our first in-product agent
This agent lives inside LangSmith and combs through traces, giving you insights into:
🧑🤝🧑how users are using your agent
⁉️how your agent may be messing up
🛃{your custom insight here}
The problem we saw was that people were launching agents... and didn't know how their users were actually using them! You put a chat box in front of people, and they may ask it anything - the surface area for agents is often super wide
In addition - agents would fail silently. They could give a bad response - this wouldn't show up in error logs, but its good to know.
If you know what look for, you can set up LLM as a judge evaluators. But what if you don't? (most people don't initially)
The best way to figure this out - as @HamelHusain says - "look at your data". But LLMs are really good at looking at your data! So can they do it for you?
This is exactly what insights agent attempts to do. It's live in LangSmith today. You can read more about it here: blog.langchain.com/insights-…
Last Chance Charlene is OUT NOW OnDemand & Digital HD! Reeling from her brother's suicide, a writer/actress tries to put her complicated life back together and finally make a break in her career.
Watch #LastChanceCharlene on #AppleTV: bit.ly/3Z9FTSf#SupportIndieFilm
Scientists, and the very ideals of science, are under attack on many fronts. This is dangerous and shortsighted. So I was dismayed to hear Jon Stewart add to the "questioning" when he went on The Late Show with Stephen Colbert this week. My thoughts here.
steady.substack.com/p/in-def…
‘How the f*ck do we need a license for a bike?’ — Police in Perth Amboy, NJ, took a Black teen into custody and confiscated his bike after confronting him and his friends about bike licenses (warning: distressing)
"Prove us wrong just once… It's not fun expecting for there to be unequal justice under the law. So I'd love to be proved wrong. I'd love it if at the end of this trial there was a guilty verdict. But even then, I'm not going to celebrate." — @michaelsmith
📍RATIONING CARE has begun in Southern California w/ 0% ICU beds in many hospitals. This is from a Pasadena, CA hospital declaring to all patients that #COVID19 emergency rationing of care has begun.
➡️ Care will be prioritized by survival likelihood. Sobering. We are now here.
This is what my heart "feels" but feelings don't do shit unless you speak them and take actions that are consistent with them. I need to do better. need to be better. "you can't be woke and not talk" @TonyAaronII @ChrisCarthern I love you guys.