TruLens provides testing for LLM-based apps. TruLens is open source and free at trulens.org.

Joined July 2021
67 Photos and videos
22 May 2024
Thanks to all of the developers who have been enthusiastic users of and contributors to TruLens! TruLens will stay open source and continue with future updates and enhancements. Stay tuned for more updates. #LLMeval #LLMops #MLOps #AIQuality
22 May 2024
TruEra is going to join Snowflake! ❄️ We are excited to help drive #AIQuality at the #AIDataCloud leader. Read the announcement from the founders of TruEra: Anupam Datta, Shayak Sen, and Will Uppington. loom.ly/ZkSrjUQ The #TrustworthyAI journey continues!
1
252
22 May 2024
Congratulations to the @snowflakeDB and @truera_ai teams!  We’re excited that TruLens will stay open source and continue to be maintained and enhanced! Stay tuned for more updates soon.
22 May 2024
Snowflake, the AI Data Cloud leader, is acquiring the TruEra AI Observability platform! Read the blog from Benoit Dageville, Co-founder and President, Product at Snowflake loom.ly/n72UrJc @SnowflakeDB #AIDataCloud #DataCloud #AIQuality #MLOps #LLMOps #TrustworthyAI
2
8
985
TruLens retweeted
16 May 2024
Find out the winners of the Tool Face-Off Hackathon - stream starting now! twitch.tv/lablabai
24 Apr 2024
🚀 Get ready for an exciting adventure at the Tool Face-Off Hackathon, powered by cutting-edge technology and an extraordinary lineup of visionary speakers! 🗓️ Mark your calendars Friday, April 26th, 6:00 PM CET, as we kick off this thrilling journey with our esteemed speakers: 🎙️Anupam Datta, Co-Founder, President, Chief Scientist at TruEra Topic: Evaluating Assistants API & LlamaIndex/MongoDB applications 🎙️Laurie Voss, VP Developer Relations at LlamaIndex Topic: Advanced RAG with agentic strategies 🎙️Prakul Agarwal, ML Product Manager at Mongo DB Topic: RAG and Evaluation for LLM Success 🌐 Come learn with us about Assistants API and LlamaIndex/MongoDB. Let's spark your creativity, shape the future of tech, and compete to win! There's a $10,000 USD cash prize pool and a special prize of $3,000 USD for the best use of each toolset. 👉 Haven't registered yet? Secure your spot now and choose your preferred toolset for this epic clash of titans! Sign up here: lablab.ai/event/assistants-a…
2
6
689
TruLens retweeted
26 Apr 2024
Starts now! Check out the livestream kickoff on Twitch: twitch.tv/lablabai/
25 Apr 2024
🚀Get ready for the ultimate showdown: Tool Face-Off: OpenAI Assistants API VS Llama-Index/MongoDB. An Eval-Driven Battle you won't want to miss! 👉Starting, Friday, April 26th, at 9:00 AM PST/6:00 PM CET, until Friday May 3rd. 🧩Join us and our esteemed partners @truera_ai , @llama_index , @MongoDB , and @intel for an electrifying kick-off on Twitch twitch.tv/lablabai in less than 24 hours. 🧩Don't let a single moment slip by! Check out our detailed schedule, packed with insightful workshops and Q&A sessions led by AI professionals. These sessions are designed to elevate your skills and deepen your understanding. 🧩Secure your spot now! Fill out the registration form and gain access to resources, guides, and comprehensive information about the hackathon at lablab.ai/event/assistants-a…. 🌟Get ready for a week of AI-driven creativity, learning, and innovation!
1
4
891
22 Apr 2024
Big shout out to all of the #LLMdevelopers out there who have been downloading TruLens and using it to make great apps, fast. And thanks for all of the feature suggestions and questions, too!
22 Apr 2024
🌟TruLens has over 100k downloads!🌟 Thanks to all of the LLM developers who trust us to eval their apps! 🙏 Need to test and track an LLM app? Check out TruLens. loom.ly/PBSsivc #LLMops #LLMeval #LLMapp #LLMdev #MLops
1
5
178
TruLens retweeted
16 Apr 2024
Don't miss this hackathon, #GenAI devs! Face-Off: OpenAI Assistants API VS @llama_index/@MongoDB 💸 $10k USD prize pool 🚀 7 dev days, expert workshops 🤝 Connect w/developers 💡 Develop impactful apps Signup loom.ly/AmgpptI #LLMOps #OpenAI @IntelAI

1
5
148
15 Apr 2024
Thanks for the shoutout, DHS! If you're looking for a better way to test, eval,and monitor your #LLMapp, come and talk to us. #LLMops #MLOps #AIQuality #RAI #LLMeval #LLMtesting #LLMmonitoring
12 Apr 2024
DHS CTO Chris Kraft on Government Applications of GenAI "In order to measure the “relevancy, accuracy and groundedness” of its model, Kraft said FEMA used a program called TruEra." loom.ly/_PTOnEQ #LLMOps #LLMObservability #LLMeval #AIQuality #TRISM #genAI
1
2
94
26 Mar 2024
New #feedbackfunction alert! @josephpollack and github@MN-Noor added the @vectara hallucination evaluator as a feedback function available through the @huggingface feedback provider in TruLens🦑 Check it out! loom.ly/mRCQZSc

66
23 Mar 2024
A double whammy! TruLens just added support for running models from both @mistral and @meta on @aws bedrock as feedback functions. This includes #llama2 and #mixtral. Read more about the @aws bedrock feedback provider: trulens.org/trulens_eval/api…

1
97
23 Mar 2024
Get feedback on your LLM app with @anthropic #claude3! TruLens now supports running feedback with Claude-3, including Haiku, Sonnet and Opus. Want to see it in action? Check it out: loom.ly/t7HvrBU

2
3
188
22 Mar 2024
The RAG Triad is a helpful way of thinking about how to evaluate #RAG apps. Check out this blog for more info on what it is and how it helps to minimize #LLMApp risk like hallucination. #LLMeval #LLMops #MLops #AIQuality
22 Mar 2024
Even RAGs can suffer from hallucination, as is often the case when the retrieval fails to retrieve sufficient context or even retrieves irrelevant context. To address this challenge, TruEra has innovated the RAG triad loom.ly/eaNW_QI #Rags #LLMObservability
1
125
13 Mar 2024
Evaluate your LLM app in TruLens for free - then when you move to production, you can monitor with TruEra, and move up to higher levels of scalability and support. #LLMOps #LLMeval #LLMmonitoring #MLOps #AIQuality #RAI
13 Mar 2024
TruEra launches updated #LLMEvaluations & #LLMObservability! Featuring: 🚀 Enterprise class scalability 🧑‍🤝‍🧑 Seamless transition: individual to enterprise 🤝 Easy-to-use collab tools 👁️ Robust LLM monitoring Read the blog: loom.ly/QJbDMSw #LLMOps #MLOps #RAI
1
108
TruLens retweeted
8 Mar 2024
After attending State of the Union speech #SOTU tonight, I had a brief exchange w/ President Biden @POTUS. Me: “Mr. President, you gave a historical speech by mentioning AI in the SOTU speech for the first time in history.” @POTUS (smiling): “Yes! And keep it safe”. 1/
9
102
1,082
98,956
9 Mar 2024
SF is where it's at for the #RAG Developer Bootcamp hosted by @anyscale and @pinecone! Can't wait to see the developers get hands-on in the Saturday workshops!
9 Mar 2024
Great turnout on Day 1 of the immersive, two-day RAG Developer Bootcamp at @anyscalecompute in San Francisco. Innovators @robertnishihara, @RoieSchwabco, @gokumohandas, @pcmoritz, @hwchase17, @shayaksen, @dhaplot, and Cheng Su all speaking about the future trajectory of RAG apps!
207
TruLens retweeted
8 Mar 2024
Ready for Pie & AI? 🥧 Virtual workshop led by @_jreini: "Evaluate & Track your LLM with TruLens" Hosted by @deeplearningai meetup Bangalore & @TRJ_0751 3/12, 8 AM Pacific Virtual event - all welcome! loom.ly/VjujL60 #LLMeval #RAGeval #LLMtesting #RAGtesting

2
5
257
9 Mar 2024
.@DeepLearningAI workshop with @truera_ai and @pinecone about Building Production-Grade #LLMapps is now freely available on YouTube! #LLMdev #LLMOps #LLMeval #LLMguardrails #TrustworthyAI
8 Mar 2024
Miss yesterday's @deeplearningAI workshop on Building Production-Grade #LLMApps with TruEra and @pinecone? Watch the replay here! Over 17k people signed up to watch live, and the video already has over 9k views! loom.ly/a-XOXkM #LLMmonitoring #LLMeval #LLMops
1
2
237
TruLens retweeted
7 Mar 2024
Just a few spots left - RAG Dev Bootcamp in SF! In-person bootcamp led by experts from @anyscale @pinecone @mistralAI & TruEra! Catch @shayaksen on "Evaluating RAG Apps to Speed Dev Time and Drive Performance" Get your spot!🚀 loom.ly/MIv0Bkk #LLMeval #RAGeval #LLMOps
2
4
197
7 Mar 2024
We've got a new integration! Now you can evaluate and track apps built with @nvidia nemo guardrails. Read more: loom.ly/JMg-LDo
2
35
6 Mar 2024
The hours are ticking away at the VEGA Hackathon at Shah & Anchor Kutchhi Engineering College! Go and test those new #LLMapps! We love the enthusiasm and spirit! #LLMeval #LLMtesting #AIQuality
6 Mar 2024
TruEra is sponsoring the VEGA Hackathon at Shah & Anchor Kutchhi Engineering College. @_jreini is showing participants how to test & evaluate #LLMapps using TruLens. Good luck to the competitors for the 24 hour hackathon! loom.ly/0Pl-v4U #LLMeval #LLMObservability
1
59