Privacy is a top concern when discussing ChatGPT-like tools with professionals. With this working proof of concept, I show how open-source models and tools like @langchain enable a 100% local execution, ensuring your data never leaves your environment. github.com/imartinez/private…

Running, of course, on top of @ollama !

Local, natural-language database querying is one of the features I enjoy most in the new PrivateGPT 1.0. It comes ready-to-use (via API & UI), with support for MSSQL, Postgres, DB2, and MySQL. Give it a try this weekend! docs.privategpt.dev/tools/da…

PrivateGPT is back! In 2023, it became the first offline RAG implementation and a breakout open source project. Then we went quiet in 2024. Today, PrivateGPT 1.0 is here: a full application API layer for local AI. github.com/zylon-ai/private-…

🚀 MAJOR NEWS: Strategic partnership with @TelefonicaTech to revolutionize enterprise AI! When one of Europe's largest tech giants validates your approach, you know the market is shifting toward private AI workspaces where data sovereignty is ensured 🔐 telefonicatech.com/en/news/w…

🫵 Join us for our next event on #PrivateAI hosted by @GoogleStartups Madrid on June 9th at 17:00 for great talks and even greater food and drinks networking afterwards 🍻 Register now! lu.ma/7sym9e4r

Understanding MCP architectures helps teams make smarter AI integration decisions. The key factor is where the LLM processes data. This diagram different setups - no "wrong" choice if you're informed about the tradeoffs. More details: zylon.ai/blog/mcp-architectu…

Episode 1 of our "Zylon Success Stories" series with @UCBerkeley's @GoldmanSchool who built ChatGSPP using our open-source PrivateGPT tech - a fully private #AI chatbot running on-prem that helps students & faculty access information in a quick & easy way youtu.be/2X3TvcVWAnA

🤯 What our team at @ZylonPrivateGPT just built has shattered every boundary of on-prem enterprise AI. Agentic workflows, real-time collaboration, editable canvas, inline AI support, multi-modality... ... 100% on YOUR servers. No more "quality or privacy" dichotomy. 💪

💪 Yesterday: "I need to do this." 🦾 Today: "I need to ask AI to do this." 🧠 Tomorrow: "I need to explain the problem to AI so it can solve it." 🤖 Near future: "I need to update AI on our company vision so it can identify and solve our next critical problems." 🗒️👇

With us your company data NEVER leaves your servers, no matter what LLM we use. Our on-prem AI runs ENTIRELY local in YOUR infrastructure with zero outbound connections. It's not marketing—it's architecture. True data sovereignty means complete control. zylon.ai/blog/why-aren-t-we-…

Announcing @MistralAI Small 3.1: multimodal, multilingual, Apache 2.0, the best model in its weight class. 💻 Lightweight: Runs on a single RTX 4090 or a Mac with 32GB RAM, perfect for on-device applications. 🗣️ Fast-Response Conversations: Ideal for virtual assistants and other applications where quick, accurate responses are essential. ⚡ Low-Latency Function Calling: Capable of rapid function execution within automated or agentic workflows. 🔍 Specialized Fine-Tuning: Customizable for specific domains. 🧠 Advanced Reasoning Foundation: Inspires community innovation, with models like DeepHermes 24B by Nous Research built on Mistral Small 3. We're releasing base and instruct checkpoints for Mistral Small 3.1 to support further downstream customization of the model.

Announcing the latest DeepHermes Preview models, DeepHermes 24B and 3B! huggingface.co/collections/N… These new models are Hybrid Reasoners - meaning you can toggle ON and OFF the long chain of thought reasoning whenever you want a short, intuitive answer, or a long, well reasoned higher accuracy answer, now available on our API and to download on HuggingFace.

🔍 Knowing beats guessing every time. We've made significant strides with Opik by @Cometml. Our latest iteration brought a 52% improvement in context recall and enhanced measurement capabilities. Iterating, measuring, and optimizing—this is how we drive excellence to #PrivateAI

Just launched: RFPs automation with Zylon's Bulk Q&A Agent Flow! 🚀 Our new private AI feature extracts questions from RFPs, searches your knowledge base, and generates accurate responses with sources—all in minutes. See how engineering firms are saving 1000 hours annually:

Today, we release QwQ-32B, our new reasoning model with only 32 billion parameters that rivals cutting-edge reasoning model, e.g., DeepSeek-R1. Blog: qwenlm.github.io/blog/qwq-32… HF: huggingface.co/Qwen/QwQ-32B ModelScope: modelscope.cn/models/Qwen/Qw… Demo: huggingface.co/spaces/Qwen/Q… Qwen Chat: chat.qwen.ai This time, we investigate recipes for scaling RL and have achieved some impressive results based on our Qwen2.5-32B. We find that RL training con continuously improve the performance especially in math and coding, and we observe that the continous scaling of RL can help a medium-size model achieve competitieve performance against gigantic MoE model. Feel free to chat with our new models and provide us feedback!

8.5% of AI prompts contain sensitive data. Yet, 64% of employees use Cloud AI tools like ChatGPT without safeguards. CISOs, ignoring this = risk ⚠️ Stop compromising your most valuable assets by using Cloud-based AI providers. #PrivateAI is the solution to secure your data 🔐

Using our on‑prem Private AI through @ZylonPrivateGPT, I can confidently connect to our knowledge base and ask questions—ensuring that all input, inference, and output remain securely within our infrastructure. 🧵