Building Production-Grade LLM Apps
DeepLearningAI DeepLearningAI
319K subscribers
22,298 views
0

 Published On Streamed live on Mar 7, 2024

Last year, GenAI experimentation spread like wildfire. Developers tinkered with new foundation models, data, and use cases. However, a relatively low percentage of projects moved from prototypes to production to drive real-world impact. One significant reason for this is ensuring app trustworthiness: Is an app reliable, accurate, or fair enough to be unleashed on the world? Which app responses are hallucinatory, which ones are unsafe? Could we identify issues and mitigate them during app development and in production to meet the quality level that end users need?

This year, organizations are taking their learnings from experimentation and focusing on creating and iterating enterprise-grade apps that will be reliable in the harsher realities of production environments.

How can you make your apps enterprise grade? In this webinar, technical leaders from Pinecone and TruEra will share how to create apps that are high quality and production ready. The principles will be illustrated with Pinecone Canopy and TruLens, and notebooks will be available for participants to explore.

In this workshop, you will learn:

What do you need to create enterprise-ready AI models and apps? Your current stack might have some gaps in it. Here’s what’s working.
What do you need to evaluate and iterate on apps quickly, so that you can gain confidence that your app is ready for production?
Rapid response - what happens when an app generates a hallucinatory or irrelevant or unsafe response? How to monitor, recognize when your app is in trouble and quickly get it back on the rails.

- Please take a moment to register for our short courses here:
https://bit.ly/49xRjEb
https://bit.ly/41arJ59

- Please take a moment to register for our community forum:
https://bit.ly/42HSfUj


Below are the materials for the webinar.

- Slides:
https://docs.google.com/presentation/...

- Notebook:
https://github.com/truera/trulens/blo...

About DeepLearning.AI

DeepLearning.AI is an education technology company that is empowering the global workforce to build an AI-powered future through world-class education, hands-on training, and a collaborative community. Take your generative AI skills to the next level with short courses help you learn new skills, tools, and concepts efficiently.

About Pinecone:

Pinecone created the vector database, which acts as the long-term memory for AI models and is a core infrastructure component for AI-powered applications. The managed service lets engineers build fast and scalable applications that use embeddings from AI models, and get them into production sooner. Pinecone recently raised $100M in Series B funding at a $750M valuation. The funding round was led by Andreessen Horowitz, with participation from ICONIQ Growth and previous investors Menlo Ventures and Wing Venture Capital. Pinecone operates in San Francisco, New York, and Tel Aviv.


About TruEra:

TruEra is the leader in AI Observability, helping companies to monitor, debug, and test their AI apps in order to drive performance, quality, and trustworthiness. Powered by enterprise-class Artificial Intelligence (AI) Explainability technology based on over nine years of research, TruEra is able to facilitate faster, more accurate ML model monitoring, analysis and debugging than any other vendor. Organizations using TruEra can achieve higher quality, higher performing models that sustainably achieve measurable business results, address unfair bias, and ensure governance and compliance.

- Amnon Catav Machine Learning Engineer, Pinecone
  / amnon-catav-6a7068142  

- Anupam Datta Co-Founder and Chief Scientist, Truera
  / anupamdatta  

show more

Share/Embed