Evaluating LLM-based Applications
Databricks Databricks
118K subscribers
26,163 views
545

 Published On Jul 26, 2023

Evaluating LLM-based applications can feel like more of an art than a science. In this workshop, we'll give a hands-on introduction to evaluating language models. You'll come away with knowledge and tools you can use to evaluate your own applications, and answers to questions like:

Where do I get evaluation data from, anyway?
Is it possible to evaluate generative models in an automated way?
What metrics can I use?
What's the role of human evaluation?

Talk by: Josh Tobin

Here’s more to explore:
LLM Compact Guide: https://dbricks.co/43WuQyb Big Book of MLOps: https://dbricks.co/3r0Pqiz

Connect with us: Website: https://databricks.com
Twitter:   / databricks  
LinkedIn:   / databricks  
Instagram:   / databricksinc  
Facebook:   / databricksinc  

show more

Share/Embed