Assessing the Risks of Open AI Models with Sayash Kapoor - 675
The TWIML AI Podcast with Sam Charrington The TWIML AI Podcast with Sam Charrington
18.4K subscribers
458 views
0

 Published On Mar 11, 2024

Today we’re joined by Sayash Kapoor, a Ph.D. student in the Department of Computer Science at Princeton University. Sayash walks us through his paper: "On the Societal Impact of Open Foundation Models.” We dig into the controversy around AI safety, the risks and benefits of releasing open model weights, and how we can establish common ground for assessing the threats posed by AI. We discuss the application of the framework presented in the paper to specific risks, such as the biosecurity risk of open LLMs, as well as the growing problem of "Non Consensual Intimate Imagery" using open diffusion models.

🔔 Subscribe to our channel for more great content just like this: https://youtube.com/twimlai?sub_confi...


🗣️ CONNECT WITH US!
===============================
Subscribe to the TWIML AI Podcast: https://twimlai.com/podcast/twimlai/
Join our Slack Community: https://twimlai.com/community/
Subscribe to our newsletter: https://twimlai.com/newsletter/
Want to get in touch? Send us a message: https://twimlai.com/contact/


📖 CHAPTERS
===============================
00:00 - Introduction
06:50 - What is an open model?
11:04 - Building common ground on AI risk
15:19 - Marginal risk
18:28 - Assessing the risks of NCII
28:44 - The argument for openness
37:13 - The future of AI risk assessment
43:56 - Conclusion


🔗 LINKS & RESOURCES
===============================
On the Societal Impact of Open Foundation Models - https://crfm.stanford.edu/open-fms/pa...
Open Source Initiative - https://opensource.org/
Will releasing the weights of future large language models grant widespread access to pandemic agents? - https://arxiv.org/ftp/arxiv/papers/23...
Can large language models democratize access to dual-use biotechnology? - https://arxiv.org/ftp/arxiv/papers/23...
Artificial intelligence and biological misuse: Differentiating risks of language models and biological design tools - https://arxiv.org/ftp/arxiv/papers/23...
StopNCII.org - https://stopncii.org/


📸 Camera: https://amzn.to/3TQ3zsg
🎙️Microphone: https://amzn.to/3t5zXeV
🚦Lights: https://amzn.to/3TQlX49
🎛️ Audio Interface: https://amzn.to/3TVFAIq
🎚️ Stream Deck: https://amzn.to/3zzm7F5

show more

Share/Embed