In this video we'll use the LLM Carbon plugin for Green Software Foundation's Impact Framework to measure CO2 impact of training LLMs like Meta's Llama-7B. I'll then go through each of the inputs required to make the calculations. Lastly, we'll look at some of the other ways of using the Impact Framework.

LLM Carbon Plugin - https://github.com/Jjing-Liang/LLMCar...
Llama Training Research - https://arxiv.org/pdf/2302.13971
EPA Equivalencies Calculator - https://www.epa.gov/energy/greenhouse...
Nvidia H100 Specs (TDP) - https://www.nvidia.com/content/dam/en...
Measuring Website Carbon Usage with the Impact Framework - https://github.com/heaversm/carbonhac...
Impact Framework Repo - https://github.com/Green-Software-Fou...

0:00 - Running the calculations using the Impact Engine
2:09 - Examining inputs and outputs
3:42 - Checking our results against the research results
4:04 - Adapting the manifest file for your own metrics
4:50 - Other uses of the Impact Framework