Learn how to set up a local model using OLAMA and the Groq API for Project GraphRAG. We will also look at the limitation of using smaller local open weight models.

LINKS:
Graph RAG: https://tinyurl.com/y3f9cbnd
Github: https://github.com/microsoft/graphrag
GraphRAG flowchart: https://tinyurl.com/2s4ytcur
RAG flowchart: https://tinyurl.com/56mwzkk7
Community Creation: https://tinyurl.com/54n88c2j
Ollama OpenAI API: https://ollama.com/blog/openai-compat...
Groq API: https://console.groq.com/docs/openai

💻 RAG Beyond Basics Course:
https://prompt-s-site.thinkific.com/c...

Let's Connect:
🦾 Discord:   / discord  
☕ Buy me a Coffee: https://ko-fi.com/promptengineering
|🔴 Patreon:   / promptengineering  
💼Consulting: https://calendly.com/engineerprompt/c...
📧 Business Contact: [email protected]
Become Member: http://tinyurl.com/y5h28s6h

💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off).

Signup for Newsletter, localgpt:
https://tally.so/r/3y9bb0


TIMESTAMPS
00:00 Introduction to Project GraphRAG
00:30 Setting Up OLAMA and Choosing Models
01:14 Configuring GraphRAG with OLAMA
02:32 Using Groq API with GraphRAG
04:35 Running Local Indexing and Entity Extraction
07:15 Testing and Comparing Models
08:15 Importance of LLM Choice in GraphRAG
10:58 Optimizing Prompts for Different LLMs


All Interesting Videos:
Everything LangChain:    • LangChain  

Everything LLM:    • Large Language Models  

Everything Midjourney:    • MidJourney Tutorials  

AI Image Generation:    • AI Image Generation Tutorials