Published On Jul 7, 2024
Learn how to set up a local model using OLAMA and the Groq API for Project GraphRAG. We will also look at the limitation of using smaller local open weight models.
LINKS:
Graph RAG: https://tinyurl.com/y3f9cbnd
Github: https://github.com/microsoft/graphrag
GraphRAG flowchart: https://tinyurl.com/2s4ytcur
RAG flowchart: https://tinyurl.com/56mwzkk7
Community Creation: https://tinyurl.com/54n88c2j
Ollama OpenAI API: https://ollama.com/blog/openai-compat...
Groq API: https://console.groq.com/docs/openai
💻 RAG Beyond Basics Course:
https://prompt-s-site.thinkific.com/c...
Let's Connect:
🦾 Discord: / discord
☕ Buy me a Coffee: https://ko-fi.com/promptengineering
|🔴 Patreon: / promptengineering
💼Consulting: https://calendly.com/engineerprompt/c...
📧 Business Contact: [email protected]
Become Member: http://tinyurl.com/y5h28s6h
💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off).
Signup for Newsletter, localgpt:
https://tally.so/r/3y9bb0
TIMESTAMPS
00:00 Introduction to Project GraphRAG
00:30 Setting Up OLAMA and Choosing Models
01:14 Configuring GraphRAG with OLAMA
02:32 Using Groq API with GraphRAG
04:35 Running Local Indexing and Entity Extraction
07:15 Testing and Comparing Models
08:15 Importance of LLM Choice in GraphRAG
10:58 Optimizing Prompts for Different LLMs
All Interesting Videos:
Everything LangChain: • LangChain
Everything LLM: • Large Language Models
Everything Midjourney: • MidJourney Tutorials
AI Image Generation: • AI Image Generation Tutorials