I had an idea today to be able to chat with my local LLM that is powered by the granite foundation model from the InstructLab Project. Luckily, I was able to find an open source project called AlwaysReddy that fit the bill. In this video, I go from zero to chatting with the granite open source model in under 10 minutes. ALL IN REAL TIME with no cuts or edits.

https://github.com/instructlab
https://github.com/ILikeAI/AlwaysReddy
https://ollama.com/download
https://huggingface.co/instructlab/gr...