Crazy FAST RAG | Ollama | Nomic Embedding Model | Groq API

Описание: In this video, I will show you how to use the super fast open embedding model "nomic-embed-text" via Ollama and use the large language model via Ollama and Groq. I will first demonstrate how you can create a simple ChatGPT like UI locally in your computer with Ollama and then using Groq model ( which has super fast inference ). You can follow along with me by cloning the repo locally. The idea is once you know this approach, you can quickly switch different models.

Open Source in Action 🚀
Mixtral or Llama2 can be used as Large Language model.
nomic-embed-text as embedding model from Nomic AI via Ollama.
LangChain is used as a Framework for LLM
Groq to load the LLM
Chainlit is used for deploying.

👉🏼 Links:
Chainlit: https://docs.chainlit.io/get-started/...
LangChain: https://www.langchain.com/
Ollama: https://ollama.ai/
Groq :https://wow.groq.com/
Gorq playground: https://console.groq.com/playground
nomic-embed-text: https://blog.nomic.ai/posts/nomic-emb...
💻 GitHub repo for code: https://github.com/sudarshan-koirala/...

------------------------------------------------------------------------------------------

⏰ Timestamps
00:00 Introduction
00:43 SetUp
03:30 RAG With Chainlit and Ollama
12:57 RAG With Chainlit and Groq API
16:28 Conclusion
------------------------------------------------------------------------------------------
☕ Buy me a Coffee: https://ko-fi.com/datasciencebasics
✌️Patreon:   / datasciencebasics  

------------------------------------------------------------------------------------------
🔗 🎥 Other videos you might find helpful:

🔥 Databricks playlist:    • 30 Days Of DataBricks  

⛓️ Langflow:    • ⛓️ langflow | UI For 🦜️🔗 LangChain  
⛓️ Flowise:    • Flowise | UI For 🦜️🔗 LangChain  

🔥Chainlit playlist:    • Chainlit  

🦜️🔗 LangChain playlist:    • LangChain  

🦙 LlamaIndex Playlist:    • LlamaIndex  

------------------------------------------------------------------------------------------
🤝 Connect with me:
📺 Youtube: https://www.youtube.com/@datascienceb...
👔 LinkedIn:   / sudarshan-koirala  
🐦 Twitter:   / mesudarshan  
🔉Medium:   / sudarshan-koirala  
💼 Consulting: https://topmate.io/sudarshan_koirala

#langchain #chainlit #groq #mistral #llama2 #nomic #chatui #chatgpt #datasciencebasics