Replace OpenAI API with local models: Ollama + LiteLLM, text gen webui, google colab

Описание: I walk through my 3 favourite methods for running an OpenAI compatible api powered by local models: Ollama + Litellm, Text Generation WebUI and google colab

https://ollama.ai/
https://github.com/BerriAI/litellm
https://github.com/oobabooga/text-gen...
https://colab.research.google.com/dri...
https://github.com/Troyanovsky/Local-...

You can sign up for the next intake of the course I mentioned at
https://devacademy.co.nz/practical-ai...

00:00 Introduction
00:29 A simple script
01:02 Ollama + LiteLLM
03:57 textgen-webui
09:31 Google colab + textgen-webui