text-generation-webui (oobabooga)

text-generation-webui has a large plugin ecosystem for users already on that Web UI. For MiniTavern, enable its OpenAI-compatible extension / API.

Steps (summary)

1. Install and load a model per official docs.
2. In extensions or launch flags, enable the openai compatible API (name/toggle follows the current branch).
3. Listen on 0.0.0.0 or allow LAN; common default port is 5000 or whatever the docs say.
4. Self-test: http://127.0.0.1:port/v1/models.
5. MiniTavern Base URL: http://YOUR_PC_IP:port/v1.

Tips

• Branches and extensions change fast — trust the README of the version you cloned.
• For “out of the box”, prefer Ollama / LM Studio / KoboldCPP.

Next

Configure in MiniTavern · Tools overview