Oobabooga Text Generation Web UI
If you're running with the option
Run AGiXT and Text Generation Web UI with Docker (NVIDIA Only), you can access the Text Generation Web UI at http://localhost:7860/?__theme=dark to download and and configure your models. The
AI_PROVIDER_URI will be
http://text-generation-webui:5000 for your AGiXT agents.
- Create a new agent
AI_PROVIDER_URIto the URI of your Oobabooga server.
PROMPT_SUFFIXif your model requires it. For example, for models like Vicuna, you will want to enter the
- Review and set any of the other settings as you see fit from the agent settings page.