DB-GPT Product Provides LLM Model Management in web interface.Including LLM Create, Start and Stop. Now DB-GPT support LLMs:
Multi LLMs Support, Supports multiple large language models, currently supporting
Support API Proxy LLMs
Create && Start LLM Model#
Make sure your LLM Model file is downloaded or LLM Model Proxy api service is ready.
When create success, you can see: Then you can choose and switch llm model service to chat.
Stop LLM Model#