LLM Usage#

DB-GPT provides a management and deployment solution for multiple models. This chapter mainly discusses how to deploy different models.

https://github.com/eosphoros-ai/DB-GPT/assets/13723926/a0d0840f-570a-4409-bb7d-bec6535a5f62
Multi LLMs Support, Supports multiple large language models, currently supporting

  • 🔥 InternLM(7b,20b)

  • 🔥 Baichuan2(7b,13b)

  • 🔥 Vicuna-v1.5(7b,13b)

  • 🔥 llama-2(7b,13b,70b)

  • WizardLM-v1.2(13b)

  • Vicuna (7b,13b)

  • ChatGLM-6b (int4,int8)

  • ChatGLM2-6b (int4,int8)

  • guanaco(7b,13b,33b)

  • Gorilla(7b,13b)

  • Baichuan(7b,13b)

  • OpenAI

  • llama_cpp

  • quantization