Docs
Supported LLMs

Supported LLMs

Currently, the only supported Large Langauge Model (LLM) types are ChatOpenAI and OpenAI.

  • The LLM settings, including the type, provider, name, and arguments, are defined in the LLMSettings interface.
  • The load_llm_from_config() function in model.ts is used to load the LLM from the configuration.

As for future updates, stay tuned! The code is designed to be easily extendable for supporting more types of LLMs in the future. For example, new LLM types can be added to the llm_type_to_cls_dict dictionary in the model.ts, and the corresponding class can be implemented to handle the new LLM type.

Last updated on August 13, 2023