Skip to content

A Provider captures the details of one chatbot service/API. This captures how the API works, not the details of the underlying large language model. Different providers might offer the same (open source) model behind a different API.

Usage

Provider(base_url = class_missing, extra_args = class_missing)

Arguments

base_url

The base URL for the API.

extra_args

Arbitrary extra arguments to be included in the request body.

Details

To add support for a new backend, you will need to subclass Provider (adding any additional fields that your provider needs) and then implement the various generics that control the behavior of each provider.