It can be one (ex: 'amazon' or 'google') or multiple provider(s) (ex: 'amazon,microsoft,google') that the data will be redirected to in order to get the processed results.
Providers can also be invoked with specific models (ex: providers: 'amazon/model1, amazon/model2, google/model3')

Providers in this list will be used as fallback if the call to provider in providers parameter fails. To use this feature, you must input only one provider in the providers parameter. but you can put up to 5 fallbacks.

They will be tried in the same order they are input, and it will stop to the first provider who doesn't fail.

Doesn't work with async subfeatures.

A list containing all the conversations between the user and the assistant. Each item in the list should be a dictionary with two keys: 'role' and 'message'.

role: Specifies the role of the speaker and can have the values 'user' or 'assistant'.

message: A list of dictionaries. Each dictionary in the 'message' list must contain the keys 'type' and 'content'.

Structure

• type: Specifies the type of content and can be 'media_url', 'media_base64', or 'text'.
• content: A dictionary with the actual content based on the 'type':
  • If 'type' is 'media_url', 'content' must contain 'media_url' and must not contain 'media_base64' or 'text'.
  • If 'type' is 'media_base64', 'content' must contain 'media_base64' and must not contain 'media_url' or 'text'.
  • If 'type' is 'text', 'content' must contain 'text' and must not contain 'media_url' or 'media_base64'.

Example

[
  {
    'role': 'user',
    'content': [
      {
        'type': 'text',
        'content': {'text': 'Describe this image'}
      },
      {
        'type': 'media_url',
        'content': {
           'media_url': 'https://upload.wikimedia.org/wikipedia/commons/thumb/d/dd/Gfp-wisconsin-madison-the-nature-boardwalk.jpg/2560px-Gfp-wisconsin-madison-the-nature-boardwalk.jpg',
           'media_type': 'image/jpeg'}
      },
    ]
  }
]

A list of sequences where the model will stop generating further tokens. Useful for controlling response length and format.