You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
GPTScript can be used against alternative models that expose an OpenAI-compatible API or have a provider available.
4
+
Here is an example using Claude:
6
5
7
-
### Using a model with an OpenAI compatible API
8
-
9
-
```gptscript
10
-
model: mistral-large-latest from https://api.mistral.ai/v1
11
-
12
-
Say hello world
13
-
```
14
-
15
-
:::note
16
-
Mistral's La Plateforme has an OpenAI-compatible API, but the model does not behave identically to gpt-4. For that reason, we also have a provider for it that might get better results in some cases.
17
-
:::
18
-
19
-
### Using a model that requires a provider
20
6
```gptscript
21
7
model: claude-3-haiku-20240307 from github.com/gptscript-ai/claude3-anthropic-provider
22
8
23
9
Say hello world
24
10
```
25
11
26
-
### Authentication
12
+
A note on model compatibility:
27
13
28
-
For OpenAI compatible providers, GPTScript will look for an API key to be configured with the
29
-
prefix `GPTSCRIPT_PROVIDER_`, the base domain converted to environment variable format, and a suffix of `_API_KEY`.
30
-
For example, if you are using `mistral-large-latest from https://api.mistral.ai/v1`, the environment variable would
31
-
be `GPTSCRIPT_PROVIDER_API_MISTRAL_AI_API_KEY`.
14
+
:::important
15
+
While the providers allow GPTScript to work with other models, the effectiveness of using a
16
+
different model will depend on a combination of prompt engineering and the quality of the model. You may need to change
17
+
wording or add more description if you are not getting the results you want. In some cases, the model might not be
18
+
capable of intelligently handling the complex function calls.
19
+
:::
20
+
21
+
## Authentication
32
22
33
23
Each provider has different requirements for authentication. Please check the readme for the provider you are
34
24
trying to use.
@@ -50,16 +40,40 @@ The following providers are currently available:
50
40
For any provider that supports listing models, you can use this command:
0 commit comments