mirror of
https://github.com/zhayujie/chatgpt-on-wechat.git
synced 2026-06-02 00:57:41 +08:00
63 lines
1.8 KiB
Plaintext
63 lines
1.8 KiB
Plaintext
---
|
|
title: Custom
|
|
description: Custom vendor configuration for third-party API proxies and local models
|
|
---
|
|
|
|
For model services accessed via the OpenAI-compatible protocol or locally deployed models, such as:
|
|
|
|
- **Third-party API proxies**: call multiple models through a unified API base
|
|
- **Local models**: models deployed locally with tools like Ollama, vLLM, LocalAI
|
|
- **Private deployments**: model services deployed inside an enterprise
|
|
|
|
<Note>
|
|
Difference from the `openai` vendor: when a custom vendor is selected, switching models via `/config model` does not automatically switch the vendor type — the custom API address is always used.
|
|
</Note>
|
|
|
|
## Text Chat
|
|
|
|
### Third-party API proxy
|
|
|
|
```json
|
|
{
|
|
"bot_type": "custom",
|
|
"model": "",
|
|
"custom_api_key": "YOUR_API_KEY",
|
|
"custom_api_base": "https://{your-proxy.com}/v1"
|
|
}
|
|
```
|
|
|
|
| Parameter | Description |
|
|
| --- | --- |
|
|
| `bot_type` | Must be set to `custom` |
|
|
| `model` | Model name; any model name supported by the proxy service |
|
|
| `custom_api_key` | API key provided by the proxy service |
|
|
| `custom_api_base` | API endpoint provided by the proxy service; must be OpenAI-compatible |
|
|
|
|
### Local models
|
|
|
|
Local models usually do not require an API key — only the API base needs to be filled in:
|
|
|
|
```json
|
|
{
|
|
"bot_type": "custom",
|
|
"model": "qwen3.5:27b",
|
|
"custom_api_base": "http://localhost:11434/v1"
|
|
}
|
|
```
|
|
|
|
Common local deployment tools and their default endpoints:
|
|
|
|
| Tool | Default API Base |
|
|
| --- | --- |
|
|
| [Ollama](https://ollama.com) | `http://localhost:11434/v1` |
|
|
| [vLLM](https://docs.vllm.ai) | `http://localhost:8000/v1` |
|
|
| [LocalAI](https://localai.io) | `http://localhost:8080/v1` |
|
|
|
|
### Switching Models
|
|
|
|
Switching models under a custom vendor only changes `model` — `bot_type` and the API endpoint remain unchanged:
|
|
|
|
```
|
|
/config model qwen3.5:27b
|
|
```
|