mirror of
https://github.com/LLM-Red-Team/kimi-free-api.git
synced 2025-04-20 09:39:14 +08:00
Compare commits
85 Commits
Author | SHA1 | Date | |
---|---|---|---|
|
3b8bf35c65 | ||
|
d43ce6c41d | ||
|
856c1420b2 | ||
|
9f58f1858f | ||
|
1375e7c6c4 | ||
|
1dd7f89cbc | ||
|
cc198adfbd | ||
|
06119ed0a1 | ||
|
e1a68de548 | ||
|
22b3a4b3b7 | ||
|
c8bb4e64ee | ||
|
3e8efee623 | ||
|
63e6189c63 | ||
|
f133a9bc01 | ||
|
7bc0585352 | ||
|
38d59e20fc | ||
|
bc37f56d1f | ||
|
b2ae0554ee | ||
|
399de41b61 | ||
|
44316372a5 | ||
|
fcc2c9f795 | ||
|
a626a78553 | ||
|
5f2eb803aa | ||
|
684aedae1c | ||
|
984d724367 | ||
|
889c874264 | ||
|
6105410dd2 | ||
|
01ff5c250a | ||
|
82a8359634 | ||
|
7275ab7e11 | ||
|
d862808226 | ||
|
7cc6033201 | ||
|
8f72c5de78 | ||
|
72df4e1fc1 | ||
|
9b00be5883 | ||
|
61cc3a4655 | ||
|
1aa45264f1 | ||
|
56caa486c8 | ||
|
2aa6465a36 | ||
|
09250f208a | ||
|
a2d5ab9390 | ||
|
fe584180b1 | ||
|
c1c601b498 | ||
|
b9caca3289 | ||
|
2b32fc66f4 | ||
|
bffd5a24a3 | ||
|
95f8c4e3e3 | ||
|
0632d8111e | ||
|
f1aa2e822c | ||
|
53436b5f21 | ||
|
e8284288c9 | ||
|
04db70bec5 | ||
|
f7c1fa7be3 | ||
|
b9d479b9f6 | ||
|
c9c26fdd31 | ||
|
43e14b6e3e | ||
|
65a3fed83b | ||
|
4a225853af | ||
|
6b343f4094 | ||
|
e8c6622e83 | ||
|
ae6dc4a79f | ||
|
bdb8ced5ce | ||
|
a0c1bba3c9 | ||
|
c6da81a53e | ||
|
77d42d9484 | ||
|
d73a9bc95d | ||
|
65f45697e8 | ||
|
875bb55f21 | ||
|
cbf215d8a8 | ||
|
7c3bc3c0d8 | ||
|
ae8e8316e4 | ||
|
e1b7e55e70 | ||
|
e1710ee95a | ||
|
d14d062078 | ||
|
1a3327cc8d | ||
|
cfec318bd0 | ||
|
1d18ac3f6b | ||
|
b52e84bda0 | ||
|
ee7cb9fdff | ||
|
a12a967202 | ||
|
bff5623f73 | ||
|
2d2454b65b | ||
|
4642939835 | ||
|
87593a270a | ||
|
ce89c29b05 |
48
.github/workflows/sync.yml
vendored
Normal file
48
.github/workflows/sync.yml
vendored
Normal file
@ -0,0 +1,48 @@
|
|||||||
|
name: Upstream Sync
|
||||||
|
|
||||||
|
permissions:
|
||||||
|
contents: write
|
||||||
|
issues: write
|
||||||
|
actions: write
|
||||||
|
|
||||||
|
on:
|
||||||
|
schedule:
|
||||||
|
- cron: '0 * * * *' # every hour
|
||||||
|
workflow_dispatch:
|
||||||
|
|
||||||
|
jobs:
|
||||||
|
sync_latest_from_upstream:
|
||||||
|
name: Sync latest commits from upstream repo
|
||||||
|
runs-on: ubuntu-latest
|
||||||
|
if: ${{ github.event.repository.fork }}
|
||||||
|
|
||||||
|
steps:
|
||||||
|
- uses: actions/checkout@v4
|
||||||
|
|
||||||
|
- name: Clean issue notice
|
||||||
|
uses: actions-cool/issues-helper@v3
|
||||||
|
with:
|
||||||
|
actions: 'close-issues'
|
||||||
|
labels: '🚨 Sync Fail'
|
||||||
|
|
||||||
|
- name: Sync upstream changes
|
||||||
|
id: sync
|
||||||
|
uses: aormsby/Fork-Sync-With-Upstream-action@v3.4
|
||||||
|
with:
|
||||||
|
upstream_sync_repo: LLM-Red-Team/kimi-free-api
|
||||||
|
upstream_sync_branch: master
|
||||||
|
target_sync_branch: master
|
||||||
|
target_repo_token: ${{ secrets.GITHUB_TOKEN }} # automatically generated, no need to set
|
||||||
|
test_mode: false
|
||||||
|
|
||||||
|
- name: Sync check
|
||||||
|
if: failure()
|
||||||
|
uses: actions-cool/issues-helper@v3
|
||||||
|
with:
|
||||||
|
actions: 'create-issue'
|
||||||
|
title: '🚨 同步失败 | Sync Fail'
|
||||||
|
labels: '🚨 Sync Fail'
|
||||||
|
body: |
|
||||||
|
Due to a change in the workflow file of the LLM-Red-Team/kimi-free-api upstream repository, GitHub has automatically suspended the scheduled automatic update. You need to manually sync your fork. Please refer to the detailed [Tutorial][tutorial-en-US] for instructions.
|
||||||
|
|
||||||
|
由于 LLM-Red-Team/kimi-free-api 上游仓库的 workflow 文件变更,导致 GitHub 自动暂停了本次自动更新,你需要手动 Sync Fork 一次,
|
127
README.md
127
README.md
@ -6,36 +6,50 @@
|
|||||||
<span>[ 中文 | <a href="README_EN.md">English</a> ]</span>
|
<span>[ 中文 | <a href="README_EN.md">English</a> ]</span>
|
||||||
|
|
||||||
|
|
||||||

|
[](LICENSE)
|
||||||

|

|
||||||

|

|
||||||

|

|
||||||
|
|
||||||
支持高速流式输出、支持多轮对话、支持联网搜索、支持长文档解读、支持图像解析,零配置部署,多路token支持,自动清理会话痕迹。
|
支持高速流式输出、支持多轮对话、支持联网搜索、支持智能体对话、支持探索版、支持K1思考模型、支持长文档解读、支持图像解析,零配置部署,多路token支持,自动清理会话痕迹。
|
||||||
|
|
||||||
与ChatGPT接口完全兼容。
|
与ChatGPT接口完全兼容。
|
||||||
|
|
||||||
还有以下四个free-api欢迎关注:
|
还有以下十个free-api欢迎关注:
|
||||||
|
|
||||||
阶跃星辰 (跃问StepChat) 接口转API [step-free-api](https://github.com/LLM-Red-Team/step-free-api)
|
阶跃星辰 (跃问StepChat) 接口转API [step-free-api](https://github.com/LLM-Red-Team/step-free-api)
|
||||||
|
|
||||||
阿里通义 (Qwen) 接口转API [qwen-free-api](https://github.com/LLM-Red-Team/qwen-free-api)
|
阿里通义 (Qwen) 接口转API [qwen-free-api](https://github.com/LLM-Red-Team/qwen-free-api)
|
||||||
|
|
||||||
ZhipuAI (智谱清言) 接口转API [glm-free-api](https://github.com/LLM-Red-Team/glm-free-api)
|
智谱AI (智谱清言) 接口转API [glm-free-api](https://github.com/LLM-Red-Team/glm-free-api)
|
||||||
|
|
||||||
聆心智能 (Emohaa) 接口转API [emohaa-free-api](https://github.com/LLM-Red-Team/emohaa-free-api)
|
秘塔AI (Metaso) 接口转API [metaso-free-api](https://github.com/LLM-Red-Team/metaso-free-api)
|
||||||
|
|
||||||
|
字节跳动(豆包)接口转API [doubao-free-api](https://github.com/LLM-Red-Team/doubao-free-api)
|
||||||
|
|
||||||
|
字节跳动(即梦AI)接口转API [jimeng-free-api](https://github.com/LLM-Red-Team/jimeng-free-api)
|
||||||
|
|
||||||
|
讯飞星火(Spark)接口转API [spark-free-api](https://github.com/LLM-Red-Team/spark-free-api)
|
||||||
|
|
||||||
|
MiniMax(海螺AI)接口转API [hailuo-free-api](https://github.com/LLM-Red-Team/hailuo-free-api)
|
||||||
|
|
||||||
|
深度求索(DeepSeek)接口转API [deepseek-free-api](https://github.com/LLM-Red-Team/deepseek-free-api)
|
||||||
|
|
||||||
|
聆心智能 (Emohaa) 接口转API [emohaa-free-api](https://github.com/LLM-Red-Team/emohaa-free-api)(当前不可用)
|
||||||
|
|
||||||
## 目录
|
## 目录
|
||||||
|
|
||||||
* [免责声明](#免责声明)
|
* [免责声明](#免责声明)
|
||||||
* [在线体验](#在线体验)
|
|
||||||
* [效果示例](#效果示例)
|
* [效果示例](#效果示例)
|
||||||
* [接入准备](#接入准备)
|
* [接入准备](#接入准备)
|
||||||
* [多账号接入](#多账号接入)
|
* [多账号接入](#多账号接入)
|
||||||
* [Docker部署](#Docker部署)
|
* [Docker部署](#Docker部署)
|
||||||
* [Docker-compose部署](#Docker-compose部署)
|
* [Docker-compose部署](#Docker-compose部署)
|
||||||
* [Vercel部署](#Vercel部署)
|
* [Render部署](#Render部署)
|
||||||
|
* [Vercel部署](#Vercel部署)
|
||||||
|
* [Zeabur部署](#Zeabur部署)
|
||||||
* [原生部署](#原生部署)
|
* [原生部署](#原生部署)
|
||||||
|
* [推荐使用客户端](#推荐使用客户端)
|
||||||
* [接口列表](#接口列表)
|
* [接口列表](#接口列表)
|
||||||
* [对话补全](#对话补全)
|
* [对话补全](#对话补全)
|
||||||
* [文档解读](#文档解读)
|
* [文档解读](#文档解读)
|
||||||
@ -43,9 +57,13 @@ ZhipuAI (智谱清言) 接口转API [glm-free-api](https://github.com/LLM-Red-Te
|
|||||||
* [refresh_token存活检测](#refresh_token存活检测)
|
* [refresh_token存活检测](#refresh_token存活检测)
|
||||||
* [注意事项](#注意事项)
|
* [注意事项](#注意事项)
|
||||||
* [Nginx反代优化](#Nginx反代优化)
|
* [Nginx反代优化](#Nginx反代优化)
|
||||||
|
* [Token统计](#Token统计)
|
||||||
|
* [Star History](#star-history)
|
||||||
|
|
||||||
## 免责声明
|
## 免责声明
|
||||||
|
|
||||||
|
**逆向API是不稳定的,建议前往MoonshotAI官方 https://platform.moonshot.cn/ 付费使用API,避免封禁的风险。**
|
||||||
|
|
||||||
**本组织和个人不接受任何资金捐助和交易,此项目是纯粹研究交流学习性质!**
|
**本组织和个人不接受任何资金捐助和交易,此项目是纯粹研究交流学习性质!**
|
||||||
|
|
||||||
**仅限自用,禁止对外提供服务或商用,避免对官方造成服务压力,否则风险自担!**
|
**仅限自用,禁止对外提供服务或商用,避免对官方造成服务压力,否则风险自担!**
|
||||||
@ -54,12 +72,6 @@ ZhipuAI (智谱清言) 接口转API [glm-free-api](https://github.com/LLM-Red-Te
|
|||||||
|
|
||||||
**仅限自用,禁止对外提供服务或商用,避免对官方造成服务压力,否则风险自担!**
|
**仅限自用,禁止对外提供服务或商用,避免对官方造成服务压力,否则风险自担!**
|
||||||
|
|
||||||
## 在线体验
|
|
||||||
|
|
||||||
此链接仅临时测试功能,不可长期使用,长期使用请自行部署。
|
|
||||||
|
|
||||||
https://udify.app/chat/Po0F6BMJ15q5vu2P
|
|
||||||
|
|
||||||
## 效果示例
|
## 效果示例
|
||||||
|
|
||||||
### 验明正身Demo
|
### 验明正身Demo
|
||||||
@ -74,11 +86,17 @@ https://udify.app/chat/Po0F6BMJ15q5vu2P
|
|||||||
|
|
||||||

|

|
||||||
|
|
||||||
|
### 智能体对话Demo
|
||||||
|
|
||||||
|
此处使用 [翻译通](https://kimi.moonshot.cn/chat/coo6l3pkqq4ri39f36bg) 智能体。
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
### 长文档解读Demo
|
### 长文档解读Demo
|
||||||
|
|
||||||

|

|
||||||
|
|
||||||
### 图像解析Demo
|
### 图像OCR Demo
|
||||||
|
|
||||||

|

|
||||||
|
|
||||||
@ -108,7 +126,7 @@ https://udify.app/chat/Po0F6BMJ15q5vu2P
|
|||||||
|
|
||||||
## Docker部署
|
## Docker部署
|
||||||
|
|
||||||
请准备一台具有公网IP的服务器并将8000端口开放。
|
请准备能够部署Docker镜像且能够访问网络的设备或服务器,并将8000端口开放。
|
||||||
|
|
||||||
拉取镜像并启动服务
|
拉取镜像并启动服务
|
||||||
|
|
||||||
@ -150,13 +168,38 @@ services:
|
|||||||
- TZ=Asia/Shanghai
|
- TZ=Asia/Shanghai
|
||||||
```
|
```
|
||||||
|
|
||||||
|
### Render部署
|
||||||
|
|
||||||
|
**注意:部分部署区域可能无法连接kimi,如容器日志出现请求超时或无法连接(新加坡实测不可用)请切换其他区域部署!**
|
||||||
|
**注意:免费账户的容器实例将在一段时间不活动时自动停止运行,这会导致下次请求时遇到50秒或更长的延迟,建议查看[Render容器保活](https://github.com/LLM-Red-Team/free-api-hub/#Render%E5%AE%B9%E5%99%A8%E4%BF%9D%E6%B4%BB)**
|
||||||
|
|
||||||
|
1. fork本项目到你的github账号下。
|
||||||
|
|
||||||
|
2. 访问 [Render](https://dashboard.render.com/) 并登录你的github账号。
|
||||||
|
|
||||||
|
3. 构建你的 Web Service(New+ -> Build and deploy from a Git repository -> Connect你fork的项目 -> 选择部署区域 -> 选择实例类型为Free -> Create Web Service)。
|
||||||
|
|
||||||
|
4. 等待构建完成后,复制分配的域名并拼接URL访问即可。
|
||||||
|
|
||||||
### Vercel部署
|
### Vercel部署
|
||||||
|
|
||||||
**注意:Vercel免费账户的请求响应超时时间为10秒,但接口响应通常较久,可能会遇到Vercel返回的504超时错误**
|
**注意:Vercel免费账户的请求响应超时时间为10秒,但接口响应通常较久,可能会遇到Vercel返回的504超时错误!**
|
||||||
|
|
||||||
点击按钮快速部署:
|
请先确保安装了Node.js环境。
|
||||||
|
|
||||||
[](https://vercel.com/import/project?template=https://github.com/LLM-Red-Team/kimi-free-api)
|
```shell
|
||||||
|
npm i -g vercel --registry http://registry.npmmirror.com
|
||||||
|
vercel login
|
||||||
|
git clone https://github.com/LLM-Red-Team/kimi-free-api
|
||||||
|
cd kimi-free-api
|
||||||
|
vercel --prod
|
||||||
|
```
|
||||||
|
|
||||||
|
### Zeabur部署
|
||||||
|
|
||||||
|
**注意:免费账户的容器实例可能无法稳定运行**
|
||||||
|
|
||||||
|
[](https://zeabur.com/templates/GRFYBP)
|
||||||
|
|
||||||
## 原生部署
|
## 原生部署
|
||||||
|
|
||||||
@ -206,6 +249,14 @@ pm2 reload kimi-free-api
|
|||||||
pm2 stop kimi-free-api
|
pm2 stop kimi-free-api
|
||||||
```
|
```
|
||||||
|
|
||||||
|
## 推荐使用客户端
|
||||||
|
|
||||||
|
使用以下二次开发客户端接入free-api系列项目更快更简单,支持文档/图像上传!
|
||||||
|
|
||||||
|
由 [Clivia](https://github.com/Yanyutin753/lobe-chat) 二次开发的LobeChat [https://github.com/Yanyutin753/lobe-chat](https://github.com/Yanyutin753/lobe-chat)
|
||||||
|
|
||||||
|
由 [时光@](https://github.com/SuYxh) 二次开发的ChatGPT Web [https://github.com/SuYxh/chatgpt-web-sea](https://github.com/SuYxh/chatgpt-web-sea)
|
||||||
|
|
||||||
## 接口列表
|
## 接口列表
|
||||||
|
|
||||||
目前支持与openai兼容的 `/v1/chat/completions` 接口,可自行使用与openai或其他兼容的客户端接入接口,或者使用 [dify](https://dify.ai/) 等线上服务接入使用。
|
目前支持与openai兼容的 `/v1/chat/completions` 接口,可自行使用与openai或其他兼容的客户端接入接口,或者使用 [dify](https://dify.ai/) 等线上服务接入使用。
|
||||||
@ -225,8 +276,19 @@ Authorization: Bearer [refresh_token]
|
|||||||
请求数据:
|
请求数据:
|
||||||
```json
|
```json
|
||||||
{
|
{
|
||||||
// 模型名称随意填写,如果不希望输出检索过程模型名称请包含silent_search
|
// 模型名称
|
||||||
|
// kimi:默认模型
|
||||||
|
// kimi-search:联网检索模型
|
||||||
|
// kimi-research:探索版模型
|
||||||
|
// kimi-k1:K1模型
|
||||||
|
// kimi-math:数学模型
|
||||||
|
// kimi-silent:不输出检索过程模型
|
||||||
|
// search/research/k1/math/silent:可自由组合使用
|
||||||
|
// 如果使用kimi+智能体,model请填写智能体ID,就是浏览器地址栏上尾部的一串英文+数字20个字符的ID
|
||||||
"model": "kimi",
|
"model": "kimi",
|
||||||
|
// 目前多轮对话基于消息合并实现,某些场景可能导致能力下降且受单轮最大Token数限制
|
||||||
|
// 如果您想获得原生的多轮对话体验,可以传入首轮消息获得的id,来接续上下文,注意如果使用这个,首轮必须传none,否则第二轮会空响应!
|
||||||
|
// "conversation_id": "cnndivilnl96vah411dg",
|
||||||
"messages": [
|
"messages": [
|
||||||
{
|
{
|
||||||
"role": "user",
|
"role": "user",
|
||||||
@ -243,6 +305,7 @@ Authorization: Bearer [refresh_token]
|
|||||||
响应数据:
|
响应数据:
|
||||||
```json
|
```json
|
||||||
{
|
{
|
||||||
|
// 如果想获得原生多轮对话体验,此id,你可以传入到下一轮对话的conversation_id来接续上下文
|
||||||
"id": "cnndivilnl96vah411dg",
|
"id": "cnndivilnl96vah411dg",
|
||||||
"model": "kimi",
|
"model": "kimi",
|
||||||
"object": "chat.completion",
|
"object": "chat.completion",
|
||||||
@ -280,7 +343,15 @@ Authorization: Bearer [refresh_token]
|
|||||||
请求数据:
|
请求数据:
|
||||||
```json
|
```json
|
||||||
{
|
{
|
||||||
// 模型名称随意填写,如果不希望输出检索过程模型名称请包含silent_search
|
// 模型名称
|
||||||
|
// kimi:默认模型
|
||||||
|
// kimi-search:联网检索模型
|
||||||
|
// kimi-research:探索版模型
|
||||||
|
// kimi-k1:K1模型
|
||||||
|
// kimi-math:数学模型
|
||||||
|
// kimi-silent:不输出检索过程模型
|
||||||
|
// search/research/k1/math/silent:可自由组合使用
|
||||||
|
// 如果使用kimi+智能体,model请填写智能体ID,就是浏览器地址栏上尾部的一串英文+数字20个字符的ID
|
||||||
"model": "kimi",
|
"model": "kimi",
|
||||||
"messages": [
|
"messages": [
|
||||||
{
|
{
|
||||||
@ -329,7 +400,7 @@ Authorization: Bearer [refresh_token]
|
|||||||
}
|
}
|
||||||
```
|
```
|
||||||
|
|
||||||
### 图像解析
|
### 图像OCR
|
||||||
|
|
||||||
提供一个可访问的图像URL或者BASE64_URL进行解析。
|
提供一个可访问的图像URL或者BASE64_URL进行解析。
|
||||||
|
|
||||||
@ -346,7 +417,15 @@ Authorization: Bearer [refresh_token]
|
|||||||
请求数据:
|
请求数据:
|
||||||
```json
|
```json
|
||||||
{
|
{
|
||||||
// 模型名称随意填写,如果不希望输出检索过程模型名称请包含silent_search
|
// 模型名称
|
||||||
|
// kimi:默认模型
|
||||||
|
// kimi-search:联网检索模型
|
||||||
|
// kimi-research:探索版模型
|
||||||
|
// kimi-k1:K1模型
|
||||||
|
// kimi-math:数学模型
|
||||||
|
// kimi-silent:不输出检索过程模型
|
||||||
|
// search/research/k1/math/silent:可自由组合使用
|
||||||
|
// 如果使用kimi+智能体,model请填写智能体ID,就是浏览器地址栏上尾部的一串英文+数字20个字符的ID
|
||||||
"model": "kimi",
|
"model": "kimi",
|
||||||
"messages": [
|
"messages": [
|
||||||
{
|
{
|
||||||
@ -397,7 +476,7 @@ Authorization: Bearer [refresh_token]
|
|||||||
|
|
||||||
### refresh_token存活检测
|
### refresh_token存活检测
|
||||||
|
|
||||||
检测refresh_token是否存活,如果存活live未true,否则为false,请不要频繁(小于10分钟)调用此接口。
|
检测refresh_token是否存活,如果存活live为true,否则为false,请不要频繁(小于10分钟)调用此接口。
|
||||||
|
|
||||||
**POST /token/check**
|
**POST /token/check**
|
||||||
|
|
||||||
@ -440,4 +519,4 @@ keepalive_timeout 120;
|
|||||||
|
|
||||||
## Star History
|
## Star History
|
||||||
|
|
||||||
[](https://star-history.com/#LLM-Red-Team/kimi-free-api&Date)
|
[](https://star-history.com/#LLM-Red-Team/kimi-free-api&Date)
|
||||||
|
176
README_EN.md
176
README_EN.md
@ -1,6 +1,9 @@
|
|||||||
# KIMI AI Free Service
|
# KIMI AI Free Service
|
||||||
|
|
||||||

|
|
||||||
|
<hr>
|
||||||
|
|
||||||
|
[](LICENSE)
|
||||||

|

|
||||||

|

|
||||||

|

|
||||||
@ -9,35 +12,46 @@ Supports high-speed streaming output, multi-turn dialogues, internet search, lon
|
|||||||
|
|
||||||
Fully compatible with the ChatGPT interface.
|
Fully compatible with the ChatGPT interface.
|
||||||
|
|
||||||
Also, the following four free APIs are available for your attention:
|
Also, the following free APIs are available for your attention:
|
||||||
|
|
||||||
Step to the Stars (StepChat) API to API [step-free-api](https://github.com/LLM-Red-Team/step-free-api)
|
StepFun (StepChat) API to API [step-free-api](https://github.com/LLM-Red-Team/step-free-api)
|
||||||
|
|
||||||
Ali Tongyi (Qwen) API to API [qwen-free-api](https://github.com/LLM-Red-Team/qwen-free-api)
|
Ali Tongyi (Qwen) API to API [qwen-free-api](https://github.com/LLM-Red-Team/qwen-free-api)
|
||||||
|
|
||||||
ZhipuAI (Wisdom Map Clear Words) API to API [glm-free-api](https://github.com/LLM-Red-Team/glm-free-api)
|
ZhipuAI (ChatGLM) API to API [glm-free-api](https://github.com/LLM-Red-Team/glm-free-api)
|
||||||
|
|
||||||
Listening Intelligence (Emohaa) API to API [emohaa-free-api](https://github.com/LLM-Red-Team/emohaa-free-api)
|
Meta Sota (metaso) API to API [metaso-free-api](https://github.com/LLM-Red-Team/metaso-free-api)
|
||||||
|
|
||||||
|
Iflytek Spark (Spark) API to API [spark-free-api](https://github.com/LLM-Red-Team/spark-free-api)
|
||||||
|
|
||||||
|
Lingxin Intelligence (Emohaa) API to API [emohaa-free-api](https://github.com/LLM-Red-Team/emohaa-free-api) (OUT OF ORDER)
|
||||||
|
|
||||||
## Table of Contents
|
## Table of Contents
|
||||||
|
|
||||||
* [Disclaimer](#disclaimer)
|
* [Announcement](#Announcement)
|
||||||
*[Online experience](#在线experience)
|
* [Online experience](#Online-Experience)
|
||||||
* [Effect Example](#EffectExample)
|
* [Effect Examples](#Effect-Examples)
|
||||||
* [Access preparation](#access preparation)
|
* [Access preparation](#Access-Preparation)
|
||||||
* [Multiple account access](#multiple account access)
|
* [Multiple account access](#Multi-Account-Access)
|
||||||
* [Docker Deployment](#DockerDeployment)
|
* [Docker Deployment](#Docker-Deployment)
|
||||||
* [Docker-compose deployment](#Docker-compose deployment)
|
* [Docker-compose Deployment](#Docker-compose-Deployment)
|
||||||
* [Native Deployment](#nativedeployment)
|
* [Render Deployment](Render-Deployment)
|
||||||
* [Interface List](#Interface List)
|
* [Vercel Deployment](#Vercel-Deployment)
|
||||||
* [Dialogue completion](#dialogue completion)
|
* [Zeabur Deployment](#Zeabur-Deployment)
|
||||||
* [Document Interpretation](#document interpretation)
|
* [Native Deployment](#Native-Deployment)
|
||||||
* [Image analysis](#imageanalysis)
|
* [Interface List](#Interface-List)
|
||||||
* [refresh_token survival detection](#refresh_token survival detection)
|
* [Conversation completion](#conversation-completion)
|
||||||
* [Note](# NOTE)
|
* [Document Interpretation](#document-interpretation)
|
||||||
* [Nginx anti-generation optimization](#Nginx anti-generation optimization)
|
* [Image analysis](#image-analysis)
|
||||||
|
* [refresh_token survival detection](#refresh_token-survival-detection)
|
||||||
|
* [Precautions](#Precautions)
|
||||||
|
* [Nginx anti-generation optimization](#Nginx-anti-generation-optimization)
|
||||||
|
* [Token statistics](#Token-statistics)
|
||||||
|
* [Star History](#star-history)
|
||||||
|
|
||||||
|
## Announcement
|
||||||
|
|
||||||
## Disclaimer
|
**This API is unstable. So we highly recommend you go to the [MoonshotAI](https://platform.moonshot.cn/) use the offical API, avoiding banned.**
|
||||||
|
|
||||||
**This organization and individuals do not accept any financial donations and transactions. This project is purely for research, communication, and learning purposes!**
|
**This organization and individuals do not accept any financial donations and transactions. This project is purely for research, communication, and learning purposes!**
|
||||||
|
|
||||||
@ -121,13 +135,13 @@ Restart service
|
|||||||
docker restart kimi-free-api
|
docker restart kimi-free-api
|
||||||
```
|
```
|
||||||
|
|
||||||
Out of service
|
Shut down service
|
||||||
|
|
||||||
```shell
|
```shell
|
||||||
docker stop kimi-free-api
|
docker stop kimi-free-api
|
||||||
```
|
```
|
||||||
|
|
||||||
### Docker-compose deployment
|
### Docker-compose Deployment
|
||||||
|
|
||||||
```yaml
|
```yaml
|
||||||
version: '3'
|
version: '3'
|
||||||
@ -143,7 +157,37 @@ services:
|
|||||||
- TZ=Asia/Shanghai
|
- TZ=Asia/Shanghai
|
||||||
```
|
```
|
||||||
|
|
||||||
## Native deployment
|
### Render Deployment
|
||||||
|
|
||||||
|
**Attention: Some deployment regions may not be able to connect to Kimi. If container logs show request timeouts or connection failures (Singapore has been tested and found unavailable), please switch to another deployment region!**
|
||||||
|
|
||||||
|
**Attention Container instances for free accounts will automatically stop after a period of inactivity, which may result in a 50-second or longer delay during the next request. It is recommended to check [Render Container Keepalive](https://github.com/LLM-Red-Team/free-api-hub/#Render%E5%AE%B9%E5%99%A8%E4%BF%9D%E6%B4%BB)**
|
||||||
|
|
||||||
|
1. Fork this project to your GitHub account.
|
||||||
|
|
||||||
|
2. Visit [Render](https://dashboard.render.com/) and log in with your GitHub account.
|
||||||
|
|
||||||
|
3. Build your Web Service (New+ -> Build and deploy from a Git repository -> Connect your forked project -> Select deployment region -> Choose instance type as Free -> Create Web Service).
|
||||||
|
|
||||||
|
4. After the build is complete, copy the assigned domain and append the URL to access it.
|
||||||
|
|
||||||
|
### Vercel Deployment
|
||||||
|
**Note: Vercel free accounts have a request response timeout of 10 seconds, but interface responses are usually longer, which may result in a 504 timeout error from Vercel!**
|
||||||
|
|
||||||
|
Please ensure that Node.js environment is installed first.
|
||||||
|
```shell
|
||||||
|
npm i -g vercel --registry http://registry.npmmirror.com
|
||||||
|
vercel login
|
||||||
|
git clone https://github.com/LLM-Red-Team/kimi-free-api
|
||||||
|
cd kimi-free-api
|
||||||
|
vercel --prod
|
||||||
|
```
|
||||||
|
|
||||||
|
### Zeabur Deployment
|
||||||
|
|
||||||
|
[](https://zeabur.com/templates/GRFYBP)
|
||||||
|
|
||||||
|
## Native Deployment
|
||||||
|
|
||||||
Please prepare a server with a public IP and open port 8000.
|
Please prepare a server with a public IP and open port 8000.
|
||||||
|
|
||||||
@ -185,12 +229,20 @@ Restart service
|
|||||||
pm2 reload kimi-free-api
|
pm2 reload kimi-free-api
|
||||||
```
|
```
|
||||||
|
|
||||||
Out of service
|
Shut down service
|
||||||
|
|
||||||
```shell
|
```shell
|
||||||
pm2 stop kimi-free-api
|
pm2 stop kimi-free-api
|
||||||
```
|
```
|
||||||
|
|
||||||
|
## Recommended Clients
|
||||||
|
|
||||||
|
Using the following second-developed clients for free-api series projects is faster and easier, and supports document/image uploads!
|
||||||
|
|
||||||
|
[Clivia](https://github.com/Yanyutin753/lobe-chat)'s modified LobeChat [https://github.com/Yanyutin753/lobe-chat](https://github.com/Yanyutin753/lobe-chat)
|
||||||
|
|
||||||
|
[Time@](https://github.com/SuYxh)'s modified ChatGPT Web [https://github.com/SuYxh/chatgpt-web-sea](https://github.com/SuYxh/chatgpt-web-sea)
|
||||||
|
|
||||||
## interface list
|
## interface list
|
||||||
|
|
||||||
Currently, the `/v1/chat/completions` interface compatible with openai is supported. You can use the client access interface compatible with openai or other clients, or use online services such as [dify](https://dify.ai/) Access and use.
|
Currently, the `/v1/chat/completions` interface compatible with openai is supported. You can use the client access interface compatible with openai or other clients, or use online services such as [dify](https://dify.ai/) Access and use.
|
||||||
@ -209,7 +261,15 @@ Authorization: Bearer [refresh_token]
|
|||||||
Request data:
|
Request data:
|
||||||
```json
|
```json
|
||||||
{
|
{
|
||||||
// Fill in the model name as you like. If you do not want to output the retrieval process model name, please include silent_search.
|
// Model name
|
||||||
|
// kimi: default model
|
||||||
|
// kimi-search: online search model
|
||||||
|
// kimi-research: exploration version model
|
||||||
|
// kimi-k1: K1 model
|
||||||
|
// kimi-math: math model
|
||||||
|
// kimi-silent: model without search process output
|
||||||
|
// search/research/k1/math/silent: can be freely combined
|
||||||
|
// If using kimi+agent, fill in the agent ID for model, which is the 20-character ID of letters and numbers at the end of the browser address bar
|
||||||
"model": "kimi",
|
"model": "kimi",
|
||||||
"messages": [
|
"messages": [
|
||||||
{
|
{
|
||||||
@ -265,27 +325,35 @@ Authorization: Bearer [refresh_token]
|
|||||||
Request data:
|
Request data:
|
||||||
```json
|
```json
|
||||||
{
|
{
|
||||||
// Fill in the model name as you like. If you do not want to output the retrieval process model name, please include silent_search.
|
// Model name
|
||||||
"model": "kimi",
|
// kimi: default model
|
||||||
"messages": [
|
// kimi-search: online search model
|
||||||
{
|
// kimi-research: exploration version model
|
||||||
"role": "user",
|
// kimi-k1: K1 model
|
||||||
"content": [
|
// kimi-math: math model
|
||||||
{
|
// kimi-silent: model without search process output
|
||||||
"type": "file",
|
// search/research/k1/math/silent: can be freely combined
|
||||||
"file_url": {
|
// If using kimi+agent, fill in the agent ID for model, which is the 20-character ID of letters and numbers at the end of the browser address bar
|
||||||
"url": "https://mj101-1317487292.cos.ap-shanghai.myqcloud.com/ai/test.pdf"
|
"model": "kimi",
|
||||||
}
|
"messages": [
|
||||||
},
|
{
|
||||||
{
|
"role": "user",
|
||||||
"type": "text",
|
"content": [
|
||||||
"text": "What does the document say?"
|
{
|
||||||
}
|
"type": "file",
|
||||||
]
|
"file_url": {
|
||||||
}
|
"url": "https://mj101-1317487292.cos.ap-shanghai.myqcloud.com/ai/test.pdf"
|
||||||
],
|
}
|
||||||
// It is recommended to turn off online search to prevent interference in interpreting results.
|
},
|
||||||
"use_search": false
|
{
|
||||||
|
"type": "text",
|
||||||
|
"text": "What does the document say?"
|
||||||
|
}
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
// It is recommended to turn off online search to prevent interference in interpreting results.
|
||||||
|
"use_search": false
|
||||||
}
|
}
|
||||||
```
|
```
|
||||||
|
|
||||||
@ -331,7 +399,15 @@ Authorization: Bearer [refresh_token]
|
|||||||
Request data:
|
Request data:
|
||||||
```json
|
```json
|
||||||
{
|
{
|
||||||
// Fill in the model name as you like. If you do not want to output the retrieval process model name, please include silent_search.
|
// Model name
|
||||||
|
// kimi: default model
|
||||||
|
// kimi-search: online search model
|
||||||
|
// kimi-research: exploration version model
|
||||||
|
// kimi-k1: K1 model
|
||||||
|
// kimi-math: math model
|
||||||
|
// kimi-silent: model without search process output
|
||||||
|
// search/research/k1/math/silent: can be freely combined
|
||||||
|
// If using kimi+agent, fill in the agent ID for model, which is the 20-character ID of letters and numbers at the end of the browser address bar
|
||||||
"model": "kimi",
|
"model": "kimi",
|
||||||
"messages": [
|
"messages": [
|
||||||
{
|
{
|
||||||
@ -400,7 +476,7 @@ Response data:
|
|||||||
}
|
}
|
||||||
```
|
```
|
||||||
|
|
||||||
## Precautions
|
## Notification
|
||||||
|
|
||||||
### Nginx anti-generation optimization
|
### Nginx anti-generation optimization
|
||||||
|
|
||||||
@ -425,4 +501,4 @@ Since the inference side is not in kimi-free-api, the token cannot be counted an
|
|||||||
|
|
||||||
## Star History
|
## Star History
|
||||||
|
|
||||||
[](https://star-history.com/ #LLM-Red-Team/kimi-free-api&Date)
|
[](https://star-history.com/#LLM-Red-Team/kimi-free-api&Date)
|
||||||
|
BIN
doc/example-7.png
Normal file
BIN
doc/example-7.png
Normal file
Binary file not shown.
After Width: | Height: | Size: 44 KiB |
@ -1,6 +1,6 @@
|
|||||||
{
|
{
|
||||||
"name": "kimi-free-api",
|
"name": "kimi-free-api",
|
||||||
"version": "0.0.25",
|
"version": "0.0.36",
|
||||||
"description": "Kimi Free API Server",
|
"description": "Kimi Free API Server",
|
||||||
"type": "module",
|
"type": "module",
|
||||||
"main": "dist/index.js",
|
"main": "dist/index.js",
|
||||||
@ -13,8 +13,8 @@
|
|||||||
"dist/"
|
"dist/"
|
||||||
],
|
],
|
||||||
"scripts": {
|
"scripts": {
|
||||||
"dev": "tsup src/index.ts --format cjs,esm --sourcemap --dts --publicDir public --watch --onSuccess \"node dist/index.js\"",
|
"dev": "tsup src/index.ts --format cjs,esm --sourcemap --dts --publicDir public --watch --onSuccess \"node --enable-source-maps --no-node-snapshot dist/index.js\"",
|
||||||
"start": "node dist/index.js",
|
"start": "node --enable-source-maps --no-node-snapshot dist/index.js",
|
||||||
"build": "tsup src/index.ts --format cjs,esm --sourcemap --dts --clean --publicDir public"
|
"build": "tsup src/index.ts --format cjs,esm --sourcemap --dts --clean --publicDir public"
|
||||||
},
|
},
|
||||||
"author": "Vinlic",
|
"author": "Vinlic",
|
||||||
|
@ -5,5 +5,6 @@ export default {
|
|||||||
API_TOKEN_EXPIRES: [-2002, 'Token已失效'],
|
API_TOKEN_EXPIRES: [-2002, 'Token已失效'],
|
||||||
API_FILE_URL_INVALID: [-2003, '远程文件URL非法'],
|
API_FILE_URL_INVALID: [-2003, '远程文件URL非法'],
|
||||||
API_FILE_EXECEEDS_SIZE: [-2004, '远程文件超出大小'],
|
API_FILE_EXECEEDS_SIZE: [-2004, '远程文件超出大小'],
|
||||||
API_CHAT_STREAM_PUSHING: [-2005, '已有对话流正在输出']
|
API_CHAT_STREAM_PUSHING: [-2005, '已有对话流正在输出'],
|
||||||
|
API_RESEARCH_EXCEEDS_LIMIT: [-2006, '探索版使用量已达到上限']
|
||||||
}
|
}
|
@ -2,8 +2,9 @@ import { PassThrough } from "stream";
|
|||||||
import path from 'path';
|
import path from 'path';
|
||||||
import _ from 'lodash';
|
import _ from 'lodash';
|
||||||
import mime from 'mime';
|
import mime from 'mime';
|
||||||
import axios, { AxiosResponse } from 'axios';
|
import axios, { AxiosRequestConfig, AxiosResponse } from 'axios';
|
||||||
|
|
||||||
|
import type IStreamMessage from "../interfaces/IStreamMessage.ts";
|
||||||
import APIException from "@/lib/exceptions/APIException.ts";
|
import APIException from "@/lib/exceptions/APIException.ts";
|
||||||
import EX from "@/api/consts/exceptions.ts";
|
import EX from "@/api/consts/exceptions.ts";
|
||||||
import { createParser } from 'eventsource-parser'
|
import { createParser } from 'eventsource-parser'
|
||||||
@ -12,27 +13,39 @@ import util from '@/lib/util.ts';
|
|||||||
|
|
||||||
// 模型名称
|
// 模型名称
|
||||||
const MODEL_NAME = 'kimi';
|
const MODEL_NAME = 'kimi';
|
||||||
|
// 设备ID
|
||||||
|
const DEVICE_ID = Math.random() * 999999999999999999 + 7000000000000000000;
|
||||||
|
// SessionID
|
||||||
|
const SESSION_ID = Math.random() * 99999999999999999 + 1700000000000000000;
|
||||||
// access_token有效期
|
// access_token有效期
|
||||||
const ACCESS_TOKEN_EXPIRES = 300;
|
const ACCESS_TOKEN_EXPIRES = 300;
|
||||||
// 最大重试次数
|
// 最大重试次数
|
||||||
const MAX_RETRY_COUNT = 3;
|
const MAX_RETRY_COUNT = 3;
|
||||||
// 重试延迟
|
// 重试延迟
|
||||||
const RETRY_DELAY = 5000;
|
const RETRY_DELAY = 5000;
|
||||||
|
// 基础URL
|
||||||
|
const BASE_URL = 'https://kimi.moonshot.cn';
|
||||||
// 伪装headers
|
// 伪装headers
|
||||||
const FAKE_HEADERS = {
|
const FAKE_HEADERS = {
|
||||||
'Accept': '*/*',
|
'Accept': '*/*',
|
||||||
'Accept-Encoding': 'gzip, deflate, br, zstd',
|
'Accept-Encoding': 'gzip, deflate, br, zstd',
|
||||||
'Accept-Language': 'zh-CN,zh;q=0.9',
|
'Accept-Language': 'zh-CN,zh;q=0.9,en-US;q=0.8,en;q=0.7',
|
||||||
'Origin': 'https://kimi.moonshot.cn',
|
'Cache-Control': 'no-cache',
|
||||||
// 'Cookie': util.generateCookie(),
|
'Pragma': 'no-cache',
|
||||||
|
'Origin': BASE_URL,
|
||||||
|
'Cookie': util.generateCookie(),
|
||||||
'R-Timezone': 'Asia/Shanghai',
|
'R-Timezone': 'Asia/Shanghai',
|
||||||
'Sec-Ch-Ua': '"Chromium";v="122", "Not(A:Brand";v="24", "Google Chrome";v="122"',
|
'Sec-Ch-Ua': '"Google Chrome";v="131", "Chromium";v="131", "Not_A Brand";v="24"',
|
||||||
'Sec-Ch-Ua-Mobile': '?0',
|
'Sec-Ch-Ua-Mobile': '?0',
|
||||||
'Sec-Ch-Ua-Platform': '"Windows"',
|
'Sec-Ch-Ua-Platform': '"Windows"',
|
||||||
'Sec-Fetch-Dest': 'empty',
|
'Sec-Fetch-Dest': 'empty',
|
||||||
'Sec-Fetch-Mode': 'cors',
|
'Sec-Fetch-Mode': 'cors',
|
||||||
'Sec-Fetch-Site': 'same-origin',
|
'Sec-Fetch-Site': 'same-origin',
|
||||||
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.0.0 Safari/537.36'
|
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36',
|
||||||
|
'Priority': 'u=1, i',
|
||||||
|
'X-Msh-Device-Id': `${DEVICE_ID}`,
|
||||||
|
'X-Msh-Platform': 'web',
|
||||||
|
'X-Msh-Session-Id': `${SESSION_ID}`
|
||||||
};
|
};
|
||||||
// 文件最大大小
|
// 文件最大大小
|
||||||
const FILE_MAX_SIZE = 100 * 1024 * 1024;
|
const FILE_MAX_SIZE = 100 * 1024 * 1024;
|
||||||
@ -54,11 +67,10 @@ async function requestToken(refreshToken: string) {
|
|||||||
accessTokenRequestQueueMap[refreshToken] = [];
|
accessTokenRequestQueueMap[refreshToken] = [];
|
||||||
logger.info(`Refresh token: ${refreshToken}`);
|
logger.info(`Refresh token: ${refreshToken}`);
|
||||||
const result = await (async () => {
|
const result = await (async () => {
|
||||||
const result = await axios.get('https://kimi.moonshot.cn/api/auth/token/refresh', {
|
const result = await axios.get(`${BASE_URL}/api/auth/token/refresh`, {
|
||||||
headers: {
|
headers: {
|
||||||
Authorization: `Bearer ${refreshToken}`,
|
Authorization: `Bearer ${refreshToken}`,
|
||||||
Referer: 'https://kimi.moonshot.cn/',
|
...FAKE_HEADERS,
|
||||||
...FAKE_HEADERS
|
|
||||||
},
|
},
|
||||||
timeout: 15000,
|
timeout: 15000,
|
||||||
validateStatus: () => true
|
validateStatus: () => true
|
||||||
@ -67,7 +79,18 @@ async function requestToken(refreshToken: string) {
|
|||||||
access_token,
|
access_token,
|
||||||
refresh_token
|
refresh_token
|
||||||
} = checkResult(result, refreshToken);
|
} = checkResult(result, refreshToken);
|
||||||
|
const userResult = await axios.get(`${BASE_URL}/api/user`, {
|
||||||
|
headers: {
|
||||||
|
Authorization: `Bearer ${access_token}`,
|
||||||
|
...FAKE_HEADERS,
|
||||||
|
},
|
||||||
|
timeout: 15000,
|
||||||
|
validateStatus: () => true
|
||||||
|
});
|
||||||
|
if(!userResult.data.id)
|
||||||
|
throw new APIException(EX.API_REQUEST_FAILED, '获取用户信息失败');
|
||||||
return {
|
return {
|
||||||
|
userId: userResult.data.id,
|
||||||
accessToken: access_token,
|
accessToken: access_token,
|
||||||
refreshToken: refresh_token,
|
refreshToken: refresh_token,
|
||||||
refreshTime: util.unixTimestamp() + ACCESS_TOKEN_EXPIRES
|
refreshTime: util.unixTimestamp() + ACCESS_TOKEN_EXPIRES
|
||||||
@ -82,6 +105,7 @@ async function requestToken(refreshToken: string) {
|
|||||||
return result;
|
return result;
|
||||||
})
|
})
|
||||||
.catch(err => {
|
.catch(err => {
|
||||||
|
logger.error(err);
|
||||||
if (accessTokenRequestQueueMap[refreshToken]) {
|
if (accessTokenRequestQueueMap[refreshToken]) {
|
||||||
accessTokenRequestQueueMap[refreshToken].forEach(resolve => resolve(err));
|
accessTokenRequestQueueMap[refreshToken].forEach(resolve => resolve(err));
|
||||||
delete accessTokenRequestQueueMap[refreshToken];
|
delete accessTokenRequestQueueMap[refreshToken];
|
||||||
@ -100,7 +124,7 @@ async function requestToken(refreshToken: string) {
|
|||||||
*
|
*
|
||||||
* @param refreshToken 用于刷新access_token的refresh_token
|
* @param refreshToken 用于刷新access_token的refresh_token
|
||||||
*/
|
*/
|
||||||
async function acquireToken(refreshToken: string): Promise<string> {
|
async function acquireToken(refreshToken: string): Promise<any> {
|
||||||
let result = accessTokenMap.get(refreshToken);
|
let result = accessTokenMap.get(refreshToken);
|
||||||
if (!result) {
|
if (!result) {
|
||||||
result = await requestToken(refreshToken);
|
result = await requestToken(refreshToken);
|
||||||
@ -110,7 +134,39 @@ async function acquireToken(refreshToken: string): Promise<string> {
|
|||||||
result = await requestToken(refreshToken);
|
result = await requestToken(refreshToken);
|
||||||
accessTokenMap.set(refreshToken, result);
|
accessTokenMap.set(refreshToken, result);
|
||||||
}
|
}
|
||||||
return result.accessToken;
|
return result;
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* 发送请求
|
||||||
|
*/
|
||||||
|
export async function request(
|
||||||
|
method: string,
|
||||||
|
uri: string,
|
||||||
|
refreshToken: string,
|
||||||
|
options: AxiosRequestConfig = {}
|
||||||
|
) {
|
||||||
|
const {
|
||||||
|
accessToken,
|
||||||
|
userId
|
||||||
|
} = await acquireToken(refreshToken);
|
||||||
|
logger.info(`url: ${uri}`);
|
||||||
|
const result = await axios({
|
||||||
|
method,
|
||||||
|
url: `${BASE_URL}${uri}`,
|
||||||
|
params: options.params,
|
||||||
|
data: options.data,
|
||||||
|
headers: {
|
||||||
|
Authorization: `Bearer ${accessToken}`,
|
||||||
|
'X-Traffic-Id': userId,
|
||||||
|
...FAKE_HEADERS,
|
||||||
|
...(options.headers || {})
|
||||||
|
},
|
||||||
|
timeout: options.timeout || 15000,
|
||||||
|
responseType: options.responseType,
|
||||||
|
validateStatus: () => true
|
||||||
|
});
|
||||||
|
return checkResult(result, refreshToken);
|
||||||
}
|
}
|
||||||
|
|
||||||
/**
|
/**
|
||||||
@ -120,23 +176,17 @@ async function acquireToken(refreshToken: string): Promise<string> {
|
|||||||
*
|
*
|
||||||
* @param refreshToken 用于刷新access_token的refresh_token
|
* @param refreshToken 用于刷新access_token的refresh_token
|
||||||
*/
|
*/
|
||||||
async function createConversation(name: string, refreshToken: string) {
|
async function createConversation(model: string, name: string, refreshToken: string) {
|
||||||
const token = await acquireToken(refreshToken);
|
|
||||||
const result = await axios.post('https://kimi.moonshot.cn/api/chat', {
|
|
||||||
name,
|
|
||||||
is_example: false
|
|
||||||
}, {
|
|
||||||
headers: {
|
|
||||||
Authorization: `Bearer ${token}`,
|
|
||||||
Referer: 'https://kimi.moonshot.cn/',
|
|
||||||
...FAKE_HEADERS
|
|
||||||
},
|
|
||||||
timeout: 15000,
|
|
||||||
validateStatus: () => true
|
|
||||||
});
|
|
||||||
const {
|
const {
|
||||||
id: convId
|
id: convId
|
||||||
} = checkResult(result, refreshToken);
|
} = await request('POST', '/api/chat', refreshToken, {
|
||||||
|
data: {
|
||||||
|
enter_method: 'new_chat',
|
||||||
|
is_example: false,
|
||||||
|
kimiplus_id: /^[0-9a-z]{20}$/.test(model) ? model : 'kimi',
|
||||||
|
name
|
||||||
|
}
|
||||||
|
});
|
||||||
return convId;
|
return convId;
|
||||||
}
|
}
|
||||||
|
|
||||||
@ -148,17 +198,77 @@ async function createConversation(name: string, refreshToken: string) {
|
|||||||
* @param refreshToken 用于刷新access_token的refresh_token
|
* @param refreshToken 用于刷新access_token的refresh_token
|
||||||
*/
|
*/
|
||||||
async function removeConversation(convId: string, refreshToken: string) {
|
async function removeConversation(convId: string, refreshToken: string) {
|
||||||
const token = await acquireToken(refreshToken);
|
return await request('DELETE', `/api/chat/${convId}`, refreshToken);
|
||||||
const result = await axios.delete(`https://kimi.moonshot.cn/api/chat/${convId}`, {
|
}
|
||||||
headers: {
|
|
||||||
Authorization: `Bearer ${token}`,
|
/**
|
||||||
Referer: `https://kimi.moonshot.cn/chat/${convId}`,
|
* 获取建议
|
||||||
...FAKE_HEADERS
|
*
|
||||||
},
|
* @param refreshToken 用于刷新access_token的refresh_token
|
||||||
timeout: 15000,
|
*/
|
||||||
validateStatus: () => true
|
async function getSuggestion(query: string, refreshToken: string) {
|
||||||
|
return await request('POST', '/api/suggestion', refreshToken, {
|
||||||
|
data: {
|
||||||
|
offset: 0,
|
||||||
|
page_referer: 'chat',
|
||||||
|
query: query.replace('user:', '').replace('assistant:', ''),
|
||||||
|
scene: 'first_round',
|
||||||
|
size: 10
|
||||||
|
}
|
||||||
});
|
});
|
||||||
checkResult(result, refreshToken);
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* 预处理N2S
|
||||||
|
*
|
||||||
|
* 预处理N2S,用于获取搜索结果
|
||||||
|
*
|
||||||
|
* @param model 模型名称
|
||||||
|
* @param messages 参考gpt系列消息格式,多轮对话请完整提供上下文
|
||||||
|
* @param refs 引用文件ID列表
|
||||||
|
* @param refreshToken 用于刷新access_token的refresh_token
|
||||||
|
* @param refConvId 引用会话ID
|
||||||
|
*/
|
||||||
|
async function preN2s(model: string, messages: { role: string, content: string }[], refs: string[], refreshToken: string, refConvId?: string) {
|
||||||
|
const isSearchModel = model.indexOf('search') != -1;
|
||||||
|
return await request('POST', `/api/chat/${refConvId}/pre-n2s`, refreshToken, {
|
||||||
|
data: {
|
||||||
|
is_pro_search: false,
|
||||||
|
kimiplus_id: /^[0-9a-z]{20}$/.test(model) ? model : 'kimi',
|
||||||
|
messages,
|
||||||
|
refs,
|
||||||
|
use_search: isSearchModel
|
||||||
|
}
|
||||||
|
});
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* token计数
|
||||||
|
*
|
||||||
|
* @param query 查询内容
|
||||||
|
* @param refreshToken 用于刷新access_token的refresh_token
|
||||||
|
* @param refConvId 引用会话ID
|
||||||
|
*/
|
||||||
|
async function tokenSize(query: string, refs: string[], refreshToken: string, refConvId: string) {
|
||||||
|
return await request('POST', `/api/chat/${refConvId}/token_size`, refreshToken, {
|
||||||
|
data: {
|
||||||
|
content: query,
|
||||||
|
refs: []
|
||||||
|
}
|
||||||
|
});
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* 获取探索版使用量
|
||||||
|
*
|
||||||
|
* @param refreshToken 用于刷新access_token的refresh_token
|
||||||
|
*/
|
||||||
|
async function getResearchUsage(refreshToken: string): Promise<{
|
||||||
|
remain,
|
||||||
|
total,
|
||||||
|
used
|
||||||
|
}> {
|
||||||
|
return await request('GET', '/api/chat/research/usage', refreshToken);
|
||||||
}
|
}
|
||||||
|
|
||||||
/**
|
/**
|
||||||
@ -167,49 +277,110 @@ async function removeConversation(convId: string, refreshToken: string) {
|
|||||||
* @param model 模型名称
|
* @param model 模型名称
|
||||||
* @param messages 参考gpt系列消息格式,多轮对话请完整提供上下文
|
* @param messages 参考gpt系列消息格式,多轮对话请完整提供上下文
|
||||||
* @param refreshToken 用于刷新access_token的refresh_token
|
* @param refreshToken 用于刷新access_token的refresh_token
|
||||||
* @param useSearch 是否开启联网搜索
|
* @param refConvId 引用会话ID
|
||||||
* @param retryCount 重试次数
|
* @param retryCount 重试次数
|
||||||
*/
|
*/
|
||||||
async function createCompletion(model = MODEL_NAME, messages: any[], refreshToken: string, useSearch = true, retryCount = 0) {
|
async function createCompletion(model = MODEL_NAME, messages: any[], refreshToken: string, refConvId?: string, retryCount = 0, segmentId?: string): Promise<IStreamMessage> {
|
||||||
return (async () => {
|
return (async () => {
|
||||||
logger.info(messages);
|
logger.info(messages);
|
||||||
|
|
||||||
|
// 创建会话
|
||||||
|
const convId = /[0-9a-zA-Z]{20}/.test(refConvId) ? refConvId : await createConversation(model, "未命名会话", refreshToken);
|
||||||
|
|
||||||
// 提取引用文件URL并上传kimi获得引用的文件ID列表
|
// 提取引用文件URL并上传kimi获得引用的文件ID列表
|
||||||
const refFileUrls = extractRefFileUrls(messages);
|
const refFileUrls = extractRefFileUrls(messages);
|
||||||
const refs = refFileUrls.length ? await Promise.all(refFileUrls.map(fileUrl => uploadFile(fileUrl, refreshToken))) : [];
|
const refResults = refFileUrls.length ? await Promise.all(refFileUrls.map(fileUrl => uploadFile(fileUrl, refreshToken, convId))) : [];
|
||||||
|
const refs = refResults.map(result => result.id);
|
||||||
|
const refsFile = refResults.map(result => ({
|
||||||
|
detail: result,
|
||||||
|
done: true,
|
||||||
|
file: {},
|
||||||
|
file_info: result,
|
||||||
|
id: result.id,
|
||||||
|
name: result.name,
|
||||||
|
parse_status: 'success',
|
||||||
|
size: result.size,
|
||||||
|
upload_progress: 100,
|
||||||
|
upload_status: 'success'
|
||||||
|
}));
|
||||||
|
|
||||||
// 伪装调用获取用户信息
|
// 伪装调用获取用户信息
|
||||||
fakeRequest(refreshToken)
|
fakeRequest(refreshToken)
|
||||||
.catch(err => logger.error(err));
|
.catch(err => logger.error(err));
|
||||||
|
|
||||||
// 创建会话
|
// 消息预处理
|
||||||
const convId = await createConversation(`cmpl-${util.uuid(false)}`, refreshToken);
|
const sendMessages = messagesPrepare(messages, !!refConvId);
|
||||||
|
|
||||||
// 请求流
|
!segmentId && preN2s(model, sendMessages, refs, refreshToken, convId)
|
||||||
const token = await acquireToken(refreshToken);
|
.catch(err => logger.error(err));
|
||||||
const result = await axios.post(`https://kimi.moonshot.cn/api/chat/${convId}/completion/stream`, {
|
getSuggestion(sendMessages[0].content, refreshToken)
|
||||||
messages: messagesPrepare(messages),
|
.catch(err => logger.error(err));
|
||||||
refs,
|
tokenSize(sendMessages[0].content, refs, refreshToken, convId)
|
||||||
use_search: useSearch
|
.catch(err => logger.error(err));
|
||||||
}, {
|
|
||||||
headers: {
|
const isMath = model.indexOf('math') != -1;
|
||||||
Authorization: `Bearer ${token}`,
|
const isSearchModel = model.indexOf('search') != -1;
|
||||||
Referer: `https://kimi.moonshot.cn/chat/${convId}`,
|
const isResearchModel = model.indexOf('research') != -1;
|
||||||
...FAKE_HEADERS
|
const isK1Model = model.indexOf('k1') != -1;
|
||||||
|
|
||||||
|
logger.info(`使用模型: ${model},是否联网检索: ${isSearchModel},是否探索版: ${isResearchModel},是否K1模型: ${isK1Model},是否数学模型: ${isMath}`);
|
||||||
|
|
||||||
|
if(segmentId)
|
||||||
|
logger.info(`继续请求,segmentId: ${segmentId}`);
|
||||||
|
|
||||||
|
// 检查探索版使用量
|
||||||
|
if(isResearchModel) {
|
||||||
|
const {
|
||||||
|
total,
|
||||||
|
used
|
||||||
|
} = await getResearchUsage(refreshToken);
|
||||||
|
if(used >= total)
|
||||||
|
throw new APIException(EX.API_RESEARCH_EXCEEDS_LIMIT, `探索版使用量已达到上限`);
|
||||||
|
logger.info(`探索版当前额度: ${used}/${total}`);
|
||||||
|
}
|
||||||
|
|
||||||
|
const kimiplusId = isK1Model ? 'crm40ee9e5jvhsn7ptcg' : (/^[0-9a-z]{20}$/.test(model) ? model : 'kimi');
|
||||||
|
|
||||||
|
// 请求补全流
|
||||||
|
const stream = await request('POST', `/api/chat/${convId}/completion/stream`, refreshToken, {
|
||||||
|
data: segmentId ? {
|
||||||
|
segment_id: segmentId,
|
||||||
|
action: 'continue',
|
||||||
|
messages: [{ role: 'user', content: ' ' }],
|
||||||
|
kimiplus_id: kimiplusId,
|
||||||
|
extend: { sidebar: true }
|
||||||
|
} : {
|
||||||
|
kimiplus_id: kimiplusId,
|
||||||
|
messages: sendMessages,
|
||||||
|
refs,
|
||||||
|
refs_file: refsFile,
|
||||||
|
use_math: isMath,
|
||||||
|
use_research: isResearchModel,
|
||||||
|
use_search: isSearchModel,
|
||||||
|
extend: { sidebar: true }
|
||||||
|
},
|
||||||
|
headers: {
|
||||||
|
Referer: `https://kimi.moonshot.cn/chat/${convId}`
|
||||||
},
|
},
|
||||||
// 120秒超时
|
|
||||||
timeout: 120000,
|
|
||||||
validateStatus: () => true,
|
|
||||||
responseType: 'stream'
|
responseType: 'stream'
|
||||||
});
|
});
|
||||||
|
|
||||||
const streamStartTime = util.timestamp();
|
const streamStartTime = util.timestamp();
|
||||||
|
|
||||||
// 接收流为输出文本
|
// 接收流为输出文本
|
||||||
const answer = await receiveStream(model, convId, result.data);
|
const answer = await receiveStream(model, convId, stream);
|
||||||
|
|
||||||
|
// 如果上次请求生成长度超限,则继续请求
|
||||||
|
if(answer.choices[0].finish_reason == 'length' && answer.segment_id) {
|
||||||
|
const continueAnswer = await createCompletion(model, [], refreshToken, convId, retryCount, answer.segment_id);
|
||||||
|
answer.choices[0].message.content += continueAnswer.choices[0].message.content;
|
||||||
|
}
|
||||||
|
|
||||||
logger.success(`Stream has completed transfer ${util.timestamp() - streamStartTime}ms`);
|
logger.success(`Stream has completed transfer ${util.timestamp() - streamStartTime}ms`);
|
||||||
|
|
||||||
// 异步移除会话,如果消息不合规,此操作可能会抛出数据库错误异常,请忽略
|
// 异步移除会话,如果消息不合规,此操作可能会抛出数据库错误异常,请忽略
|
||||||
removeConversation(convId, refreshToken)
|
// 如果引用会话将不会清除,因为我们不知道什么时候你会结束会话
|
||||||
|
!refConvId && removeConversation(convId, refreshToken)
|
||||||
.catch(err => console.error(err));
|
.catch(err => console.error(err));
|
||||||
|
|
||||||
return answer;
|
return answer;
|
||||||
@ -220,7 +391,7 @@ async function createCompletion(model = MODEL_NAME, messages: any[], refreshToke
|
|||||||
logger.warn(`Try again after ${RETRY_DELAY / 1000}s...`);
|
logger.warn(`Try again after ${RETRY_DELAY / 1000}s...`);
|
||||||
return (async () => {
|
return (async () => {
|
||||||
await new Promise(resolve => setTimeout(resolve, RETRY_DELAY));
|
await new Promise(resolve => setTimeout(resolve, RETRY_DELAY));
|
||||||
return createCompletion(model, messages, refreshToken, useSearch, retryCount + 1);
|
return createCompletion(model, messages, refreshToken, refConvId, retryCount + 1);
|
||||||
})();
|
})();
|
||||||
}
|
}
|
||||||
throw err;
|
throw err;
|
||||||
@ -233,47 +404,91 @@ async function createCompletion(model = MODEL_NAME, messages: any[], refreshToke
|
|||||||
* @param model 模型名称
|
* @param model 模型名称
|
||||||
* @param messages 参考gpt系列消息格式,多轮对话请完整提供上下文
|
* @param messages 参考gpt系列消息格式,多轮对话请完整提供上下文
|
||||||
* @param refreshToken 用于刷新access_token的refresh_token
|
* @param refreshToken 用于刷新access_token的refresh_token
|
||||||
* @param useSearch 是否开启联网搜索
|
* @param refConvId 引用会话ID
|
||||||
* @param retryCount 重试次数
|
* @param retryCount 重试次数
|
||||||
*/
|
*/
|
||||||
async function createCompletionStream(model = MODEL_NAME, messages: any[], refreshToken: string, useSearch = true, retryCount = 0) {
|
async function createCompletionStream(model = MODEL_NAME, messages: any[], refreshToken: string, refConvId?: string, retryCount = 0) {
|
||||||
return (async () => {
|
return (async () => {
|
||||||
logger.info(messages);
|
logger.info(messages);
|
||||||
|
|
||||||
|
// 创建会话
|
||||||
|
const convId = /[0-9a-zA-Z]{20}/.test(refConvId) ? refConvId : await createConversation(model, "未命名会话", refreshToken);
|
||||||
|
|
||||||
// 提取引用文件URL并上传kimi获得引用的文件ID列表
|
// 提取引用文件URL并上传kimi获得引用的文件ID列表
|
||||||
const refFileUrls = extractRefFileUrls(messages);
|
const refFileUrls = extractRefFileUrls(messages);
|
||||||
const refs = refFileUrls.length ? await Promise.all(refFileUrls.map(fileUrl => uploadFile(fileUrl, refreshToken))) : [];
|
const refResults = refFileUrls.length ? await Promise.all(refFileUrls.map(fileUrl => uploadFile(fileUrl, refreshToken, convId))) : [];
|
||||||
|
const refs = refResults.map(result => result.id);
|
||||||
|
const refsFile = refResults.map(result => ({
|
||||||
|
detail: result,
|
||||||
|
done: true,
|
||||||
|
file: {},
|
||||||
|
file_info: result,
|
||||||
|
id: result.id,
|
||||||
|
name: result.name,
|
||||||
|
parse_status: 'success',
|
||||||
|
size: result.size,
|
||||||
|
upload_progress: 100,
|
||||||
|
upload_status: 'success'
|
||||||
|
}));
|
||||||
|
|
||||||
// 伪装调用获取用户信息
|
// 伪装调用获取用户信息
|
||||||
fakeRequest(refreshToken)
|
fakeRequest(refreshToken)
|
||||||
.catch(err => logger.error(err));
|
.catch(err => logger.error(err));
|
||||||
|
|
||||||
// 创建会话
|
const sendMessages = messagesPrepare(messages, !!refConvId);
|
||||||
const convId = await createConversation(`cmpl-${util.uuid(false)}`, refreshToken);
|
|
||||||
|
|
||||||
// 请求流
|
preN2s(model, sendMessages, refs, refreshToken, convId)
|
||||||
const token = await acquireToken(refreshToken);
|
.catch(err => logger.error(err));
|
||||||
const result = await axios.post(`https://kimi.moonshot.cn/api/chat/${convId}/completion/stream`, {
|
getSuggestion(sendMessages[0].content, refreshToken)
|
||||||
messages: messagesPrepare(messages),
|
.catch(err => logger.error(err));
|
||||||
refs,
|
tokenSize(sendMessages[0].content, refs, refreshToken, convId)
|
||||||
use_search: useSearch
|
.catch(err => logger.error(err));
|
||||||
}, {
|
|
||||||
// 120秒超时
|
const isMath = model.indexOf('math') != -1;
|
||||||
timeout: 120000,
|
const isSearchModel = model.indexOf('search') != -1;
|
||||||
headers: {
|
const isResearchModel = model.indexOf('research') != -1;
|
||||||
Authorization: `Bearer ${token}`,
|
const isK1Model = model.indexOf('k1') != -1;
|
||||||
Referer: `https://kimi.moonshot.cn/chat/${convId}`,
|
|
||||||
...FAKE_HEADERS
|
logger.info(`使用模型: ${model},是否联网检索: ${isSearchModel},是否探索版: ${isResearchModel},是否K1模型: ${isK1Model},是否数学模型: ${isMath}`);
|
||||||
|
|
||||||
|
// 检查探索版使用量
|
||||||
|
if(isResearchModel) {
|
||||||
|
const {
|
||||||
|
total,
|
||||||
|
used
|
||||||
|
} = await getResearchUsage(refreshToken);
|
||||||
|
if(used >= total)
|
||||||
|
throw new APIException(EX.API_RESEARCH_EXCEEDS_LIMIT, `探索版使用量已达到上限`);
|
||||||
|
logger.info(`探索版当前额度: ${used}/${total}`);
|
||||||
|
}
|
||||||
|
|
||||||
|
const kimiplusId = isK1Model ? 'crm40ee9e5jvhsn7ptcg' : (/^[0-9a-z]{20}$/.test(model) ? model : 'kimi');
|
||||||
|
|
||||||
|
// 请求补全流
|
||||||
|
const stream = await request('POST', `/api/chat/${convId}/completion/stream`, refreshToken, {
|
||||||
|
data: {
|
||||||
|
kimiplus_id: kimiplusId,
|
||||||
|
messages: sendMessages,
|
||||||
|
refs,
|
||||||
|
refs_file: refsFile,
|
||||||
|
use_math: isMath,
|
||||||
|
use_research: isResearchModel,
|
||||||
|
use_search: isSearchModel,
|
||||||
|
extend: { sidebar: true }
|
||||||
|
},
|
||||||
|
headers: {
|
||||||
|
Referer: `https://kimi.moonshot.cn/chat/${convId}`
|
||||||
},
|
},
|
||||||
validateStatus: () => true,
|
|
||||||
responseType: 'stream'
|
responseType: 'stream'
|
||||||
});
|
});
|
||||||
|
|
||||||
const streamStartTime = util.timestamp();
|
const streamStartTime = util.timestamp();
|
||||||
// 创建转换流将消息格式转换为gpt兼容格式
|
// 创建转换流将消息格式转换为gpt兼容格式
|
||||||
return createTransStream(model, convId, result.data, () => {
|
return createTransStream(model, convId, stream, () => {
|
||||||
logger.success(`Stream has completed transfer ${util.timestamp() - streamStartTime}ms`);
|
logger.success(`Stream has completed transfer ${util.timestamp() - streamStartTime}ms`);
|
||||||
// 流传输结束后异步移除会话,如果消息不合规,此操作可能会抛出数据库错误异常,请忽略
|
// 流传输结束后异步移除会话,如果消息不合规,此操作可能会抛出数据库错误异常,请忽略
|
||||||
removeConversation(convId, refreshToken)
|
// 如果引用会话将不会清除,因为我们不知道什么时候你会结束会话
|
||||||
|
!refConvId && removeConversation(convId, refreshToken)
|
||||||
.catch(err => console.error(err));
|
.catch(err => console.error(err));
|
||||||
});
|
});
|
||||||
})()
|
})()
|
||||||
@ -283,7 +498,7 @@ async function createCompletionStream(model = MODEL_NAME, messages: any[], refre
|
|||||||
logger.warn(`Try again after ${RETRY_DELAY / 1000}s...`);
|
logger.warn(`Try again after ${RETRY_DELAY / 1000}s...`);
|
||||||
return (async () => {
|
return (async () => {
|
||||||
await new Promise(resolve => setTimeout(resolve, RETRY_DELAY));
|
await new Promise(resolve => setTimeout(resolve, RETRY_DELAY));
|
||||||
return createCompletionStream(model, messages, refreshToken, useSearch, retryCount + 1);
|
return createCompletionStream(model, messages, refreshToken, refConvId, retryCount + 1);
|
||||||
})();
|
})();
|
||||||
}
|
}
|
||||||
throw err;
|
throw err;
|
||||||
@ -298,28 +513,29 @@ async function createCompletionStream(model = MODEL_NAME, messages: any[], refre
|
|||||||
* @param refreshToken 用于刷新access_token的refresh_token
|
* @param refreshToken 用于刷新access_token的refresh_token
|
||||||
*/
|
*/
|
||||||
async function fakeRequest(refreshToken: string) {
|
async function fakeRequest(refreshToken: string) {
|
||||||
const token = await acquireToken(refreshToken);
|
|
||||||
const options = {
|
|
||||||
headers: {
|
|
||||||
Authorization: `Bearer ${token}`,
|
|
||||||
Referer: `https://kimi.moonshot.cn/`,
|
|
||||||
...FAKE_HEADERS
|
|
||||||
}
|
|
||||||
};
|
|
||||||
await [
|
await [
|
||||||
() => axios.get('https://kimi.moonshot.cn/api/user', options),
|
() => request('GET', '/api/user', refreshToken),
|
||||||
() => axios.get('https://kimi.moonshot.cn/api/chat_1m/user/status', options),
|
() => request('POST', '/api/user/usage', refreshToken, {
|
||||||
() => axios.post('https://kimi.moonshot.cn/api/chat/list', {
|
data: {
|
||||||
offset: 0,
|
usage: ['kimiv', 'math']
|
||||||
size: 50
|
}
|
||||||
}, options),
|
}),
|
||||||
() => axios.post('https://kimi.moonshot.cn/api/show_case/list', {
|
() => request('GET', '/api/chat_1m/user/status', refreshToken),
|
||||||
offset: 0,
|
() => request('GET', '/api/kimi_mv/user/status', refreshToken),
|
||||||
size: 4,
|
() => request('POST', '/api/kimiplus/history', refreshToken),
|
||||||
enable_cache: true,
|
() => request('POST', '/api/kimiplus/search', refreshToken, {
|
||||||
order: "asc"
|
data: {
|
||||||
}, options)
|
offset: 0,
|
||||||
][Math.floor(Math.random() * 4)]();
|
size: 20
|
||||||
|
}
|
||||||
|
}),
|
||||||
|
() => request('POST', '/api/chat/list', refreshToken, {
|
||||||
|
data: {
|
||||||
|
offset: 0,
|
||||||
|
size: 50
|
||||||
|
}
|
||||||
|
}),
|
||||||
|
][Math.floor(Math.random() * 7)]();
|
||||||
}
|
}
|
||||||
|
|
||||||
/**
|
/**
|
||||||
@ -360,14 +576,28 @@ function extractRefFileUrls(messages: any[]) {
|
|||||||
* user:新消息
|
* user:新消息
|
||||||
*
|
*
|
||||||
* @param messages 参考gpt系列消息格式,多轮对话请完整提供上下文
|
* @param messages 参考gpt系列消息格式,多轮对话请完整提供上下文
|
||||||
|
* @param isRefConv 是否为引用会话
|
||||||
*/
|
*/
|
||||||
function messagesPrepare(messages: any[]) {
|
function messagesPrepare(messages: any[], isRefConv = false) {
|
||||||
// 注入消息提升注意力
|
let content;
|
||||||
let latestMessage = messages[messages.length - 1];
|
if (isRefConv || messages.length < 2) {
|
||||||
let hasFileOrImage = Array.isArray(latestMessage.content)
|
content = messages.reduce((content, message) => {
|
||||||
&& latestMessage.content.some(v => (typeof v === 'object' && ['file', 'image_url'].includes(v['type'])));
|
if (_.isArray(message.content)) {
|
||||||
// 第二轮开始注入system prompt
|
return message.content.reduce((_content, v) => {
|
||||||
if (messages.length > 2) {
|
if (!_.isObject(v) || v['type'] != 'text') return _content;
|
||||||
|
return _content + `${v["text"] || ""}\n`;
|
||||||
|
}, content);
|
||||||
|
}
|
||||||
|
return content += `${message.role == 'user' ? wrapUrlsToTags(message.content) : message.content}\n`;
|
||||||
|
}, '')
|
||||||
|
logger.info("\n透传内容:\n" + content);
|
||||||
|
}
|
||||||
|
else {
|
||||||
|
// 注入消息提升注意力
|
||||||
|
let latestMessage = messages[messages.length - 1];
|
||||||
|
let hasFileOrImage = Array.isArray(latestMessage.content)
|
||||||
|
&& latestMessage.content.some(v => (typeof v === 'object' && ['file', 'image_url'].includes(v['type'])));
|
||||||
|
// 第二轮开始注入system prompt
|
||||||
if (hasFileOrImage) {
|
if (hasFileOrImage) {
|
||||||
let newFileMessage = {
|
let newFileMessage = {
|
||||||
"content": "关注用户最新发送文件和消息",
|
"content": "关注用户最新发送文件和消息",
|
||||||
@ -383,18 +613,18 @@ function messagesPrepare(messages: any[]) {
|
|||||||
messages.splice(messages.length - 1, 0, newTextMessage);
|
messages.splice(messages.length - 1, 0, newTextMessage);
|
||||||
logger.info("注入提升尾部消息注意力system prompt");
|
logger.info("注入提升尾部消息注意力system prompt");
|
||||||
}
|
}
|
||||||
|
content = messages.reduce((content, message) => {
|
||||||
|
if (_.isArray(message.content)) {
|
||||||
|
return message.content.reduce((_content, v) => {
|
||||||
|
if (!_.isObject(v) || v['type'] != 'text') return _content;
|
||||||
|
return _content + `${message.role || "user"}:${v["text"] || ""}\n`;
|
||||||
|
}, content);
|
||||||
|
}
|
||||||
|
return content += `${message.role || "user"}:${message.role == 'user' ? wrapUrlsToTags(message.content) : message.content}\n`;
|
||||||
|
}, '')
|
||||||
|
logger.info("\n对话合并:\n" + content);
|
||||||
}
|
}
|
||||||
|
|
||||||
const content = messages.reduce((content, message) => {
|
|
||||||
if (Array.isArray(message.content)) {
|
|
||||||
return message.content.reduce((_content, v) => {
|
|
||||||
if (!_.isObject(v) || v['type'] != 'text') return _content;
|
|
||||||
return _content + `${message.role || "user"}:${v["text"] || ""}\n`;
|
|
||||||
}, content);
|
|
||||||
}
|
|
||||||
return content += `${message.role || 'user'}:${wrapUrlsToTags(message.content)}\n`;
|
|
||||||
}, '');
|
|
||||||
logger.info("\n对话合并:\n" + content);
|
|
||||||
return [
|
return [
|
||||||
{ role: 'user', content }
|
{ role: 'user', content }
|
||||||
]
|
]
|
||||||
@ -417,16 +647,20 @@ function wrapUrlsToTags(content: string) {
|
|||||||
* @param filename 文件名称
|
* @param filename 文件名称
|
||||||
* @param refreshToken 用于刷新access_token的refresh_token
|
* @param refreshToken 用于刷新access_token的refresh_token
|
||||||
*/
|
*/
|
||||||
async function preSignUrl(filename: string, refreshToken: string) {
|
async function preSignUrl(action: string, filename: string, refreshToken: string) {
|
||||||
const token = await acquireToken(refreshToken);
|
const {
|
||||||
|
accessToken,
|
||||||
|
userId
|
||||||
|
} = await acquireToken(refreshToken);
|
||||||
const result = await axios.post('https://kimi.moonshot.cn/api/pre-sign-url', {
|
const result = await axios.post('https://kimi.moonshot.cn/api/pre-sign-url', {
|
||||||
action: 'file',
|
action,
|
||||||
name: filename
|
name: filename
|
||||||
}, {
|
}, {
|
||||||
timeout: 15000,
|
timeout: 15000,
|
||||||
headers: {
|
headers: {
|
||||||
Authorization: `Bearer ${token}`,
|
Authorization: `Bearer ${accessToken}`,
|
||||||
Referer: `https://kimi.moonshot.cn/`,
|
Referer: `https://kimi.moonshot.cn/`,
|
||||||
|
'X-Traffic-Id': userId,
|
||||||
...FAKE_HEADERS
|
...FAKE_HEADERS
|
||||||
},
|
},
|
||||||
validateStatus: () => true
|
validateStatus: () => true
|
||||||
@ -461,8 +695,9 @@ async function checkFileUrl(fileUrl: string) {
|
|||||||
*
|
*
|
||||||
* @param fileUrl 文件URL
|
* @param fileUrl 文件URL
|
||||||
* @param refreshToken 用于刷新access_token的refresh_token
|
* @param refreshToken 用于刷新access_token的refresh_token
|
||||||
|
* @param refConvId 引用会话ID
|
||||||
*/
|
*/
|
||||||
async function uploadFile(fileUrl: string, refreshToken: string) {
|
async function uploadFile(fileUrl: string, refreshToken: string, refConvId?: string) {
|
||||||
// 预检查远程文件URL可用性
|
// 预检查远程文件URL可用性
|
||||||
await checkFileUrl(fileUrl);
|
await checkFileUrl(fileUrl);
|
||||||
|
|
||||||
@ -486,16 +721,22 @@ async function uploadFile(fileUrl: string, refreshToken: string) {
|
|||||||
}));
|
}));
|
||||||
}
|
}
|
||||||
|
|
||||||
|
const fileType = (mimeType || '').includes('image') ? 'image' : 'file';
|
||||||
|
|
||||||
// 获取预签名文件URL
|
// 获取预签名文件URL
|
||||||
const {
|
let {
|
||||||
url: uploadUrl,
|
url: uploadUrl,
|
||||||
object_name: objectName
|
object_name: objectName,
|
||||||
} = await preSignUrl(filename, refreshToken);
|
file_id: fileId
|
||||||
|
} = await preSignUrl(fileType, filename, refreshToken);
|
||||||
|
|
||||||
// 获取文件的MIME类型
|
// 获取文件的MIME类型
|
||||||
mimeType = mimeType || mime.getType(filename);
|
mimeType = mimeType || mime.getType(filename);
|
||||||
// 上传文件到目标OSS
|
// 上传文件到目标OSS
|
||||||
const token = await acquireToken(refreshToken);
|
const {
|
||||||
|
accessToken,
|
||||||
|
userId
|
||||||
|
} = await acquireToken(refreshToken);
|
||||||
let result = await axios.request({
|
let result = await axios.request({
|
||||||
method: 'PUT',
|
method: 'PUT',
|
||||||
url: uploadUrl,
|
url: uploadUrl,
|
||||||
@ -506,43 +747,67 @@ async function uploadFile(fileUrl: string, refreshToken: string) {
|
|||||||
timeout: 120000,
|
timeout: 120000,
|
||||||
headers: {
|
headers: {
|
||||||
'Content-Type': mimeType,
|
'Content-Type': mimeType,
|
||||||
Authorization: `Bearer ${token}`,
|
Authorization: `Bearer ${accessToken}`,
|
||||||
Referer: `https://kimi.moonshot.cn/`,
|
Referer: `https://kimi.moonshot.cn/`,
|
||||||
|
'X-Traffic-Id': userId,
|
||||||
...FAKE_HEADERS
|
...FAKE_HEADERS
|
||||||
},
|
},
|
||||||
validateStatus: () => true
|
validateStatus: () => true
|
||||||
});
|
});
|
||||||
checkResult(result, refreshToken);
|
checkResult(result, refreshToken);
|
||||||
|
|
||||||
// 获取文件上传结果
|
let status, startTime = Date.now();
|
||||||
result = await axios.post('https://kimi.moonshot.cn/api/file', {
|
let fileDetail;
|
||||||
type: 'file',
|
while (status != 'initialized' && status != 'parsed') {
|
||||||
name: filename,
|
if (Date.now() - startTime > 30000)
|
||||||
object_name: objectName,
|
throw new Error('文件等待处理超时');
|
||||||
timeout: 15000
|
// 获取文件上传结果
|
||||||
}, {
|
result = await axios.post('https://kimi.moonshot.cn/api/file', fileType == 'image' ? {
|
||||||
headers: {
|
type: 'image',
|
||||||
Authorization: `Bearer ${token}`,
|
file_id: fileId,
|
||||||
Referer: `https://kimi.moonshot.cn/`,
|
name: filename
|
||||||
...FAKE_HEADERS
|
} : {
|
||||||
}
|
type: 'file',
|
||||||
});
|
name: filename,
|
||||||
const { id: fileId } = checkResult(result, refreshToken);
|
object_name: objectName,
|
||||||
|
file_id: '',
|
||||||
|
chat_id: refConvId
|
||||||
|
}, {
|
||||||
|
headers: {
|
||||||
|
Authorization: `Bearer ${accessToken}`,
|
||||||
|
Referer: `https://kimi.moonshot.cn/`,
|
||||||
|
'X-Traffic-Id': userId,
|
||||||
|
...FAKE_HEADERS
|
||||||
|
}
|
||||||
|
});
|
||||||
|
fileDetail = checkResult(result, refreshToken);
|
||||||
|
({ id: fileId, status } = fileDetail);
|
||||||
|
}
|
||||||
|
|
||||||
// 处理文件转换
|
startTime = Date.now();
|
||||||
result = await axios.post('https://kimi.moonshot.cn/api/file/parse_process', {
|
let parseFinish = status == 'parsed';
|
||||||
ids: [fileId],
|
while (!parseFinish) {
|
||||||
timeout: 120000
|
if (Date.now() - startTime > 30000)
|
||||||
}, {
|
throw new Error('文件等待处理超时');
|
||||||
headers: {
|
// 处理文件转换
|
||||||
Authorization: `Bearer ${token}`,
|
parseFinish = await new Promise(resolve => {
|
||||||
Referer: `https://kimi.moonshot.cn/`,
|
axios.post('https://kimi.moonshot.cn/api/file/parse_process', {
|
||||||
...FAKE_HEADERS
|
ids: [fileId],
|
||||||
}
|
timeout: 120000
|
||||||
});
|
}, {
|
||||||
checkResult(result, refreshToken);
|
headers: {
|
||||||
|
Authorization: `Bearer ${accessToken}`,
|
||||||
|
Referer: `https://kimi.moonshot.cn/`,
|
||||||
|
'X-Traffic-Id': userId,
|
||||||
|
...FAKE_HEADERS
|
||||||
|
}
|
||||||
|
})
|
||||||
|
.then(() => resolve(true))
|
||||||
|
.catch(() => resolve(false));
|
||||||
|
});
|
||||||
|
}
|
||||||
|
|
||||||
return fileId;
|
return fileDetail;
|
||||||
}
|
}
|
||||||
|
|
||||||
/**
|
/**
|
||||||
@ -575,7 +840,9 @@ function checkResult(result: AxiosResponse, refreshToken: string) {
|
|||||||
* @param convId 会话ID
|
* @param convId 会话ID
|
||||||
* @param stream 消息流
|
* @param stream 消息流
|
||||||
*/
|
*/
|
||||||
async function receiveStream(model: string, convId: string, stream: any) {
|
async function receiveStream(model: string, convId: string, stream: any): Promise<IStreamMessage> {
|
||||||
|
let webSearchCount = 0;
|
||||||
|
let temp = Buffer.from('');
|
||||||
return new Promise((resolve, reject) => {
|
return new Promise((resolve, reject) => {
|
||||||
// 消息初始化
|
// 消息初始化
|
||||||
const data = {
|
const data = {
|
||||||
@ -586,10 +853,11 @@ async function receiveStream(model: string, convId: string, stream: any) {
|
|||||||
{ index: 0, message: { role: 'assistant', content: '' }, finish_reason: 'stop' }
|
{ index: 0, message: { role: 'assistant', content: '' }, finish_reason: 'stop' }
|
||||||
],
|
],
|
||||||
usage: { prompt_tokens: 1, completion_tokens: 1, total_tokens: 2 },
|
usage: { prompt_tokens: 1, completion_tokens: 1, total_tokens: 2 },
|
||||||
|
segment_id: '',
|
||||||
created: util.unixTimestamp()
|
created: util.unixTimestamp()
|
||||||
};
|
};
|
||||||
let refContent = '';
|
let refContent = '';
|
||||||
const silentSearch = model.indexOf('silent_search') != -1;
|
const silentSearch = model.indexOf('silent') != -1;
|
||||||
const parser = createParser(event => {
|
const parser = createParser(event => {
|
||||||
try {
|
try {
|
||||||
if (event.type !== "event") return;
|
if (event.type !== "event") return;
|
||||||
@ -599,8 +867,16 @@ async function receiveStream(model: string, convId: string, stream: any) {
|
|||||||
throw new Error(`Stream response invalid: ${event.data}`);
|
throw new Error(`Stream response invalid: ${event.data}`);
|
||||||
// 处理消息
|
// 处理消息
|
||||||
if (result.event == 'cmpl' && result.text) {
|
if (result.event == 'cmpl' && result.text) {
|
||||||
const exceptCharIndex = result.text.indexOf("<22>");
|
data.choices[0].message.content += result.text;
|
||||||
data.choices[0].message.content += result.text.substring(0, exceptCharIndex == -1 ? result.text.length : exceptCharIndex);
|
}
|
||||||
|
// 处理请求ID
|
||||||
|
else if(result.event == 'req') {
|
||||||
|
data.segment_id = result.id;
|
||||||
|
}
|
||||||
|
// 处理超长文本
|
||||||
|
else if(result.event == 'length') {
|
||||||
|
logger.warn('此次生成达到max_tokens,稍候将继续请求拼接完整响应');
|
||||||
|
data.choices[0].finish_reason = 'length';
|
||||||
}
|
}
|
||||||
// 处理结束或错误
|
// 处理结束或错误
|
||||||
else if (result.event == 'all_done' || result.event == 'error') {
|
else if (result.event == 'all_done' || result.event == 'error') {
|
||||||
@ -609,8 +885,10 @@ async function receiveStream(model: string, convId: string, stream: any) {
|
|||||||
resolve(data);
|
resolve(data);
|
||||||
}
|
}
|
||||||
// 处理联网搜索
|
// 处理联网搜索
|
||||||
else if (!silentSearch && result.event == 'search_plus' && result.msg && result.msg.type == 'get_res')
|
else if (!silentSearch && result.event == 'search_plus' && result.msg && result.msg.type == 'get_res') {
|
||||||
refContent += `${result.msg.title}(${result.msg.url})\n`;
|
webSearchCount += 1;
|
||||||
|
refContent += `【检索 ${webSearchCount}】 [${result.msg.title}](${result.msg.url})\n\n`;
|
||||||
|
}
|
||||||
// else
|
// else
|
||||||
// logger.warn(result.event, result);
|
// logger.warn(result.event, result);
|
||||||
}
|
}
|
||||||
@ -620,7 +898,20 @@ async function receiveStream(model: string, convId: string, stream: any) {
|
|||||||
}
|
}
|
||||||
});
|
});
|
||||||
// 将流数据喂给SSE转换器
|
// 将流数据喂给SSE转换器
|
||||||
stream.on("data", buffer => parser.feed(buffer.toString()));
|
stream.on("data", buffer => {
|
||||||
|
// 检查buffer是否以完整UTF8字符结尾
|
||||||
|
if (buffer.toString().indexOf('<27>') != -1) {
|
||||||
|
// 如果不完整则累积buffer直到收到完整字符
|
||||||
|
temp = Buffer.concat([temp, buffer]);
|
||||||
|
return;
|
||||||
|
}
|
||||||
|
// 将之前累积的不完整buffer拼接
|
||||||
|
if (temp.length > 0) {
|
||||||
|
buffer = Buffer.concat([temp, buffer]);
|
||||||
|
temp = Buffer.from('');
|
||||||
|
}
|
||||||
|
parser.feed(buffer.toString());
|
||||||
|
});
|
||||||
stream.once("error", err => reject(err));
|
stream.once("error", err => reject(err));
|
||||||
stream.once("close", () => resolve(data));
|
stream.once("close", () => resolve(data));
|
||||||
});
|
});
|
||||||
@ -641,8 +932,11 @@ function createTransStream(model: string, convId: string, stream: any, endCallba
|
|||||||
const created = util.unixTimestamp();
|
const created = util.unixTimestamp();
|
||||||
// 创建转换流
|
// 创建转换流
|
||||||
const transStream = new PassThrough();
|
const transStream = new PassThrough();
|
||||||
|
let webSearchCount = 0;
|
||||||
let searchFlag = false;
|
let searchFlag = false;
|
||||||
const silentSearch = model.indexOf('silent_search') != -1;
|
let lengthExceed = false;
|
||||||
|
let segmentId = '';
|
||||||
|
const silentSearch = model.indexOf('silent') != -1;
|
||||||
!transStream.closed && transStream.write(`data: ${JSON.stringify({
|
!transStream.closed && transStream.write(`data: ${JSON.stringify({
|
||||||
id: convId,
|
id: convId,
|
||||||
model,
|
model,
|
||||||
@ -650,6 +944,7 @@ function createTransStream(model: string, convId: string, stream: any, endCallba
|
|||||||
choices: [
|
choices: [
|
||||||
{ index: 0, delta: { role: 'assistant', content: '' }, finish_reason: null }
|
{ index: 0, delta: { role: 'assistant', content: '' }, finish_reason: null }
|
||||||
],
|
],
|
||||||
|
segment_id: '',
|
||||||
created
|
created
|
||||||
})}\n\n`);
|
})}\n\n`);
|
||||||
const parser = createParser(event => {
|
const parser = createParser(event => {
|
||||||
@ -670,12 +965,21 @@ function createTransStream(model: string, convId: string, stream: any, endCallba
|
|||||||
choices: [
|
choices: [
|
||||||
{ index: 0, delta: { content: (searchFlag ? '\n' : '') + chunk }, finish_reason: null }
|
{ index: 0, delta: { content: (searchFlag ? '\n' : '') + chunk }, finish_reason: null }
|
||||||
],
|
],
|
||||||
|
segment_id: segmentId,
|
||||||
created
|
created
|
||||||
})}\n\n`;
|
})}\n\n`;
|
||||||
if (searchFlag)
|
if (searchFlag)
|
||||||
searchFlag = false;
|
searchFlag = false;
|
||||||
!transStream.closed && transStream.write(data);
|
!transStream.closed && transStream.write(data);
|
||||||
}
|
}
|
||||||
|
// 处理请求ID
|
||||||
|
else if(result.event == 'req') {
|
||||||
|
segmentId = result.id;
|
||||||
|
}
|
||||||
|
// 处理超长文本
|
||||||
|
else if (result.event == 'length') {
|
||||||
|
lengthExceed = true;
|
||||||
|
}
|
||||||
// 处理结束或错误
|
// 处理结束或错误
|
||||||
else if (result.event == 'all_done' || result.event == 'error') {
|
else if (result.event == 'all_done' || result.event == 'error') {
|
||||||
const data = `data: ${JSON.stringify({
|
const data = `data: ${JSON.stringify({
|
||||||
@ -686,10 +990,11 @@ function createTransStream(model: string, convId: string, stream: any, endCallba
|
|||||||
{
|
{
|
||||||
index: 0, delta: result.event == 'error' ? {
|
index: 0, delta: result.event == 'error' ? {
|
||||||
content: '\n[内容由于不合规被停止生成,我们换个话题吧]'
|
content: '\n[内容由于不合规被停止生成,我们换个话题吧]'
|
||||||
} : {}, finish_reason: 'stop'
|
} : {}, finish_reason: lengthExceed ? 'length' : 'stop'
|
||||||
}
|
}
|
||||||
],
|
],
|
||||||
usage: { prompt_tokens: 1, completion_tokens: 1, total_tokens: 2 },
|
usage: { prompt_tokens: 1, completion_tokens: 1, total_tokens: 2 },
|
||||||
|
segment_id: segmentId,
|
||||||
created
|
created
|
||||||
})}\n\n`;
|
})}\n\n`;
|
||||||
!transStream.closed && transStream.write(data);
|
!transStream.closed && transStream.write(data);
|
||||||
@ -700,6 +1005,7 @@ function createTransStream(model: string, convId: string, stream: any, endCallba
|
|||||||
else if (!silentSearch && result.event == 'search_plus' && result.msg && result.msg.type == 'get_res') {
|
else if (!silentSearch && result.event == 'search_plus' && result.msg && result.msg.type == 'get_res') {
|
||||||
if (!searchFlag)
|
if (!searchFlag)
|
||||||
searchFlag = true;
|
searchFlag = true;
|
||||||
|
webSearchCount += 1;
|
||||||
const data = `data: ${JSON.stringify({
|
const data = `data: ${JSON.stringify({
|
||||||
id: convId,
|
id: convId,
|
||||||
model,
|
model,
|
||||||
@ -707,10 +1013,11 @@ function createTransStream(model: string, convId: string, stream: any, endCallba
|
|||||||
choices: [
|
choices: [
|
||||||
{
|
{
|
||||||
index: 0, delta: {
|
index: 0, delta: {
|
||||||
content: `检索 ${result.msg.title}(${result.msg.url}) ...\n`
|
content: `【检索 ${webSearchCount}】 [${result.msg.title}](${result.msg.url})\n`
|
||||||
}, finish_reason: null
|
}, finish_reason: null
|
||||||
}
|
}
|
||||||
],
|
],
|
||||||
|
segment_id: segmentId,
|
||||||
created
|
created
|
||||||
})}\n\n`;
|
})}\n\n`;
|
||||||
!transStream.closed && transStream.write(data);
|
!transStream.closed && transStream.write(data);
|
||||||
@ -759,7 +1066,7 @@ async function getTokenLiveStatus(refreshToken: string) {
|
|||||||
} = checkResult(result, refreshToken);
|
} = checkResult(result, refreshToken);
|
||||||
return !!(access_token && refresh_token)
|
return !!(access_token && refresh_token)
|
||||||
}
|
}
|
||||||
catch(err) {
|
catch (err) {
|
||||||
return false;
|
return false;
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
20
src/api/interfaces/IStreamMessage.ts
Normal file
20
src/api/interfaces/IStreamMessage.ts
Normal file
@ -0,0 +1,20 @@
|
|||||||
|
export default interface IStreamMessage {
|
||||||
|
id: string;
|
||||||
|
model: string;
|
||||||
|
object: string;
|
||||||
|
choices: {
|
||||||
|
index: number;
|
||||||
|
message: {
|
||||||
|
role: string;
|
||||||
|
content: string;
|
||||||
|
};
|
||||||
|
finish_reason: string;
|
||||||
|
}[];
|
||||||
|
usage: {
|
||||||
|
prompt_tokens: number;
|
||||||
|
completion_tokens: number;
|
||||||
|
total_tokens: number;
|
||||||
|
};
|
||||||
|
segment_id?: string;
|
||||||
|
created: number;
|
||||||
|
}
|
@ -13,22 +13,26 @@ export default {
|
|||||||
|
|
||||||
'/completions': async (request: Request) => {
|
'/completions': async (request: Request) => {
|
||||||
request
|
request
|
||||||
|
.validate('body.conversation_id', v => _.isUndefined(v) || _.isString(v))
|
||||||
.validate('body.messages', _.isArray)
|
.validate('body.messages', _.isArray)
|
||||||
.validate('headers.authorization', _.isString)
|
.validate('headers.authorization', _.isString)
|
||||||
// refresh_token切分
|
// refresh_token切分
|
||||||
const tokens = chat.tokenSplit(request.headers.authorization);
|
const tokens = chat.tokenSplit(request.headers.authorization);
|
||||||
// 随机挑选一个refresh_token
|
// 随机挑选一个refresh_token
|
||||||
const token = _.sample(tokens);
|
const token = _.sample(tokens);
|
||||||
const model = request.body.model;
|
let { model, conversation_id: convId, messages, stream, use_search } = request.body;
|
||||||
const messages = request.body.messages;
|
|
||||||
if (request.body.stream) {
|
if(use_search)
|
||||||
const stream = await chat.createCompletionStream(model, messages, token, request.body.use_search);
|
model = 'kimi-search';
|
||||||
|
|
||||||
|
if (stream) {
|
||||||
|
const stream = await chat.createCompletionStream(model, messages, token, convId);
|
||||||
return new Response(stream, {
|
return new Response(stream, {
|
||||||
type: "text/event-stream"
|
type: "text/event-stream"
|
||||||
});
|
});
|
||||||
}
|
}
|
||||||
else
|
else
|
||||||
return await chat.createCompletion(model, messages, token, request.body.use_search);
|
return await chat.createCompletion(model, messages, token, convId);
|
||||||
}
|
}
|
||||||
|
|
||||||
}
|
}
|
||||||
|
@ -4,6 +4,7 @@ import Response from '@/lib/response/Response.ts';
|
|||||||
import chat from "./chat.ts";
|
import chat from "./chat.ts";
|
||||||
import ping from "./ping.ts";
|
import ping from "./ping.ts";
|
||||||
import token from './token.ts';
|
import token from './token.ts';
|
||||||
|
import models from './models.ts';
|
||||||
|
|
||||||
export default [
|
export default [
|
||||||
{
|
{
|
||||||
@ -21,5 +22,6 @@ export default [
|
|||||||
},
|
},
|
||||||
chat,
|
chat,
|
||||||
ping,
|
ping,
|
||||||
token
|
token,
|
||||||
|
models
|
||||||
];
|
];
|
41
src/api/routes/models.ts
Normal file
41
src/api/routes/models.ts
Normal file
@ -0,0 +1,41 @@
|
|||||||
|
import _ from 'lodash';
|
||||||
|
|
||||||
|
export default {
|
||||||
|
|
||||||
|
prefix: '/v1',
|
||||||
|
|
||||||
|
get: {
|
||||||
|
'/models': async () => {
|
||||||
|
return {
|
||||||
|
"data": [
|
||||||
|
{
|
||||||
|
"id": "moonshot-v1",
|
||||||
|
"object": "model",
|
||||||
|
"owned_by": "kimi-free-api"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "moonshot-v1-8k",
|
||||||
|
"object": "model",
|
||||||
|
"owned_by": "kimi-free-api"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "moonshot-v1-32k",
|
||||||
|
"object": "model",
|
||||||
|
"owned_by": "kimi-free-api"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "moonshot-v1-128k",
|
||||||
|
"object": "model",
|
||||||
|
"owned_by": "kimi-free-api"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"id": "moonshot-v1-vision",
|
||||||
|
"object": "model",
|
||||||
|
"owned_by": "kimi-free-api"
|
||||||
|
}
|
||||||
|
]
|
||||||
|
};
|
||||||
|
}
|
||||||
|
|
||||||
|
}
|
||||||
|
}
|
@ -50,13 +50,10 @@ const util = {
|
|||||||
generateCookie() {
|
generateCookie() {
|
||||||
const timestamp = util.unixTimestamp();
|
const timestamp = util.unixTimestamp();
|
||||||
const items = [
|
const items = [
|
||||||
`Hm_lvt_4532beacc312859e0aa3e4a80566b706=${timestamp - Math.round(Math.random() * 2592000)}`,
|
|
||||||
`Hm_lvt_358cae4815e85d48f7e8ab7f3680a74b=${timestamp - Math.round(Math.random() * 2592000)}`,
|
`Hm_lvt_358cae4815e85d48f7e8ab7f3680a74b=${timestamp - Math.round(Math.random() * 2592000)}`,
|
||||||
`_ga=GA1.1.${util.generateRandomString({ length: 10, charset: 'numeric' })}.${timestamp - Math.round(Math.random() * 2592000)}`,
|
`_ga=GA1.1.${util.generateRandomString({ length: 10, charset: 'numeric' })}.${timestamp - Math.round(Math.random() * 2592000)}`,
|
||||||
`_ga_31QPQG2YYD=GS1.1.${timestamp - Math.round(Math.random() * 2592000)}.17.0.${timestamp - Math.round(Math.random() * 2592000)}.0.0.0`,
|
`_ga_YXD8W70SZP=GS1.1.${timestamp - Math.round(Math.random() * 2592000)}.1.1.${timestamp - Math.round(Math.random() * 2592000)}.0.0.0`,
|
||||||
`Hm_lpvt_4532beacc312859e0aa3e4a80566b706=${timestamp - Math.round(Math.random() * 2592000)}`,
|
`Hm_lpvt_358cae4815e85d48f7e8ab7f3680a74b=${timestamp - Math.round(Math.random() * 2592000)}`
|
||||||
`Hm_lpvt_358cae4815e85d48f7e8ab7f3680a74b=${timestamp - Math.round(Math.random() * 2592000)}`,
|
|
||||||
`_ga_YXD8W70SZP=GS1.1.${timestamp - Math.round(Math.random() * 2592000)}.35.1.${timestamp - Math.round(Math.random() * 2592000)}.0.0.0`
|
|
||||||
];
|
];
|
||||||
return items.join('; ');
|
return items.join('; ');
|
||||||
},
|
},
|
||||||
|
Loading…
x
Reference in New Issue
Block a user