-LAN- d3f5b1cbb6 refactor: use tiktoken for token calculation (#12416) ...

Signed-off-by: -LAN- <laipz8200@outlook.com>

2025-01-07 13:32:30 +08:00

..

__base

refactor: use tiktoken for token calculation (#12416)

2025-01-07 13:32:30 +08:00

anthropic

fix: handle document fetching from URL in Anthropic LLM model, solving base64 decoding error (#11858)

2024-12-20 18:23:42 +08:00

azure_ai_studio

chore(lint): cleanup repeated cause exception in logging.exception replaced by helpful message (#10425)

2024-11-15 15:41:40 +08:00

azure_openai

fix: o1 model error, use max_completion_tokens instead of max_tokens. (#12037)

2024-12-25 13:29:43 +08:00

baichuan

fix: volcengine_maas and baichuan message error (#11625)

2024-12-16 13:05:27 +08:00

bedrock

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

chatglm

chore: refurbish Python code by applying refurb linter rules (#8296)

2024-09-12 15:50:49 +08:00

cohere

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

deepseek

fix: deepseek reports an error when using Response Format #11677 (#11678)

2024-12-16 12:58:03 +08:00

fireworks

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

fishaudio

fix: fish audio wrong validate credentials interface (#11019)

2024-11-23 23:39:41 +08:00

gitee_ai

fix: Update the API call address for the text_embedding model (#12342)

2025-01-03 19:19:17 +08:00

google

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

gpustack

Support TTS and Speech2Text for Model Provider GPUStack (#12381)

2025-01-07 09:42:11 +08:00

groq

feat: Add response format support for openai compat models (#12240)

2025-01-02 09:59:34 +08:00

huggingface_hub

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

huggingface_tei

fix: fix typo (#12034)

2024-12-24 15:23:27 +08:00

hunyuan

feat:Add support for stop parameter in hunyuan model #12313 (#12315)

2025-01-03 09:15:04 +08:00

jina

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

leptonai

chore(api/core): apply ruff reformatting (#7624)

2024-09-10 17:00:20 +08:00

localai

chore: format get_customizable_model_schema return value (#9335)

2024-10-21 19:05:44 +08:00

minimax

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

mistralai

[Pixtral] Add new model ; add vision (#11231)

2024-12-11 10:14:16 +08:00

mixedbread

refactor: move the embedding to the rag module and abstract the rerank runner for extension (#9423)

2024-10-17 19:12:42 +08:00

moonshot

fix: #12143 support streaming mode content start with "data:" (#12171)

2025-01-03 16:33:37 +08:00

nomic

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

novita

chore(api/core): apply ruff reformatting (#7624)

2024-09-10 17:00:20 +08:00

nvidia

refactor: move the embedding to the rag module and abstract the rerank runner for extension (#9423)

2024-10-17 19:12:42 +08:00

nvidia_nim

chore(api/core): apply ruff reformatting (#7624)

2024-09-10 17:00:20 +08:00

oci

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

ollama

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

openai

feat: Add response format support for openai compat models (#12240)

2025-01-02 09:59:34 +08:00

openai_api_compatible

fix: #12143 support streaming mode content start with "data:" (#12171)

2025-01-03 16:33:37 +08:00

openllm

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

openrouter

Support streaming output for OpenAI o1-preview and o1-mini (#10890)

2024-11-20 15:10:41 +08:00

perfxcloud

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

replicate

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

sagemaker

[Fix] revert sagemaker llm to support model hub (#12378)

2025-01-06 18:01:45 +08:00

siliconflow

Fixes #12414: Add cheaper model and long context model for Qwen2.5-72B-Instruct from siliconflow (#12415)

2025-01-07 11:28:24 +08:00

spark

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

stepfun

fix: #12143 support streaming mode content start with "data:" (#12171)

2025-01-03 16:33:37 +08:00

tencent

chore: refurbish Python code by applying refurb linter rules (#8296)

2024-09-12 15:50:49 +08:00

togetherai

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

tongyi

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

triton_inference_server

chore: format get_customizable_model_schema return value (#9335)

2024-10-21 19:05:44 +08:00

upstage

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

vertex_ai

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

vessl_ai

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

volcengine_maas

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

voyage

fix: int None will cause error for context size (#11055)

2024-11-25 21:04:16 +08:00

wenxin

feat: support Ernie-lite-pro-128k (#12161)

2024-12-27 20:23:46 +08:00

x

feat: add grok-2-1212 and grok-2-vision-1212 (#11672)

2024-12-15 21:18:24 +08:00

xinference

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

yi

feat: mypy for all type check (#10921)

2024-12-24 18:38:51 +08:00

zhinao

chore(api/core): apply ruff reformatting (#7624)

2024-09-10 17:00:20 +08:00

zhipuai

feat: Add response format support to GLM-4 (#12252)

2025-01-03 09:38:50 +08:00

__init__.py

Model Runtime (#1858)

2024-01-02 23:42:00 +08:00

_position.yaml

feat: add voyage ai as a new model provider (#8747)

2024-09-29 16:55:59 +08:00

model_provider_factory.py

feat: support pinning, including, and excluding for model providers and tools (#7419)

2024-08-21 11:16:43 +08:00