diff --git a/README.md b/README.md index 8617cb39..5a5fac0d 100644 --- a/README.md +++ b/README.md @@ -29,19 +29,19 @@ More patterns are coming soon... The LLM model integration can be accomplished with simple configuration, currently agentUniverse supported models include: -||Vendors|Models| -|:-----:|:--------:|:------:| -||Qwen|qwen2.5-72b-instruct、qwq-32b-preview、qwen-max、…| -||Deepseek|deepseek-r1、deepseek-v3、deepseek-r1-distill-qwen-32b、…| -||OpenAI|GPT-4o、GPT-4o mini、OpenAI o1、OpenAI o3-mini、…| -||Claude|Claude 3.5 Sonnet、Claude 3 Opus、…| -||Gemini|Gemini 2.0 Flash、Gemini 2.0 Flash Thinking、Gemini 1.5 Pro、…| -||Llama|llama3.3-70b-instruct、llama3.2-3b-instruct、llama3.2-1b-instruct、…| -||KIMI|moonshot-v1-128k、moonshot-v1-32k、moonshot-v1-8k、…| -||WenXin|ERNIE 4.0、ERNIE 4.0 Turbo、ERNIE 3.5、…| -||chatglm|chatglm3-6b、chatglm-6b-v2、…| -||BaiChuan|baichuan2-turbo、baichuan2-13b-chat-v1、…| -||Doubao|Doubao-pro-128k、Doubao-pro-32k、Doubao-lite-128k、…| +|-|Vendors| Models | +|:-----:|:--------:|:------------------------------------------------------------------------------------------------------------------:| +|| Qwen | [✨**new**] **qwen3 Series**（qwen3-235b-a22b、qwen3-32b、qwen3-30b-a3b, etc.）、qwen2.5-72b-instruct、qwq-32b-preview、qwen-max、… | +||Deepseek| deepseek-r1、deepseek-v3、deepseek-r1-distill-qwen-32b、… | +|| OpenAI | GPT-4o、GPT-4o mini、OpenAI o1、OpenAI o3-mini、… | +|| Claude | Claude 3.5 Sonnet、Claude 3 Opus、… | +|| Gemini | Gemini 2.0 Flash、Gemini 2.0 Flash Thinking、Gemini 1.5 Pro、… | +|| Llama | llama3.3-70b-instruct、llama3.2-3b-instruct、llama3.2-1b-instruct、… | +|| KIMI | moonshot-v1-128k、moonshot-v1-32k、moonshot-v1-8k、… | +|| WenXin | ERNIE 4.0、ERNIE 4.0 Turbo、ERNIE 3.5、… | +||chatglm | chatglm3-6b、chatglm-6b-v2、… | +||BaiChuan| baichuan2-turbo、baichuan2-13b-chat-v1、… | +|| Doubao | Doubao-pro-128k、Doubao-pro-32k、Doubao-lite-128k、… | For example, to use deepseek model, you can simply set DEEPSEEK_API_KEY value in the custom_key.toml file, and set the llm_model name in the agent configuration file to 'default_deepseek_llm' and you're all set. For more information about llm configuration, please refer to [switch-the-llm](https://github.com/agentuniverse-ai/agentUniverse/blob/master/docs/guidebook/en/Get_Start/2.Run_Your_First_Tutorial_Example.md#switch-the-llm). diff --git a/README_zh.md b/README_zh.md index 51762009..52290cf8 100644 --- a/README_zh.md +++ b/README_zh.md @@ -24,6 +24,22 @@ 更多模式组件持续推出中... +The LLM model integration can be accomplished with simple configuration, currently agentUniverse supported models include: + +|-|供应商| 模型 | +|:-----:|:--------:|:------------------------------------------------------------------------------------------------------------------------:| +||Qwen| [✨**new**] **qwen3 Series**（qwen3-235b-a22b、qwen3-32b、qwen3-30b-a3b, etc.） 、qwen2.5-72b-instruct、qwq-32b-preview、qwen-max、… | +||Deepseek| deepseek-r1、deepseek-v3、deepseek-r1-distill-qwen-32b、… | +||OpenAI| GPT-4o、GPT-4o mini、OpenAI o1、OpenAI o3-mini、… | +||Claude| Claude 3.5 Sonnet、Claude 3 Opus、… | +||Gemini| Gemini 2.0 Flash、Gemini 2.0 Flash Thinking、Gemini 1.5 Pro、… | +||Llama| llama3.3-70b-instruct、llama3.2-3b-instruct、llama3.2-1b-instruct、… | +||KIMI| moonshot-v1-128k、moonshot-v1-32k、moonshot-v1-8k、… | +||WenXin| ERNIE 4.0、ERNIE 4.0 Turbo、ERNIE 3.5、… | +||chatglm| chatglm3-6b、chatglm-6b-v2、… | +||BaiChuan| baichuan2-turbo、baichuan2-13b-chat-v1、… | +||Doubao| Doubao-pro-128k、Doubao-pro-32k、Doubao-lite-128k、… | + **************************************** ## 目录 diff --git a/examples/sample_standard_app/intelligence/agentic/agent/agent_instance/demo_agent.yaml b/examples/sample_standard_app/intelligence/agentic/agent/agent_instance/demo_agent.yaml index f6825697..4a0f2ad6 100644 --- a/examples/sample_standard_app/intelligence/agentic/agent/agent_instance/demo_agent.yaml +++ b/examples/sample_standard_app/intelligence/agentic/agent/agent_instance/demo_agent.yaml @@ -35,7 +35,7 @@ profile: # # Note: The current configuration uses Way 1, as shown below llm_model: - name: 'deepseek-chat' + name: 'qwen3-32b' action: # Please select the tools and knowledge base. tool: diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_0_6b_official_channel.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_0_6b_official_channel.yaml new file mode 100644 index 00000000..c9d9bc50 --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_0_6b_official_channel.yaml @@ -0,0 +1,8 @@ +channel_name: 'qwen3-0.6b-official' +channel_api_key: '${DASHSCOPE_API_KEY}' +channel_api_base: 'https://dashscope.aliyuncs.com/compatible-mode/v1' +channel_model_name: 'qwen3-0.6b' +model_support_stream: True +model_support_max_context_length: 32768 +model_is_openai_protocol_compatible: True +meta_class: 'agentuniverse.llm.llm_channel.dashscope_llm_channel.DashscopeLLMChannel' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_14b_official_channel.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_14b_official_channel.yaml new file mode 100644 index 00000000..69f89c5e --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_14b_official_channel.yaml @@ -0,0 +1,8 @@ +channel_name: 'qwen3-14b-official' +channel_api_key: '${DASHSCOPE_API_KEY}' +channel_api_base: 'https://dashscope.aliyuncs.com/compatible-mode/v1' +channel_model_name: 'qwen3-14b' +model_support_stream: True +model_support_max_context_length: 131072 +model_is_openai_protocol_compatible: True +meta_class: 'agentuniverse.llm.llm_channel.dashscope_llm_channel.DashscopeLLMChannel' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_1_7b_official_channel.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_1_7b_official_channel.yaml new file mode 100644 index 00000000..26625989 --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_1_7b_official_channel.yaml @@ -0,0 +1,8 @@ +channel_name: 'qwen3-1.7b-official' +channel_api_key: '${DASHSCOPE_API_KEY}' +channel_api_base: 'https://dashscope.aliyuncs.com/compatible-mode/v1' +channel_model_name: 'qwen3-1.7b' +model_support_stream: True +model_support_max_context_length: 32768 +model_is_openai_protocol_compatible: True +meta_class: 'agentuniverse.llm.llm_channel.dashscope_llm_channel.DashscopeLLMChannel' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_235b_a22b_official_channel.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_235b_a22b_official_channel.yaml new file mode 100644 index 00000000..97e02dbc --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_235b_a22b_official_channel.yaml @@ -0,0 +1,8 @@ +channel_name: 'qwen3-235b-a22b' +channel_api_key: '${DASHSCOPE_API_KEY}' +channel_api_base: 'https://dashscope.aliyuncs.com/compatible-mode/v1' +channel_model_name: 'qwen3-235b-a22b' +model_support_stream: True +model_support_max_context_length: 131072 +model_is_openai_protocol_compatible: True +meta_class: 'agentuniverse.llm.llm_channel.dashscope_llm_channel.DashscopeLLMChannel' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_30b_a3b_official_channel.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_30b_a3b_official_channel.yaml new file mode 100644 index 00000000..e7278ca0 --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_30b_a3b_official_channel.yaml @@ -0,0 +1,8 @@ +channel_name: 'qwen3-30b-a3b-official' +channel_api_key: '${DASHSCOPE_API_KEY}' +channel_api_base: 'https://dashscope.aliyuncs.com/compatible-mode/v1' +channel_model_name: 'qwen3-30b-a3b' +model_support_stream: True +model_support_max_context_length: 131072 +model_is_openai_protocol_compatible: True +meta_class: 'agentuniverse.llm.llm_channel.dashscope_llm_channel.DashscopeLLMChannel' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_32b_official_channel.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_32b_official_channel.yaml new file mode 100644 index 00000000..da8b715e --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_32b_official_channel.yaml @@ -0,0 +1,8 @@ +channel_name: 'qwen3-32b-official' +channel_api_key: '${DASHSCOPE_API_KEY}' +channel_api_base: 'https://dashscope.aliyuncs.com/compatible-mode/v1' +channel_model_name: 'qwen3-32b' +model_support_stream: True +model_support_max_context_length: 131072 +model_is_openai_protocol_compatible: True +meta_class: 'agentuniverse.llm.llm_channel.dashscope_llm_channel.DashscopeLLMChannel' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_4b_official_channel.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_4b_official_channel.yaml new file mode 100644 index 00000000..cd338f51 --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_4b_official_channel.yaml @@ -0,0 +1,8 @@ +channel_name: 'qwen3-4b-official' +channel_api_key: '${DASHSCOPE_API_KEY}' +channel_api_base: 'https://dashscope.aliyuncs.com/compatible-mode/v1' +channel_model_name: 'qwen3-4b' +model_support_stream: True +model_support_max_context_length: 131072 +model_is_openai_protocol_compatible: True +meta_class: 'agentuniverse.llm.llm_channel.dashscope_llm_channel.DashscopeLLMChannel' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_8b_official_channel.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_8b_official_channel.yaml new file mode 100644 index 00000000..7d6ae522 --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/channel/qwen3/qwen3_8b_official_channel.yaml @@ -0,0 +1,8 @@ +channel_name: 'qwen3-8b-official' +channel_api_key: '${DASHSCOPE_API_KEY}' +channel_api_base: 'https://dashscope.aliyuncs.com/compatible-mode/v1' +channel_model_name: 'qwen3-8b' +model_support_stream: True +model_support_max_context_length: 131072 +model_is_openai_protocol_compatible: True +meta_class: 'agentuniverse.llm.llm_channel.dashscope_llm_channel.DashscopeLLMChannel' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_0_6b.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_0_6b.yaml new file mode 100644 index 00000000..71b62b78 --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_0_6b.yaml @@ -0,0 +1,9 @@ +name: 'qwen3-0.6b' +description: 'qwen3-0.6b' +model_name: 'qwen3-0.6b' +temperature: 0.5 +max_tokens: 8192 +max_context_length: 32768 +streaming: True +channel: qwen3-0.6b-official +meta_class: 'agentuniverse.llm.default.qwen_openai_style_llm.QWenOpenAIStyleLLM' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_14b.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_14b.yaml new file mode 100644 index 00000000..eb6a6345 --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_14b.yaml @@ -0,0 +1,9 @@ +name: 'qwen3-14b' +description: 'qwen3-14b' +model_name: 'qwen3-14b' +temperature: 0.5 +max_tokens: 8192 +max_context_length: 131072 +streaming: True +channel: qwen3-14b-official +meta_class: 'agentuniverse.llm.default.qwen_openai_style_llm.QWenOpenAIStyleLLM' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_1_7b.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_1_7b.yaml new file mode 100644 index 00000000..d8e0e0fa --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_1_7b.yaml @@ -0,0 +1,9 @@ +name: 'qwen3-1.7b' +description: 'qwen3-1.7b' +model_name: 'qwen3-1.7b' +temperature: 0.5 +max_tokens: 8192 +max_context_length: 32768 +streaming: True +channel: qwen3-1.7b-official +meta_class: 'agentuniverse.llm.default.qwen_openai_style_llm.QWenOpenAIStyleLLM' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_235b_a22b.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_235b_a22b.yaml new file mode 100644 index 00000000..87fb50bc --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_235b_a22b.yaml @@ -0,0 +1,9 @@ +name: 'qwen3-235b-a22b' +description: 'qwen3-235b-a22b' +model_name: 'qwen3-235b-a22b' +temperature: 0.5 +max_tokens: 8192 +max_context_length: 131072 +streaming: True +channel: qwen3-235b-a22b-official +meta_class: 'agentuniverse.llm.default.qwen_openai_style_llm.QWenOpenAIStyleLLM' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_30b_a3b.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_30b_a3b.yaml new file mode 100644 index 00000000..b96622a1 --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_30b_a3b.yaml @@ -0,0 +1,9 @@ +name: 'qwen3-30b-a3b' +description: 'qwen3-30b-a3b' +model_name: 'qwen3-30b-a3b' +temperature: 0.5 +max_tokens: 8192 +max_context_length: 131072 +streaming: True +channel: qwen3-30b-a3b-official +meta_class: 'agentuniverse.llm.default.qwen_openai_style_llm.QWenOpenAIStyleLLM' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_32b.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_32b.yaml new file mode 100644 index 00000000..2e0cb043 --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_32b.yaml @@ -0,0 +1,9 @@ +name: 'qwen3-32b' +description: 'qwen3-32b' +model_name: 'qwen3-32b' +temperature: 0.5 +max_tokens: 8192 +max_context_length: 131072 +streaming: True +channel: qwen3-32b-official +meta_class: 'agentuniverse.llm.default.qwen_openai_style_llm.QWenOpenAIStyleLLM' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_4b.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_4b.yaml new file mode 100644 index 00000000..7a7fb0f6 --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_4b.yaml @@ -0,0 +1,9 @@ +name: 'qwen3-4b' +description: 'qwen3-4b' +model_name: 'qwen3-4b' +temperature: 0.5 +max_tokens: 8192 +max_context_length: 131072 +streaming: True +channel: qwen3-4b-official +meta_class: 'agentuniverse.llm.default.qwen_openai_style_llm.QWenOpenAIStyleLLM' \ No newline at end of file diff --git a/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_8b.yaml b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_8b.yaml new file mode 100644 index 00000000..42c9e8f3 --- /dev/null +++ b/examples/sample_standard_app/intelligence/agentic/llm/buildin/qwen/qwen3/qwen3_8b.yaml @@ -0,0 +1,9 @@ +name: 'qwen3-8b' +description: 'qwen3-8b' +model_name: 'qwen3-8b' +temperature: 0.5 +max_tokens: 8192 +max_context_length: 131072 +streaming: True +channel: qwen3-8b-official +meta_class: 'agentuniverse.llm.default.qwen_openai_style_llm.QWenOpenAIStyleLLM' \ No newline at end of file