3_1_2_WenXin_LLM_Use.md

WenXin Usage

1. Create the relevant file.

Create a YAML file, for example, user_wenxin.yaml Paste the following content into your user_wenxin.yaml file.

name: 'user_wenxin_llm'
description: 'user wenxin llm with spi'
model_name: 'ERNIE-3.5-8K'
max_tokens: 1000
streaming: true
metadata:
  type: 'LLM'
  module: 'agentuniverse.llm.default.wenxin_llm'
  class: 'WenXinLLM'

2. Environment Setup

Must be configured: QIANFAN_AK、QIANFAN_SK

2.1 Configure through Python code

import os
os.environ['QIANFAN_AK'] = '*****'
os.environ['QIANFAN_SK'] = 'xxxxx'

2.2 Configure through the configuration file

In the custom_key.toml file under the config directory of the project, add the configuration:

QIANFAN_AK="sk-******"
QIANFAN_SK="https://xxxxxx"

3. Obtaining the WenXin API KEY

Reference QianFan Official Documentation: https://cloud.baidu.com/doc/WENXINWORKSHOP/s/Dlkm79mnx

4. Tips

In agentuniverse, we have already created an llm with the name default_wenxin_llm. After configuring the QIANFAN_AK、QIANFAN_SK, users can directly use it.