Asynchronous invocation API

Plugin parameter passing: In your application, select a plugin and then click Publish.

Custom parameter passing This example shows how to query for city cuisine. In the application, create custom parameters in the Start node. Reference the custom parameters in the Prompts of the LLM Node. After testing, Publish the application.

Plugin parameter passing This example uses a tool to query dorm rules. To pass plugin parameters, add a Plug-in Node and select the desired plugin. In the application, create custom parameters in the Start node and pass them to the input parameters of the plugin node. Reference the custom parameters and plugin output parameters in the Prompts of the LLM Node. After testing, Publish the application.

API call

• Custom parameters: Pass parameters using biz_params. The parameter names and types must match those configured in the application.
  Python

  Python

  from openai import AsyncOpenAI
  import asyncio
  import os
  
  # If the environment variable is not configured, replace the following line with your Model Studio API key: api_key="sk-xxx".
  # However, to avoid security risks, we recommend not hard-coding the API key in production code.
  api_key=os.getenv("DASHSCOPE_API_KEY")
  app_id='APP_ID' # Replace with your actual application ID
  base_url = f'https://dashscope.aliyuncs.com/api/v2/apps/agent/{app_id}/compatible-mode/v1/'
  
  # Initialize the asynchronous client
  client = AsyncOpenAI(
    api_key=api_key,
    base_url=base_url
  )
  async def main():
    # Asynchronous call
    response = await client.responses.create(
      input="Hello",
      extra_body={
          "biz_params": {"city": "Beijing"}
      },
      background=True
    )
  
    # Print the complete response JSON object
    print(response.model_dump_json(indent=2))
  
  # Run the asynchronous main function
  if __name__ == "__main__":
    asyncio.run(main())
  

• Plugin parameters: Pass parameters via biz_params. Use user_defined_params to pass plugin parameters and user_defined_tokens to pass authentication tokens. The parameter names and types must match the plugin's configuration.
  Python

  Python

  """
  Example of calling an Alibaba Cloud Model Studio application
  asynchronously.
  """
  from openai import AsyncOpenAI
  import asyncio
  import os
  
  # ==================== Configuration ====================
  
  # API key configuration
  # If the environment variable is not configured, you can replace the following line with: api_key="sk-xxx"
  # To avoid security risks, we recommend not hard-coding the API key in production code.
  api_key = os.getenv("DASHSCOPE_API_KEY")
  
  # Application ID (Get this from Model Studio console -> Applications -> Publish channels -> API)
  app_id = 'YOUR_APP_ID'  # Replace with your actual application ID
  
  # Base URL
  base_url = f'https://dashscope.aliyuncs.com/api/v2/apps/agent/{app_id}/compatible-mode/v1/'
  
  # ==================== Client Initialization ====================
  
  client = AsyncOpenAI(
      api_key=api_key,
      base_url=base_url
  )
  
  # ==================== Business Parameter Configuration (Optional) ====================
  
  # biz_params is used to pass custom parameters to plugins in the application.
  # Replace YOUR_PLUGIN_ID with the actual plugin ID from the plugin details page in the Model Studio console.
  biz_params = {
      # Custom parameters: Parameters passed to a specified plugin.
      "user_defined_params": {
          "YOUR_PLUGIN_ID": {  # Replace with the actual plugin ID
              "article_index": 9   # Custom parameter, set according to the plugin's requirements.
          }
      },
      # Custom tokens: Provide authentication information for the specified plugin. Replace YOUR_TOKEN with a valid authentication token.
      "user_defined_tokens": {
          "YOUR_PLUGIN_ID": {  # Replace with the actual plugin ID
              "user_token": "YOUR_TOKEN" # The authentication token required by the plugin.
          }
      }
  }
  
  # ==================== Main Function ====================
  
  async def main():
      """Call the agent application asynchronously."""
  
      # Make the asynchronous request
      # - input: The user's question or instruction.
      # - extra_body: Additional parameters, including biz_params.
      # - background: true indicates asynchronous execution.
      response = await client.responses.create(
          input="Hello",
          extra_body={
              "biz_params": biz_params
          },
          background=True
      )
  
      # Print the complete response JSON object
      print(response.model_dump_json(indent=2))
  
  # ==================== Program Entry Point ====================
  
  if __name__ == "__main__":
      asyncio.run(main())