Conversation API reference

Detailed documentation on the conversation API

Alpha

The conversation API is currently in alpha.

Dapr provides an API to interact with Large Language Models (LLMs) and enables critical performance and security functionality with features like prompt caching and PII data obfuscation.

Converse

This endpoint lets you converse with LLMs.

POST /v1.0-alpha1/conversation/<llm-name>/converse

URL parameters

Parameter	Description
`llm-name`	The name of the LLM component. See a list of all available conversation components.

Request body

Field	Description
`conversationContext`
`inputs`
`parameters`

Request content

REQUEST = {
  "inputs": ["what is Dapr", "Why use Dapr"],
  "parameters": {},
}

HTTP response codes

Code	Description
`202`	Accepted
`400`	Request was malformed
`500`	Request formatted correctly, error in dapr code or underlying component

Response content

RESPONSE  = {
  "outputs": {
    {
       "result": "Dapr is distribution application runtime ...",
       "parameters": {},
    },
    {
       "result": "Dapr can help developers ...",
       "parameters": {},
    }
  },
}

Next steps

Conversation API overview

Feedback

Was this page helpful?

Glad to hear it! Please tell us how we can improve.

Sorry to hear that. Please tell us how we can improve.

Last modified December 10, 2024: [Conversation API] initial docs setup (#4419) (78f6cb94)