Create Eval Agent
Eval Agents
Create Eval Agent
Create a new eval agent, optionally seeded from a template.
POST
Create Eval Agent
Headers
string
required
Your API key for authentication.
Body Parameters
string
Display name for the eval agent. Between 1 and 200 characters.
string | null
Optional description of what the eval agent grades.
string | null
Key of a shipped template to seed the agent from.
string | null
ID of a saved user template to seed the agent from.
string
The modality for the eval agent. One of
text or audio.template_key and user_template_id are mutually exclusive. If both are provided, user_template_id wins.Response
object
The newly created eval agent.
string
Unique identifier for the eval agent.
string
ID of the organization that owns this eval agent.
string
Unique slug key for the eval agent within the organization.
string
Display name of the eval agent.
string | null
Optional description of what the eval agent grades.
string
ID of the current editable draft version.
string | null
ID of the published version, or
null if never published.object
Key-value metadata associated with the eval agent. Values are strings.
string
ISO 8601 timestamp for when the eval agent was created.
string
ISO 8601 timestamp for when the eval agent was last updated.
string | null
ISO 8601 timestamp if the eval agent has been soft-deleted, otherwise
null.object
The editable draft version created alongside the agent.
string
Unique identifier for this version.
string
ID of the organization that owns this version.
string
ID of the parent eval agent.
integer
Sequential version number.
string
Name of this version.
string | null
Optional description of this version.
string
Always
"editable" for a newly created draft.string
One of
text or audio.string
The system prompt for the judge LLM, in Markdown.
string
The grading prompt for the judge LLM, in Markdown.
array of objects
Verdict levels for graded mode. Empty array for pass/fail mode. Each level contains
level_key, label, prompt_md, and optionally color.array of strings
Which level keys count as a target match. Empty array for pass/fail agents.
number
Relative weight of this agent in aggregate scoring. Between 0 and 100.
string | null
ID of the version this was forked from, or
null if this is the first version.string | null
Identifier of the user who created this version, or
null.string
ISO 8601 timestamp for when this version was created.
string
ISO 8601 timestamp for when this version was last updated.