Serving & Models
Monitor model serving endpoints and send inference requests.
Example prompts
Section titled “Example prompts”“Is my agent-endpoint-v2 serving endpoint ready?”
“List all serving endpoints in my workspace”
“Send a test query to my model endpoint with this input”
manage_serving_endpoint
Section titled “manage_serving_endpoint”Description: Manage Model Serving endpoints: get status, list, query.
Parameters:
| Parameter | Type | Required | Description |
|---|---|---|---|
action | str | Yes | — |
name | Optional[str] | No | — |
messages | Optional[List[Dict[str, str]]] | No | — |
inputs | Optional[Dict[str, Any]] | No | — |
dataframe_records | Optional[List[Dict[str, Any]]] | No | — |
max_tokens | Optional[int] | No | — |
temperature | Optional[float] | No | — |
limit | int | No | — |