Skip to content

The whole routing chain for this world

GET
/api/v1/config/router
curl --request GET \
--url http://localhost:11044/api/v1/config/router \
--header 'X-Embabel-Api-Key: <X-Embabel-Api-Key>'

Each context with the role or model it uses and the model that resolves; every role with its deployment and world model and the contexts that use it; the chat models available; and the deployment’s own model settings, which no world can change yet.

The chain, resolved

Media type*/*

The whole model-routing chain of the signed-in user’s world, resolved: contexts, roles, the models available, and the deployment’s own model settings. Answered by GET /config/router

object
contexts
required

Every context, with the role or model it uses and the model that resolves

Array<object>

One context, a job this world uses a model for, with the role or model it is set to and the model that answers it. Part of GET /config/router

object
deploymentModel

The model the deployment’s default for this context names; null when that default selects by role, or there is no default

string
deploymentRole

The role the deployment’s default for this context selects by; null when that default names a model, or there is no default (the planner, which follows chat, or a context the deployment leaves unset)

string
followsChat
required

True for the planner when it has no role or model of its own, so it runs on whatever chat runs on, through chat’s role; false for every other context

boolean
id
required

The context: chat, plannerLlm, codingLlm, fallbackCodingLlm, rankerLlm or lensLlm; the {id} in PUT /config/router/contexts/{id}

string
model

The model this world pinned the context to; null when it pinned none

string
resolved

The model it runs on now; null when nothing can serve it, or when the context names no model at all (a fallback coder with neither a setting nor a default)

object
local
required

True when its provider runs locally: LM Studio, Ollama or Docker

boolean
name
required

The model’s name, as the appliance’s model provider knows it

string
provider

Who serves it, as the model provider names it (for example LM Studio); null when the model is not among those the provider lists

string
role

The role this world chose for the context; null when it chose none

string
roleInUse

The role the context reaches its model through, from this world’s setting or else the deployment’s default; null when it reaches a model without one

string
deploymentUses
required

Model settings the deployment makes that no world can change yet

Array<object>

A model setting the deployment makes under assistant.infrastructure, which no world can change yet; listed in GET /config/router as deploymentUses

object
model

The model it names; null when it selects by role rather than by name

string
role

The LLM role it selects its model through; null when it does not select by role

string
setting
required

Where it is configured: the property path under assistant.infrastructure, by Kotlin property name (camelCase)

string
models
required

The language models the appliance can serve, local ones first, then by name

Array<object>

A model as the router resolves it: its name, who serves it, and whether it runs on this machine

object
local
required

True when its provider runs locally: LM Studio, Ollama or Docker

boolean
name
required

The model’s name, as the appliance’s model provider knows it

string
provider

Who serves it, as the model provider names it (for example LM Studio); null when the model is not among those the provider lists

string
roles
required

Standard roles first, then the deployment’s, then this world’s custom roles

Array<object>

One LLM role, standard, mapped by the deployment, or added by this world, with the model it resolves to and the contexts that use it. Part of GET /config/router

object
custom
required

True for a role this world added, the only kind that can be deleted

boolean
deploymentModel

The model the deployment maps this role to in embabel.models.llms; null when it maps none

string
description

What the role is for; null for a role only the deployment declares, which carries no description

string
group

Where a standard role is shown: GENERAL or VIRTUAL_CYPHER; null for deployment and custom roles

string
id
required

The role’s id, such as chat_best or vc_execution

string
resolved

The model the role reaches now: this world’s choice when it made one, else what the platform selects for the role; null when nothing can serve it

object
local
required

True when its provider runs locally: LM Studio, Ollama or Docker

boolean
name
required

The model’s name, as the appliance’s model provider knows it

string
provider

Who serves it, as the model provider names it (for example LM Studio); null when the model is not among those the provider lists

string
usedBy
required

Ids of the contexts that reach their model through this role

Array<string>
worldModel

The model this world chose for the role, overriding the deployment’s; null when it chose none

string