Skip to content
mistral.rs

load_lora_adapter

POST
/v1/load_lora_adapter
 
curl --request POST \
  --url https://example.com/v1/load_lora_adapter \
  --header 'Content-Type: application/json' \
  --data '{ "lora_name": "production", "lora_path": "/srv/adapters/production" }'

Registered only when runtime LoRA mutation is enabled. CLI servers enable it with MISTRALRS_ALLOW_RUNTIME_LORA_UPDATING.

Request Body required

Section titled “Request Body required ”
Media type application/json
object
expected_generation

Replace only if the alias still points at this generation.

string | null
load_inplace

Atomically replace an existing alias. Defaults to false, matching vLLM.

boolean
lora_name
required

Request-facing adapter alias.

string
lora_path
required

Local server filesystem directory containing PEFT safetensors files.

string
model
string | null
Example 
{
  "lora_name": "production",
  "lora_path": "/srv/adapters/production"
}

Responses

Section titled “ Responses ”

200

Section titled “200 ”

LoRA adapter loaded

Media type application/json
object
bytes
required
integer format: int64
generation
required
string
id
required
string
object
required
string
rank
required
integer
revision
string | null
source
string | null
Example generated
{
  "bytes": 1,
  "generation": "example",
  "id": "example",
  "object": "example",
  "rank": 1,
  "revision": "example",
  "source": "example"
}

400

Section titled “400 ”

Invalid request

Media type application/json
object
error
required
object
code
required
string
message
required
string
type
required
string
Example generated
{
  "error": {
    "code": "example",
    "message": "example",
    "type": "example"
  }
}

403

Section titled “403 ”

Adapter path is not allowed

Media type application/json
object
error
required
object
code
required
string
message
required
string
type
required
string
Example generated
{
  "error": {
    "code": "example",
    "message": "example",
    "type": "example"
  }
}

404

Section titled “404 ”

Model or adapter path was not found

Media type application/json
object
error
required
object
code
required
string
message
required
string
type
required
string
Example generated
{
  "error": {
    "code": "example",
    "message": "example",
    "type": "example"
  }
}

409

Section titled “409 ”

LoRA runtime is unavailable or at capacity

Media type application/json
object
error
required
object
code
required
string
message
required
string
type
required
string
Example generated
{
  "error": {
    "code": "example",
    "message": "example",
    "type": "example"
  }
}

413

Section titled “413 ”

Adapter input files exceed the configured safety limit

Media type application/json
object
error
required
object
code
required
string
message
required
string
type
required
string
Example generated
{
  "error": {
    "code": "example",
    "message": "example",
    "type": "example"
  }
}

415

Section titled “415 ”

Request content type is not JSON

Media type application/json
object
error
required
object
code
required
string
message
required
string
type
required
string
Example generated
{
  "error": {
    "code": "example",
    "message": "example",
    "type": "example"
  }
}

422

Section titled “422 ”

Adapter files are invalid or unsupported

Media type application/json
object
error
required
object
code
required
string
message
required
string
type
required
string
Example generated
{
  "error": {
    "code": "example",
    "message": "example",
    "type": "example"
  }
}

429

Section titled “429 ”

Another adapter load is already in progress

Media type application/json
object
error
required
object
code
required
string
message
required
string
type
required
string
Example generated
{
  "error": {
    "code": "example",
    "message": "example",
    "type": "example"
  }
}

500

Section titled “500 ”

Adapter loading task failed

Media type application/json
object
error
required
object
code
required
string
message
required
string
type
required
string
Example generated
{
  "error": {
    "code": "example",
    "message": "example",
    "type": "example"
  }
}

503

Section titled “503 ”

Adapter storage or model device is unavailable

Media type application/json
object
error
required
object
code
required
string
message
required
string
type
required
string
Example generated
{
  "error": {
    "code": "example",
    "message": "example",
    "type": "example"
  }
}