Elastic Deployment

Create Endpoint

post

Create a new endpoint

Authorizations

Authorizationx-api-key

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Body

application/json

Elastic Endpoint Create Request v2

namestring · min: 1Required

Deployment name

Pattern: ^(?=[A-Za-z])[A-Za-z0-9@._-]{1,20}$

imageRegistrystring · max: 255Optional

Docker registry URL

imagestring · min: 1 · max: 255Required

Docker image name

Example: vllm/vllm-openai:latest

minSingleCardVramInGbinteger · int32 · max: 1536Optional

Minimum GPU single card VRAM in GB

minSingleCardVcpuinteger · int32Optional

Minimum GPU single card vCPU count

minSingleCardRamInGbinteger · int32 · max: 1536Optional

Minimum GPU single card RAM in GB

workersinteger · int32 · min: 1Required

Number of workers

credentialIdinteger · int64Optional

Credential ID

containerVolumeInGbinteger · int32 · min: 20Required

Container volume in GB

initializationCommandstringOptional

Initialization command

serviceModestring · min: 1Required

Service mode: ALB, QUEUE, CUSTOM

Example: QUEUE

webhookstring · max: 512Optional

Webhook URL for receiving task results

Pattern: ^https?://.*

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Endpoint created successfully

*/*

10001

Invalid request parameters

*/*

post

/v2/serverless

HTTPcURLJavaScriptPython

POST /v2/serverless HTTP/1.1
Host: api.yottalabs.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Content-Type: application/json
Accept: */*
Content-Length: 410

{
  "name": "text",
  "imageRegistry": "text",
  "image": "vllm/vllm-openai:latest",
  "resources": [
    {
      "region": "text",
      "gpuType": "text",
      "gpuCount": 1
    }
  ],
  "minSingleCardVramInGb": 1,
  "minSingleCardVcpu": 1,
  "minSingleCardRamInGb": 1,
  "workers": 1,
  "credentialId": 1,
  "containerVolumeInGb": 1,
  "initializationCommand": "text",
  "envVars": [
    {
      "key": "text",
      "value": "text"
    }
  ],
  "expose": {
    "port": 1,
    "protocol": "http"
  },
  "serviceMode": "QUEUE",
  "webhook": "text"
}

{
  "message": "text",
  "code": 1,
  "data": null
}

Submit Task

post

Submit a task to a QUEUE-mode endpoint

Authorizations

Authorizationx-api-key

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Path parameters

idinteger · int64Required

Body

application/json

Elastic Endpoint Submit Task Request v2

taskIdstring · max: 255Optional

User-defined task ID. Auto-generated UUID if omitted

Pattern: ^[A-Za-z0-9_]*$

inputanyRequired

Task input data

workerPortinteger · int32 · min: 1 · max: 65535Required

Worker port (1-65535)

Example: 8000

processUristring · max: 255Required

Process URI on the worker

Example: /v1/chat/completions

webhookstring · max: 512Optional

Webhook URL for result delivery

Pattern: ^https?://.*

webhookAuthKeystring · max: 255Optional

Webhook authentication key

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Task submitted successfully

*/*

10001

Invalid request or non-QUEUE endpoint

*/*

14000

Endpoint not found

*/*

24000

Serverless unavailable

*/*

24001

Serverless does not exist

*/*

post

/v2/serverless/{id}/tasks

HTTPcURLJavaScriptPython

POST /v2/serverless/{id}/tasks HTTP/1.1
Host: api.yottalabs.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Content-Type: application/json
Accept: */*
Content-Length: 170

{
  "taskId": "text",
  "input": null,
  "workerPort": 8000,
  "processUri": "/v1/chat/completions",
  "webhook": "text",
  "webhookAuthKey": "text",
  "headers": {
    "ANY_ADDITIONAL_PROPERTY": "text"
  }
}

{
  "message": "text",
  "code": 1,
  "data": null
}

Start Endpoint

post

Start or resume a stopped endpoint

Authorizations

Authorizationx-api-key

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Path parameters

idinteger · int64Required

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Endpoint started

*/*

14000

Endpoint not found

*/*

post

/v2/serverless/{id}/start

HTTPcURLJavaScriptPython

POST /v2/serverless/{id}/start HTTP/1.1
Host: api.yottalabs.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

Stop Endpoint

post

Stop a running endpoint

Authorizations

Authorizationx-api-key

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Path parameters

idinteger · int64Required

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Endpoint stopped

*/*

14000

Endpoint not found

*/*

post

/v2/serverless/{id}/stop

HTTPcURLJavaScriptPython

POST /v2/serverless/{id}/stop HTTP/1.1
Host: api.yottalabs.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

Scale Workers

put

Scale the number of workers for an endpoint

Authorizations

Authorizationx-api-key

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Path parameters

idinteger · int64Required

Query parameters

countinteger · int32Required

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Workers scaled

*/*

14000

Endpoint not found

*/*

put

/v2/serverless/{id}/workers

HTTPcURLJavaScriptPython

PUT /v2/serverless/{id}/workers?count=1 HTTP/1.1
Host: api.yottalabs.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

Update Endpoint

patch

Update a specific endpoint

Authorizations

Authorizationx-api-key

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Path parameters

idinteger · int64Required

Body

application/json

Elastic Endpoint Update Request v2

namestring · min: 1Required

Deployment name

Pattern: ^(?=[A-Za-z])[A-Za-z0-9@._-]{1,20}$

minSingleCardVramInGbinteger · int32Optional

Minimum GPU single card VRAM in GB

minSingleCardVcpuinteger · int32Optional

Minimum GPU single card vCPU count

minSingleCardRamInGbinteger · int32Optional

Minimum GPU single card RAM in GB

workersinteger · int32 · min: 1Required

Number of workers

credentialIdinteger · int64Optional

Credential ID

containerVolumeInGbinteger · int32 · min: 20Required

Container volume in GB

initializationCommandstringOptional

Initialization command

webhookstring · max: 512Optional

Webhook URL for receiving task results

Pattern: ^https?://.*

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Endpoint updated successfully

*/*

14000

Endpoint not found

*/*

patch

/v2/serverless/{id}

HTTPcURLJavaScriptPython

PATCH /v2/serverless/{id} HTTP/1.1
Host: api.yottalabs.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Content-Type: application/json
Accept: */*
Content-Length: 331

{
  "name": "text",
  "resources": [
    {
      "region": "text",
      "gpuType": "text",
      "gpuCount": 1
    }
  ],
  "minSingleCardVramInGb": 1,
  "minSingleCardVcpu": 1,
  "minSingleCardRamInGb": 1,
  "workers": 1,
  "credentialId": 1,
  "containerVolumeInGb": 1,
  "initializationCommand": "text",
  "envVars": [
    {
      "key": "text",
      "value": "text"
    }
  ],
  "expose": {
    "port": 1,
    "protocol": "http"
  },
  "webhook": "text"
}

{
  "message": "text",
  "code": 1,
  "data": null
}

Delete Endpoint

delete

Delete an endpoint

Authorizations

Authorizationx-api-key

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Path parameters

idinteger · int64Required

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Endpoint deleted

*/*

14000

Endpoint not found

*/*

delete

/v2/serverless/{id}

HTTPcURLJavaScriptPython

DELETE /v2/serverless/{id} HTTP/1.1
Host: api.yottalabs.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

List Endpoints

get

Get all elastic endpoints

Authorizations

Authorizationx-api-key

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Query parameters

statusListstring[]Optional

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Success

*/*

get

/v2/serverless

HTTPcURLJavaScriptPython

GET /v2/serverless HTTP/1.1
Host: api.yottalabs.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

Get Endpoint

get

Get details of a specific endpoint

Authorizations

Authorizationx-api-key

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Path parameters

idinteger · int64Required

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Endpoint found

*/*

14000

Endpoint not found

*/*

get

/v2/serverless/{id}

HTTPcURLJavaScriptPython

GET /v2/serverless/{id} HTTP/1.1
Host: api.yottalabs.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

Get Task

get

Get details of a specific task

Authorizations

Authorizationx-api-key

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Path parameters

idinteger · int64Required

taskIdstringRequired

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Task found

*/*

14000

Endpoint not found

*/*

24000

Serverless unavailable

*/*

24011

Task does not exist

*/*

get

/v2/serverless/{id}/tasks/{taskId}

HTTPcURLJavaScriptPython

GET /v2/serverless/{id}/tasks/{taskId} HTTP/1.1
Host: api.yottalabs.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

Get Task Count

get

Get task statistics grouped by status

Authorizations

Authorizationx-api-key

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Path parameters

idinteger · int64Required

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Success

*/*

14000

Endpoint not found

*/*

24000

Serverless unavailable

*/*

24001

Serverless does not exist

*/*

get

/v2/serverless/{id}/tasks/count

HTTPcURLJavaScriptPython

GET /v2/serverless/{id}/tasks/count HTTP/1.1
Host: api.yottalabs.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

List Workers

get

Get all workers of an endpoint

Authorizations

Authorizationx-api-key

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Path parameters

idinteger · int64Required

Query parameters

statusListstring[]Optional

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Success

*/*

get

/v2/serverless/{id}/workers

HTTPcURLJavaScriptPython

GET /v2/serverless/{id}/workers HTTP/1.1
Host: api.yottalabs.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

Get GPU resource list V2

post

Get GPU resource list with supply capacity

Authorizations

Authorizationx-api-key

AuthorizationstringRequired

Bearer authentication header of the form Bearer <token>.

Body

application/json

ResourceGpuListSearchRequest

queryTypeinteger · int32Optional

Query Type (1:Single,2:Multiple)

Default: 2:Multiple

regionsstring[]Optional

Regions

gpuTypesstring[]Optional

GPU Types

minSingleCardVraminteger · int32 · max: 1536Required

Min single card vram unit: GB

maxSingleCardVraminteger · int32 · max: 1536Required

Max single card vram unit: GB

minSingleCardRaminteger · int32 · max: 1536Optional

Min single card ram unit: GB

maxSingleCardRaminteger · int32 · max: 1536Optional

Max single card ram unit: GB

podModelTypeinteger · int32Optional

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

400

Bad Request

*/*

500

Internal Server Error

*/*

post

/api/v2/resource/gpu/list

HTTPcURLJavaScriptPython

POST /api/v2/resource/gpu/list HTTP/1.1
Host: api.yottalabs.ai
Authorization: Bearer YOUR_SECRET_TOKEN
Content-Type: application/json
Accept: */*
Content-Length: 168

{
  "queryType": "2:Multiple",
  "regions": [
    "text"
  ],
  "gpuTypes": [
    "text"
  ],
  "minSingleCardVram": 1,
  "maxSingleCardVram": 1,
  "minSingleCardRam": 1,
  "maxSingleCardRam": 1,
  "podModelType": 1
}

{
  "message": "text",
  "code": 1,
  "data": [
    {
      "gpuType": "text",
      "gpuDisplayName": "text",
      "region": "text",
      "regionDisplayName": "text",
      "supplyCapacity": 1,
      "singleCardVram": 1,
      "singleCardRam": 1,
      "singleCardVcpu": 1,
      "singleCardPrice": 1,
      "singleCardContainerVolumeLimit": 1,
      "persistentVolumeLimit": 1,
      "persistentVolumePrice": 1,
      "containerVolumePrice": 1,
      "storageType": "text",
      "ramType": "text",
      "status": 1
    }
  ]
}