Serverless

Create Endpoint

post

Create a new endpoint

Authorizations

x-api-key

x-api-keystringRequired

Body

application/json

Elastic Endpoint Create Request v2

namestring · min: 1Required

Deployment name

Pattern: ^(?=[A-Za-z])[A-Za-z0-9@._-]{1,20}$

imageRegistrystring · max: 255Optional

Docker registry URL

imagestring · min: 1 · max: 255Required

Docker image name

Example: vllm/vllm-openai:latest

minSingleCardVramInGbinteger · int32 · max: 1536Optional

Minimum GPU single card VRAM in GB

minSingleCardVcpuinteger · int32Optional

Minimum GPU single card vCPU count

minSingleCardRamInGbinteger · int32 · max: 1536Optional

Minimum GPU single card RAM in GB

workersinteger · int32 · min: 1Required

Number of workers

credentialIdinteger · int64Optional

Credential ID

containerVolumeInGbinteger · int32 · min: 20Required

Container volume in GB

initializationCommandstringOptional

Initialization command

serviceModestring · min: 1Required

Service mode: ALB, QUEUE, CUSTOM

Example: QUEUE

webhookstring · max: 512Optional

Webhook URL for receiving task results

Pattern: ^https?://.*

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Endpoint created successfully

*/*

10001

Invalid request parameters

*/*

post

/v2/serverless

HTTPcURLJavaScriptPython

POST /v2/serverless HTTP/1.1
Host: api.yottalabs.ai
x-api-key: YOUR_API_KEY
Content-Type: application/json
Accept: */*
Content-Length: 410

{
  "name": "text",
  "imageRegistry": "text",
  "image": "vllm/vllm-openai:latest",
  "resources": [
    {
      "region": "text",
      "gpuType": "text",
      "gpuCount": 1
    }
  ],
  "minSingleCardVramInGb": 1,
  "minSingleCardVcpu": 1,
  "minSingleCardRamInGb": 1,
  "workers": 1,
  "credentialId": 1,
  "containerVolumeInGb": 1,
  "initializationCommand": "text",
  "envVars": [
    {
      "key": "text",
      "value": "text"
    }
  ],
  "expose": {
    "port": 1,
    "protocol": "http"
  },
  "serviceMode": "QUEUE",
  "webhook": "text"
}

{
  "message": "text",
  "code": 1,
  "data": null
}

Submit Task

post

Submit a task to a QUEUE-mode endpoint

Authorizations

x-api-key

x-api-keystringRequired

Path parameters

idinteger · int64Required

Body

application/json

Elastic Endpoint Submit Task Request v2

taskIdstring · max: 255Optional

User-defined task ID. Auto-generated UUID if omitted

Pattern: ^[A-Za-z0-9_]*$

inputanyRequired

Task input data

workerPortinteger · int32 · min: 1 · max: 65535Required

Worker port (1-65535)

Example: 8000

processUristring · max: 255Required

Process URI on the worker

Example: /v1/chat/completions

webhookstring · max: 512Optional

Webhook URL for result delivery

Pattern: ^https?://.*

webhookAuthKeystring · max: 255Optional

Webhook authentication key

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Task submitted successfully

*/*

10001

Invalid request or non-QUEUE endpoint

*/*

14000

Endpoint not found

*/*

24000

Serverless unavailable

*/*

24001

Serverless does not exist

*/*

post

/v2/serverless/{id}/tasks

HTTPcURLJavaScriptPython

POST /v2/serverless/{id}/tasks HTTP/1.1
Host: api.yottalabs.ai
x-api-key: YOUR_API_KEY
Content-Type: application/json
Accept: */*
Content-Length: 170

{
  "taskId": "text",
  "input": null,
  "workerPort": 8000,
  "processUri": "/v1/chat/completions",
  "webhook": "text",
  "webhookAuthKey": "text",
  "headers": {
    "ANY_ADDITIONAL_PROPERTY": "text"
  }
}

{
  "message": "text",
  "code": 1,
  "data": null
}

Start Endpoint

post

Start or resume a stopped endpoint

Authorizations

x-api-key

x-api-keystringRequired

Path parameters

idinteger · int64Required

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Endpoint started

*/*

14000

Endpoint not found

*/*

post

/v2/serverless/{id}/start

HTTPcURLJavaScriptPython

POST /v2/serverless/{id}/start HTTP/1.1
Host: api.yottalabs.ai
x-api-key: YOUR_API_KEY
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

Stop Endpoint

post

Stop a running endpoint

Authorizations

x-api-key

x-api-keystringRequired

Path parameters

idinteger · int64Required

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Endpoint stopped

*/*

14000

Endpoint not found

*/*

post

/v2/serverless/{id}/stop

HTTPcURLJavaScriptPython

POST /v2/serverless/{id}/stop HTTP/1.1
Host: api.yottalabs.ai
x-api-key: YOUR_API_KEY
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

Delete Endpoint

delete

Delete an endpoint

Authorizations

x-api-key

x-api-keystringRequired

Path parameters

idinteger · int64Required

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Endpoint deleted

*/*

14000

Endpoint not found

*/*

delete

/v2/serverless/{id}

HTTPcURLJavaScriptPython

DELETE /v2/serverless/{id} HTTP/1.1
Host: api.yottalabs.ai
x-api-key: YOUR_API_KEY
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

Get Endpoint

get

Get details of a specific endpoint

Authorizations

x-api-key

x-api-keystringRequired

Path parameters

idinteger · int64Required

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Endpoint found

*/*

14000

Endpoint not found

*/*

get

/v2/serverless/{id}

HTTPcURLJavaScriptPython

GET /v2/serverless/{id} HTTP/1.1
Host: api.yottalabs.ai
x-api-key: YOUR_API_KEY
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

List Tasks

get

Get all tasks of a QUEUE-mode endpoint

Authorizations

x-api-key

x-api-keystringRequired

Path parameters

idinteger · int64Required

Query parameters

statusstringOptional

Filter by status: PROCESSING, DELIVERED, SUCCESS, FAILED

pageNumberinteger · int32OptionalDefault: 1

pageSizeinteger · int32OptionalDefault: 10

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Success

*/*

14000

Endpoint not found

*/*

24000

Serverless unavailable

*/*

24001

Serverless does not exist

*/*

get

/v2/serverless/{id}/tasks

HTTPcURLJavaScriptPython

GET /v2/serverless/{id}/tasks HTTP/1.1
Host: api.yottalabs.ai
x-api-key: YOUR_API_KEY
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

List Endpoints

get

Get all elastic endpoints

Authorizations

x-api-key

x-api-keystringRequired

Query parameters

statusListstring[]Optional

Responses

200

Success, returns list of endpoints

*/*

messagestringOptional

message

codeinteger · int32Optional

code

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Success

*/*

get

/v2/serverless

HTTPcURLJavaScriptPython

GET /v2/serverless HTTP/1.1
Host: api.yottalabs.ai
x-api-key: YOUR_API_KEY
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": [
    {
      "id": 1,
      "name": "text",
      "creator": "text",
      "domain": "text",
      "imageRegistry": "text",
      "image": "text",
      "resources": [
        {
          "region": "text",
          "regionDisplayName": "text",
          "gpuType": "text",
          "gpuDisplayName": "text",
          "gpuCount": 1,
          "singleCardVramInGb": 1,
          "singleCardVcpu": 1,
          "singleCardRamInGb": 1
        }
      ],
      "minSingleCardVramInGb": 1,
      "minSingleCardVcpu": 1,
      "minSingleCardRamInGb": 1,
      "credentialId": 1,
      "containerVolumeInGb": 1,
      "initializationCommand": "text",
      "environmentVars": [
        {
          "key": "text",
          "value": "text"
        }
      ],
      "expose": {
        "port": 1,
        "protocol": "text"
      },
      "totalWorkers": 1,
      "runningWorkers": 1,
      "cost": 1,
      "perSecondPrice": 1,
      "perHourPrice": 1,
      "serviceMode": "ALB",
      "webhook": "text",
      "status": "INITIALIZING"
    }
  ]
}

Scale Workers

put

Scale the number of workers for an endpoint

Authorizations

x-api-key

x-api-keystringRequired

Path parameters

idinteger · int64Required

Query parameters

countinteger · int32Required

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Workers scaled

*/*

14000

Endpoint not found

*/*

put

/v2/serverless/{id}/workers

HTTPcURLJavaScriptPython

PUT /v2/serverless/{id}/workers?count=1 HTTP/1.1
Host: api.yottalabs.ai
x-api-key: YOUR_API_KEY
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

Get Task

get

Get details of a specific task

Authorizations

x-api-key

x-api-keystringRequired

Path parameters

idinteger · int64Required

taskIdstringRequired

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Task found

*/*

14000

Endpoint not found

*/*

24000

Serverless unavailable

*/*

24011

Task does not exist

*/*

get

/v2/serverless/{id}/tasks/{taskId}

HTTPcURLJavaScriptPython

GET /v2/serverless/{id}/tasks/{taskId} HTTP/1.1
Host: api.yottalabs.ai
x-api-key: YOUR_API_KEY
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}

Update Endpoint

patch

Update a specific endpoint

Authorizations

x-api-key

x-api-keystringRequired

Path parameters

idinteger · int64Required

Body

application/json

Elastic Endpoint Update Request v2

namestring · min: 1Required

Deployment name

Pattern: ^(?=[A-Za-z])[A-Za-z0-9@._-]{1,20}$

minSingleCardVramInGbinteger · int32Optional

Minimum GPU single card VRAM in GB

minSingleCardVcpuinteger · int32Optional

Minimum GPU single card vCPU count

minSingleCardRamInGbinteger · int32Optional

Minimum GPU single card RAM in GB

workersinteger · int32 · min: 1Required

Number of workers

credentialIdinteger · int64Optional

Credential ID

containerVolumeInGbinteger · int32 · min: 20Required

Container volume in GB

initializationCommandstringOptional

Initialization command

webhookstring · max: 512Optional

Webhook URL for receiving task results

Pattern: ^https?://.*

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Endpoint updated successfully

*/*

14000

Endpoint not found

*/*

patch

/v2/serverless/{id}

HTTPcURLJavaScriptPython

PATCH /v2/serverless/{id} HTTP/1.1
Host: api.yottalabs.ai
x-api-key: YOUR_API_KEY
Content-Type: application/json
Accept: */*
Content-Length: 331

{
  "name": "text",
  "resources": [
    {
      "region": "text",
      "gpuType": "text",
      "gpuCount": 1
    }
  ],
  "minSingleCardVramInGb": 1,
  "minSingleCardVcpu": 1,
  "minSingleCardRamInGb": 1,
  "workers": 1,
  "credentialId": 1,
  "containerVolumeInGb": 1,
  "initializationCommand": "text",
  "envVars": [
    {
      "key": "text",
      "value": "text"
    }
  ],
  "expose": {
    "port": 1,
    "protocol": "http"
  },
  "webhook": "text"
}

{
  "message": "text",
  "code": 1,
  "data": null
}

Get Task Count

get

Get task statistics grouped by status

Authorizations

x-api-key

x-api-keystringRequired

Path parameters

idinteger · int64Required

Responses

200

OK

*/*

messagestringOptional

message

codeinteger · int32Optional

code

dataanyOptional

data

400

Bad Request

*/*

500

Internal Server Error

*/*

10000

Success

*/*

14000

Endpoint not found

*/*

24000

Serverless unavailable

*/*

24001

Serverless does not exist

*/*

get

/v2/serverless/{id}/tasks/count

HTTPcURLJavaScriptPython

GET /v2/serverless/{id}/tasks/count HTTP/1.1
Host: api.yottalabs.ai
x-api-key: YOUR_API_KEY
Accept: */*

{
  "message": "text",
  "code": 1,
  "data": null
}