Usage
Options
string
template hash (required, but Note: if you use this field, you can skip search_params, as they are automatically inferred from the template)
integer
template id (optional)
boolean
Disable default search param query args
string
launch args string for create instance ex: “—onstart onstart_wget.sh —env ‘-e ONSTART_PATH=https://s3.amazonaws.com/vast.ai/onstart_OOBA.sh’ —image atinoda/text-generation-webui:default-nightly —disk 64”
string
deployment endpoint name (allows multiple workergroups to share same deployment endpoint)
integer
deployment endpoint id (allows multiple workergroups to share same deployment endpoint)
number
estimated GPU RAM req (independent of search string)
string
search param string for search offers ex: “gpu_ram>=23 num_gpus=2 gpu_name=RTX_4090 inet_down>200 direct_port_count>2 disk_space>=64”