Server
Deployments, inspect
Deployments, create & lifecycle
Deployments, schedules & auto-recovery
Deploy options
deploy_base_model takes these options on top of the model and serving settings:
The model name must be a Hugging Face repository id in
owner/name form. Anything
else is refused before a GPU is rented. See
Model names.
Fine-tuning, jobs
Eval checks
create_fine_tuning_job takes eval_checks: up to 10 checks to score the
held-back answers with, one per kind, each with an optional target (0 to 100, the
lowest share of answers in percent that must pass). Call
suggest_eval_checks(dataset_id) for the checks that fit a dataset, then pass the
ones you want without their label and suggested fields.
progress.eval.checks on the job gives each check’s share of
passing answers for the base model and the fine-tune, its target, and whether the
target was met, with targets_met and targets_total. See
Checks.
Fine-tuning, outputs
Datasets
GPU availability
Logs
All log tools return GPU-workload and deployment output, not Valkyrie’s own internal application logs.Paging through persisted logs
get_persisted_logs returns stored logs one bounded page at a time, so large log
histories don’t time out your client:
- Each page holds up to 10 log entries, newest first. Valkyrie truncates long entry text, so a single page stays small.
- The response includes
next_before_id. Pass it back asbefore_idto fetch the next, older page. Repeat until you reach the entries you need. - To jump straight to an earlier incident, pass
collected_beforewith a UTC ISO-8601 timestamp that includes a timezone, such as2026-09-20T14:00:00Z. Valkyrie returns only entries collected before that time. A timestamp without a timezone returns an error. tail_lineslimits the lines incombined_logsfor the page, up to 500.
"before_id": <next_before_id> from the previous response.
get_deployment_logs returns stored logs directly for a deployment whose instance
is stopped or terminated. It doesn’t try a live fetch from the instance.
These responses have "source": "persisted" and contain the most recent page of
stored entries. Use get_persisted_logs with deployment_id to page further back.
Aliases
An alias is a stable URL,/{account_slug}/{alias}/v1, that points at a deployment
or an inference pool. See Aliases.
A pool alias answers only account-wide API keys. See
Point an alias at an inference pool.
Inference pools
A pool puts several deployments of the same model behind one endpoint (/inference-pools/{pool}/v1, or an alias that points at the pool).
Valkyrie routes each request to a healthy member
with a free request slot and queues it when every slot is busy.
A pool is managed when it has a member template and a desired_size. Valkyrie
then deploys members from the template (billed like any deployment), replaces
members it loses, and drains and removes extra ones when you lower the size. A pool
without a template never provisions or tears down deployments: you add and remove
existing deployments yourself.
Managed pools are switched on per environment. Where they aren’t on yet, a
managed pool keeps its template and sizes but deploys nothing, and behaves like a
pool without a template. Contact support if a managed pool’s members don’t appear.
Each member’s request slots come from its runtime configuration unless you set
slot_capacity_override.