
The Playground: a conversation with an endpoint, with a system prompt set on the right.
Chat with an endpoint
1
Pick an endpoint
Choose one of your running endpoints in the Endpoint card. Base-model
endpoints are marked (base). Open endpoint takes you to its page.
2
Adjust the settings (optional)
Add a System prompt with instructions for every reply, and set the
Temperature and Max tokens.
3
Send a message
Type a message and press Enter to send it. Shift+Enter adds a new line.
Click Clear to start over.
Compare side by side
Click Compare side by side to send every message to two endpoints at once, with the same settings, and read the answers in two columns. Each answer shows how long the model took, for example Answered in 1.8 s, so you can compare speed as well as quality. What you compare against, under Compare with:- This endpoint, without fine-tuning. The default for a fine-tuned version served as a LoRA adapter on vLLM. The same endpoint answers with the adapter switched off, so you see what fine-tuning changed without deploying the base model on a second GPU.
- Another endpoint. For a base model, or a fine-tune served as merged weights, Valkyrie picks a running endpoint of the same base model for you. You can choose any other endpoint from the list. If none is running, deploy the base model first.
Messages you send here are real requests to your endpoints, so they must be
running. In compare mode both answers are billed like any request, including the
one without fine-tuning. The adapter-off answer is a Playground feature: it isn’t
available for fine-tunes served as merged weights or through the
OpenAI-compatible API.