Skip to content

Kerbside for OpenStack

Nova's spice-direct console type lets OpenStack users open a native SPICE client, but leaves the proxy that client connects to as someone else's job. Kerbside is that proxy, designed alongside spice-direct, so the console URL Nova returns is a Kerbside URL.

Value proposition

Nova 2025.1 (Epoxy) added the spice-direct console type so that users can open a native SPICE client instead of the HTML5 transcoding proxy. That console type did not arrive independently of Kerbside. The Kerbside developers proposed it to Nova as the upstream half of this deployment, and it was refined and landed with the Nova team through the Nova specification process. What landed is deliberately general: any protocol-aware proxy could answer it. But Kerbside is the proxy it was designed alongside, and the two projects have moved together since.

A native client has to connect to something, and OpenStack is — wisely — unwilling to give a client network a route to TCP ports on a hypervisor. So spice-direct does not hand the user a hypervisor address at all. It hands out a URL built from Nova's [spice] spice_direct_proxy_base_url with a console auth token attached, and in a Kerbside deployment that setting names Kerbside's /nova-console.vv.

Kerbside is therefore not an alternative to Nova's console story. It is the half of it that Nova deliberately left to someone else:

  • Kerbside is the console endpoint, not a bolt-on. The two scraped deployments sit beside a console path the platform already had — oVirt's portal, Shaken Fist's own broker. Here Nova has nowhere else to point a native client, so there is no second path to keep in sync and nothing for a user to bypass Kerbside with. The console URL Nova returns is the Kerbside URL.
  • The SPICE firewall is on by default. Kerbside terminates the client's connection, drives the SPICE link handshake itself, and classifies every framed message against a per-channel allowlist. See proxy-architecture.md.
  • Sessions are objects, not TCP flows. Every proxied console is a row you can list over the REST API, with an audit trail, and can terminate in flight — which nothing else on this path can do once a token has been exchanged.
  • The hypervisors are never reachable from the client network. Clients reach Kerbside; Kerbside reaches the compute nodes. This is the property OpenStack wanted in the first place, and it is what lets a compute node's console ports stay on the management network.
  • The backend leg is not subject-pinned on this path. This is the one place this deployment is weaker than the two already documented, and it is better known now than discovered later. Nova's token validation answers with the instance uuid, the compute node's address, and the plaintext and TLS console ports — and nothing about the hypervisor's certificate. There is no subject for Kerbside to pin against, so the console it records carries none and the proxy relays that backend without host-subject enforcement. Both scraped deployments learn a subject from the platform during discovery; this one has no discovery and nothing to learn a subject from. What still holds: the backend leg escalates to TLS when the hypervisor demands it, verified against the CA you configure for the cloud where you configure one, and the firewall still inspects every message on it. And the client-facing leg is still pinned, by PROXY_HOST_SUBJECT — which is Kerbside's own certificate subject, written into the .vv file for the client to check. That is a different leg: client to Kerbside, not Kerbside to hypervisor. See the limitations table.
  • One entry point across clouds. A single Kerbside can broker OpenStack alongside oVirt and Shaken Fist sources; users keep one console entry point as workloads move.

Users get the SPICE features an HTML5 console cannot offer: high-resolution and multi-monitor desktops, USB passthrough, audio, and adaptive compression.

How it works

Nothing is discovered in advance. There is no OpenStack source driver in kerbside/sources/, and the maintenance loop's scrape pass skips an entry of this type outright, so the discovery interval that governs the oVirt and Shaken Fist sources does not apply here at all. A console exists in Kerbside because a user asked Nova for one, and not before.

flowchart TD
    user["User<br/>(OpenStack client or portal,<br/>then remote-viewer or ryll)"]
    nova["Nova compute API<br/>(remote-consoles)"]
    kerbside["Kerbside<br/>/nova-console.vv"]
    novaauth["Nova compute API<br/>(os-console-auth-tokens)"]
    hypervisor["Hypervisor QEMU"]

    user -- "1. ask for a spice-direct console" --> nova
    nova -- "2. a URL at Kerbside,<br/>carrying a Nova token" --> user
    user -- "3. GET /nova-console.vv?token=..." --> kerbside
    kerbside <-- "A. validate the token" --> novaauth
    kerbside -- "4. the console is recorded now,<br/>not by a scrape" --> kerbside
    kerbside -- "5. .vv file" --> user
    user -- "6. connect, Kerbside's own token" --> kerbside
    kerbside -- "7. console port → NEED_SECURED → TLS port<br/>where the hypervisor demands it" --> hypervisor

The request (1, 2). Nova, not Kerbside, decides that a user may have a console. A client asks for one at compute API microversion 2.99 or later — openstack console url show --spice-direct <instance> is the one-line form — and Nova answers with a console of type spice-direct, protocol spice, and a URL. That URL is spice_direct_proxy_base_url with a freshly minted console auth token attached.

The exchange (3, A, 4). Following that URL lands on Kerbside's /nova-console.vv endpoint, which is the whole of the OpenStack implementation (NovaToken in kerbside/api.py). Kerbside authenticates to Keystone as the service account you configured for the cloud and asks Nova to validate the token it was handed; which endpoints that needs is under Network below. That is a live call per exchange, so it sits between oVirt's per-request ticket and Shaken Fist's entirely offline signature check: a Nova that is down means no new consoles, while sessions already running are untouched. Where several OpenStack clouds are configured, each is tried in turn, and a token none of them recognises ends as a 404. Only a clean "I do not know this token" moves on to the next cloud, though: a cloud that errors — bad credentials, an unreachable Keystone, a certificate problem — ends the whole request there, so a broken cloud early in sources.yaml takes out console access for every cloud listed after it.

The validation answer carries the instance uuid, the compute node's address, and that console's plaintext and TLS ports. Kerbside writes them into its console table at that moment, creating the row if this instance has never been asked for before and refreshing it if it has. This is the only thing that ever creates an OpenStack console row.

The client leg (5, 6). The .vv file points at PUBLIC_FQDN and Kerbside's own ports, carries Kerbside's CA and, when PROXY_HOST_SUBJECT is set, Kerbside's own certificate subject for the client to check. It carries a short-lived Kerbside console token, which is what the client presents on connect. The Nova token is used at the exchange and goes no further: the client authenticates to Kerbside.

The backend leg (7). Kerbside dials the address Nova reported — which is that compute node's [spice] server_proxyclient_address — on the plaintext console port. If the hypervisor answers the link handshake with NEED_SECURED, Kerbside retries on the TLS port, verifying against the CA configured for the cloud where one is configured (rust/kerbside-proxy/src/backend.rs). Where none is, the proxy passes no CA to the protocol crate, and create_tls_connector in ryll's shakenfist-spice-protocol falls back to the public web trust store with hostname verification — which an internal hypervisor's certificate will not satisfy, so the escalation fails rather than proceeding unverified. Whether that escalation happens is the hypervisor's decision rather than Kerbside's: a Kolla-Ansible deployment turns it on with nova_spice_require_secure, which in turn requires libvirt TLS. Where qemu does not demand it the leg stays on the plaintext port, so both ports have to be reachable. Either way Kerbside presents an empty SPICE ticket on that leg — the field is sent, with no ticket material in it — because Nova's validation response carries none. The console port is guarded by where it sits on the network, which is the assumption spice-direct is built on and precisely why Kerbside has to be between it and the user.

No scrape, and therefore no reconciliation. The pass that removes consoles it can no longer see is scoped to the sources it actually enumerated, and an OpenStack entry is skipped rather than enumerated, so its consoles are retained indefinitely and by design (see console-sources.md). A row for an instance that has since been deleted stays listed until the cloud is removed from sources.yaml altogether. Nova will not mint a token for an instance that no longer exists, so the row is unreachable by the path this page describes — but it is still in the console list, and the administrative .vv download described under User interaction model will still open it. That path mints a Kerbside console token from the stored row without calling Nova at all, so nothing in it notices the instance is gone.

By then the recorded address and ports may belong to something else, because libvirt reuses console ports as instances come and go. That is the reason to remove a decommissioned cloud from sources.yaml rather than leave it configured and ignored.

How to set it up

OpenStack side

Nova. Kerbside needs Nova 2025.1 (Epoxy) or newer with SPICE consoles enabled, and two settings in [spice] do the work:

  • spice_direct_proxy_base_url must name Kerbside's exchange endpoint, https://<kerbside>:13002/nova-console.vv in the Kolla-Ansible deployment. This is the setting that makes a spice-direct request resolve to Kerbside; without it Nova has nowhere to point a native client.
  • server_proxyclient_address is the address Nova reports for a console, and therefore the address Kerbside dials. It has to be an address Kerbside can reach — see Network below.

Clients must speak compute API microversion 2.99 or later. Earlier microversions reject the spice-direct console type outright, which is the first thing to check if a console request fails before Kerbside is ever involved.

Guests. The instance needs a SPICE-capable virtual display, as it would for any SPICE console, and the guest wants qemu-guest-agent and spice-vdagent installed — they are what give you clipboard sharing, display resizing, and clean resolution changes. Kerbside relays the agent channel; it does not decode it.

Account. Kerbside authenticates to Keystone as a service account and validates console tokens minted for other users' instances, which is an administrative operation rather than a project-scoped one. The Kolla-Ansible role registers a dedicated kerbside user (kerbside_keystone_user) in the service project for this, but grants it the admin role. No least-privilege role has been built or tested; treat one as untried.

Deployment. Kerbside's OpenStack support has always been a set of upstream contributions as much as code in this repository, and kerbside-patches is where they are tracked. It carries the Nova changes behind spice-direct itself, which have landed; the openstacksdk and python-openstackclient support that exposes the console type to users; follow-on Nova work, such as extra specs for the sound model and USB redirection; and the Kolla and Kolla-Ansible changes that deploy Kerbside as a component of the cloud, next to the other control plane services. Those deployment changes are being upstreamed under the spice-direct-consoles topic. Checked on 2026-09-27:

Change What it does Status
kolla 975495 Builds the Kerbside container image Merged
kolla-ansible 976889 Deploys Kerbside with Kolla-Ansible Open
kolla-ansible 988189 Adds the Kerbside CI scenario jobs Open
kolla-ansible 988913 Runs Nova's upstream spice-direct Tempest test in those jobs Open
kolla-ansible 989614 Runs Kerbside's own Tempest test in those jobs Open
kolla-ansible 967801 Always configures a routable console address, which spice-direct needs and only the HTML5 path used to get Open

The SPICE settings those depend on are already upstream: kolla-ansible 967800 added the SPICE configuration options and 967802, which is where nova_spice_require_secure comes from, allows requiring secure channels.

So the image build is upstream and the deployment code is not. Until 976889 merges, take the deployment from kerbside-patches, which carries these as patches against Kolla-Ansible master and is what Kerbside's own CI deploys. The topic on the OpenStack Gerrit is the live answer if this snapshot has aged.

Network

Kerbside needs direct L3 reachability to every compute node's SPICE console port range — both the plaintext and TLS ports, typically from 5900 upwards — at whatever address that node's server_proxyclient_address names.

This is the prerequisite most likely to be missed, and it fails in a distinctive way on this path. The exchange itself only needs Keystone and Nova, so a .vv file is produced and downloads perfectly; the failure appears only when the SPICE client tries to connect, one step later than an operator watching the exchange would expect.

Kerbside must also reach Keystone and Nova. Keystone authentication goes to the url configured for the cloud, and Nova is then found in the service catalogue on the source's interface, which defaults to internal. That is the right default: Kerbside is a control plane service, the validation is an administrative service-to-service call like the ones Nova's own console proxies make, and Kerbside already has to be on the management network to reach the compute nodes. So set url to the internal Keystone endpoint too, and Kerbside needs nothing from the public edge at all. Set interface: public only where Kerbside sits outside the cloud it brokers, as it may in a multi-cloud deployment.

Clients need to reach two things and only two things: Nova's API, to ask for a console, and Kerbside, at the name spice_direct_proxy_base_url uses, both to exchange the token and to run the SPICE session. Nothing needs a route to a compute node, which is the entire point.

Kerbside side

Add an OpenStack entry to sources.yaml. It names the Keystone endpoint and the service account, and — because there is no discovery pass — that is all Kerbside does with it until a token arrives. The option reference is in console-sources.md; two things about it are worth knowing here rather than there:

  • The CA you configure for the cloud is the hypervisor's, not the client's. It is what the backend leg verifies against when a hypervisor escalates to TLS. Kerbside's own certificate, which the client verifies, is a separate setting entirely. Configuring only the second does not leave the backend leg unverified; it leaves it verifying against the public web trust store, which an internal hypervisor's certificate will not satisfy. A hypervisor that escalates then fails the handshake — see The backend leg above.
  • There is no discovery interval to tune, and no errored state to watch. The entry is registered and appears in the administrative interface, and every scrape pass then skips it. It will never be marked errored by a failed scrape, because it is never scraped — a wrong credential or an unreachable Keystone surfaces at the first exchange, as a failed console request, not as a red source in the UI.

General settings, including PUBLIC_FQDN, Kerbside's own ports and CA, and PROXY_HOST_SUBJECT, are in configuration.md.

A worked example

Two CI paths deploy Kerbside into a Kolla-Ansible cloud: this repository's openstack_matrix lane, and the Kolla-Ansible Zuul scenario jobs proposed upstream. They run overlapping but different Tempest selections.

Kerbside's own lane. The openstack_matrix job in .github/workflows/functional-tests.yml builds an all-in-one Kolla-Ansible deployment from kerbside-patches on a Debian 13 Shaken Fist guest, with this checkout's Kerbside deployed into it, then runs kerbside-patches' tools/test-console smoke check followed by a curated Tempest subset from this repository's tempest-plugin/. testing.md is the authority on how it is built, including why the guest distribution is load-bearing rather than incidental.

What the Tempest test proves is worth stating precisely, because it is less than the other two use-case lanes prove. test_spice_console_via_kerbside boots an instance, asks Nova for a spice-direct console, follows the returned URL, parses the .vv Kerbside serves, and completes a SPICE link handshake against Kerbside over TLS using the CA embedded in that file. That exercises the whole exchange — Nova's mint, the validation callback, the console row, the .vv — and proves the front door answers as SPICE. It stops there: it does not authenticate through to a hypervisor console, so the backend leg is not driven end to end the way the oVirt and Shaken Fist lanes drive theirs. Nova's upstream spice-direct Tempest test is deliberately left out of this lane's default selection, because it bypasses Kerbside and connects straight to the libvirt console port.

Two differences from a real deployment. The lane is all-in-one, so the control plane, the single compute node and Kerbside share a machine. And it runs in the merge queue rather than on pull requests — see the limitations table.

The Kolla-Ansible scenario jobs. The kerbside-patches series proposes a kerbside scenario for Kolla-Ansible's own Zuul CI, in three stacked changes listed under Deployment above:

  • 988189 adds non-voting, check-pipeline jobs on Debian trixie, Ubuntu noble and Rocky 10. Each builds the Kerbside and SPICE-enabled libvirt images, deploys an all-in-one cloud with enable_kerbside and nova_console: spice, and runs the default .*smoke.* Tempest set. That proves a Kolla-Ansible cloud with Kerbside enabled still passes smoke; it tests nothing SPICE-specific.
  • 988913 turns on compute-feature-enabled.spice_console and adds Nova's upstream tempest.api.compute.admin.test_spice.SpiceDirectConsoleTestJSON. That test is the one this repository's lane leaves out: it exchanges the token for the hypervisor's address itself and handshakes with the libvirt console port directly. Here it is useful for what it proves about the half Kerbside depends on, that the compute node's console is reachable at the address Nova reports, rather than about Kerbside.
  • 989614 installs this repository's tempest-plugin/ from the develop branch and adds test_spice_console_via_kerbside, the same front-door test the lane above runs.

Together those cover both halves separately: Kerbside answering as SPICE at the URL Nova hands out, and the hypervisor console Kerbside would dial. Neither connects the two. No test in either path yet authenticates through Kerbside to a hypervisor console. The Kolla-Ansible jobs install the plugin from Kerbside's develop rather than a release, so a plugin change reaches them without a Kolla-Ansible change. They are all still under review, and non-voting once merged. kerbside-patches' own GitHub CI deploys the same role and runs tools/test-console, but not Tempest.

User interaction model

Kerbside is a proxy, not a portal. Something has to ask for a console on the user's behalf and deliver the resulting .vv file — the "broker" role described in the documentation index. OpenStack is the case where that something is already standard equipment:

  • Nova itself. The intended path, and the reason this deployment needs no portal written for it. The user asks Nova for a console for an instance; Nova decides whether they may have it, using Keystone and its own project model, and mints the token. Kerbside never needs an opinion about who owns which instance. The one thing Nova does not do is deliver the .vv: it returns a URL, and something has to fetch it and hand the result to a SPICE client. A desktop with remote-viewer associated with application/x-virt-viewer does that by itself; a portal does it on the user's behalf.
  • Kerbside's own web UI and REST API, which list consoles and offer a .vv download. They run under Kerbside's own authentication rather than Keystone's, so this is an administrative entry point rather than a user-facing one — and it is also where an operator inspects or terminates a live session. Note that for OpenStack the list contains only instances somebody has already opened a console on: an instance nobody has asked Nova about is not there to be listed.
  • Nova's HTML5 console, which can be enabled alongside spice-direct. It bypasses Kerbside entirely and is not a session Kerbside can see, audit or terminate. Useful as a fallback; not the path the native client users are on.
  • Bumblebee VDI. Developed at the NeCTAR research cloud, and superficially similar to Kerbside in that it also makes it easier for a user to obtain a virtual desktop. It is not a competitor to Kerbside, though: it fills the broker role this section is enumerating, orchestrating the creation of virtual desktops and then access to them, so it sits where Nova sits here rather than where Kerbside does. It orchestrates HTML5 consoles exclusively, using Apache Guacamole as its own HTML5 proxy, so it misses SPICE's richer features and carries an HTML5 desktop's performance implications.

Status and limitations

Kerbside is experimental overall. The OpenStack path is exercised on every merge-queue entry against a real Kolla-Ansible deployment, which covers the Nova console request, the token exchange including the validation callback, the console row created by it, the .vv Kerbside serves, and a SPICE link handshake against the proxy over TLS. The proposed Kolla-Ansible scenario jobs would add the same test upstream, alongside Nova's own test of the hypervisor console; see A worked example.

Not covered, and worth knowing before you deploy:

Limitation Detail
No backend host-subject pinning Nova's token validation returns no certificate subject for the compute node, so the console Kerbside records carries none and the proxy relays that backend without host-subject enforcement. A redirected backend is then caught by CA verification, where a CA is configured and the hypervisor escalated to TLS, but never by identity. This is not PROXY_HOST_SUBJECT, which pins the client-to-Kerbside leg and is unaffected; the unpinned leg is Kerbside-to-hypervisor. Both the oVirt and Shaken Fist paths can pin this leg because their discovery learns a subject; this path has no discovery.
openstack_matrix is merge-tier only The lane builds container images and an all-in-one cloud, so it runs in the merge queue and on workflow_dispatch, never on a pull request. An OpenStack regression therefore surfaces after review has finished, when the change is already queued to land, and ejects the merge group rather than failing the author's own PR. The Shaken Fist and static equivalents are smoke-tier and catch the same class of regression per-PR. See testing.md.
The backend leg is not driven end to end in CI The Kerbside Tempest test completes a SPICE link handshake against Kerbside but does not authenticate through to a hypervisor console, so the relay, the TLS escalation and the firewall are proven on this cloud's traffic only as far as the front door. The proposed Kolla-Ansible jobs also run Nova's test against the hypervisor console directly, which proves that side is reachable but still not the path between the two. They are driven end to end by the oVirt, Shaken Fist and direct-qemu lanes, against other sources.
Least-privilege accounts untested Only an account holding the admin role has been exercised: the Kolla-Ansible role's dedicated kerbside user has it. Validating another user's console token is an administrative call, so a project-scoped account is not expected to work; no minimal role has been built.
Console rows are never reconciled Nothing scrapes this cloud, so nothing ever removes a console it can no longer see. A row for a deleted instance stays listed until the cloud is removed from sources.yaml. Nova will not mint a token for it, so it is unreachable through the spice-direct path — but Kerbside's own administrative .vv download mints a token from the stored row without calling Nova, and will still open it. Since libvirt reuses console ports, the recorded address and ports may by then belong to a different instance, possibly another tenant's. Remove a decommissioned cloud from sources.yaml rather than leaving it configured.
Configured clouds share one token exchange Every configured cloud is asked to validate tokens minted by the others, so each cloud's operators can observe tokens destined for their neighbours, and a cloud which fails for any reason other than cleanly disowning a token — bad credentials, an unreachable Keystone, a certificate error — denies console access to the clouds after it rather than being skipped. Order therefore matters (the token is offered to each configured cloud in file order until one validates it), and a cloud being taken out of service should be removed from the file rather than left to fail. How the exchange reaches that behaviour, and when several clouds behind one Kerbside is the right shape, are in multi-cloud.md.
Single-node deployments only, in testing The lane is all-in-one, so one compute node. Multiple compute nodes should work — the address and ports come from the token validation on every exchange rather than from a cached inventory — but no lane covers them.
Deployment support is not upstream yet As of 2026-09-27 the Kolla image build has merged and kolla-ansible change 976889 is still open, so a stock Kolla-Ansible cannot deploy Kerbside. kerbside-patches is the supported route until it lands.
Certificate verification for the cloud The Kolla-Ansible role in kerbside-patches sets verify to Kolla's openstack_cacert where one is configured, and leaves it on otherwise. A hand-written sources.yaml can still turn it off, and that costs more than it appears to: one session carries both the Keystone authentication and the Nova validation call, so the answer that decides a caller may reach a hypervisor console is then accepted over an unverified connection. A deployment with an internal CA wants verify pointed at that CA bundle rather than off. See console-sources.md.
The exchange endpoint is unauthenticated and uncached /nova-console.vv carries a Nova token instead of Kerbside credentials, so it has to be reachable by users without authenticating first. Every request re-reads sources.yaml and performs a fresh Keystone password authentication and Nova validation call for each configured cloud in turn, with no session reuse, caching or rate limiting. An unauthenticated caller can therefore drive repeated Keystone authentications, and exchange latency grows with the number of configured clouds. Rate limiting in front of Kerbside is a deployment concern.
Live migration during a session Not characterised. The compute node's address and the console ports are captured at exchange time; an instance that migrates mid-session has not been tested.
Nova 2025.1 or newer only No spice-direct console type exists before it, and no earlier release is tested.

See also

📝 Report an issue with this page