Skip to content

feat: support for vm runtime configurations for compute units and texera micro services - #8572

Open
dzueck wants to merge 2 commits into
apache:mainfrom
dzueck:vm-runtimes
Open

dzueck wants to merge 2 commits into
apache:mainfrom
dzueck:vm-runtimes

Conversation

@dzueck

@dzueck dzueck commented Sep 17, 2026

Copy link
Copy Markdown

What changes were proposed in this PR?

Adds support for running compute units and micro services inside a vm using kata containers. This is important for security as arbitrary code submitted by users can run inside these compute units. This PR adds the option to use VMs, but does not require it. It is only targeted at k8s deployments and was tested using RKE2. Note: k8s distributions like minikube may need additional steps to support VMs.

To enable VMs you must first install kata containers following these instructions. Make sure to follow the helm instructions. After this, you can enable Compute Units to use a VM by modifying these two lines in bin/k8s/values.yaml:

  • name: KUBERNETES_COMPUTING_UNIT_RUNTIME_CLASS_CPU
    value: "kata-qemu-runtime-rs"
  • name: KUBERNETES_COMPUTING_UNIT_RUNTIME_CLASS_GPU
    value: "kata-qemu-nvidia-gpu-runtime-rs"

To enable texera specific micro services to run in a VM modify this line:
global:
texeraMicroServiceRuntimeClass: "kata-qemu-runtime-rs"

Any related issues, documentation, discussions?

Closes #8545
Discussed in #8430

How was this PR tested?

Primarily tested in v1.2.0 where performance tests were done with various micro benchmark workflows which can be seen in #8430. Additional functionality testing still needs to be done on the latest commits.

Was this PR authored or co-authored using generative AI tooling?

Generated-by: Gemini 4.1 Pro

@github-actions github-actions Bot added infra platform Non-amber Scala service paths labels Sep 17, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Automated Reviewer Suggestions

Based on the git blame history of the changed files, we recommend the following reviewers:

  • Contributors with relevant context: @aicam, @tanishqgandhi1908, @bobbai00
    You can notify them by mentioning @aicam, @tanishqgandhi1908, @bobbai00 in a comment.

@dzueck
dzueck marked this pull request as draft September 17, 2026 19:53
@dzueck

dzueck commented Sep 18, 2026

Copy link
Copy Markdown
Author

I have now tested it on the main branch and it works there too. Removing draft marking.

@dzueck
dzueck marked this pull request as ready for review September 18, 2026 22:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

infra platform Non-amber Scala service paths

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support Virtual Machine runtimes for compute units and other micro services

1 participant