Open
Conversation
Adds a complete NVIDIA OSMO test case for warehouse AMR (Autonomous Mobile Robot) navigation using a MobilityGen-style pipeline on Amazon EKS. The pipeline includes 6 stages: scene setup, occupancy mapping, trajectory generation, multi-modal rendering (parallel RGB/depth/segmentation), domain augmentation, and X-Mobility foundation model training. Uses OSMO DAG orchestration, KAI Scheduler, and heterogeneous compute (G-series for rendering, P-series for training).
bluecrayon52
requested changes
Mar 13, 2026
Contributor
bluecrayon52
left a comment
There was a problem hiding this comment.
I'm getting a page not found error in the NVIDIA OSMO installation guide link provided in the AMRNavigation/kubernetes/README.md.
It looks like Nvidia provides an AWS Infra with Terraform guide, did you use something like this to deploy the EKS cluster?
I'm ok with the Terraform infrastructure being outside of the scope of the test case and externally referenceable to a stack that Nvidia maintains.
Does it make sense to also include:
- Links or Helm commands for installing the in-cluster prerequisites (GPU operator, KAI scheduler, Karpenter, OSMO)
- YAML manifests for the required Karpenter NodePools that the
4.verify-osmo.shscript checks for with instructions on how to apply (osmo-rendering, osmo-gpu-training, osmo-cpu-batch, osmo-cpu-system) - Instructions for loading the nvidia/X-Mobility dataset from HuggingFace to S3
If you plan to cut another PR to provide architecture setup automations, then perhaps we can link to those resources in the prerequisites section of this test case?
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
3.test_cases/osmo/AMRNavigation/for warehouse AMR (Autonomous Mobile Robot) navigation synthetic data generation and trainingContents
src/): Full Python implementation for each stagekubernetes/): setup, build, verify, submitKey OSMO features demonstrated
inputs:Test plan