Skip to content

Podman --gpus all support instead of --devices nvidia.com/gpu=all for compability #21156

Closed
@Gnyblast

Description

@Gnyblast

Feature request description

We have as a company been trying to adapt podman for many usages recently especially for Machine Learning side. Datalore and Prefect is just two of them and in both cases we hitting the wall on attaching GPUs to the container. Both of these application are dedicated to get used with Docker but we managed to get them run with podman for their base server, but they also access to the docker.sock which is podman.sock we mount and they spawn their own containers on demand to run some tasks. That's where we hit the wall, these applications are hardcoded to send API commands in a way that docker understands on how to bind GPUs to the container but podman has no idea because it uses a different run arguments for that purpose. This is really a thing that prevents us using it and I imagine it should be an easy fix to make podman understand --gpus all is exactly same thing as --devices nvidia.com/gpu=all .

Suggest potential solution

If podman can consider --gpus all same as --devices nvidia.com/gpu=all it will be solving toto many problems.

Have you considered any alternatives?

Yes I tried everything, in datalore local agents, gives you option to append run arguments so local agents can get used, but weirdly external agents doesn't give you that option and sends --gpus all hardcoded and I don't want to wait for this development on their side.

Additional context

Add any other context or screenshots about the feature request here.

Metadata

Metadata

Assignees

No one assigned

    Labels

    kind/featureCategorizes issue or PR as related to a new feature.locked - please file new issue/PRAssist humans wanting to comment on an old issue or PR with locked comments.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions