Skip to content

integrate the model registration flow with runtime #567

@Jeffwan

Description

@Jeffwan

🚀 Feature Description and Motivation

Right now, the lora controller talks with engine directly to

  • fetch metrics
  • register model adapter
  • fetch loras

Our ai runtime is available and we should switch to this solution. Let's do more testing against it.

Part of #521 and related to #49

Use Case

No response

Proposed Solution

No response

Metadata

Metadata

Assignees

Labels

area/runtimekind/featureCategorizes issue or PR as related to a new feature.

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions