🚀 Feature Description and Motivation
Right now, the lora controller talks with engine directly to
- fetch metrics
- register model adapter
- fetch loras
Our ai runtime is available and we should switch to this solution. Let's do more testing against it.
Part of #521 and related to #49
Use Case
No response
Proposed Solution
No response