Add routing for model adapter

[varungup90]

#146

[Jeffwan]

Do we need to create HTTPRoute for lora?

[varungup90]

Do we need to create HTTPRoute for lora?

We can not create HTTProute for lora since HTTProute needs a backend ref which is a service. Given that, I have switched to always using targetpod for every query and pods are fetched from internal cache to save time. Going forward we do not need to create httproute, I will remove that in next PR.

Edit: added a TODO in model router controller.

[Jeffwan]

@varungup90 We do create endpoint and service for each model adapter. The purpose is to make sure all model entrypoint is service. The difference part is it use headless service in that case. Does HTTPRoute works with such setting?

[varungup90]

@varungup90 We do create endpoint and service for each model adapter. The purpose is to make sure all model entrypoint is service. The difference part is it use headless service in that case. Does HTTPRoute works with such setting?

updated to add/delete httproute based on model adapter.

[Jeffwan]

based on model adapter.

I didn't see update in model adapter controller? Did you push the commits?

[Jeffwan]

It seems HTTPRoute is still managed in model router. It's ok at this moment. The downside is user have to use some labels which could be encapsulated inside the controller by us. Let's make necessary refactor later.

[Jeffwan]

/lgtm