Deprecate sendnn_decoder in favor of sendnn with warmup_mode

[tjohnson31415]

If TORCH_SENDNN_LOG is set to WARNING instead of CRITICAL, there are logs stating

You're using a deprecated backend. Please use sendnn in conjunction with warmup_mode

This PR makes the change to sendnn. For backwards compatibility, sendnn_decoder is overwritten to sendnn and a warning is logged.

[github-actions]

👋 Hi! Thank you for contributing to vLLM support on Spyre.
Just a reminder: Make sure that your code passes all the linting checks, otherwise your PR won't be able to be merged. To do so, first install the linting requirements, then run format.sh and commit the changes. This can be done with uv directly:

uv sync --frozen --group lint --active --inexact

Or this can be done with pip:

uv pip compile --group lint > requirements-lint.txt
pip install -r requirements-lint.txt
bash format.sh

Now you are good to go 🚀

[joerunde]

I think I may have been mistaken when I wrote this and we actually need the sendnn_decoder backend for v0 embeddings. At least I think it looks like that's how our internal CI is set up to run them right now.

Would be good to double check that, though hopefully we deprecate soon anyway

[tjohnson31415]

Yeah, my understanding is that decoder models can be used for embeddings as well (typically via "pooling").

I'm not following what needs to be checked. This PR is removing use of the sendnn_decoder backend (with a fallback to sendnn), so all embedding models would use sendnn.

[joerunde]

bot:test
MARKERS="embedding"

[joerunde]

bot:test
MARKERS="embedding"

[joerunde]

bot:test
MARKERS="embedding"

[tjohnson31415]

bot:test
MARKERS="embedding"

[tjohnson31415]

A few internal CI tests are failing, but the same tests pass for me in my dev environment.

[joerunde]

I had to fix the internal automation, but I did see my last test run pass 🤔. Can't hurt to try again!

[joerunde]

bot:test
MARKERS="embedding"

[waleedqk]

bot:test
MARKERS="embedding"

[waleedqk]

bot:test
MARKERS="embedding"

[waleedqk]

bot:test
MARKERS="embedding"

[waleedqk]

bot:test
MARKERS="embedding"

[waleedqk]

bot:test
MARKERS="embedding"