Remove workflows for very old torch versions (#7090)

These jobs haven't been run in a long time and were originally used when
compatibility with torch <2 was more important.

Signed-off-by: Logan Adams <[email protected]>

Author: loadams