v0.8.0

Breaking Changes

As a consequence of the torch 2.6.0 upgrade, sparse support is disabled for megablocks (meaning that only grouped support is available).

For additional context, torch 2.6.0 depends on triton 3.2.0, which introduced some change to how it handles dtype promotion when two binary operands have different dtypes, and as a result we're encountering an int16 overflow in the stk dependency of megablocks which results in an illegal memory access (IMA). Once this issue is resolved, we will release a new version of megablocks. View #168 for additional details.

What's Changed

• Updated pytorch and disabled sparse tests by @rithwik-db in #168

New Contributors

• @rithwik-db made their first contribution in #168

Full Changelog: v0.7.0...v0.8.0