zenlm/engine
1
0
Fork 0
mirror of https://github.com/zenlm/engine.git synced 2026-10-30 15:00:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
main
engine/mistralrs-quant/kernels/scalar_fp8
T
History
Eric BuehlerandGitHub c82f9e033d Reworked and improved attention chunking (#1591) 
* Add chunking to naive attn

* Add it to cublaslt as well

* Even better!

* Clippy

* Remove prompt chunksize apis

* Prompt chunksize logging

* Format

* Determine based on mask type

* Max seq len in device map

* Max seq len in device map

* Format
2025-08-03 07:52:33 -04:00
..
scalar_fp8_dummy.cu
Reworked and improved attention chunking (#1591)
2025-08-03 07:52:33 -04:00
scalar_fp8.cu
Reworked and improved attention chunking (#1591)
2025-08-03 07:52:33 -04:00