Files
zeekayandHanzo Dev d51a119438 quant: the FP8 conversion kernels report a failed launch and skip an empty tensor
A conversion launch that failed printed to stderr and exited the process, from
inside a serving engine; it returns the CUDA error to the caller, who reports
it with the tensor's shape. A tensor with no elements launches nothing, since a
zero-block grid is itself the error.

(cherry picked from commit f29516e09cd6c1777575ec27481bf57efbff4003)

Co-authored-by: Hanzo Dev <[email protected]>
2026-09-17 20:36:44 -07:00
..