Files
zeekay fa9475a308 ModernBERT's attention on Metal is the composite again: the fused SDPA moved Kai's answers.
On Metal F32, Kai a3 with the fused kernel answered control val at 0.558 where the composite
and the CPU answer 0.601 (163 cases), and 0.546 against 0.558 on 1,600 harness questions; F32
kernels that agree should match to rounding. Until the kernel's mask and strides are checked
against the composite here, inference takes the composite, as training does.

Claude-Session: https://claude.ai/code/session_018Gt5TvrE2rxXuZikWSauv3
2026-09-27 05:34:10 -07:00
..
2026-01-16 13:01:08 -08:00