oa::ml::matrix::mat_mul_nt
Multiply [..., K] Float32 activations by a quantized [N, K] weight without materializing a Float32 weight matrix. The result shape is [..., N]. Errors Returns an error unless the weight has rank 2, the input has rank at least 2 with a matching last dimension, all planes are contiguous base storage on one engine, the flattened dimensions fit the u32 kernel ABI, or allocation/recording fails.
Function Documentation
Multiply [..., K] Float32 activations by a quantized [N, K] weight without materializing a Float32 weight matrix. The result shape is [..., N]. Errors Returns an error unless the weight has rank 2, the input has rank at least 2 with a matching last dimension, all planes are contiguous base storage on one engine, the flattened dimensions fit the u32 kernel ABI, or allocation/recording fails.