Realm

oa::ml::matrix::mat_mul_nt

Multiply [..., K] Float32 activations by a quantized [N, K] weight without materializing a Float32 weight matrix. The result shape is [..., N]. Errors Returns an error unless the weight has rank 2, the input has rank at least 2 with a matching last dimension, all planes are contiguous base storage on one engine, the flattened dimensions fit the u32 kernel ABI, or allocation/recording fails.

FnRust public API

Function Documentation

pub fn mat_mul_nt( input: &Matrix, weight: &QuantMatrix ) -> Result<Matrix>
Multiply [..., K] Float32 activations by a quantized [N, K] weight without materializing a Float32 weight matrix. The result shape is [..., N]. Errors Returns an error unless the weight has rank 2, the input has rank at least 2 with a matching last dimension, all planes are contiguous base storage on one engine, the flattened dimensions fit the u32 kernel ABI, or allocation/recording fails.