Struct GatherQmmOptions 

pub struct GatherQmmOptions<'a> {
    pub mode: QuantizationMode,
    pub group_size: Option<i32>,
    pub bits: Option<i32>,
    pub transpose: bool,
    pub lhs_indices: Option<&'a Array>,
    pub rhs_indices: Option<&'a Array>,
    pub sorted_indices: bool,
}

Configuration for gather_qmm.

Fields

mode: QuantizationMode

Quantization format used to pack the weights.

group_size: Option<i32>

Elements sharing a scale; None selects the mode’s default.

bits: Option<i32>

Bits per packed element; None selects the mode’s default.

transpose: bool

Transpose the packed weight matrix. Defaults to true.

lhs_indices: Option<&'a Array>

Indices into the input batch dimensions.

rhs_indices: Option<&'a Array>

Indices into the weight batch dimensions.

sorted_indices: bool

Whether the supplied indices are sorted. Defaults to false.

Trait Implementations

impl<'a> Clone for GatherQmmOptions<'a>

fn clone(&self) -> GatherQmmOptions<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Copy for GatherQmmOptions<'a>

impl<'a> Debug for GatherQmmOptions<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for GatherQmmOptions<'_>

fn default() -> Self

Returns the “default value” for a type.