Skip to content

[inference] add int8 rotary embedding kernel for smoothquant #3896

[inference] add int8 rotary embedding kernel for smoothquant

[inference] add int8 rotary embedding kernel for smoothquant #3896