Skip to content

Commit

Permalink
[nnpackage] Add mx dtypes to schema (#14299)
Browse files Browse the repository at this point in the history
* [nnpackage] Add mx dtypes to schema

This adds mxfp4 and mxint8 to circle schema.

ONE-DCO-1.0-Signed-off-by: Hyukjin Jeong <[email protected]>

* Update version history

* Stick to 0.9

* Remove empty line
  • Loading branch information
jinevening authored Nov 5, 2024
1 parent b1f1f70 commit 20d9e96
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion nnpackage/schema/circle_schema.fbs
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@
// Version 0.7: Base up to TensorFlow Lite v2.15.0 schema, deprecate data_format in Subgraph table
// Version 0.8: GRU op is added. UINT4 is added.
// Version 0.9: GGML_Q{X}_{Y} types are added. Weight compression option is added.
// ROPE op is added.
// ROPE op is added. MXFP4, MXINT8 types are added.

namespace circle;

Expand Down Expand Up @@ -78,6 +78,10 @@ enum TensorType : byte {
GGML_Q4_1 = -3,
GGML_Q8_0 = -4,
GGML_Q8_1 = -5,

// MX dtypes
MXFP4 = -6,
MXINT8 = -7,
}

// Custom quantization parameters for experimenting with new quantization
Expand Down

0 comments on commit 20d9e96

Please sign in to comment.