Quantisation.

INT8, INT4, FP8 and block-scaled formats that cut memory and power with measured accuracy loss.

Standards

  • OCP Microscaling Formats (MX) Specification v1.0
  • IEEE 754-2019 (floating-point arithmetic)

Edge inference, model serving and optimisation