Energy-aware inference.

Measuring and reducing energy per inference as a design target alongside accuracy and latency.

Standards

  • MLPerf Power
  • ISO/IEC 30134 (data centre KPIs)

Edge inference, model serving and optimisation