Compilers and runtimes.

Graph compilers and portable model formats that target many accelerator types from one model.

Standards

  • ONNX specification
  • MLIR (LLVM project)

Edge inference, model serving and optimisation