Edge server inference.

Vision, language and sensor models served from far and near edge servers at bounded latency.

Standards

  • MLPerf Inference: Edge
  • ONNX specification

Edge inference, model serving and optimisation