Split and collaborative inference.

Dividing a model between device, edge and cloud to balance latency, bandwidth and privacy.

Standards

  • 3GPP TR 22.874 (AI/ML model transfer in 5GS)
  • 3GPP TR 23.700-80

Edge inference, model serving and optimisation