Montline.

Blog · Industry Updates

Edge AI Technology Update

Onboard inference became the default architecture in 2026, and the number that sells it — TOPS — is the number buyers most often misread.

8 of 10Method note

Overview

  • TOPS is theoretical peak compute. It does not tell you frame rate, latency, or whether your model fits. Two modules quoting the same TOPS can differ by a wide margin in delivered accuracy after quantisation.
  • Published engineering budgets for 2026: a 6 TOPS module runs a small detection model at 1080p around 60 Hz with 20–30 ms of inference latency, landing near 40–50 ms end to end. A 1 TOPS module reaches real time only by dropping frame rate, resolution or model depth.
  • Weight and power are the real constraints. Typical figures are 40–70 g and 3–5 W at 1 TOPS, 80–120 g and 5–9 W at 6 TOPS — and sustained load, not peak, is what causes thermal throttling mid-mission.
  • Power quality matters as much as draw: NPU current comes in bursts that can reach two to three times average. A power system that cannot supply the burst will brown out the module under sustained load.
Collected 9 October 2026 from public module vendors and integration guidance, including a 12 TOPS sub-10 W companion computer announced 30 September 2026. Montline publishes compute figures only with the model, quantisation and measured latency attached.

Related pages

More in this area

Tell us what the system needs to do

We will tell you what is achievable, what it takes, and what we would need from you.

Discuss Your Project