Frigate NVR Real-Time Inference & NPU FPS Sizer [Coral vs Hailo-8]
Calculate real-time object detection throughput across Coral TPU, Hailo-8L, and Hailo-8 accelerators with YOLO models.
Frigate NVR Real-Time Inference & NPU FPS Sizer
Calculate object detection throughput across Coral TPU, Hailo-8L, and Hailo-8 accelerators with YOLO models.
Hailo-8L handles up to 8 cameras at 5-10 FPS with sub-4ms latency.
Engineering Methodology & Mathematical Proof
Surveillance Inference Engineering: NPU Capacity & Latency Dynamics
Frigate NVR separates video ingest into two concurrent pipelines: the continuous record stream (direct H.264/H.265 passthrough to disk) and the reduced detect stream (typically 720p to 1080p at 5 FPS) fed directly into the neural processing unit (NPU).
1. Aggregate Inference Demand Formula
The required system throughput is calculated as:
Total_Required_Inference_FPS = Camera_Count * Detection_Stream_FPS
For an 8-camera setup running at 5 FPS detection, the NPU must process 40 inferences per second continuously during active motion events.
2. Lab Benchmarked Processing Ceilings
Our lab stress-tested each accelerator with Frigate 0.14+ across standardized test footage:
3. Inference Duty Cycle & Overload Safeguards
An accelerator should never operate beyond an 80% sustained duty cycle. When an NPU hits 100% saturation, frame buffers in Frigate fill up, triggering motion detection latency spikes of 500ms to 2,000ms. If your camera count exceeds 8 streams running YOLOv8 or YOLOv11, the 26 TOPS Hailo-8 module is essential.
Lab Tested Hardware for this Profile
Verified BenchmarksHailo-8 M.2 AI Acceleration Module (26 TOPS)
The definitive neural coprocessor for Frigate 0.15+, running modern YOLOv8 and YOLOv11 models without breaking a sweat.
Ubiquiti UniFi Protect G4 Pro 4K PoE Camera
Our primary optical test camera in the lab, delivering uncompromising 4K clarity and zero-friction RTSPS integration.
Reolink ColorX CX410 PoE Camera
The definitive camera sensor for local Frigate AI NVRs - eliminates black & white infrared blur and insect false alarms.
Minisforum MS-01 WorkStation (Intel i9-13900H)
The undisputed king of compact homelab virtualization nodes, pairing dual 10G SFP+ with enterprise PCIe expandability.
Frequently Asked Questions
Q:How many detection FPS does a camera stream require in Frigate?
In real-world production surveillance, 5 FPS per camera is the golden standard. It provides sufficient temporal resolution to capture moving vehicles, humans, and pets without overloading the accelerator. Fast perimeter gates or vehicle driveways can be set to 10 FPS.
Q:Why is the Hailo-8L superior to the Google Coral Dual Edge TPU?
The Hailo-8L provides 13 TOPS of compute and native PCIe Gen3 x2 support, executing modern YOLOv8n models at 3.4ms latency (215 FPS capacity). The Google Coral TPU (4-8 TOPS) relies on older EdgeTPU compiler tooling and struggles with newer YOLO architectures, capping out around 42-80 FPS with 9.8ms latency.
Q:Can I use an Intel iGPU with OpenVINO instead of an NPU?
Yes, Intel 12th to 14th Gen iGPUs (UHD 770) running OpenVINO can achieve 50-70 inf/s. However, doing so raises host CPU package power by 12W to 18W. A dedicated Hailo-8L M.2 module consumes only 2.5W, keeping the mini-PC whisper quiet and cool.
Related Hardware Calculators
All 7 ToolsSize unified LPDDR5X RAM requirements across 8B, 14B, 32B, 70B, and 120B models before purchasing mini-PC hardware.
Quantify context window expansion penalties, FP8 cache compression savings, and memory bandwidth requirements.
Simulate 24/7 drive spin costs, base platform idle power, and real 3-year TCO against commercial cloud subscriptions.