Prodigal AI logoProdigal AI
People Tracker & Threat-based Object Detection
Computer Vision

People Tracker & Threat-based Object Detection

November 2023
Security Solutions Inc.
Duration:10 months

Overview

Customized and quantized MobileNetV2 to optimize training/inference for fish-eye camera systems.

This security system focuses on tracking people and detecting potentially threatening objects in surveillance footage, particularly from fish-eye cameras that provide wide coverage but introduce distortion challenges.

We customized MobileNetV2 architecture to handle the unique distortion patterns of fish-eye lenses while maintaining detection accuracy across the entire field of view.

The solution includes sophisticated tracking algorithms to maintain identity consistency as subjects move through the monitored space.

Technologies

MobileNetV2TensorFlowCUDAC++PythonDeepSORTOpenVINO

Key Features

  • Multi-person tracking with persistent IDs
  • Threat object detection (weapons, suspicious packages)
  • Fish-eye lens distortion compensation
  • Real-time alerting system
  • Integration with existing CCTV infrastructure
  • Video evidence archiving with detection metadata
  • Heat mapping of movement patterns

Challenges & Solutions

Fish-eye Lens Distortion

Developed a custom data augmentation pipeline that simulates fish-eye distortion and trained the model specifically on this transformed data.

Real-time Performance Requirements

Applied model quantization reducing bit precision to int8 and optimized the inference pipeline, achieving 30+ FPS on edge devices.

False Positive Reduction

Implemented a two-stage detection approach with a fast initial detector followed by a more precise classifier for potential threats.

Client Feedback

"The system's ability to accurately track individuals across our wide-angle cameras while identifying potential threats has significantly improved our security operations."

Michael Wong

Michael Wong

Security Director, Metro Transit Authority

Other Projects