Initializing FireSense AI...
WSDM 2025 | Dehradun, India

Real-Time Fire Severity Classification Using CNN-LSTM

A hybrid AI-human labeling framework with distributed edge-cloud architecture for accurate, cost-effective fire disaster management systems.

94.39% Classification Accuracy
<500ms End-to-End Latency
$5 Per Edge Node
system_architecture.py
πŸ“Ή

ESP-32 CAM Edge Node

Real-time image capture at 10 FPS

πŸ”„

Preprocessing Pipeline

JPEG compression & WiFi transmission

🧠

CNN-LSTM Inference

EfficientNetB3 + Bidirectional LSTM

🚨

Alert Generation

Real-time severity classification

94.39% Accuracy
Core Contributions

Three Key Innovations

Advancing the state-of-the-art in vision-based fire detection through integrated innovations

πŸ€–

Hybrid AI-Human Labeling

Gemini 2.5 Flash automated annotation with 100% expert verification, achieving gold-standard dataset quality while reducing annotation time.

73% Time Reduction
(398 β†’ 107 hours)
🧬

CNN-LSTM Architecture

EfficientNetB3 for spatial feature extraction combined with bidirectional LSTM layers for temporal modeling of flame evolution patterns.

6.68% Improvement over
previous SOTA
☁️

Edge-Cloud Deployment

Distributed architecture using ESP-32 CAM modules for scalable, cost-effective real-time fire surveillance with sub-500ms latency.

10+ Concurrent streams
per GPU server
System Design

End-to-End Pipeline Architecture

From video capture to real-time severity classification

πŸ“Ή
Video Input
MIVIA Fire Dataset
31 Videos
πŸ–ΌοΈ
Frame Extraction
23,906 Frames
640Γ—480px
🏷️
Hybrid Labeling
Gemini + Expert
6 Classes
πŸ“Š
Augmentation
32,343 Samples
Balanced Classes
🧠
CNN-LSTM
EfficientNetB3
+ BiLSTM
Classification

Six-Class Severity Classification

Granular severity assessment for informed emergency response decisions

βœ…
No Fire
F1: 97.0%
πŸ’¨
Smoke
F1: 90.5%
πŸ”₯
Low Fire
F1: 91.5%
πŸ”₯πŸ”₯
Medium Fire
F1: 95.7%
πŸ”₯πŸ”₯πŸ”₯
High Fire
F1: 95.1%
πŸ”₯πŸ’¨
Fire+Smoke
F1: 91.8%
Results

Performance Metrics

State-of-the-art results on the MIVIA Fire benchmark dataset

94.3%
Overall Accuracy
93.7%
Macro F1-Score
96.3%
mAP@50
0.4s
Mean Latency
Interactive

Live Demo

Upload an image to see the fire severity classification in action

πŸ“€

Upload Fire Image

Drag & drop or click to select an image

Preview
πŸ“Š

Classification Results

⚑ Powered by AI Sense CNN+RNN
Fire Sense AI 6 class Model loading
--
Confidence: --
No Fire
0%
Smoke
0%
Low Fire
0%
Medium Fire
0%
High Fire
0%
Fire+Smoke
0%
Benchmarks

State-of-the-Art Comparison

Performance comparison with existing fire detection methods

Method Year Approach Accuracy F1-Score
Chen et al. 2004 Color + Motion 78.42% 78.0%
TΓΆreyin et al. 2006 Wavelet Analysis 82.15% 81.9%
BoWFire 2015 Bag-of-Visual-Words 83.33% 74-79%
Foggia et al. 2015 Multi-expert Fusion 87.71% 87.1%
ATT Squeeze U-Net 2021 Deep Learning 89.45% 88.9%
Two-Stream Net 2024 Spatial + Optical Flow 92.15% 91.5%
Proposed (Ours) NEW 2024 CNN-LSTM Hybrid 94.39% 93.78%
Economics

Deployment Cost Analysis

Cost-effective solution for fire surveillance at scale

Traditional PTZ
$31,650
3-Year TCO (10 cameras)
  • $1,200 per camera unit
  • Complex installation
  • High maintenance costs
  • Limited scalability
Savings
26.9%
Total Cost Reduction
  • 99.6% edge hardware savings
  • 73% annotation time saved
  • Sub-500ms latency
  • 10+ concurrent streams
πŸŽ“ Research Presentation

World Summit on Disaster Management 2025

E-Poster Presentation | November 29, 2025

πŸ“ Dehradun, India
πŸ“… November 28 - 30, 2025
πŸ›οΈ UPES Campus
↑