AI-Powered Video Situational Awareness Platform with Explainable Alerts

Most video analytics spot objects and stop there, and operators spend hours checking what each alert means. NTT DATA built a situational awareness platform on vision language models (VLMs) for clients in industry, public safety, corrections and energy and utilities. Users write monitoring rules in plain English, and every alert explains why the system raised the flag.
Operations specialists review explainable video alerts across industrial, public safety, corrections and energy environments.
Rule creation: Plain English
Users define monitoring logic without writing code.
Alerts: Explainable
Each alert describes the conditions behind the trigger.
New use cases: No retraining
New scenarios need new rules, not a new model.
Sectors: 4
Industrial, public safety, corrections, and energy and utilities.
AI-Powered Video Situational Awareness Platform with Explainable Alerts
Video monitoring with context
Objectives
Interpret video streams in context, adapt monitoring to different scenarios and give operators alerts they trust.
Opportunity
VLMs read scenes, objects, actions and interactions, so monitoring logic moves out of code and into everyday language.
Detection without context

Organizations across sectors watch complex environments in real time and need to respond fast when something critical happens. Traditional video analytics detect objects but miss behaviors and interactions. Teams close the gap by reviewing footage by hand.

Key Challenges
1: False positives. Alerts based on object detection alone fire without enough context.
2: Manual review. Operators confirm each alert by watching the footage.
3: Rigid rules. Defining or changing monitoring logic requires development work.
4: One scenario at a time. Each new use case calls for another model or more training.
Solution
A VLM platform driven by natural language rules

NTT DATA developed an AI-powered platform, built with Python and NVIDIA technology, to understand video streams in context and generate actionable, explainable alerts from rules written in natural language.

check icon
Natural language rules

Users describe what to watch in plain English, and the platform turns each description into detection logic.

check icon
Context-aware video understanding

The VLM interprets scenes, objects, actions and interactions within every stream. NTT DATA selects the model per site and task, with no lock-in to one AI vendor.

check icon
Explainable alerts

An alert fires only when its conditions are met and arrives with a short explanation of what the model saw.

check icon
Region and context customization

Rules apply to specific areas of the frame, and users add context wherever a scenario needs more detail.

Impact
Alerts operators believe and act on

Context understanding detects critical events more accurately, from fire and smoke at industrial sites to anomalous behavior in public spaces and violence in corrections facilities. Operators spend less time on manual monitoring, safety and risk mitigation improve across sites, and the platform scales to new use cases without retraining. Explainable alerting keeps the AI transparent, and the operator decides each response with the reason in front of them.

Drag