Rakshak (रक्षक): AI Powered Comprehensive Security Solution

Rakshak is an AI powered Comprehensive Security Solution which provides Web Interface platform for Security personels, Mobile App (Multi-lingual, Dual Mode) for On Duty guards and Citizens to administer, report and enhance overall security.

Rakshak integrates various Machine Learning & Deep Learning based models to detect & identify various types of crimes/accidents via CCTV streams.

Problem Definition✨

• Security personnel (Police)👮🏻‍♂️ are burdened with manually monitoring multiple CCTV streams, leading to potential security incidents.

• 👀Manual surveillance not only consumes manpower but also increases the risk of human error and security breaches.

• On-duty personnel struggle to maintain real-time communication with authorities analyzing CCTV footage for incident detection.

• The lack of a user-friendly platform for incident reporting by citizens contributes to delays in emergency response protocols.

Scope & Features 💡

Rakshak consists of Web Interface for Admins, Mobile App Module for On-Duty personnels, Mobile App for Citizens.

🖥️Web Interface for Admins:

• Admin for particular police Station can access dashboard containing stats📊📈 of various detected/reported incidents.

• View CCTV streams for specific location via Interactive map🗺️.

• View Real-time incident detections (accidents/crime) detected in CCTV streams.

• Automated Alerts & notifications🔔 about detected incidents & plot details such as description, type, location on 🗺️

• Admin has access to LLM powered interface🤖 to query in natural language about incidents and gain insights.

• Provides an interface for Feedback Learning🧠 which enables to train model via admins feedback about False Positives & False Negatives.

• View Info & Status of all on-duty personnels.

👮🏻‍♂️Mobile App for On-Duty personnels:

• Report Incidents in vicinity by providing basic info such as type description and visual evidence.🏞️

• Get notified about the status of reported Incident.

👩‍👩‍👧‍👦Mobile App for Citizens:

• Mobile App provides Automated Alerts & Notifications about incidents🔔 in vicinty. View details about incidents 📍 plotted on map🗺️

• Access to CCTV streams of specific location via user-friendly map.

Video Demo ▶️

Tech Stack 👨‍💻

• React, Typescript & FAST API (Web Interface)
• Flutter, Dart, BLOC for State Management
• MongoDB, AWS S3 (For Storage)
• Mapbox API, Google Maps SDK
• TensorFlow, YOLO, PyTorch (Machine Learning)
• Mixtral 8x7B Open source LLM

Start Mobile App

Flutter SDK version requirement : >=2.12.0 < 3.0.0

cd App
flutter pub get
flutter run

Start frontend

cd Frontend
npm install
npm run dev

Start backend

cd Backend
python -m venv venv
source venv/bin/activate
pip install -r requirements.txt
uvicorn main:app --reload --port=5000

Start video streaming server

cd video-server
python -m venv venv
source venv/bin/activate
pip install -r requirements.txt
python video_server.py