VAST DataEngine - Video Search and Summarization (VSS) Foundation Stack

• A Real-Time Video Search and Analysis system powered by VAST DataEngine, using Nvidia NIM's & Cosmos-Reason Models.

• This Blueprint is were released to bridge the gap between NVIDIA’s VSS reference architectures, and showcases the e2e utilization of the full VAST AI OS production-grade capabilities, including Agentic & Serverless Event-based Compute Framework and VastDB Vector-Store.

---

Overview

The system has two main parts:

1. K8s Application - Web UI and REST API (Kubernetes)
2. Ingest Pipeline - Serverless video processing (VAST DataEngine)

---

Deployment

Component	Guide
VSS - Retrieval Web UI; K8s Application (Backend, Frontend, Streaming, Batch Sync)	vss-k8s-application
VSS - DataEngine; Ingest Pipeline (Segmenter, Reasoner, Embedder, Writer)	dataengine-vss-ingest-pipeline

Quick Start

1. Deploy K8s Application:

   cd deployments/vss-k8s-application
   vim backend-secret.yaml  # Configure credentials
   ./QUICK_DEPLOY.sh <namespace> <cluster_name>

2. Deploy Ingest Pipeline (choose one):

   • Using GUI: Configure vss-gui-secret-file-template.yaml, then use DataEngine UI
   • Using CLI: Configure vss-cli-secret-file-template.yaml, then run vastde commands

   See Ingest Pipeline Guide for full instructions.

3. Test: Upload a video and search at http://video-lab.<cluster_name>.vastdata.com

---

Key Features

Feature	Description	Documentation
Video Analysis Prompts	Configurable AI scenarios (surveillance, traffic, sports, etc.)	video-reasoner
Custom AI Prompts	Per-video custom prompts (max 800 chars)	video-reasoner
Metadata Filters	Filter by camera_id, location, capture_type	ingest
LLM Settings	Adjustable search/synthesis parameters	video-backend
Time Filtering	Filter by upload time (presets or custom range)	video-backend
Video Streaming	Capture YouTube videos to S3	video-streaming
Batch Sync	Copy MP4 files between S3 buckets	video-batch-sync
Authentication	VAST username + S3 secret key	video-backend

---

Component Documentation

Component	Description
video-backend	REST API, authentication, search
video-frontend	Angular web UI
video-streaming	YouTube capture service
video-batch-sync	S3 batch copy service
video-segmenter	Splits videos into segments
video-reasoner	AI video analysis
video-embedder	Vector embeddings
vastdb-writer	Stores vectors in VastDB

---

Pipeline Flow

Upload Video → video-chunks bucket
                    ↓
            video-segmenter
                    ↓
        video-chunks-segments bucket
                    ↓
            video-reasoner (AI analysis)
                    ↓
            video-embedder (vectors)
                    ↓
            vastdb-writer (store)
                    ↓
              Search Ready

---

Need Help?

• K8s Deployment: See K8s Application Guide
• Ingest Pipeline: See Ingest Pipeline Guide
• Community: VAST Community Forums