# 2D Image Annotation: LiveCamera Scribe ### Real-Time Annotation & Spatial Media Alignment in Hybrid Mission Spaces **LiveCamera Scribe** enables participants to draw, tag, and annotate directly onto **live video feeds**—such as ROVs, handheld cameras, or fixed shipboard views—and have those annotations **projected into shared physical or digital environments** using estimated camera pose. It also supports **dragging in and spatially aligning media** (photos, movies, screenshares) to 3D-scanned surfaces within the room using [AnySurface 3D scanning](https://stigmergic.webdav.acequia.io:3334/pitches/anysurface-3d-scan.md) or photogrammetry. --- ## ✨ Core Functionality ### 🎥 Live Annotation - Annotate live video feeds in real time. - Mark features, add labels, sketch outlines, or highlight moving targets. - All annotations are spatialized using camera pose estimation. ### 🧲 Media Placement in 3D Rooms - Drag and drop: - Still images (e.g., frame captures, reference photos), - Video clips (e.g., previous dives, mission briefings), - Screenshares (e.g., map tools, dashboards), - Live camera feeds. - Align these assets onto **3D-scanned room geometry** using: - Photogrammetry-based meshes, - [AnySurface 3D scanning](https://stigmergic.webdav.acequia.io:3334/pitches/anysurface-3d-scan.md) projector-camera calibration. - Media becomes **anchored to physical surfaces** (walls, tables, domes) and responds to room geometry in real-time projection or virtual rendering. ### 🧭 Pose-Linked Projection - All annotations and aligned media honor camera pose or projection geometry. - Supports compositing into: - Web-based 3D viewers (CesiumJS, Three.js), - Physical spaces via calibrated projection mapping. --- ## 🌍 Use Cases - **ROV Dive Narration** Scientists trace reefs, mark fauna, and tag geological features live—annotations projected into a mission control dome or viewer. - **Mission Briefing Rooms** Drop in relevant maps, video frames, or past dive photos onto physical wall regions for reference—anchored spatially for walk-around interaction. - **Remote Training** Experts annotate feeds while students watch in a hybrid room, guided by projected cues and reference media aligned to the walls. - **Collaborative Forensics or Ecological Survey** Multi-perspective photo alignment reconstructs scenes (e.g., wrecks, coral damage) across media types and viewpoints. --- ## 🧠 Technical Requirements - **Video Feed Integration** - Supports low-latency WebRTC, HLS, or DASH. - Pose telemetry via WebSocket, embedded metadata, or manual calibration. - **Annotation Tools** - Drawing (line, brush, polygon), labels, timestamps. - Time-synced overlays on live feed. - **Surface-Aware Media Alignment** - Snap-to-mesh projection using photogrammetry or [AnySurface 3D scanning](https://stigmergic.webdav.acequia.io:3334/pitches/anysurface-3d-scan.md). - Transformation tools for rotation, scaling, and refinement. - **Projection Pipeline** - Converts screen-space annotations/media into 3D-space overlays. - Feeds projection-mapped surfaces or WebGL viewers. --- ## 🔗 Strategic Integration | Integrated With | Benefit | |---------------------|------------------------------------------------------------------| | [Zoom Room](https://stigmergic.webdav.acequia.io:3334/pitches/zoom-room.md) | Feeds and media aligned to mission control room geometry. | | Digital Graffiti | Extends from temporal annotation to embodied projection. | | Dual Space | Connects browser and physical interfaces through shared space. | | Mission Specialist | Remote users contribute to shared spatial annotation. | --- ## 🚀 Future Extensions - AI-assisted annotation for object and species detection. - Replay mode with spatial-temporal navigation through annotated footage. - Support for multiple room geometries (e.g., vessel interior, sandtable, dome). - Timeline stacking of multiple mission-day annotations across media types. --- > **LiveCamera Scribe** bridges live observation, embodied presence, and collaborative annotation—transforming the mission space into a layered, spatial notebook of shared discovery.