# Strategic Collaboration Areas: OceanX × Redfish × Simtable × Harvard Vis Lab  
### September Hackathon – Initial Integration Agenda

This document outlines eight strategic collaboration areas for exploration during the September hackathon aboard the OceanXplorer. These directions blend storytelling, science, embodiment, and hybrid interaction, building on shared capacities from OceanX, Redfish Group, Simtable, and the Harvard Visualization Lab.

---

## 1. [Zoom Room: Hybrid Mission Interface](https://stigmergic.webdav.acequia.io:3334/pitches/zoom-room.md)

A spatial collaboration layer where distributed participant video feeds, screenshares, and 3D viewers are composited in a shared mission space.  
- **Screenshare parsing**: Extract map bounding boxes (Leaflet, MapLibre, OpenLayers, etc.) and 3D camera poses.
- **Laserpointer interaction**: Allows spatial manipulation of content in browser or projection-mapped environments.
- **Geospatial compositing**: Feeds rendered in 2D map canvases and 3D globe/terrain models.
- **LiveCamera Scribe**: Participants can annotate live camera views, with those annotations projected spatially into shared rooms or 3D viewers.

---

## 2. Digital Graffiti: Temporal-Spatial Annotation

Enable scientists, students, and artists to draw, tag, and narrate over imagery, video, and geospatial data across time and space.  
- **Annotation interface**: Temporal keyframes, depth-aware marks, and spatially referenced notes.
- **Applications**: ROV dive annotations, reef changes, migration path storytelling.
- **Extension via [LiveCamera Scribe](https://stigmergic.webdav.acequia.io:3334/pitches/live-camera-scribe.md)**: Draw directly on live video feeds, spatialized via camera pose estimation.

---

## 3. Mission Specialist Network: Distributed Interpretation Roles

Formalize remote or onboard roles for participants who steer models, interpret visuals, or guide navigation—without direct control of instruments.  
- **Use cases**: Youth engaging in science tasks; remote elders or artists co-curating exploration; scientists providing asynchronous commentary.
- **Tools**: Zoom Room integration, annotation channels, [LiveCamera Scribe] for guided interpretation.

---

## 4. Dual Space: Synchronized Physical + Digital Presence

Co-locate mission activity across physical environments (rooms, sandtables) and browser-based or XR 3D viewers.  
- **Projection mapping + web viewers**: Mirror the mission room inside a digital twin.
- **Interaction**: Gestures, touch, voice, and gaze mapped between spaces.
- **Integration**: [LiveCamera Scribe] annotations appear in both physical and digital layers.

---

## 5. Time–Space Modeling of Ocean Phenomena

Agent-based and timelapse models of dynamic ocean systems, blending scientific observation with speculative futures.  
- **Data sources**: Remote sensing, shipboard sensors, bathymetry, cameras.
- **Tools**: realtime.earth, AgentScript, Simtable sandtables.
- **Applications**: Current systems, marine ecology, human impact simulation.

---

## 6. Dual Photogrammetry: Shared Scene Reconstruction

Merge camera pose data and photogrammetry outputs from multiple perspectives—shipboard ROVs, drone flyovers, and land-based scans.  
- **Goal**: Richer, more accurate reconstructions and shared frames of reference.
- **Output**: Time-evolving 3D datasets for mapping coral, wrecks, terrain, fauna.

---

## 7. Vibe Science: Collective Dynamics as Signal

Explore physiological, rhythmic, and semantic synchrony among participants as meaningful data.  
- **Examples**:
  - Heartbeat or gaze entrainment during dive viewings.
  - Textual clustering of spontaneous reactions.
- **Tools**: Fourier analysis, sentiment mapping, audio/gesture overlays.
- **Purpose**: Reveal emergent coherence and emotional tone of group experience.

---

## 8. [LiveCamera Scribe: Annotate and Project Live Views](https://stigmergic.webdav.acequia.io:3334/pitches/live-camera-scribe.md)

Enable participants to annotate **live camera feeds**—from ROVs, shipboard cameras, or mobile devices—and project those annotations:
- Into the **shared mission space** (e.g., walls, sandtable, dome),
- Into **3D web environments**, using known or estimated camera pose.
- Use cases include real-time storytelling, pointing, labeling, and collaborative focus.
- Pairs especially well with Zoom Room, Digital Graffiti, and Dual Space environments.

---

## Summary Table

| Strategic Direction       | Primary Outcome                                      |
|---------------------------|-------------------------------------------------------|
| Zoom Room                 | Hybrid geospatial mission interface                   |
| Digital Graffiti          | Collaborative annotation over time and space          |
| Mission Specialist        | Inclusive roles for distributed or nontechnical users |
| Dual Space                | Synchronous physical–digital mission co-presence      |
| Time–Space Modeling       | Simulation of ocean phenomena for insight/storytelling|
| Dual Photogrammetry       | Enhanced collaborative 3D scene reconstruction        |
| Vibe Science              | Understanding group dynamics during exploration       |
| LiveCamera Scribe         | Live annotation of video feeds projected into space   |

---

This stack supports an integrated, embodied form of ocean exploration, blending spatial computing, participatory design, and media-rich storytelling. It offers a new template for collaborative science and hybrid cognition in fieldwork and mission-based research.