Drones operate with modular autonomy stacks: perception, localization, prediction, planning, and control. These modules rely heavily on real-time sensor input and preloaded maps, which can falter in dynamic or degraded conditions—poor visibility, occlusions, or unexpected traffic behavior. Our system introduces a complementary layer: a selective sampling engine that curates high-value video frames from vehicle-mounted or aerial cameras, forming a spatiotemporal catalog of environmental states and trajectory outcomes. This catalog becomes a living memory of the tour, encoding not just what was seen, but how the drone responded and what alternatives existed.  

By applying importance sampling, our copilot prioritizes frames with semantic richness—intersections, merges, pedestrian zones, or adverse weather—creating a dense vector space of contextually significant moments. These vectors are indexed by time, location, and scenario type, enabling retrospective analysis and predictive planning. For example, if a drone needs to calculate distance to a detour waypoint, this could help with similar geometry, overlay ground data, and suggest trajectory adjustments based on historical success rates.  

This retrieval is powered by agentic query framing, where the copilot interprets system or user intent—“What’s the safest merge strategy here?” or “How did similar vehicles handle this turn during rain?”—and matches it against cataloged vectors and online traffic feeds. The result is a semantic response, not just a path: a recommendation grounded in prior information, enriched by real-time data, and tailored to current conditions.  

Our analytics framework respects both autonomous and non-autonomous drone or swarm architectures, acting as a non-invasive overlay that feeds contextual insights into the planning module. It does not replace the planner—it informs it, offering scores, grounded preferences, and fallback strategies when primary sensors degrade.  

Moreover, our system’s customizability with online maps and traffic information integration allows for enriched drone video sensing applications. By leveraging standard 100m high point of reference for aerial images adjusted from online satellite maps of urban scenes, we detect objects that help beyond what custom models are trained for. In addition, the use of catalogued objects, grounded truth, and commodity models for analysis, we make this cost-effective. This help drones to evolve from perceive and plan to remember, compare and adapt which is aligned with the future of agentic mobility.