Global-to-local decision intelligence using a cross-reality VR platform and satellite earth observation

Researchers in the Human Systems Lab explore the design development of Earth Mission Control (EMC), a cross-reality (XR) Climate Intelligence platform that helps to translate complex satellite and climate data into interactive experiences that people and communities can understand and engage with. The research explores its data modalities and its use in making data-informed climate decisions.

Authors: Minoo Rathnasabapathy, Rachel Connolly, Lucas De Bonet, Dava Newman

Citation: M. Rathnasabapathy, R. Connolly, L. De Bonet and D. Newman, “Global-to-Local Decision Intelligence Using a Cross-Reality VR Platform and Satellite Earth Observation,” in IEEE Pervasive Computing, vol. 24, no. 4, pp. 74-84, Oct.-Dec. 2025

Abstract:
The integration of physical, digital, and immersive modalities into decision intelligence is transforming how complex challenges, such as climate change, are addressed. For example, visualizing rising sea levels in coastal communities can help provide actionable insights to urban planners for adaptation and mitigation efforts. Cross-reality platforms that combine multimodalities offer critical progress in overcoming barriers of data accessibility for climate decision-making by providing actionable insights and fostering collaboration among diverse stakeholders. This design approach serves as a basis for the design of Earth Mission Control (EMC), an immersive decision-support platform that integrates satellite Earth observation data into virtual reality and physical environments, allowing users to interact with critical climate insights across its multimodal features, such as hyperwalls, 3D map tables, and interactive dashboards. This article highlights EMC’s capabilities through its multiuser and remote access features and provides examples of hyperlocal climate storyboards (vignettes) that connect global climate trends to localized impacts.