A Community-Driven Workflow Recommendations and Reuse Infrastructure

Abstract

NASA Earth Exchange (NEX) aims to provide a platform to enable and facilitate scientific collaboration and knowledge sharing in the Earth sciences, as current satellite measurements rapidly magnify the accumulation of more than 40 years of NASA datasets. One of the main objectives of NEX is to help Earth scientists leverage and reuse various data processing software modules developed by their peers, in order to quickly run value-added executable experiments (workflows). Toward this goal, this paper reports our efforts of leveraging social network analysis to intelligently extract hidden information from data processing workflows. By modeling Earth science workflow modules as social entities and their dependencies as social relationships, this research opens up new vistas for applying social science to facilitate software reuse and distributed workflow development. As a proof of concept, a prototyping system has been developed as a plug-in to the NEX workflow design and management system (VisTrails) to aid Earth scientists in discovering and reusing workflow modules and extending them to solve more complex science problems.