T. Elsethagen, E. Stephan, B. Raju, M. Schram, M. Macduff, Darrern Kerbyson, K. K. van Dam, Alok Singh, I. Altintas
{"title":"Data provenance hybridization supporting extreme-scale scientific workflow applications","authors":"T. Elsethagen, E. Stephan, B. Raju, M. Schram, M. Macduff, Darrern Kerbyson, K. K. van Dam, Alok Singh, I. Altintas","doi":"10.1109/NYSDS.2016.7747819","DOIUrl":"https://doi.org/10.1109/NYSDS.2016.7747819","url":null,"abstract":"As high performance computing (HPC) infrastructures continue to grow in capability and complexity, so do the applications that they serve. HPC and distributed-area computing (DAC) (e.g. grid and cloud) users are looking increasingly toward workflow solutions to orchestrate their complex application coupling, pre- and post-processing needs. To that end, the US Department of Energy Integrated end-to-end Performance Prediction and Diagnosis for Extreme Scientific Workflows (IPPD) project is currently investigating an integrated approach to prediction and diagnosis of these extreme-scale scientific workflows. To gain insight and a more quantitative understanding of a workflow's performance our method includes not only the capture of traditional provenance information, but also the capture and integration of system environment metrics helping to give context and explanation for a workflow's execution. In this paper, we describe IPPD's provenance management solution (ProvEn) and its hybrid data store combining both of these data provenance perspectives. We discuss design and implementation details that include provenance disclosure, scalability, data integration, and a discussion on query and analysis capabilities. We also present use case examples for climate modeling and thermal modeling application domains.","PeriodicalId":406964,"journal":{"name":"2016 New York Scientific Data Summit (NYSDS)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129736838","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Curating identifiable data for sharing: The databrary project","authors":"R. Gilmore, K. Adolph, David S Millman","doi":"10.1109/NYSDS.2016.7747817","DOIUrl":"https://doi.org/10.1109/NYSDS.2016.7747817","url":null,"abstract":"Video captures the nuances and dynamics of human behavior more cheaply and completely than other recording methods. Although the detailed fidelity of video provides significant potential for reuse, this potential goes largely unrealized because videos are rarely shared. Moreover, the large size of video files, diversity of file formats, and incompatible software tools pose technical challenges, and recordings of faces and voices pose issues regarding participant identifiability. The Databrary (databrary.org) data library, based at NYU, has developed solutions for: securely sharing research video while respecting participants' privacy, storing and streaming shared video, and managing video datasets and associated metadata. Video data are big data, and interest in recording, analyzing, and sharing video for research, education, and policy purposes continues to grow. Databrary makes video data sharing convenient and attractive for researchers, thereby increasing transparency and enhancing the potential for discovery.","PeriodicalId":406964,"journal":{"name":"2016 New York Scientific Data Summit (NYSDS)","volume":"72 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115087178","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Boyu Zhang, Line C. Pouchard, Preston M. Smith, A. Gasc, B. Pijanowski
{"title":"Data storage and sharing for the long tail of science","authors":"Boyu Zhang, Line C. Pouchard, Preston M. Smith, A. Gasc, B. Pijanowski","doi":"10.1109/NYSDS.2016.7747811","DOIUrl":"https://doi.org/10.1109/NYSDS.2016.7747811","url":null,"abstract":"Research data infrastructure such as storage must now accommodate new requirements resulting from trends in research data management that require researchers to store their data for the long term and make it available to other researchers. We propose Data Depot, a system and service that provides capabilities for shared space within a group, shared applications, flexible access patterns and ease of transfer at Purdue University. We evaluate Depot as a solution for storing and sharing multi-terabytes of data produced in the long tail of science with a use case in soundscape ecology studies from the Human-Environment Modeling and Analysis Laboratory. We observe that with the capabilities enabled by Data Depot, researchers can easily deploy fine-grained data access control, manage data transfer and sharing, as well as integrate their workflows into a High Performance Computing environment.","PeriodicalId":406964,"journal":{"name":"2016 New York Scientific Data Summit (NYSDS)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122779295","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
L. Hou, Kunal Singh, D. Samaras, T. Kurç, Yi Gao, R. Seidman, J. Saltz
{"title":"Automatic histopathology image analysis with CNNs","authors":"L. Hou, Kunal Singh, D. Samaras, T. Kurç, Yi Gao, R. Seidman, J. Saltz","doi":"10.1109/NYSDS.2016.7747812","DOIUrl":"https://doi.org/10.1109/NYSDS.2016.7747812","url":null,"abstract":"We define Pathomics as the process of high throughput generation, interrogation, and mining of quantitative features from high-resolution histopathology tissue images. Analysis and mining of large volumes of imaging features has great potential to enhance our understanding of tumors. The basic Pathomics workflow consists of several steps: segmentation of tissue images to delineate the boundaries of nuclei, cells, and other structures; computation of size, shape, intensity, and texture features for each segmented object; classification of images and patients based on imaging features; and correlation of classification results with genomic signatures and clinical outcome. Executing a Pathomics workflow on a dataset of thousands of very high resolution (gigapixels) and heterogeneous histopathology images is a computationally challenging problem. In this paper, we use Convolutional Neural Networks (CNN) for automatic recognition of nuclear morphological attributes in histopathology images of glioma, the most common malignant brain tumor. We constructed a comprehensive multi-label dataset of glioma nuclei and applied two CNN based methods on this dataset. Both methods perform well recognizing some but not all morphological attributes and are complementary with each other.","PeriodicalId":406964,"journal":{"name":"2016 New York Scientific Data Summit (NYSDS)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123812767","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shenghui Cheng, B. Wang, Wen Zhong, C. Xie, Salman Mahmood, Jun Wang, K. Mueller
{"title":"Model-driven visual analytics for big data","authors":"Shenghui Cheng, B. Wang, Wen Zhong, C. Xie, Salman Mahmood, Jun Wang, K. Mueller","doi":"10.1109/NYSDS.2016.7747827","DOIUrl":"https://doi.org/10.1109/NYSDS.2016.7747827","url":null,"abstract":"The growth of digital data is tremendous. Any aspect of life and matter is being recorded and stored on cheap disks, either in the cloud, in businesses, or in research labs. We can now afford to explore very complex relationships with many variables playing a part. But for this we need powerful tools that allow us to be creative, to sculpt this intricate insight formulated as models from the raw block of data. High-quality visual feedback plays a decisive role here. The subject of this poster is a framework we have developed over the years to make the exploration of large multivariate data more intuitive and direct. The components of this framework were conceived in tight collaborations with domain experts in the fields of climate science, health informatics, computer systems, and others.","PeriodicalId":406964,"journal":{"name":"2016 New York Scientific Data Summit (NYSDS)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114947266","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Visualization of the Higgs Interaction in the Standard Model and Beyond the Standard Model Physics","authors":"H. Lee, M. McGuigan","doi":"10.1109/NYSDS.2016.7747823","DOIUrl":"https://doi.org/10.1109/NYSDS.2016.7747823","url":null,"abstract":"We use visualization to investigate the Higgs Interaction in the Standard Model and Beyond the Standard Model Physics. The Higgs discovery at the Large Hadron Collider has allowed for a precise determination of the Higgs Potential. We visualize this potential and the Higgs interactions with the fermions of the Standard Model as well as beyond standard model such as interactions with Dark matter and heavy neutrinos. We animate these potentials with respect to energy and temperature (different energies and temperatures per frame) to see how the potential changes shape as one moves up in energy or temperature.","PeriodicalId":406964,"journal":{"name":"2016 New York Scientific Data Summit (NYSDS)","volume":"61 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132019304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Visualization and simulation of the material properties of carbon nanotori","authors":"Y. Low, M. McGuigan","doi":"10.1109/NYSDS.2016.7747824","DOIUrl":"https://doi.org/10.1109/NYSDS.2016.7747824","url":null,"abstract":"We use visualization, animation, and simulation to investigate the material properties of carbon nanotori. To study the carbon nanotori we use the tight-binding model with nearest neighbor interactions together with an interaction term involving the Coulomb interaction between the electrons and has been effectively used for graphene and carbon nanotubes. We use the non-interacting tight-binding model to for our simulations and visualizations.","PeriodicalId":406964,"journal":{"name":"2016 New York Scientific Data Summit (NYSDS)","volume":"116 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127836839","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A framework to visualize temporal behavioral relationships in streaming multivariate data","authors":"Shenghui Cheng, K. Mueller, W. Xu","doi":"10.1109/NYSDS.2016.7747808","DOIUrl":"https://doi.org/10.1109/NYSDS.2016.7747808","url":null,"abstract":"Big Data analysis for scientific data is extremely challenging due to the following features - high resolution, extreme scale, high acquisition rate, multivariate data format and aggregating in the streaming fashion. Therefore, a visual analysis tool that can process, reduce, manipulate and display extreme-scale data is critical for scientists to make the right decision on-site and adjust their measurement strategies during the experiment. The lack of these tools not only severely reduces the scientific throughput, but also impairs our capability for scientific discoveries. In this paper, we describe StreamVisND - an interactive framework that provides several linked displays designed to reveal multivariate temporal behavior patterns from various perspectives. All of these displays generalize standard visualization paradigms such as line graphs from time samples to time intervals. As such the integral data type of our application is the time interval which we represent as a vector of time samples. Relationships of time intervals are expressed as similarities, possibly warped over time, of pairs of time vectors. These similarities can be among different variables at the same time interval, or different time intervals of the same variable. The former results in a line graph of streaming variables, while the latter results in a new display we called illustrative transform lines of time intervals over the variables. For both displays since the comparative metric is now pairwise similarity, as opposed to absolute value, we require an optimization algorithm, such as multidimensional scaling to perform mapping into display coordinates. Additional displays include a 2D embedding of temporal snapshots of the variables, as well as a 2D embedding of temporal relationships changes among the variables. We demonstrate our system in an environmental pollution diagnostics setting and have obtained encouraging results.","PeriodicalId":406964,"journal":{"name":"2016 New York Scientific Data Summit (NYSDS)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133282492","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pir Muhammad Siddique, R. Malik, A. A. Chohan, W. Khan, S. Siddiqui, A. Minhas, Shaheena Bashir, Maleeha Maria, Sobia Shafique, N. Waheed, M. Azam, R. Qamar
{"title":"Analysis of VSX1, HGF and LOX in the Pakistani familial and sporadic Keratoconus patients","authors":"Pir Muhammad Siddique, R. Malik, A. A. Chohan, W. Khan, S. Siddiqui, A. Minhas, Shaheena Bashir, Maleeha Maria, Sobia Shafique, N. Waheed, M. Azam, R. Qamar","doi":"10.1109/NYSDS.2016.7747822","DOIUrl":"https://doi.org/10.1109/NYSDS.2016.7747822","url":null,"abstract":"Purpose: Three genes VSX1, HGF and LOX have been previously reported to be causative of keratoconus (KC) in different populations. In the current study we investigated the role of these genes in three autosomal recessive Pakistani families and 100 sporadic KC cases from Pakistan. Methods: Mutation analysis of VSX1 gene was done by Sanger sequencing of three KC families, while 100 sporadic cases including 10 cases with positive maternal family history were sequenced for mutation hotspot exon 2 of the gene. For the sporadic cases, case-control association analysis was also performed for KC associated reported polymorphisms in HGF (rs17501108 and rs3735520), and LOX (rs1800449, rs2288393 and rs2956540) gene through polymerase chain reaction-restriction fragment length polymorphism (PCR-RFLP) method. Results: Screening of the VSX1 did not reveal any mutation in KC panel, a synonymous polymorphism rs12480307 (c.546A>G; p.Ala182Ala) in exon 3 was observed in one of the proband who inherited it homozyogusly from the carrier parent. This polymorphism was not observed in sporadic KC cases. In addition no significant association of the HGF and LOX SNPs were observed through case-control association analysis of sporadic cases. Conclusion: This is the first report of KC genetics from Pakistan where we excluded the role of VSX1 in Pakistani KC panel, in addition none of the previously reported SNPs of HGF and LOX have any involvement in disease pathogenesis in Pakistani KC cases.","PeriodicalId":406964,"journal":{"name":"2016 New York Scientific Data Summit (NYSDS)","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133889278","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Stillerman, T. Fredian, M. Greenwald, J. Wright
{"title":"A general purpose tool-set for representing data relationships: Converting data into knowledge","authors":"J. Stillerman, T. Fredian, M. Greenwald, J. Wright","doi":"10.1109/NYSDS.2016.7747809","DOIUrl":"https://doi.org/10.1109/NYSDS.2016.7747809","url":null,"abstract":"Rich metadata is required to find and understand the recorded measurements from modern experiments with their immense and complex data stores. Systems to store and manage these metadata have improved over time, but in most cases are ad-hoc collections of data relationships, often represented in domain or site specific application code. We are developing a general set of tools to store, manage, and retrieve data-relationship metadata. These tools will be agnostic to the underlying data storage mechanisms, and to the data stored in them, making the system applicable across a wide range of science domains. Data management tools typically represent at least one relationship paradigm through implicit or explicit metadata. The addition of these metadata allows the data to be searched and understood by larger groups of users over longer periods of time. Using these systems, researchers are less dependent on one on one communication with the scientists involved in running the experiments, nor to rely on their ability to remember the details of their data. In the magnetic fusion research community, the MDSplus system is widely used to record raw and processed data from experiments. Users create a hierarchical relationship tree for each instance of their experiment, allowing them to record the meanings of what is recorded. Most users of this system, add to this a set of ad-hoc tools to help users locate specific experiment runs, which they can then access via this hierarchical organization. However, the MDSplus tree is only one possible organization of the records, and these additional applications that relate the experiment `shots' into run days, experimental proposals, logbook entries, run summaries, analysis work flow, publications, etc. have up until now, been implemented on an experiment by experiment basis. The Metadata Provenance Ontology project, MPO, is a system built to record data provenance information about computed results. It allows users to record the inputs and outputs from each step of their computational workflows, in particular, what raw and processed data were used as inputs, what codes were run and what results were produced. The resulting collections of provenance graphs can be annotated, grouped, searched, filtered and browsed. This provides a powerful tool to record, understand, and locate computed results. However, this can be understood as one more specific data relationship, which can be construed as an instance of something more general. Building on concepts developed in these projects, we are developing a general system that could be used to represent all of these kinds of data relationships as mathematical graphs. Just as MDSplus and MPO were generalizations of data management needs for a collection of users, this new system will generalize the storage, location, and retrieval of the relationships between data. The system will store data relationships as data, not encoded in a set of application specific programs or ad hoc da","PeriodicalId":406964,"journal":{"name":"2016 New York Scientific Data Summit (NYSDS)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130960396","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}