Exploring Scalable Computing Architectures for Interactions Analysis

Characterization of pharmacological signal transductions leading to drug-induced expressions of genes and proteins requires the capability to identify interactions among different potential predictor components, e.g. genomic data, clinical data, and environmental data. The detection of these gene-gene and gene-environment interactions remains challenging due to the exponential computational complexity and high dimensionality of the interaction problem. The problem is further exacerbated due to the involvement of very large-scale epidemiological datasets. Efficient high-order interaction analysis of such large-scale data is not feasible with the traditional frameworks. Parallel implementations of such applications in traditional cluster environments are often inefficient due to the storage bandwidth and network I/O limitations. Scalable distributed platforms can offer better scalability to such problems compared to the cluster architectures. Moreover, such data- and compute- intensive problems can benefit even further from data-intensive supercomputing (DISC) architectures that have been shown to yield superior performance compared to the regularly used cluster platforms. In this paper, we evaluate the applicability of different architectures such as traditional server based distributed architectures supported on commodity hardware and shared nothing architectures with massively parallel processing capabilities, towards the Interaction Analysis problem. Our experiments show that the massively parallel processing, shared-nothing architecture outweigh the benefits often realized through traditional server based and even distributed computing architectures. We conclude that the rapidly growing class of shared nothing architectures offers a potentially efficient and viable alternative to facilitate high-order interaction analysis involving extremely large scale biological datasets and is well suited to this category of data- and compute- intensive problems that cannot be addressed effectively using traditional frameworks.