Relationship between data engineering and software engineering

Abstract

Data engineering and software engineering have a very close relationship. Our ability in developing and maintaining large-scale software mainly depends on our ability to understand, analyze, use and update the enormous amount of data associated with various phases of the life cycle of the large-scale software system under consideration. Although many tools to provide useful assistance in developing and maintaining software are available, they are often not effective for large-scale software due to the complexity in dealing with the very large amount of data. One way to overcome this difficulty is to develop a knowledge-based software environment so that artificial intelligence techniques can be applied to large-scale software development and maintenance. On the other hand, the effectiveness and quality of data engineering depend upon the performance of the software engineering approaches and tools used in data engineering. In this panel session, the panelists will discuss various aspects of this subject and exchange their ideas and experiences in this area. Ample time will be available for discussion from the floor.