分布式内存并行计算机上的可伸缩并行矩阵乘法

Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000 Pub Date : 2000-05-01 DOI:10.1109/IPDPS.2000.846000

Keqin Li

{"title":"分布式内存并行计算机上的可伸缩并行矩阵乘法","authors":"Keqin Li","doi":"10.1109/IPDPS.2000.846000","DOIUrl":null,"url":null,"abstract":"Consider any known sequential algorithm for matrix multiplication over an arbitrary ring with time complexity O(N/sup /spl alpha//), where 2</spl alpha//spl les/3. We show that such an algorithm can be parallelized on a distributed memory parallel computer (DMPC) in O (log N) time by using N/sup /spl alpha///log N processors. Such a parallel computation is cost optimal and matches the performance of PRAM. Furthermore, our parallelization on a DMPC can be made fully scalable, that is, for all 1/spl les/p/spl les/N/spl alpha//sup /spl alpha///log N, multiplying two N/spl times/N matrices can be performed by a DMPC with p processors in O(N/sup /spl alpha///p) rime, i.e., linear speedup and cost optimality can be achieved in the range [1..N/sup /spl alpha///log N]. This unifies all known algorithms for matrix multiplication on DMPC, standard or non-standard, sequential or parallel. Extensions of our methods and results to other parallel systems are also presented. The above claims result in significant progress in scalable parallel matrix multiplication (as well as solving many other important problems) on distributed memory systems, both theoretically and practically.","PeriodicalId":206541,"journal":{"name":"Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000","volume":"43 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2000-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"26","resultStr":"{\"title\":\"Scalable parallel matrix multiplication on distributed memory parallel computers\",\"authors\":\"Keqin Li\",\"doi\":\"10.1109/IPDPS.2000.846000\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Consider any known sequential algorithm for matrix multiplication over an arbitrary ring with time complexity O(N/sup /spl alpha//), where 2</spl alpha//spl les/3. We show that such an algorithm can be parallelized on a distributed memory parallel computer (DMPC) in O (log N) time by using N/sup /spl alpha///log N processors. Such a parallel computation is cost optimal and matches the performance of PRAM. Furthermore, our parallelization on a DMPC can be made fully scalable, that is, for all 1/spl les/p/spl les/N/spl alpha//sup /spl alpha///log N, multiplying two N/spl times/N matrices can be performed by a DMPC with p processors in O(N/sup /spl alpha///p) rime, i.e., linear speedup and cost optimality can be achieved in the range [1..N/sup /spl alpha///log N]. This unifies all known algorithms for matrix multiplication on DMPC, standard or non-standard, sequential or parallel. Extensions of our methods and results to other parallel systems are also presented. The above claims result in significant progress in scalable parallel matrix multiplication (as well as solving many other important problems) on distributed memory systems, both theoretically and practically.\",\"PeriodicalId\":206541,\"journal\":{\"name\":\"Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000\",\"volume\":\"43 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2000-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"26\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IPDPS.2000.846000\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IPDPS.2000.846000","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}