Artykuł w czasopiśmie
Brak miniatury
Licencja
ClosedAccessDostęp zamknięty
 

Scalable computing in Java with PCJ Library. Improved collective operations

Uproszczony widok
dc.abstract.enMachine learning and Big Data workloads are becoming as important as traditional HPC ones. AI and Big Data users tend to use new programming languages such as Python, Julia, or Java, while the HPC community is still dominated by C/C++ or Fortran. Hence, there is a need for new programming libraries and languages that will integrate different applications and allow them to run on large computer infrastructure. Since modest computers are multinode and multicore, parallel execution is an additional challenge here. For that purpose, we have developed the PCJ library, which introduces parallel programming capabilities to Java using the Partitioned Global Address Space model. It does not modify language nor running environment (JVM). The PCJ library allows for easy development of parallel code and runs it on laptops, workstations, supercomputers, and the cloud. This paper presents an overview of the PCJ library and its usage in parallelizing selected workloads, including HPC, AI, and Big Data. The performance and scalability are presented. We present recent addition to the PCJ library, which are collective operations. The collective operations significantly reduce the number of lines of code to write, ensuring good performance.
dc.affiliationUniwersytet Warszawski
dc.conference.countryTajwan
dc.conference.datefinish2021-03-26
dc.conference.datestart2021-03-22
dc.conference.placeTajpej
dc.conference.seriesInternational Symposium on Grids and Clouds
dc.conference.seriesInternational Symposium on Grids and Clouds
dc.conference.seriesshortcutISGC
dc.conference.shortcutISGC2021
dc.conference.weblinkhttps://pos.sissa.it/378/
dc.contributor.authorNowicki, Marek
dc.contributor.authorBała, Piotr
dc.contributor.authorGórski, Łukasz
dc.date.accessioned2024-01-25T19:43:28Z
dc.date.available2024-01-25T19:43:28Z
dc.date.issued2021
dc.description.financePublikacja bezkosztowa
dc.description.volume378
dc.identifier.doi10.22323/1.378.0007
dc.identifier.issn1824-8039
dc.identifier.urihttps://repozytorium.uw.edu.pl//handle/item/119037
dc.identifier.weblinkhttp://dx.doi.org/10.22323/1.378.0007
dc.languageeng
dc.pbn.affiliationcomputer and information sciences
dc.relation.ispartofPROCEEDINGS OF SCIENCE
dc.relation.pages1-19
dc.rightsClosedAccess
dc.sciencecloudnosend
dc.titleScalable computing in Java with PCJ Library. Improved collective operations
dc.typeJournalArticle
dspace.entity.typePublication