In this video from FOSDEM 2020, John Hanley from ECMWF presents: Building Cloud-Based Services to Enable Earth Science Workflows across HPC Centres. Weather forecasts produced by ECMWF and environment services by the Copernicus programme act as a vital input for many downstream simulations and applications. A variety of products, such as ECMWF reanalyses and archived […]
Introducing HPC with a Raspberry Pi Cluster
February 12, 2020 by
Colin Sauze from Aberystwyth University gave this talk at FOSDEM 2020. “The motivation for this was to overcome key problems faced by new HPC users. The talk will also discuss some of the technical challenges in deploying an HPC environment to a Raspberry Pi and attempts to keep that environment as close to a “real” HPC as possible. Methods to automate the installation process will also be covered.”
Distributed HPC Applications with Unprivileged Containers
February 9, 2020 by
Felix Abecassis and Jonathan Calmels from NVIDIA gave this talk at FOSDEM 2020. “We will present the challenges in doing distributed deep learning training at scale on shared heterogeneous infrastructure. At NVIDIA, we use containers extensively in our GPU clusters for both HPC and deep learning applications. We love containers for how they simplify software packaging and enable reproducibility without sacrificing performance.”
Efficient Model Selection for Deep Neural Networks on Massively Parallel Processing Databases
February 4, 2020 by
Frank McQuillan from Pivotal gave this talk at FOSDEM 2020. “In this session we will present an efficient way to train many deep learning model configurations at the same time with Greenplum, a free and open source massively parallel database based on PostgreSQL. The implementation involves distributing data to the workers that have GPUs available and hopping model state between those workers, without sacrificing reproducibility or accuracy.”
