Welcome to the DISCnet HPC/Scalable computing course. The module introduces high performance computing (HPC), high-throughput computing (HTC), parallel computing, and cloud computing. Using SCIAMA supercomputer access, students will work with real-world applications / simulation codes to familiarize them with the techniques applied.
On this website, we will provide you with information, slides and exercises you need for this course.
Program
Each day will be split into morning lectures, which will introduce the concepts of HPC and parallel computing, while in the afternoon, we will run a workshop, where students will be provided with specific ‘hands-on’ training of how to use SCIAMA (ICG supercomputer), and how to begin applying their knowledge. The morning session will be split up into two lectures while the afternoon session will consist of tutorials. Students can work in teams during the practicals.
Day 1 – HARDWARE/SYSTEM
10:00 – 10:30: Welcome / Motivation
10:30 – 11:15: HPC Hardware (Gary Burton, ICG) [slides]
11:15 – 11:30: coffee/tea break
11:30 – 12:45: HPC OS/Software (Gary Burton, ICG) [slides]
12:45 – 13:45: lunch break
13:45 – 14:30: check-in / preparations [slides-keys]
14:30 – 14:45: coffee/tea break
14:45 – 17:00: Hands-on workshop for SCIAMA / Tutorials [exercises]
Day 2 – DATA PROCESSING
9:00 – 10:30: Introduction to Parallel Programming / Design (Jascha Schewtschenko, ICG) [slides]
10:30 – 11:00: coffee/tea break
10:45 – 12:30: Coding in Parallel: OpenMP, Pthreads & MPI (Jascha Schewtschenko, ICG) [slides]
12:30 – 13:00: Lunch break
13:30 – 15:30: Tutorials [exercises] [openmp-syntax]
15:30 – 16:00: coffee/tea break
16:00 – 18:00: Evening Lab / Coding Challenge
Day 3 – DATA STORAGE
9:00 – 9:45: Introduction to storage (NFS, GFS) and databases (e.g. SQL) (Jascha Schewtschenko, ICG) [slides]
10:00 – 11:00: Hadoop, Apache Spark, Apache Drill – Part 1 (Leon Clayton, MapR) [slides-1] [slides-2]
11:00 – 11:15: coffee/tea break
11:15 – 12:30: Hadoop, Apache Spark, Apache Drill – Part 2 (Leon Clayton, MapR) [slides-3]
12:30 – 13:30: Lunch break
13:30 – 14:30: Google Cloud Services (Hatem Nawar, Google)
14:30 – 16:30: Hands-on workshop for Google services, Hadoop, Apache Spark, Apache Drill [install-drill] [hands-on]
16:30 – 16:45: Farewell