The Importance of Supercomputing

Most people use their computers (which includes mobile phones) for communication, social media, games, entertainment, office applications, and the like. Most of the time these activities are not particularly onerous in terms of computing as such or do not lead to enormous benefits in productivity, inventions, and discovery. There is one field, however, rarely discussed, that does do this - and that is supercomputing. It is through supercomputing that we are witnessing the most important technological advances of our day, including astronomy, weather and climate forecasting, materials science and engineering, molecular modeling, genomics, neurology, geoscience, and finance - all with numerous success stories (https://web.archive.org/web/20151031013056/https://www.hpcuserforum.com/downloads/HPCSuccessStories.pdf).

Usually, I draw a distinction between supercomputing and high-performance computing. Specifically, a supercomputer is any computer system that has exceptional computational power at a particular point in time, many (but not all) of which are measured in the bi-annual Top500 list (https://top500.org/). Once upon a time dominated by monolithic mainframes supercomputers, in a contemporary sense, are a subset of high-performance computing, which is typically arranged as a cluster of commodity-grade servers with a high-speed interconnect and message-passing software that allows the entire unit to be treated as a whole. One can even put together a "supercomputer" from Raspberry Pi systems, as the University of Southhampton illustrates (https://www.youtube.com/watch?v=Jq5nrHz9I94).

How important is this? For many years now we've known that there is a strong association between research output (https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1679248) and access to such systems. Macroeconomic analysis (https://www.hpcuserforum.com/downloads/idcstudy.zip) shows that for every dollar invested in supercomputing, there is a return of forty-four dollars in profits or cost-savings. Both these metrics are almost certainly going to increase in time; datasets and problem complexity are growing at a rate greater than the computational performance of personal systems. More researchers need access to supercomputers.

However, researchers do require training to use such systems. The environment, the interface, the use of schedulers on a shared system, the location of data (https://www.youtube.com/watch?v=9eyFDBPk4Yw), is all something that needs to be learned. This is a big part of my life; in the last week, I spent three days teaching researchers from the basic of using a supercomputer system to scripting jobs, to using Australia's most powerful system Gadi at NCI (https://nci.org.au/news-events/news/australias-gadi-a-recognised-powerhouse-global-supercomputing-ranking), along with contributions at a board meeting of the international HPC Certification Forum (https://www.hpc-certification.org/). It is often a challenging vocation, but I feel confident that it is making a real difference to our shared lives. For that, I am very grateful.

From: https://levlafayette.com/node/750