A good starting point is probably to understand the challenges and opportunities of an HPC. Here is a unique opportunity to understand it all.
This course provides a high-level view of the architecture and the usage modes of an HPC system. The applicability of HPC for a selected number of applications will be understood. The challenges of developing and running applications on such an HPC platform will be comprehended.
More info: Competence.lu