Scalable computing has governed another dimension. Contrary to the traditional HPC definition of total number of processors in a system, the newly rising dimension scales with the number of different type of processing units sharing the computational load. HPC systems are expected to employ a more diverse set of accelerators to accommodate the increasing computational and power demands of evolving workloads. In the meantime, mobile and embedded devices already packing a wide range of processing heterogeneity are expected to become highly connected and distributed.