I am a scientist working in a high performance computing project(the computational programming aspect) and I have no idea of networking or networking hardware required to answer my question. A professor friend of mine who works in HPC gave me the following configuration - Buy two AMD Ryzen 16 core processors and connect them through an infiniband interconnect. We are planning to buy 2 desktops that host those AMD Ryzen 16 core processors. That we hope will give us the same speed as a 32 core processor. If the question is raised as to why not buy a single 32 core processor the answer is the prevailing market situation has rendered the 32 or 64 core processor unavailable(World wide present chip shortage)
My question is whether the above architecture allows one to add a 64 core processor in the future or whether all the nodes in this cluster have to have the same number of cores ?
We are planning to run high performance weather forecast simulations as shown here - HPC for weather forecasting and this software is designed for use across multiple nodes. It has been parallelized.