After many attempts at running DMTCP and MPI on a cluster, I've managed to run it on a single node. This is the script I'm using to install it. After finishing the installation, I set a dmtcp_coordinator on a terminal and run dmtcp_launch --join-coordinator -i 360 mpirun -np 4 ./application on another terminal (I'm using screen to launch both terminals because I'm working with Ubuntu Server). I'm using MPICH (3.3a2), DMTCP (2.5.2) on Ubuntu Server 18.04.6. I've also managed to make MVAPICH to work with it (but had to force it to use TCP over Infiniband on the ./configure process). Now I'm try ..read more

root@localhost:~/capstone/mpi# mpirun --allow-run-as-root -np 1 python3 index.py [localhost:18945] opal_ifinit: ioctl(SIOCGIFHWADDR) failed with errno=13 [localhost:18945] pmix_ifinit: ioctl(SIOCGIFHWADDR) failed with errno=13 [localhost:18945] ptl_tool: problems getting address for index 122 (kernel index -1) -------------------------------------------------------------------------- The PMIx server's listener thread failed to start. We cannot continue. -------------------------------------------------------------------------- I am using termux with ubuntu. I need to run a python program. How ..read more

Rescale is hiring for a few roles right now. Mostly in Japan/Korea right now, but you can fill out a General Interest Form to be considered for future openings in other teams/locations. #HPC #CFD #CAE submitted by /u/GrittyHPC [visit reddit] [comments ..read more

Hey folks, I have a BS in computer science and recently completed a PhD in astrophysics. I've decided that I'm done with the academia and have been trying to figure out what my next step should be. My thesis work involved running and analyzing large-scale simulations on HPC machines, and I've spent the last year as a postdoc rewriting and optimizing the simulation software we used to take advantage of the latest GPU hardware. I also have a little bit of experience playing with PyTorch to build initial conditions for our simulations using generative AI. I'm most interested in transitioning to ..read more

Hi, I was looking to use TBB concurrent_vector I am running C++ library Pagmo2 and would like to pass a vector or array between threads with thread safety. While one could use mutixes and/or locks, the data will be passed frequently and locks would really slow things down. I suspect and hope that TBB concurrent_vector could allow multiple threads to modify without delays associated with locks provided I set the concurrent_vector size and not change it - just read and write values from a fixed size array e.g. concurrent_vector no growth or shrink operations will be performed after the initial ..read more

I have experience with compute clusters used for research purposes. Soon, we might need a GPU cluster for Machine Learning purposes. I’m interested in getting involved. I think it’s good for my career too, since this use case is becoming a huge part of the economy. Can anyone point me to some online material for administering GPU clusters? Specifically, I’m looking learn enough in the near future to decide whether we should buy GPUs or do this in the cloud. submitted by /u/bigtablebacc [visit reddit] [comments ..read more

I have an FDR InfiniBand system made of what on eBay was compatible and cheap enough. Some of the HCAs I bought have had their GUIDs customized and I'm curious what value there is in doing so. If there is, how do you choose your custom values? submitted by /u/naptastic [visit reddit] [comments ..read more

I recently just received a PhD offer in HPC (specifically about tensor network) in USA. But I came from an asian country and would like to live in APAC after graduation. Is there any industrial research center in APAC that is doing research on HPC (doesn't have to be specifically on this topic)? submitted by /u/Impossible_Toe1063 [visit reddit] [comments ..read more

Have noticed a good amount of these type of posts lately. I have worked for a few different universities and have seen some of these in person that were designed by grad students etc. In general, IT staff loathes them. The first grad student who designed and set it up doesn’t normally have any issues requiring IT staff support, but after they leave they tend to be abandoned. This tends to be because they are setup in non standard configurations, or the hardware was borderline obsolete after 3-5 years. It’s probably an excellent learning experience for that first grad student on a variety of t ..read more

Hi guys. I have been a Computational Fluid Dynamics (CFD) engineer for about 6 years now. And everyday I get impressed by the machines we submit jobs to. I have been trying to get to understand them better since I began this job. Two years ago, our cluster that we used to submit jobs to got projects loaded up on it for 3 years ish forward. So my manager bought about 10 computers (each having like a 128 cores and 1024 GB RAM). If you ask me it was an insane decision over contracting a third-party company to buy our own cluster to be managed by them, but I won’t complain cause I liked setting t ..read more