How to Install Slurm on CentOS 7 Cluster

Slurm is an open-source workload manager designed for Linux clusters of all sizes. It’s a great system for queuing jobs for your HPC applications. I’m going to show you how to install Slurm on a CentOS 7 cluster. Delete failed installation of Slurm Install MariaDB Create the global users Install  Munge Install Slurm Use Slurm Cluster Server and Compute Nodes I configured our nodes with the following hostnames using these steps. Our server is: buhpc3 The clients are: buhpc1 buhpc2...

More

How to Install GlusterFS on CentOS 7

GlusterFS is a scale-out network-attached storage file system. In this tutorial, we’ll be setting up GlusterFS on a cluster with CentOS 7.  Our cluster has 6 nodes connected through a switch. I’ll be using all 6 nodes as servers for distributed replicated storage with opportunity for more nodes to be clients that can access files from the GlusterFS servers. How does GlusterFS work In a GlusterFS, servers are used to store data in a distributed manner, and clients can access...

More

How to Install Ganglia on CentOS 7

Ganglia is a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids. Ganglia is useful when monitoring nodes of a cluster. Setting up Ganglia on CentOS 7 with a bunch of nodes can be confusing. In this blog, I’ll show you how to setup Ganglia and its web interface properly. Our cluster has 6 nodes connected through a switch. Cluster Server and Clients I configured our nodes with the following hostnames using these steps. Our server...

More

How to Add Github.io to Namecheap Domain

As you probably know, you can create username.github.io, and Github will host your static website. What if you want this username.github.io to be a different domain name that you purchased on namecheap? Let’s say that I have buhpc.github.io, and I want it to be buhpc.com, which I have purchased on namecheap. How exactly do I do that? Add CNAME to username.github.io We should add CNAME to our username.github.io. We can easily do this through the terminal or website GUI. I’ll...

More

How to Add Subdomains on Namecheap

Adding subdomains on Namecheap is quick and easy. Let’s say that I have a remote computer with IP address, 128.197.115.158. I want to be able to SSH into this machine, but I hate needing to remember the IP address. Well, if you have purchased a website domain name on Namecheap like I have, just add a subdomain to your website! One of my websites that I have registered with Namecheap is http://buhpc.com, so I’ll be using that as the example.  ...

More

How to Bypass Intel PXE Boot

You might encounter a PXE Boot loading screen on your cluster, but you don’t have PXE Boot. And your network isn’t even configured yet! Many machines built to be part of clusters will pop up to this PXE screen and will loop forever! What do you do?   Change the Boot Order Let’s say that all I want to do is boot the machine and install a new operating system. I have my trusty CentOS 7 Bootable USB installer drive...

More

How to Compile HPCG

HPCG, which stands for High Performance Conjugate Gradients, is a benchmark project to create a new metric for ranking HPC systems. HPCG measures the performance of basic operations including sparse matrix-vector multiplication, sparse triangular solve, vector updates, global dot products and more. The implementation is written in C++ with MPI and OpenMP support. http://www.hpcg-benchmark.org/software/index.html   HPCG Reference Code There are versions of HPCG optimized for NVIDIA GPUs or Intel XEON Phis. For this blog post, I’ll show you how to...

More

How to Setup the Intel Compilers on a Cluster

Intel compilers like icc or icl are very useful for any cluster with Intel processors. They’ve been known to produce very efficient numerical code. If you are still a student, you can grab the student Intel Parallel Studio XE Cluster Edition, which includes Fortran and C/C++ for free for a year. Here’s our experience. If you need more information, definitely check out the official Intel Parallel Studio XE Cluster Edition guide. Dependencies You should have the GCC C and C++...

More

Running MPI – Common MPI Troubleshooting Problems

In this post, I’ll list some common troubleshooting problems that I have experienced with MPI libraries after I compiled MPICH on my cluster for the first time. The following assumes that: You have at least 2 nodes as part of your cluster. You have MPI compiled inside a NFS (Network File System), a shared folder. I will divide the common problems into separate sections. For my first installation of an MPI library, I was using http://www.mpich.org/downloads/   MPI Paths on each...

More

yum [Errno 14] HTTP Error 404 – Not Found

When you run a yum command like: yum install vim You may get the following error: Loaded plugins: fastestmirror http://repo.dimenoc.com/pub/centos/7.1.1503/os/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 – Not Found Trying other mirror. Is this ok [y/d/N]: y Downloading packages: Delta RPMs disabled because /usr/bin/applydeltarpm not installed. vim-enhanced-7.4.160-1.el7.x86 FAILED http://ftp.linux.ncsu.edu/pub/CentOS/7.1.1503/os/x86_64/Packages/vim-enhanced-7.4.160-1.el7.x86_64.rpm: [Errno 14] HTTP Error 404 – Not Found To fix the error: yum clean all yum update Now try again: yum install vim The command should continue normally.

More