« Previous 1 2 3 4
Command-line tools for the HPC administrator
Line Items
Summary
I hope in this article that I have pointed out some useful commands for HPC administration. Although the commands tend to be very simple, they can be very powerful (e.g., watch); they are also very useful for plain old Linux administration, not just for HPC. Keep these commands close by on a Post-it note; when you're beginning to debug an issue, a glance at the list will remind you to start with simple tools. You can move on to the "fancy" solutions after you have found the problem. These tools have saved my bacon more than one time, and I hope they help you.
Infos
- Shared libraries: http://tldp.org/HOWTO/Program-Library-HOWTO/shared-libraries.html
- OpenSSH: https://en.wikipedia.org/wiki/OpenSSH
- Parallel shells: http://www.linuxpromagazine.com/Issues/2014/166/Parallel-Shells
- pdsh: https://github.com/chaos/pdsh
- SSHFS: http://www.admin-magazine.com/HPC/Articles/Sharing-Data-with-SSHFS
- FUSE: https://en.wikipedia.org/wiki/Filesystem_in_Userspace
- SFTP: https://en.wikipedia.org/wiki/SSH_File_Transfer_Protocol
- SSHFS performance: http://www.admin-magazine.com/HPC/Articles/Sharing-Data-with-SSHFS
- vmstat: https://linux.die.net/man/8/vmstat
- watch: https://en.wikipedia.org/wiki/Watch_(Unix)
- tmux: https://github.com/tmux/tmux/wiki
- kill: https://en.wikipedia.org/wiki/Kill_(command)
« Previous 1 2 3 4
Buy this article as PDF
(incl. VAT)
Buy ADMIN Magazine
US / Canada
UK / Australia
Related content
-
Small Tools for Managing HPC
Several very sophisticated tools can be used to manage HPC systems, but it’s the little things that make them hum. Here are a few favorites.
-
More Small Tools for HPC Admins
We look at some additional tools that you might find useful when troubleshooting HPC systems .
-
pdsh Parallel Shell
The pdsh parallel shell tool lets you run a command across multiple nodes in a cluster.
-
HPC fundamentals
The pdsh parallel shell is a fundamental HPC tool that lets you run a command across multiple nodes in a cluster. -
Sharing Data with SSHFS
Sharing data saves space, reduces data skew, and improves data management. We look at the SSHFS shared filesystem, put it through some performance tests, and show you how to tune it.