« Previous 1 2 3 4

Command-line tools for the HPC administrator

Line Items

Summary

I hope in this article that I have pointed out some useful commands for HPC administration. Although the commands tend to be very simple, they can be very powerful (e.g., watch); they are also very useful for plain old Linux administration, not just for HPC. Keep these commands close by on a Post-it note; when you're beginning to debug an issue, a glance at the list will remind you to start with simple tools. You can move on to the "fancy" solutions after you have found the problem. These tools have saved my bacon more than one time, and I hope they help you.

Infos

  1. Shared libraries: http://tldp.org/HOWTO/Program-Library-HOWTO/shared-libraries.html
  2. OpenSSH: https://en.wikipedia.org/wiki/OpenSSH
  3. Parallel shells: http://www.linuxpromagazine.com/Issues/2014/166/Parallel-Shells
  4. pdsh: https://github.com/chaos/pdsh
  5. SSHFS: http://www.admin-magazine.com/HPC/Articles/Sharing-Data-with-SSHFS
  6. FUSE: https://en.wikipedia.org/wiki/Filesystem_in_Userspace
  7. SFTP: https://en.wikipedia.org/wiki/SSH_File_Transfer_Protocol
  8. SSHFS performance: http://www.admin-magazine.com/HPC/Articles/Sharing-Data-with-SSHFS
  9. vmstat: https://linux.die.net/man/8/vmstat
  10. watch: https://en.wikipedia.org/wiki/Watch_(Unix)
  11. tmux: https://github.com/tmux/tmux/wiki
  12. kill: https://en.wikipedia.org/wiki/Kill_(command)

« Previous 1 2 3 4

Buy this article as PDF

Express-Checkout as PDF
Price $2.95
(incl. VAT)

Buy ADMIN Magazine

SINGLE ISSUES
Print Issues
Digital Issues
 
SUBSCRIPTIONS
Print Subs
Digisubs
 
TABLET & SMARTPHONE APPS
Get it on Google Play

US / Canada

Get it on Google Play

UK / Australia

Related content

  • Small Tools for Managing HPC

    Several very sophisticated tools can be used to manage HPC systems, but it’s the little things that make them hum. Here are a few favorites.

    more »
  • More Small Tools for HPC Admins

    We look at  some additional tools that you might find useful when troubleshooting HPC systems .

    more »
  • pdsh Parallel Shell

    The pdsh  parallel shell tool lets you run a command across multiple nodes in a cluster.

    more »
  • Lead Image © Kasia biel, 123RF.com
    HPC fundamentals
    The pdsh parallel shell is a fundamental HPC tool that lets you run a command across multiple nodes in a cluster.
    more »
  • Sharing Data with SSHFS

    Sharing data saves space, reduces data skew, and improves data management. We look at the SSHFS shared filesystem, put it through some performance tests, and show you how to tune it.

    more »
comments powered by Disqus