Systems Development

BeoQuota
BeoQuota manages users' files on cluster nodes. Here's how it works:


 * 1) Users can put as much as they want on the nodes' scratch space, but files will be deleted if they are not accessed for 1 week.

Users
The Systems Development project is the effort to make St. Olaf's Beowulf Clusters readily available to end users. While some consultation with the Cluster Administrators will always be an important part of any Cluster project, approved users should be able to perform independently such tasks as:


 * Log in to a cluster with their own St. Olaf username and password.
 * Upload their project code and data to a cluster.
 * Create and edit project code files.
 * Compile their project code into machine code, if necessary.
 * Create a batch script for SGE that
 * Copies necessary files from their home directory (NFS) to their job's temporary directory (local).
 * Launches an MPI job
 * Copies any output files back to their home directory
 * View or download output files from their jobs.

One way to support this is through a web interface

Administrators
Some administrative tasks are necessary to support this use of the clusters. Cluster administrators should be prepared to:


 * Grant a St. Olaf user access to one or both clusters.
 * Revoke a St. Olaf user's access to one or both clusters.
 * Manage SGE policies

Current TODO list

 * Castaway backup
 * Amber
 * Hadoop cisc(?) jars to hadoop folder, for wiki interface
 * Cooling cabinet (rab)
 * Support CS1+ projects: wiki;  HiPerCiC, Hadoop interface;  neuron;
 * Retrieve from backup: HiPerCiC (Tony, Todd, front end?)
 * SVN backup project
 * Keys (rab)