The gist here provides a script to automate the process of installing Sun Grid Engine (SGE) on a single EC2 machine.
SGE is a job scheduler for a computing cluster. This usually involves a cluster of multiple machines. However for many applications we don't need a massive computing cluster and a cluster of 8-30 nodes would be sufficient. In this tutorial we set-up SGE on a single amazon EC2 machine. The reasons for doing so are as follows:
- Automation: Setting-up a cluster with SGE is fairly involved as it requires multiple machines communicating with each other and having some shared memory. A single machine with multiple cores is already a simple cluster where the memory is shared across cores.
- Moderate Size: Amazon EC2 instances provide a variety of computing options with the number of cores ranging from 1 to 128.
- Cost: The On-Demand price structure of AWS makes this a relatively cheap option. Further cost redu