Campuses:
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| computing:department:unix:jobs:home [2009/01/29 18:39] – allan | computing:department:unix:jobs:home [2013/07/17 16:41] (current) – [I/O intensive jobs] allan | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| - | ===== How and Where to run computing jobs ===== | + | ====== How and Where to run computing jobs ====== |
| - | ==== Running Jobs on the Cluster | + | ===== What systems are available ===== |
| - | The best way to run background computing jobs on the unix cluster | + | More about that on [[: |
| + | |||
| + | ===== Running Jobs on Unix ===== | ||
| + | |||
| + | The best way to run background computing jobs on the unix systems | ||
| condor_run yourprogram | condor_run yourprogram | ||
| Line 10: | Line 14: | ||
| - | ==== Running Jobs Locally in the Background ==== | + | ===== Running Jobs Locally in the Background |
| If you're not using condor, then any non-interactive compute jobs should be //niced// - this reduces their priority level relative to interactive use, so that workstation users still have a responsive system. In the absence of interactive load, the system is still dedicated to your jobs, so in most cases runtime will not be much affected. | If you're not using condor, then any non-interactive compute jobs should be //niced// - this reduces their priority level relative to interactive use, so that workstation users still have a responsive system. In the absence of interactive load, the system is still dedicated to your jobs, so in most cases runtime will not be much affected. | ||
| Line 16: | Line 20: | ||
| If " | If " | ||
| + | # tcsh shell users: | ||
| nice +n yourprogram | nice +n yourprogram | ||
| + | |||
| + | # bash shell users: | ||
| + | nice -n yourprogram | ||
| where n is a number between 1 and 19 (the higher the number, the lower the job priority). | where n is a number between 1 and 19 (the higher the number, the lower the job priority). | ||
| Line 22: | Line 30: | ||
| You should choose the priority in the most socially-responsible way you can manage, according to how long you expect the job to run - eg, jobs which may run for days should be run at a lower priority than those which might only take a few hours. We also consider a priority of 4 to be the minimum socially-acceptable nice level to use for background jobs - so, for example: | You should choose the priority in the most socially-responsible way you can manage, according to how long you expect the job to run - eg, jobs which may run for days should be run at a lower priority than those which might only take a few hours. We also consider a priority of 4 to be the minimum socially-acceptable nice level to use for background jobs - so, for example: | ||
| + | # tcsh shell users: | ||
| nice +4 yourprogram | nice +4 yourprogram | ||
| + | # bash shell users: | ||
| + | nice -4 yourprogram | ||
| - | ==== I/O intensive jobs ==== | + | ===== I/O intensive jobs ===== |
| - | + | ||
| - | If your job requires manipulation of large files, it will be faster to use local scratch storage on the local machine rather than your home directory (which is accessed over the network). Check our pages on [[: | + | |
| - | ==== Where to run jobs ==== | + | < |
| - | * Spartha (also known as physics.umn.edu) is intended | + | |
| - | * Two systems are available for general-purpose computing, sunfire1 and sunfire2. Compute jobs may be run here, though we still suggest that condor would be a better choice. | + | |
| - | * Various research groups (HEP, Nuclear Theory, Cosmology, etc) have their own systems in the cluster and should use them accordingly. We don't restrict access | + | |
| - | * Students paying the IT computing fee (that is, physics majors and pre-qualifier graduate students) have the use of systems in the [[: | + | |
| + | If your job requires manipulation of large files (especially writing to them), it will be faster to use local scratch storage on the local machine rather than your home directory over the network. Check our pages on [[: | ||