...
If your job does not use the system openmpi, or does not use MPI, then any desired core binding will need to be set up with whatever mechanism the software uses. Otherwise, there will be no core binding. Again, that may not be a major issue. If your job does not work well with HT then run on a number of cores equal to half of the number of slots requested and the OS scheduler will minimize contention.
new SGE utilities
While SoGE is very similar to previous versions of SGE there are some new utilities that people may find of interest. There are manual pages for each of these.
...
| Table plus |
|---|
| sortColumn | 1 |
|---|
| columnTypes | S,S,I,I |
|---|
|
| Queue | Node Description | Queue Manager | Slots | Total memory (GB) |
|---|
| ANTH | (3) standard memory | Andrew Kitchen | 168 | 384 |
|---|
ARROMA | (8) standard memory | Jun Wang | 448 | 1024 |
|---|
| AS | (5) mid memory | Katharine Corum | 280 | 1280 |
|---|
BARNHART | (1) standard memory | William Barnhart | 56 | 128 |
|---|
BIGREDQ | (4) mid memory | Sara Mason | 224 | 1024 |
|---|
BIOLOGY | (1) mid memory | Matthew Brockman
| 56 | 256 |
|---|
BIOSTAT | (1) standard memory | Grant Brown | 56 | 128 |
|---|
| CCOM | (18) high memory
5 running jobs per user | Boyd Knosp | 1008 | 9216 |
|---|
| CCOM-GPU | (2) high memory with P100 accelerator | Boyd Knosp | 112 | 1024 |
|---|
CGRER | (10) standard memory | Jeremie Moen | 560 | 1280 |
|---|
| CHEMISTRY | (3) mid memory | JJ Urich | 168 | 768 |
|---|
CLAS-INSTR | (1) mid memory | JJ Urich | 56 | 256 |
|---|
| CLL | (5) standard memory | Mark Wilson
Brian Miller | 280 | 640 |
|---|
| COE | (8) mid memory | Matt McLaughlin | 448 | 2048 |
|---|
DARBROB | (1) mid memory | Benjamin Darbro | 56 | 256 |
|---|
FLATTE | (2) high memory
(3) standard memory | Michael Flatte | 280 | 1408 |
|---|
FLUIDSLAB | (8) standard memory | Mark Wilson
Brian Miller | 448 | 1024 |
|---|
| GV | (2) mid memory | Mark Wilson
Brian Miller | 112 | 512 |
|---|
| HJ | (10) standard memory
(1) high memory with P100 accelerator | Hans Johnson | 616 | 1280 |
|---|
| IFC | (10) mid memory | Mark Wilson
Brian Miller | 560 | 2560 |
|---|
| IIHG | (1) mid memory | Diana Kolbe | 560 | 256 |
|---|
INFORMATICS | (12) mid memory | Ben Rogers | 672 | 3072 |
|---|
INFORMATICS-GPU | (2) mid memory with P100 accelerator | Ben Rogers | 112 | 512 |
|---|
INFORMATICS-HM | (1) high memory | Ben Rogers | 56 | 512 |
|---|
| IVR | (4) mid memory
(1) high memory | Todd Scheetz | 280 | 1536 |
|---|
| IWA | (11) standard memory | Mark Wilson
Brian Miller | 616 | 1408 |
|---|
| JM | (1) high memory
(1) mid memory with P100 accelerator | Jake Michaelson | 112 | 1024 |
|---|
| JP | (2) high memory | Virginia Willour | 112 | 1024 |
|---|
| MANSCI | (1) standard memory | Qihang Lin | 112 | 128 |
|---|
MORL | (10) mid memory | Ann Black-Ziegelbein | 560 | 2560 |
|---|
| REX | (4) standard memory | Mark Wilson
Brian Miller | 224 | 512 |
|---|
| REXHI | (1) high memory | Mark Wilson
Brian Miller | 56 | 512 |
|---|
| SB | (4) standard memory | Scott Baalrud | 224 | 512 |
|---|
| UDAY | (4) standard memory | Mark Wilson
Brian Miller | 224 | 512 |
|---|
| UI | (15) mid memory | | 840 | 3840 |
|---|
UI-DEVELOP | (1) mid memory
(1) mid memory with P100 accelerator | | 112 | 512 |
|---|
| UI-GPU | (3) mid memory with P100 accelerator Note: Only two nodes available from 3/27 to 4/3/2017 | | 224 | 1024 |
|---|
| UI-HM | (3) high memory | | 168 | 1536 |
|---|
| UI-MPI | (19) mid memory | | 1064 | 4864 |
|---|
| all.q | (76) standard memory
(111) mid memory
(7) mid memory with P100
(31) high memory
(3) high memory with P100
(1) high memory with K80 | | 12824 | 57856 |
|---|
| NEUROSURGERY | (1) high memory with K80 | Haiming Chen | 56 | 512 |
|---|
| SEMI | (1) standard memory | Craig Pryor | 56 | 128 |
|---|
| ACB | (1) mid memory | Adam Dupuy | 56 | 256 |
|---|
|
...
There are many resources that SGE keeps track of and most of them can be used in job submissions. However, the resource designations for machines based on memory and GPU are more likely to be used in practice. For the most part, machines with different amounts of memory and GPU capability are segregated by queues. However, the all.q queue contains all machines and when running jobs in that queue it may be desirable to request specific machine types. The following table lists these out. They would be selected with the '-l resource' flag to qsub. These are all Booleans.
| Full Resource Name | Shortcut Resource Name |
|---|
| std_mem | sm |
| mid_mem | mm |
| high_mem | hm |
| gpu | gpu |
| gpu_k80 | k80 |
| gpu_p100 | p100 |
For example, if you run a job in the all.q queue and want to use a node with a GPU, but do not care which type,
...