Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Changed messages regarding Titan V, edited number of P100 nodes, and added comment about vetting 1080Ti.

Table of Contents

...

  1. standard memory → 128GB
  2. mid-memory → 256GB
  3. high-memory → 512GB

There are 26 21 machines with Nvidia P100 accelerators, 2 machines with an Nvidia K80 accelerator, 2 machines with an Nvidia P40 accelerator, and 4 machines with a Titan V accelerator.

Info

The Titan V is an experimental configuration and is not supported cluster-wide at this timenow considered as a supported configuration in GPU-capable compute nodes but is restricted to a single card per node. Staff is currently in the process of vetting the 1080Ti for use.

The Rpeak (theoretical Flops) is 285.60 TFlops, not including the accelerators, with 67.25 TB of memory. In addition, there are 2 login nodes of the same system architecture. The login nodes have 256GB of memory.

...

If your job does not use the system openmpi, or does not use MPI, then any desired core binding will need to be set up with whatever mechanism the software uses. Otherwise, there will be no core binding. Again, that may not be a major issue. If your job does not work well with HT then run on a number of cores equal to half of the number of slots requested and the OS scheduler will minimize contention. 

new SGE utilities

While SoGE is very similar to previous versions of SGE there are some new utilities that people may find of interest. There are manual pages for each of these.

...