Difference between revisions of "ALCF"

From PHASTA Wiki
Jump to: navigation, search
 
(23 intermediate revisions by 3 users not shown)
Line 1: Line 1:
From the Viz nodes connect to Theta at ALCF with the command:
+
Wiki page for information related to the '''Argonne Leadership Computing Facility''' ('''ALCF''') located at Argonne National Labs.
  
ssh -Y <username>@theta.alcf.anl.gov
+
==Overview==
 +
{| class="wikitable" style="text-align:center;"
 +
! Key
 +
! Value
 +
! Notes
 +
|-
 +
| style="font-weight:bold; text-align:left;" | Machines
 +
| Cooley
 +
| Visualization
 +
|-
 +
| style="text-align:left;" |
 +
| Theta
 +
| Compute
 +
|-
 +
| style="font-weight:bold; text-align:left;" | Job Submission System
 +
| [https://xgitlab.cels.anl.gov/aig-public/cobalt Cobalt]
 +
|
 +
|-
 +
| style="font-weight:bold; text-align:left;" | Facility Documentation
 +
| [https://www.alcf.anl.gov/support-center ALCF Support Center]
 +
|
 +
|}
  
You will find yourself in your home space on the Theta file system. To change directory into a project space you must include the path to the Theta file system. The command cd /gpfs/theta-fs1/projects will take you to the directory containing all project spaces on Theta.
+
The availability of the Cooley nodes can be found [https://status.alcf.anl.gov/cooley/activity here]. The first sixteen nodes are available for checkout by PHASTA users.
  
Note that Theta uses a file system separate from Mira/Cetus/Cooley. There is one login node on Mira, however, that can access both file system and can therefore be used to copy files between the two. This is miralac3, which is accessed with the command:
+
The availability of the Theta nodes can be found [https://status.alcf.anl.gov/theta/activity here].
  
ssh -Y <username>@miralac3.alcf.anl.gov
+
== How-To's ==
  
By default, you will be on the Mira file system (/gpfs/mira-fs0/), but you can access the Theta system by simply adding the path to it (/gpfs/theta-fs1).
+
=== Login ===
 +
From the Viz nodes, connect to either Theta or Cooley at ALCF with the command(s):
  
'''Note:'''
+
ssh <username>@theta.alcf.anl.gov
Theta is not a big machine like Mira, it's size is closer to Cetus. Therefore no big jobs will run on Theta. Also, at this time, Theta does not have a priority system. This means one should look at the availability of the machine before submitting a job. The following commands can be used to determine how many nodes are available, and the maximum job wall time for a job to be loaded onto the machine, respectively.
 
  
nodelist | grep idle | grep <queue_name> | wc
+
ssh <username>@cooley.alcf.anl.gov
nodelist | grep idle | grep <queue_name> | head
+
 
 +
It asks for a password; this is the 8-digit code in the MobilePASS+ app on your phone (instructions on how to set that up are given by ALCF when you create an account).
 +
 
 +
=== Start Interactive Session on Cooley ===
 +
 
 +
To start an interactive session, run this script:
 +
 
 +
  /projects/cfdml_aesp/Viz/cooley/Viz-SyncIO/subIntNodesTime.sh 1 120
 +
 
 +
This will reserve you one node for 120 minutes (this is the maximum time allowed by ALCF). You may need to edit the script to include the correct filesystem you are working with. This script includes "home", "grand", and "theta-fs0".
 +
 
 +
=== Copy Files From Viz Nodes To Cooley===
 +
 
 +
  scp -r [your username here]@jumpgate-phasta.colorado.edu:[insert file(s)/folder here] .
 +
 
 +
It will ask you for your password and verification; this is the same password used to login to jumpgate, not the 8-digit code from MobilePASS+.
 +
 
 +
=== Copy Files From Cooley To Viz Nodes ===
 +
 
 +
  scp -r [insert file(s)/folder here] [your username here]@jumpgate-phasta.colorado.edu:[insert destination folder here]
 +
 
 +
It will ask you for your password and verification; this is the same password used to login to jumpgate, not the 8-digit code from MobilePASS+.
 +
 
 +
=== Archiving Data to ALCF's Tape Drives ===
 +
See [[ALCF/Archiving_Data_at_ALCF|Archiving Data at ALCF ]].
 +
 
 +
== Subpages ==
 +
{{Special:PrefixIndex/ALCF/}}
 +
 
 +
[[Category:Compute Facilities]]

Latest revision as of 09:56, 5 April 2024

Wiki page for information related to the Argonne Leadership Computing Facility (ALCF) located at Argonne National Labs.

Overview

Key Value Notes
Machines Cooley Visualization
Theta Compute
Job Submission System Cobalt
Facility Documentation ALCF Support Center

The availability of the Cooley nodes can be found here. The first sixteen nodes are available for checkout by PHASTA users.

The availability of the Theta nodes can be found here.

How-To's

Login

From the Viz nodes, connect to either Theta or Cooley at ALCF with the command(s):

ssh <username>@theta.alcf.anl.gov
ssh <username>@cooley.alcf.anl.gov

It asks for a password; this is the 8-digit code in the MobilePASS+ app on your phone (instructions on how to set that up are given by ALCF when you create an account).

Start Interactive Session on Cooley

To start an interactive session, run this script:

 /projects/cfdml_aesp/Viz/cooley/Viz-SyncIO/subIntNodesTime.sh 1 120

This will reserve you one node for 120 minutes (this is the maximum time allowed by ALCF). You may need to edit the script to include the correct filesystem you are working with. This script includes "home", "grand", and "theta-fs0".

Copy Files From Viz Nodes To Cooley

 scp -r [your username here]@jumpgate-phasta.colorado.edu:[insert file(s)/folder here] .

It will ask you for your password and verification; this is the same password used to login to jumpgate, not the 8-digit code from MobilePASS+.

Copy Files From Cooley To Viz Nodes

 scp -r [insert file(s)/folder here] [your username here]@jumpgate-phasta.colorado.edu:[insert destination folder here]

It will ask you for your password and verification; this is the same password used to login to jumpgate, not the 8-digit code from MobilePASS+.

Archiving Data to ALCF's Tape Drives

See Archiving Data at ALCF .

Subpages