ALCF/Archiving Data at ALCF - Revision history

Jrwrigh: Add further documentation section

2022-10-04T15:44:17Z

Add further documentation section

Jrwrigh: Update alcf documentation link

2022-10-04T15:27:16Z

Update alcf documentation link

Jrwrigh: /* HSI Basics */ Fix Typo

2022-09-29T18:13:05Z

‎HSI Basics: Fix Typo

Jrwrigh: Jrwrigh moved page Archiving Data at ALCF to ALCF/Archiving Data at ALCF: Move to a subpage organization

2022-09-18T18:18:12Z

Jrwrigh moved page Archiving Data at ALCF to ALCF/Archiving Data at ALCF: Move to a subpage organization

Jrwrigh at 17:22, 18 September 2022

2022-09-18T17:22:28Z

Jrwrigh: Add link to ALCF root wiki page

2022-09-04T21:59:30Z

Add link to ALCF root wiki page

Prte0550: Initial HPSS setup info

2022-08-23T17:46:25Z

Initial HPSS setup info

Prte0550: Added get information

2022-08-22T21:04:34Z

Added get information

Prte0550 at 21:03, 22 August 2022

2022-08-22T21:03:02Z

Prte0550 at 21:02, 22 August 2022

2022-08-22T21:02:42Z

@@ Line 8: / Line 8: @@
 It should be noted that <code>hsi</code> does ''not'' support tab-complete or up-arrowing for past commands. It is recommended that you enter the utility with a defined plan in order to reduce the amount of annoyance that the lack of these luxuries can cause.
 == Archiving of Data ==
@@ Line 44: / Line 42: @@
 == Troubleshooting ==
 If you are a first time user of HPSS, you will likely get an error regarding a key file. This is something that must be taken care of by ALCF support (support@alcf.anl.gov). Simply email them with your ALCF username and state that you need access set up for HPSS.
 [[Category:Compute Facilities]]

← Older revision		Revision as of 15:27, 4 October 2022
Line 1:		Line 1:
−	[[ALCF]]'s High Performance Storage System (HPSS) is a robotic tape drive system used for large amount of archival data storage that will not be often accessed. The system has two interfaces listed in ~~ALCF documentation (~~[https://www.alcf.anl.gov/support-~~center~~/~~theta~~/~~using~~-hpss~~-theta~~]) that can be used, <code>hsi</code> and <code>htar</code>. In this wiki, the <code>hsi</code> interface will be focused on.	+	[[ALCF]]'s High Performance Storage System (HPSS) is a robotic tape drive system used for large amount of archival data storage that will not be often accessed. The system has two interfaces listed in [https://www.alcf.anl.gov/support/user-guides/data-management/filesystem-and-storage/hpss/index.html ALCF documentation] that can be used, <code>hsi</code> and <code>htar</code>. In this wiki, the <code>hsi</code> interface will be focused on.

	== HSI Basics ==		== HSI Basics ==

@@ Line 7: / Line 7: @@
 Navigation through HPSS operates the same as a normal command line, with <code>ls</code> <code>cd</code>, and <code>mkdir</code> among others being valid commands for navigation through HPSS. If you need to navigate though the "local" directories though, this can still be done by appending an "l" to the front of these standard commands (i.e. <code>lls</code> <code>lcd</code>, and <code>lmkdir</code>). This can be useful if you entered <code>hsi</code> at the incorrect point or wish to archive data in multiple locations.
-It should be noted that <code>hsi</code> does support tab-complete or up-arrowing for past commands. It is recommended that you enter the utility with a defined plan in order to reduce the amount of annoyance that the lack of these luxuries can cause.
+It should be noted that <code>hsi</code> does ''not'' support tab-complete or up-arrowing for past commands. It is recommended that you enter the utility with a defined plan in order to reduce the amount of annoyance that the lack of these luxuries can cause.
 While standard use cases of <code>hsi</code> will be covered below, more documentation (that is more thorough and helpful than the ALCF documentation is available here: [https://docs.nersc.gov/filesystems/archive/].
 == Archiving of Data ==

← Older revision		Revision as of 17:22, 18 September 2022
Line 44:		Line 44:
	== Troubleshooting ==		== Troubleshooting ==
	If you are a first time user of HPSS, you will likely get an error regarding a key file. This is something that must be taken care of by ALCF support (support@alcf.anl.gov). Simply email them with your ALCF username and state that you need access set up for HPSS.		If you are a first time user of HPSS, you will likely get an error regarding a key file. This is something that must be taken care of by ALCF support (support@alcf.anl.gov). Simply email them with your ALCF username and state that you need access set up for HPSS.
		+
		+	[[Category:Compute Facilities]]

← Older revision		Revision as of 21:59, 4 September 2022
Line 1:		Line 1:
−	ALCF's High Performance Storage System (HPSS) is a robotic tape drive system used for large amount of archival data storage that will not be often accessed. The system has two interfaces listed in ALCF documentation ([https://www.alcf.anl.gov/support-center/theta/using-hpss-theta]) that can be used, <code>hsi</code> and <code>htar</code>. In this wiki, the <code>hsi</code> interface will be focused on.	+	[[ALCF]]'s High Performance Storage System (HPSS) is a robotic tape drive system used for large amount of archival data storage that will not be often accessed. The system has two interfaces listed in ALCF documentation ([https://www.alcf.anl.gov/support-center/theta/using-hpss-theta]) that can be used, <code>hsi</code> and <code>htar</code>. In this wiki, the <code>hsi</code> interface will be focused on.

	== HSI Basics ==		== HSI Basics ==

← Older revision	Revision as of 18:18, 18 September 2022
(No difference)

← Older revision		Revision as of 17:46, 23 August 2022
Line 41:		Line 41:

	If you need to retrieve data from tape and put it back on the "local" system, the <code>get</code> and <code>cget</code> commands act in the same way as <code>put</code> and <code>cput</code> but in reverse.		If you need to retrieve data from tape and put it back on the "local" system, the <code>get</code> and <code>cget</code> commands act in the same way as <code>put</code> and <code>cput</code> but in reverse.
		+
		+	== Troubleshooting ==
		+	If you are a first time user of HPSS, you will likely get an error regarding a key file. This is something that must be taken care of by ALCF support (support@alcf.anl.gov). Simply email them with your ALCF username and state that you need access set up for HPSS.

← Older revision		Revision as of 21:04, 22 August 2022
Line 39:		Line 39:

	If you simply want to move the contents of a directory and everything beneath it. Simply be mindful of your "local" directory location when choosing between these options.		If you simply want to move the contents of a directory and everything beneath it. Simply be mindful of your "local" directory location when choosing between these options.
		+
		+	If you need to retrieve data from tape and put it back on the "local" system, the <code>get</code> and <code>cget</code> commands act in the same way as <code>put</code> and <code>cput</code> but in reverse.

@@ Line 3: / Line 3: @@
 == HSI Basics ==
-HSI is a utility to interface with the HPSS system. It looks and operates much like the typical bash command lines that we are used to, but with some added complexities. When you enter <code>hsi</code>, the system will place you into your home HPSS space at <code>/home/username</code>. <code>hsi</code> keeps track of both your location in this HPSS space and also your location in the "local" system that you are running <code>hsi</code> from. The <code>hsi</code> system will automatically set the "local" directory location to be the location that you entered the utility from.
+<code>hsi</code> is a utility to interface with the HPSS system. It looks and operates much like the typical bash command lines that we are used to, but with some added complexities. When you enter <code>hsi</code>, the system will place you into your home HPSS space at <code>/home/username</code>. <code>hsi</code> keeps track of both your location in this HPSS space and also your location in the "local" system that you are running <code>hsi</code> from. The <code>hsi</code> system will automatically set the "local" directory location to be the location that you entered the utility from.
 Navigation through HPSS operates the same as a normal command line, with <code>ls</code> <code>cd</code>, and <code>mkdir</code> among others being valid commands for navigation through HPSS. If you need to navigate though the "local" directories though, this can still be done by appending an "l" to the front of these standard commands (i.e. <code>lls</code> <code>lcd</code>, and <code>lmkdir</code>). This can be useful if you entered <code>hsi</code> at the incorrect point or wish to archive data in multiple locations.

@@ Line 1: / Line 1: @@
 ALCF's High Performance Storage System (HPSS) is a robotic tape drive system used for large amount of archival data storage that will not be often accessed. The system has two interfaces listed in ALCF documentation ([https://www.alcf.anl.gov/support-center/theta/using-hpss-theta]) that can be used, <code>hsi</code> and <code>htar</code>. In this wiki, the <code>hsi</code> interface will be focused on.
-== HSI Overview ==
+== HSI Basics ==
 HSI is a utility to interface with the HPSS system. It looks and operates much like the typical bash command lines that we are used to, but with some added complexities. When you enter <code>hsi</code>, the system will place you into your home HPSS space at <code>/home/username</code>. <code>hsi</code> keeps track of both your location in this HPSS space and also your location in the "local" system that you are running <code>hsi</code> from. The <code>hsi</code> system will automatically set the "local" directory location to be the location that you entered the utility from.