...
Your data on Neon will be maintained until March 1, 2019. Please be advised that any data being migrated from Neon home/scratch to a local machine must be decompressed, and therefore may end up being larger than it appears on Neon. When copying data from Neon → Argon homes, keep in mind that data stored on Argon homes cannot exceed 1TB. Reminder that the inability to submit jobs occurs once the storage quota exceeds 90%. To check your current storage, login to Neon and use the command below:
Code Block |
---|
[jhetrick@argon-login-1 ~]$ df -h . Filesystem Size Used Avail Use% Mounted on 172.29.4.35:/dpool01/Homes/jhetrick 1.0T 432G 593G 43% /Users/jhetrick |
If you find that you have run out of space in the process of copying data and cannot remove it, please see: What to do if the 'rm' command isn't deleting files
When copying large amounts of data from Neon to Argon-nfsscratch, remember that data that is placed there will be cleared 60 days later as part of our cleaning policy. The scratch cleaning policy on neon-nfsscratch will be removed on January 7th so that no data will be removed by that policy prior to the host being decommissioned on March 7.
...
As users will be unable to long into Neon after January 7, 2019, we recommend that users utilize data.hpc.uiowa.edu to transfer stored data rather than relying on mounting their home accounts directly. This will be the new method of mounting Argon home accounts moving forward due to underlying changes in how home storage space will be provided.
Fetch, WinSCP and GridFTP will all use this server address and are documented as such.All pieces of software will connect to the server with server data.hpc.uiowa.edu. Refer to the table below to choose the address storage path that pertains to you.
/hpchomes/<cluster>/<hawkid>/ | Your HPC home directory. For <cluster>, this is either "neon" or "argon" |
/Dedicated/<sharename>/ | Dedicated shares |
/Shared/<sharename>/ | Shared shares |
/nfsscratch/<cluster>/ | The NFS scratch filesystem. For <cluster>, this is either "neon" or "argon" |
...
Fetch (mac only): This will mount your Neon account. Follow the table above for setting a path to get your data from shared shares, dedicated shares, or from nfsscratch. In this case, the path below is just for home directories. You can then execute "get" commands to pull your data from Neon onto your local workstation (keep in mind the compression aspect). If you are doing this off campus (or not connected to the VPN), use port ensure that the "Port" is 40. Not Note that this using SCP method will require Duo authentication Duo authentication and you should see notification on your device.
WinSCP (windows only): This will mount your Neon account. Follow the table above for setting a path to get your data from shared shares, dedicated shares, or from nfsscratch. In the example below, the path is for home directories. The server will be data.hpc.uiowa.edu - we have to manually link it to the proper directory. Once connected, you can drag and drop files from Neon onto your local workstation. If you are doing this off campus (or not connected to the VPN), use port 40.
...