In this page:

Jupyter Notebook for Python, R, and Julia

The IDAS interface

• After creating an IDAS instance for research or class use, you will see your IDAS home page. If this is your first time accessing IDAS, your home page will be empty.
• You can create Jupyter notebooks, files, and folders in IDAS. (See details below.) Click any file or folder to open that file or folder. 
• In order to navigate back to your IDAS home page, click the Jupyter symbol on the top left corner: Image Removed.

Uploading files

• You can upload your own Jupyter notebooks and data files to IDAS. After creating an IDAS instance for research or class use, in the top right corner of your IDAS home page, click Upload.
  Image Removed
  
• Select the files to upload in your local computer. Once the upload is done, you should see the uploaded files in your directory. 

Creating a new Jupyter notebook

...

First, create an IDAS instance with Python, R, or Julia. If you are a student in a class that uses IDAS, follow the instructions here to access your class instance.

...

In the top right corner of your IDAS home page, click New.

Under Notebook, choose Python, R, or Julia in order to create a notebook in that language. For example, if you had created an instance with Python, you can create a new Jupyter notebook with Python:

...

Image Removed

Managing Jupyter notebooks

...

In your IDAS home page, check the box next to a Jupyter notebook. If the notebook is not currently running, you will have the option to duplicate, rename, move, download, view, edit, or delete that notebook.
Image Removed

...

• Duplicate: will make a copy of the notebook, stored in the same folder.
• Rename: will rename the notebook. Enter the new name in the pop-up box, then click Rename.
• Move: will move the notebook to a destination of your choice. In the pop-up box, enter the destination directory path, then click Move.
• Download: will download a copy of the notebook to your local computer.
• View: will open the notebook and allow editing the notebook, including adding cells and running codes.
• Edit: will allow editing the source code in the notebook.
• Shutdown: will shut down a notebook that is running.
• Delete (the red trash can icon): will permanently delete the notebook.

Creating new files and folders

• First, create an IDAS instance with Python, R, or Julia. If you are a student in a class that uses IDAS, follow the instructions here to access your class instance.
• In the top right corner of your IDAS home page, click New.
• Choose Text File to create a new .txt file, or Folder to create a new Folder. The text file can later be renamed to another extension, such as .py.
  Image Removed

Managing files and folders

File options

• First, create an IDAS instance with Python, R, or Julia. If you are a student in a class that uses IDAS, follow the instructions here to access your class instance.

• In your IDAS home page, check the box next to a file. You will be able to see the options available for that file:

  Image Removed

• Below is a summary of the options for a .txt file:
  • Duplicate: will make a copy of the file, stored in the same folder.
  • Rename: will rename the file. Enter the new name in the pop-up box, then click Rename.
  • Move: will move the file to a destination of your choice. In the pop-up box, enter the destination directory path, then click Move.
  • Download: will download a copy of the file to your local computer.
  • View: will open the file for viewing only. No editing.
  • Edit: will allow editing the file.

  • Delete (the red trash can icon): will permanently delete the file.

Folder options

...

In your IDAS home page, check the box next to a folder. You will have the option to rename, move, or delete that folder.

Image Removed

...

...

Working with Terminal in IDAS

The Terminal allows you to perform more tasks in IDAS, including checking system information, managing files and folders, and installing packages. Below are a few common tasks that may be helpful in IDAS.

Creating a new Terminal session

...

First, create an IDAS instance with Python, R, or Julia. If you are a student in a class that uses IDAS, follow the instructions here to access your class instance.

...

In the top right corner of your IDAS home page, click New.

...

Checking information using Terminal

...

pwd: prints the current working directory. If you are in your IDAS home diretory, the directory will be /home/<your_HawkID>.

...

cd <destination>: change directory to a destination directory. For example,

• cd demo: changes to the demo directory

• cd: (with no argument) returns to your home directory 

...

RStudio for R

Creating and saving R scripts

...

Managing files and folders

...

• New Folder: create a new folder in your current directory. Enter the folder name, and then click OK.
• Upload: upload files from your computer to your current directory in IDAS. Select the files in your local computer, and then click OK. 
  • To upload multiple files or a directory, create a zip file, which will be automatically uncompressed after upload.
• Delete: permanently delete a file or folder. Check the box next to a file or folder to select it, click Delete, then Yes.
• Rename: rename a file or folder. Check the box next to a file or folder to select it, then click Rename. Enter the new name in the pop-up box, then click OK.
• Copy: make a copy of a file or folder. Check the box next to a file or folder to select it, click More, then Copy, enter a name for the new file or folder, then click OK.
• Copy To: make a copy of a file or folder and save the copy to a directory. Check the box next to a file or folder to select it, click More, then Copy To, enter a name for the new file or folder, select a directory, then click Save.
• Move: move the file or folder to a directory of your choice. Check the box next to a file or folder to select it, click More, then Move. In the pop-up box, choose a directory, then click Choose.
• Export: download files and folders (see below)
• Set As Working Directory: navigate to a directory of your choice, then click this option to choose the current directory as the working directory.
• Go To Working Directory: click this option to go to the current working directory.
• Show Hidden Files: toggle this option to show or hide hidden files, e.g. files that start with a "."

Downloading files and folders

• • To download a file, check the box next to it. Click More, then Export. Enter a name for the downloaded file, then click Download.
  • To download a folder, check the box next to it. Click More, then Export. Enter a name for the downloaded file, then click Download. The folder will be downloaded as a .zip file.
  • To download multiple files and folders, check the boxes next to those files and folders. Click More, then Export. Enter a name for the downloaded file, then click Download. They will be downloaded as a .zip file.
    Image Removed

Switching to Jupyter Notebooks from RStudio

To access the Jupyter Hub page and use your notebooks, from your RStudio session, change the end of the URL to "tree".

Specifically for research users (fill in your HawkID):

Downloading Data from IDAS to Your Computer

There are a couple of options to get data from your IDAS account to your computer:

1. Compress the files you want to download, and then download the compressed file using the web interface of IDAS (see the section below)

2. For IDAS research users:

• If you have an Argon account or Large Scale Storage (LSS) shares, you can mount them when you spawn an IDAS research instance. This option allows you to access data in your Argon home or LSS shares while you work in IDAS. You can also move files from your IDAS home drive to your Argon home or LSS shares.
• For more information about how to mount Argon home and LSS shares in IDAS, please see step 6 in Accessing IDAS for Research Use. 

Downloading Data Using the Web Interface

Follow the steps below to download data from your IDAS home drive to your computer, using the web interface of IDAS:

1. Log in to the IDAS research instance if you have a research account. If you are a student in a class that uses IDAS, follow the instructions here to access your class instance.

2. Start a Terminal session:

• If you are using Jupyter Notebook, click "New" in the upper right section of the Jupyter Hub tree page, then choose "Terminal:

 Image Removed

• If you are using RStudio, click on the "Terminal" tab, which is next to the "Console" tab in RStudio:

Image Removed

3. In Terminal, use "zip" to compress the file(s) and/or directories that you want to download. This can take a few minutes, especially if you are compressing a lot of files. Here are some examples for using "zip":

# compress all files in the "mydir" directory
zip -r backup.zip mydir

# compress a specific file in the current directory
zip backup.zip myfile.csv

• In the "zip" command, the "-r" option means including all files in a directory.
• For more information about the "zip" command, please type in Terminal: "zip --help"

4. After the commands finish running in Terminal, a file called "backup.zip" will be available in your current directory.

• If you are using Jupyter Notebook, you can find the "backup.zip" file in your Jupyter Hub tree page, like in this partial screenshot:

Image Removed

• If you are using RStudio, you can find the "backup.zip" file in the "Files" tab in RStudio, like in this partial screenshot:

Image Removed

5. Download the "backup.zip" file to your computer:

• In Jupyter Notebook, check the box in front of the "backup.zip" file and click "Download":

 Image Removed

• In RStudio, check the box in front of the "backup.zip" file and click "More", then "Export":

Image Removed

6. Then you can use a free software such as 7-zip to extract the files in "backup.zip" to a location on your computer.

IDAS Home Drives

On IDAS, each research user gets 100GB for storage in their home drive. To check how much you have used:

• Go to the Jupyter Hub tree page (please fill in your HawkID): 

  • https://notebooks.hpc.uiowa.edu/research-interactive/user/<your_hawkid>/tree

• In the top right corner of your IDAS tree page, click New >> Terminal
  Image Removed

• In Terminal, type df -h $HOME. In the example below, 26GB out of 100GB has been used and 75GB is available:          

hawkid@jupyter-notebook-research-hawkid:~$ df -h $HOME
Filesystem      Size  Used Avail Use% Mounted on
/dev/rbd64      100G   26G   75G  26% /home/hawkid

If your home drive is full, you can go to the Jupyter Hub tree page and remove any files you don't need. You can also use Terminal to list and remove any files. 

• Go to the Jupyter Hub tree page (please fill in your HawkID): 

  • https://notebooks.hpc.uiowa.edu/research-interactive/user/<your_hawkid>/tree

  • Check the box in front of the files you want to delete, and click Delete (the red trash can icon). This will permanently delete that file:

Image Removed

• Use Terminal to list and remove files:

# list all files including hidden files
ls -al

# get the top largest 10 files and directories in your IDAS home drive:
du -shx $HOME/.[^.]* * | sort -rh | head

# delete files you no longer need
rm file1.txt file2.txt

Shutting down an IDAS instance 

1. Save any scripts or files you need to save. 

2.  Research users: Go to https://notebooks.hpc.uiowa.edu/research-interactive/hub/home

...

Image Removed

...

In this section:

Accessing IDAS:

• Accessing IDAS for Research Use

  • For research users - Information about logging into IDAS, restarting your IDAS session, and switching between JupyterLab, Jupyter Notebook, and RStudio

  • Steps to restart your IDAS session

• Accessing IDAS for Class Use

  • For class users - Information about logging into IDAS and restarting your IDAS session

Downloading data and file storage in IDAS:

• Downloading Data from IDAS to Your Computer

• File Storage in IDAS

Interfaces in IDAS:

• Jupyter Notebook in IDAS

  • Common tasks using the classic Jupyter Notebook interface in IDAS

• RStudio in IDAS

  • Common tasks using the RStudio interface in IDAS

Contact

If you have any questions or comments, please contact research-computing@uiowa.edu.