In this page:
...
Jupyter Notebook for Python, R, and Julia
The IDAS interface
- After creating an IDAS instance for research or class use, you will see your IDAS home page. If this is your first time accessing IDAS, your home page will be empty.
- You can create Jupyter notebooks, files, and folders in IDAS. (See details below.) Click any file or folder to open that file or folder.
- In order to navigate back to your IDAS home page, click the Jupyter symbol on the top left corner: .
...
- You can upload your own Jupyter notebooks and data files to IDAS. After creating an IDAS instance for research or class use, in the top right corner of your IDAS home page, click Upload.
- Select the files to upload in your local computer. Once the upload is done, you should see the uploaded files in your directory.
Creating a new Jupyter notebook
First, create an IDAS instance with Python, R, or Julia. If you are a student in a class that uses IDAS, follow the instructions here to access to access your class instance.
In the top right corner of your IDAS home page, click New.
Under Notebook, choose Python, R, or Julia in order to create a notebook in that language. For example, if you had created an instance with Python, you can create a new Jupyter notebook with Python:
If you are creating a research instance, note that Python, R, and Julia each have their own container image. For example, in order to use Julia, please select one of the three options for Julia under IDAS Image in the Spawner Options form.
Managing Jupyter notebooks
- First, create an IDAS instance with Python, R, or Julia. If you are a student in a class that uses IDAS, follow the instructions here to access to access your class instance.
In your IDAS home page, check the box next to a Jupyter notebook. If the notebook is not currently running, you will have the option to duplicate, rename, move, download, view, edit, or delete that notebook.
- If the notebook is currently running, you will have the options to duplicate, shutdown, view, edit, or delete that notebook.
- Below is a summary of these options:
- Duplicate: will make a copy of the notebook, stored in the same folder.
- Rename: will rename the notebook. Enter the new name in the pop-up box, then click Rename.
- Move: will move the notebook to a destination of your choice. In the pop-up box, enter the destination directory path, then click Move.
- Download: will download a copy of the notebook to your local computer.
- View: will open the notebook and allow editing the notebook, including adding cells and running codes.
- Edit: will allow editing the source code in the notebook.
- Shutdown: will shut down a notebook that is running.
- Delete (the red trash can icon): will permanently delete the notebook.
Tip The path to your IDAS home directory is /home/<your_HawkID>. In the example below, the Jupyter notebook will be moved to the "demo" folder inside the IDAS home directory.
Creating new files and folders
- First, create an IDAS instance with Python, R, or Julia. If you are a student in a class that uses IDAS, follow the instructions here to access to access your class instance.
- In the top right corner of your IDAS home page, click New.
- Choose Text File to create a new .txt file, or Folder to create a new Folder. The text file can later be renamed to another extension, such as .py.
Managing files and folders
File options
- First, create an IDAS instance with Python, R, or Julia. If you are a student in a class that uses IDAS, follow the instructions here to access to access your class instance.
In your IDAS home page, check the box next to a file. You will be able to see the options available for that file:
...
Tip |
---|
The path to your IDAS home directory is /home/<your_HawkID>. In the example below, the .txt file will be moved to the "demo" folder inside the IDAS home directory. |
Folder options
- First, create an IDAS instance with Python, R, or Julia. If you are a student in a class that uses IDAS, follow the instructions here to access to access your class instance.
In your IDAS home page, check the box next to a folder. You will have the option to rename, move, or delete that folder.
To rename a folder, check the box next to that folder, click Rename, enter the new folder name in the pop-up box, and click Rename:
To move a folder, check the box next to that folder, click Move, enter a new directory path in the pop-up box, and click Move. In the example below, the folder will be moved to the "demo" folder inside the IDAS home directory.
Tip The path to your IDAS home directory is /home/<your_HawkID>.
- To delete a folder, check the box next to that folder, and then click the red trash can icon. You will be asked to confirm that you want to permanently delete the folder. Click Delete to confirm the action.
...
Creating a new Terminal session
First, create an IDAS instance with Python, R, or Julia. If you are a student in a class that uses IDAS, follow the instructions here to access to access your class instance.
In the top right corner of your IDAS home page, click New.
- Click Terminal in order to start a Terminal session.
...
Creating and saving R scripts
- After creating an IDAS instance for research or class use, you will see the RStudio interface.
- To create a new (blank) R script, click File on the menu bar at the top of your RStudio screen, New File, and then R Script.
- To save an R script, click File on the menu bar, and then Save As...
- In the pop-up box, enter a name for your script in File name. Click to select a destination for your file. (Click Home to go to your home directory anytime). Click Save.
...
Specifically for research users (fill in your HawkID):
Info |
---|
|
Downloading Data from IDAS to Your Computer
...
- If you have an Argon account or Large Scale Storage (LSS) shares, you can mount them when you spawn an IDAS research instance. This option allows you to access data in your Argon home or LSS shares while you work in IDAS. You can also move files from your IDAS home drive to your Argon home or LSS shares.
- For more information about how to mount Argon home and LSS shares in IDAS, please see step 6 in Accessing IDAS for Research Use.
Downloading Data Using the Web Interface
Follow the steps below to download data from your IDAS home drive to your computer, using the web interface of IDAS:
1. Log in to the IDAS research instance if you have a research account. If you are a student in a class that uses IDAS, follow the instructions here to access to access your class instance.
2. Start a Terminal session:
...
On IDAS, each research user gets 100GB for storage in their home drive. To check how much you have used:
1. Log in to the IDAS research instance if you have a research account. If you are a student in a class that uses IDAS, follow the instructions here to access to access your class instance.
2. Start a Terminal session - Pick one of the options below:
...
Method 1: Using Terminal - If your home drive is full, you can use Terminal to list and remove any files.
Warning |
---|
Please note: this will permanently delete the file or folder. Please back up your data as needed before you delete them from IDAS. Follow the steps here to download data from IDAS to your computer before deleting your data. |
Code Block | ||
---|---|---|
| ||
# list all files including hidden files ls -al # get the top largest 10 files and directories in your IDAS home drive: du -shx $HOME/.[^.]* * | sort -rh | head # delete files you no longer need rm file1.txt file2.txt # delete a directory and all of its contents rm -r directory |
...
Method 2: Using JupyterLab - You can also use the JupyterLab interface to remove any files you don't need:
1. Go to the JupyterLab page - please fill in your HawkID:
Info |
---|
|
2. Right-click on a file or folder that you want to delete. Then click "Delete". A dialogue will ask you to confirm that you want to permanently delete that file or folder:
Warning |
---|
Please note: this will permanently delete the file or folder. Please back up your data as needed before you delete them from IDAS. Follow the steps here to download data from IDAS to your computer before deleting your data. |
Info |
---|
For RStudio users: occasionally, when an R session crashes, RStudio generates core dumps that are named "core.xxx". These core dumps are logs of the crashed sessions. They can be quite large and fill up your home drive. If those core dumps were generated more than several days ago and you are not working with our support team to troubleshoot an issue related to the core dumps, you can delete them. |
...
Info |
---|
If you are using IDAS for a class, see instead this article for information on shutting down and restarting your IDAS server. |
...