...

2. load the hadoop module when the job starts

module load hadoop

...

WARNING! Once the module is loaded it will instruct you to run "start-hadoop.sh" This will create a NON-PERSISTENT HDFS (filesystem) nothing will be saved.

-----------------------

Almost there... one more step.

Now please run

    start-hadoop.sh

to set up your environment

-----------------------

3. Instead, for a persistent file system, start hadoop set up your environment with the following script:

...