Skip to end of banner Go to start of banner

Hadoop Spark on XSEDE Bridges

Skip to end of metadata

Created by Kuhl, Spencer, last modified on Sept 26, 2017

Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Using XSEDE resource Bridges at PSC for University of Iowa coursework in Hadoop, Spark, and SparkR.

This new resource provided by PSC allows for each student to generate a dynamic virtual Hadoop cluster of one name node and two data nodes with persistent file systems. Each cluster is spun up upon student login, and halted upon logout.

- - Process for creating an XSEDE account and accessing PSC (Pittsburgh Supercomputing Center) Bridges
  - Commands to access and create a three node Hadoop cluster

No labels