Using XSEDE resource Bridges at PSC for University of Iowa coursework in Hadoop, Spark, and SparkR.
This new resource provided by PSC allows for each student to generate a dynamic virtual Hadoop cluster of one name node and two data nodes with persistent file systems. Each cluster is spun up upon student login, and halted upon logout.
- Commands to access and create a three node Hadoop cluster
- Process for creating an XSEDE account and accessing PSC (Pittsburgh Supercomputing Center) Bridges