Information on using the XSEDE resource Bridges at PSC for University of Iowa coursework in Hadoop, Spark, and SparkR.
This new resource provided by PSC allows for each student to generate a dynamic virtual Hadoop cluster of one name node and two data nodes with persistent file systems. Each cluster is spun up upon student login, and halted upon logout.
- Process for creating an XSEDE account and accessing PSC (Pittsburgh Supercomputing Center) Bridges
- Requesting Education Allocations for use in Teaching Courses
- Commands to access and create a three node Hadoop cluster