Hadoop – Frost Institute for Data Science & Computing

Intro to Hadoop and Spark Workshop 8/11/2017

Join us for an introductory workshop on Big Data “Intro. to Hadoop and Spark” on Friday, August 11, 2017, from 1:00-4:00 PM at RSMAS, Marine Science Center MSC 123. The workshop explores the differences between Big Data systems and traditional high-performance computing and will get your hands wet by running some Hadoop and spark jobs using sample data. This is an excellent opportunity to grow your projects by making use of IDSC’s Bigfoot cluster, and will develop skills that are indispensable for industry careers. BRING A LAPTOP. Read more “Intro to Hadoop and Spark Workshop 8/11/2017” →

Events - Past

BIG DATA Lunch & Learn Thursday 12/01/2016

IDSC Advanced Computing has developed a new big data platform ready for university faculty, staff, and students. The Bigfoot Hadoop cluster has made big data collection and processing possible. It provides user friendly interfaces to allow users to load, process, and query big data easily and efficiently. In this lunch-and-learn session “Process Big Data on Bigfoot Hadoop Cluster: Load and Query,” Dr. Zongjun Hu will first introduce several big data technologies behind the interfaces, and then demonstrate the general procedures to communicate with the cluster and utilize it for big data discovery research. Read more “BIG DATA Lunch & Learn Thursday 12/01/2016” →

Events - Past

Big Data Lunch & Learn, Friday 5/27/2016

We are in the era of Big Data. Data is being generated by everything around us all the time. The extreme popularity of social media pushes the scale of data even higher in volume, speed and variety. It becomes more and more critical to develop and apply new big data technologies to collect, process, understand data in a super efficient way. New big data systems and analytic algorithms have been developed and deployed extensively in industrial and academic areas. This free Lunch and Learn session (open to UM Faculty, Staff, and Students) will start with an overview of the big data technologies in Hadoop eco-system and the popular tools in big data collection, processing and analysis. It then presents the basics of Hadoop MapReduce, the parallel computing platform which make massive scalability possible. Read more “Big Data Lunch & Learn, Friday 5/27/2016” →

n>Hadoop

Intro to Hadoop and Spark Workshop 8/11/2017

BIG DATA Lunch & Learn Thursday 12/01/2016

Big Data Lunch & Learn, Friday 5/27/2016