Hadoop Training in Malaysia

This instructor-led, live training in Malaysia (online or on-site) is aimed at developers who wish to use and integrate Spark, Hadoop, and Python to process, analyse, and transform large and complex datasets.

By the end of this training, participants will be able to:

• Set up the necessary environment to start processing big data with Spark, Hadoop, and Python.
• Understand the features, core components, and architecture of Spark and Hadoop.
• Learn how to integrate Spark, Hadoop, and Python for big data processing.
• Explore the tools in the Spark ecosystem (Spark MLlib, Spark Streaming, Kafka, Sqoop, Kafka, and Flume).
• Build collaborative filtering recommendation systems similar to Netflix, YouTube, Amazon, Spotify, and Google.
• Use Apache Mahout to scale machine learning algorithms.

Apache Hadoop stands as the leading framework for processing Big Data across server clusters. Over the course of three days (or four, if an optional track is selected), participants will gain insights into the business advantages and use cases associated with Hadoop and its ecosystem. The curriculum covers planning for cluster deployment and expansion, along with practical skills in installing, maintaining, monitoring, troubleshooting, and optimising Hadoop. Attendees will also engage in bulk data loading exercises, explore various Hadoop distributions, and practise managing Hadoop ecosystem tools. The course concludes with a discussion on securing the cluster using Kerberos.

“The materials were meticulously prepared and comprehensively covered. The lab sessions were exceptionally helpful and well-organised.”
— Andrew Nguyen, Principal Integration DW Engineer, Microsoft Online Advertising

Audience

Hadoop administrators

Format

The course combines lectures with hands-on labs, maintaining an approximate split of 60% lectures and 40% practical lab work.

Apache NiFi is an open-source, flow-based data integration and event-processing platform. It enables automated, real-time data routing, transformation, and system mediation between disparate systems, with a web-based UI and fine-grained control.

This instructor-led, live training (onsite or remote) is aimed at intermediate-level administrators and engineers who wish to deploy, manage, secure, and optimize NiFi dataflows in production environments.

By the end of this training, participants will be able to:

• Install, configure, and maintain Apache NiFi clusters.
• Design and manage dataflows from varied sources and sinks.
• Implement flow automation, routing, and transformation logic.
• Optimize performance, monitor operations, and troubleshoot issues.

Format of the Course

• Interactive lecture with real-world architecture discussion.
• Hands-on labs: building, deploying, and managing flows.
• Scenario-based exercises in a live-lab environment.

Course Customization Options

• To request a customized training for this course, please contact us to arrange.

In this instructor-led live training in Malaysia, participants will learn the fundamentals of flow-based programming while developing various demo extensions, components, and processors using Apache NiFi.

By the end of this training, participants will be able to:

• Understand NiFi's architecture and dataflow concepts.
• Develop extensions using NiFi and third-party APIs.
• Custom develop their own Apache Nifi processor.
• Ingest and process real-time data from disparate and uncommon file formats and data sources.