Course Outline
Day 1:
- Front trend of Big Data
• Time of Big Data
• Application fields of Big Data
• Opportunity and challenge for enterprises in the era of big data
• Huawei Big Data solution
- FusionInsight HD Product Training
• FusionInsight HD Summary for enterprise edition
• FusionInsight HD Features Introduction
• FusionInsight HD Successful Cases
Days 2,3,4,5:
FusionInsight HD technical principles and applications of Common Big Data components lecture and practice.
FusionInsight HD Technical Principle and Application of Common Big Data Components
- HDFS Distributed File System
• HDFS Overview and Application Scenarios
• The Position of HDFS in FusionInsight HD
• HDFS system architecture
• Introduction to Key features
• FusionInsight HD Client Installation
• HDFS Hands on Lab
- MapReduce The Distributed Offline Batch Computing Framework and Yarn The Resource Negotiator
• Introduction to MapReduce and Yarn
• Functions and Architectures of MapReduce and Yarn
• Resource Management and Task Scheduling of Yarn
• Enhanced Features
- Spark2x The distributed processing engine based on memory
• Spark Overview
• Technical principle and Architec ture of Spark
• Integration of Spark in FusionInsight
- HBase Distributed storage system (NoSQL)
• Introduction to Hbase
• Functions and Architecture of HBase
• Key Processes of HBase
• Huawei Enhanced Features of HBase
• HBase Database Practice Lab
- Hive Distributed Dat a Warehouse
• Introduction to Hive
• Functions and Architecture of Hive
• Basic Hive Operations
• Hive Data Warehouse Hands on Lab
- Streaming Distributed Stream Computing Engines
• Introduction to Streaming
• System Architecture
• Key Features
• Introduction to StreamCQL
- Flink Stream and Batch Processin
• Introduction to Flink
• Technical Principle and Architecture of Flink
• Integration of Flink in FusionInsight HD
- Loader Data Exchange
• Introduction to Loader
• Loader Job Management
• Loader Data Import and Export Lab
- Flume Multi ple Logs Collection
• Flume Overview and Architecture
• Key Characteristics of Flume
• Examples of Flume Applications
• Flume Data Collection Lab
- Kafka Distributed Message Subscription system
• Introduction to Kafka
• Architecture and Functions of Kafka
• Key Kafka Processes
• Kafka Message Subscription Lab
- ZooKeeper Cluster Distributed Coordination Service
• Introduction to ZooKeeper
• The Position of ZooKeeper in FusionInsight HD
• System Architecture
• Key Features
• Relationship with Other Components
- Hadoop Cluster Comprehensive Experiment
• Loader Hive HBase Big Data Import and Query practice
• Flume HDFS Loader Mysql Hive Hue Stock Exchange Data Collection and Incremental Search practice