Oracle Big Data Fundamentals Ed 2

Suggested Prerequisite

• Database Basics and Administration
• Exposure to Big Data

Audience

• Application Developers
• Database Administrators
• Database Developers

Course Topics

Introduction

• Reviewing the Available Big Data Documentation, Tutorials, and Other Resources
• Course Road Map
• Course Objectives
• Starting the Oracle BDLite VM and accessing the Practice Files
• Questions About You
• Oracle Big Data Lite (BDLite) Virtual Machine (VM) Home Page

Introducing Oracle Big Data Strategy

• Big Data implementation examples
• Importance of Big Data
• Oracle strategy for Big Data: combining Big Data Processing Engines: Hadoop / NoSQL / RDBMS
• Characteristics of Big Data
• Big Data Opportunities: Some Examples
• Big Data Challenges

Using Oracle Big Data Lite Virtual Machine and Movieplex Application

• Reviewing the Deployment Guide
• Oracle Big Data Lite VM Home Page Sections
• Introducing the Oracle Movieplex Case Study
• Oracle Big Data Lite VM Used in this Course
• Importing the Appliance File
• Downloading and Running 7-zip Files to create Virtual Box Appliance File
• Downloading and installing Oracle VM VirtualBox and its Extension Pack
• Staring the Big Data Lite VM and Starting and Stopping Services

Introduction to the Big Data Ecosystem

• Cloudera’s Distribution Including Apache Hadoop (CDH)
• Apache Hadoop
• Types of Analysis That Use Hadoop
• CDH Architecture and Components
• Apache Hadoop Ecosystem
• Computer Clusters and Distributed Computing
• Types of Data Generated
• Apache Hadoop Core Components: HDFS, MapReduce (MR1), and YARN (MR2)

Introduction to the Hadoop Distributed File System

• Sample Hadoop High Availability (HA) Cluster
• HDFS Files and Blocks
• Hadoop Distributed Filesystem (HDFS) Design Principles, Characteristics, and Key Definitions
• Interacting With Data Stored in HDFS: Hue, Hadoop Client, WebHDFS, and HttpFS
• DataNodes (DN) Daemons Functions
• Writing a File to HDFS: Example
• Active and Standby Daemons (Services) Functions

Acquire Data using CLI, Fuse, Flume, and Kafka

• Kafka topics
• Additional Resources
• Viewing File System Contents Using the CLI
• What is Flume?
• Overview of FuseDFS
• Loading Data Using the CLI
• Reviewing the Command Line Interface (CLI)
• FS Shell Commands

Acquire and Access Data Using Oracle NoSQL Database

• Oracle NoSQL models: Key-Value and Table
• Accessing the KVStore
• What is a NoSQL Database
• Accessing the CLIs (Data, Admin, SQL)
• Acquiring and Accessing Data in a NoSQL DB
• HDFS Compared to NoSQL
• Define Oracle NoSQL Database
• RDBMS Compared to NoSQL

Introduction to MapReduce and YARN Processing Frameworks

• Data Locality Optimization in Hadoop
• Parallel Processing with MapReduce
• YARN Architecture, Features, and Daemons
• Hadoop Basic Cluster: MapReduce 1 Versus YARN (MR 2)
• MapReduce Framework Features, Benefits, and Jobs
• YARN Application Workflow
• Word Count Examples
• Submitting and Monitoring a MapReduce Job

Resource Management Using Yarn

• Static Service Pools
• Cloudera Manager Dynamic Resource Management: Example
• Working with the Fair Scheduler
• Cloudera Manager Resource Management Features
• First In, First Out (FIFO) Scheduler, Capacity Scheduler, and Fair Scheduler
• Submitting and Monitoring a MapReduce Job Using YARN
• Job Scheduling in YARN
• Using the YARN application Command

Overview of Apache Spark

• Benefits of Using Spark
• Running a Spark Application on YARN (yarn-cluster Mode)
• Spark Interactive Shells: spark-shell and pyspark
• Spark Application Components: Driver, Master, Cluster Manager, and Executors
• Monitoring Spark Jobs Using YARN’s ResourceManager Web UI
• Word Count Example by Using Interactive Scala
• Spark Architecture
• Resilient Distributed Dataset (RDD)

Overview of Apache Hive

• What is Hive?
• How is Data Stored in HDFS?
• Big Data SQL on Top of Hive Data
• Organizing and Describing Data With Hive
• Defining Tables Over HDFS
• Use Case: Storing Clickstream Data
• Hive Queries
• Hadoop Architecture

Overview of Cloudera Impala

• Hadoop: Some Data Access/Processing Options
• Cloudera Impala: Programming Interfaces
• How Impala Works with Hive
• Cloudera Impala
• How Impala Fits Into the Hadoop Ecosystem
• Overview of Cloudera Impala
• Cloudera Impala: Supported Data Formats
• Cloudera Impala: Key Features

Using Oracle XQuery for Hadoop

• XQuery Transformation and Basic Filtering
• XML Review
• Viewing the Completed Query in YARN’s ResourceManager
• Running an OXH Query
• OXH Features
• Oracle XQuery for Hadoop (OXH)
• Using OXH: Installation, Functions, Adapters, and Configuration Properties
• OXH Data Flow
• Overview of Solr
• Cloudera Search: Features

Overview of Solr

• Apache Solr (Cloudera Search)
• Cloudera Search Tasks
• Indexing in Cloudera Search
• Types of Indexing
• The solrctl Command
• Cloudera Search: Key Capabilities

Integrating Your Big Data

• Comparing Big Data Processing Engines
• Unifying Data: A Typical Requirement
• Introducing Data Unification Options
• When To Use These Options?

Batch Loading Options

• Oracle Copy to Hadoop
• Oracle Loader for Hadoop
• Apache Sqoop

Using Oracle SQL Connector for HDFS

• Using OSCH
• Performance Tuning
• Loading: Choosing a Connector
• Parallelism and Performance
• Batch and Dynamic Loading: Oracle SQL Connector for HDFS
• OSCH Architecture
• Features
• Key Benefits

Using Oracle Data Integrator and Oracle GoldenGate for Big Data

• Oracle GoldenGate for Big Data
• ODI’s Declarative Design
• Using ODI with Big Data Heterogeneous Integration with Hadoop Environments
• Using ODI Studio
• ODI Studio: Big Data Knowledge Modules
• ETL and Synchronization: Oracle Data Integrator
• ODI Knowledge Modules (KMs)Simpler Physical Design / Shorter Implementation Time
• ODI Studio Components: Overview

Using Oracle Big Data SQL

• Query Performance Overview
• Benefits: Virtualizes data access across Oracle Database, Hadoop and NoSQL stores
• Overcoming Big Data Barriers
• Barriers to Effective Big Data Adoption
• Oracle Big Data SQL: The Hybrid Solution
• Deployment Options
• Using Oracle Big Data SQL

Using Oracle Big Data Spatial and Graph

• BDSG: Graph Analysis
• Multimedia Analytics Framework
• Deployment Options for Oracle BDSG
• Oracle BDSG: Spatial Analysis
• Graph and Spatial Analysis: All About Relationships
• Additional Resources
• Strategy (supported platforms, etc)
• What is Oracle Big Data Spatial and Graph (BDSG)?

Using Oracle Advanced Analytics

• OAA: Oracle Data Mining
• OAA: Oracle R Enterprise
• Oracle Advanced Analytics (OAA)

Oracle Big Data Deployment Options

• BDA Hardware and Integrated and Optional Software
• Introduction to the Oracle Big Data Cloud Service – Compute Edition
• Running the Oracle BDA Configuration Generation Utility
• Administering and Securing the Oracle BDA
• Introduction to the Oracle Big Data Appliance
• Oracle BDA Mammoth Software Deployment Bundle
• Introduction to the Oracle Big Data Cloud Service
• Using the Oracle BDA mammoth Utility