Building a Data Lake and Configuring Snowflake

Prerequisites:

• Data Lake and Configuring Snowflake courses or equivalent knowledge

Course Topics

1: Introduction to Data Lake

• What is Data Lake / Data Warehouse / Lakehouse
• Basic principles of construction (Lake Zones: Raw, Curated, Consumer)

2: Azure Data Lake Fundamentals

• Hierarchy in Data Lake Storage, ACL (Access control lists)
• Working through Azure Portal and Storage Explorer
• Access rights management (Azure RBAC, SAS)

3: Integration with Snowflake

• External Stages (Azure Blob / ADLS)
• Storage Integration
• COPY INTO, External Tables

4: Data Ingestion and transformations

• Azure Data Factory: pipelines, datasets, linked services
• Snowpipe and automatic loading
• Transformations in Snowflake via dbt
• SQL Tasks

5: Data Governance and analytics

• Azure Purview / Microsoft Fabric Data Catalog
• Data lineage, data classification, PII data

6: Automation, monitoring

• Terraform
• CI/CD pipelines (GitHub Actions, Azure DevOps)
• Monitoring requests and costs in Snowflake