Data Modeling & Pipelines — Mandragore Academy

Python JavaScript & TypeScript SQL API Cybersecurity Fundamentals Cloud Fundamentals Data Modeling & Pipelines

Data Modeling & Pipelines — Catalog

Choisissez un cours ou un pack pour commencer.

Each course brings together 8 interactive lessons in a Learning Workspace designed to turn knowledge into operational skills. Guided lessons, practical cases, dynamic quizzes, conversational support, and progress tracking let you learn effectively, at your own pace. The 15 courses follow a level-by-level progression, from data modeling to fully industrializing a reliable, governed data platform.

🎓 15 courses • 📘 120 interactive lessons • ⏱️ 45 to 75 hours of conversational training

5 levels: Level 1 — 9,90 € excl. VAT Level 2 — 12,90 € excl. VAT Level 3 — 15,90 € excl. VAT Level 4 — 18,90 € excl. VAT Level 5 — 24,90 € excl. VAT

Best offer

Complete Pack — Data Modeling & Pipelines

🎓 Certificate : "Professional DMP" 247,50 €

📚 15 courses 📖 120 lessons ⏱ 45 to 75 h ⚡ 1800 credits included

142,90 € excl. VAT

Savings : 104,60 €

Data Engineering Foundations Pack 3 courses

🎓 Certificate : DMP — Data Engineering Foundations

📚 3 courses 📖 24 lessons ⏱ 9 to 15 h ⚡ 240 credits included

29,70 €

22,90 excl. VAT

Savings : 6,80 €

01 Level 1

Understand data architectures and pipelines

understand how data flows from source systems to BI, analytics and AI use cases

Understand the role of Data Engineering in an organization Map data sources, processing and consumers Distinguish ingestion, transformation, orchestration and consumption Compare ETL and ELT Compare batch, micro-batch and event-driven processing Distinguish data warehouse, data lake and lakehouse Understand data marts, dependencies and data layers Workshop: map an end-to-end data chain

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 80 credits included

02 Level 1

Model data for analytics

design a coherent analytical model from a business need, indicators and source data

Start from business use cases and define the analytical grain Distinguish facts, dimensions and measures Choose business keys and surrogate keys Build a star schema Understand conformed dimensions and degenerate dimensions Manage historization with Slowly Changing Dimensions Compare transactional and analytical models Workshop: model a company's sales for BI

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 80 credits included

03 Level 1

Organize analytical storage and data formats

choose a storage organization and formats suited to volume, processing and analytical use cases

Compare data warehouse, data lake and lakehouse Organize raw, staging and curated zones Choose between CSV, JSON and Parquet Understand row storage and columnar storage Partition data based on usage Manage schema, compatibility and structure evolution Discover open table formats and Apache Iceberg Workshop: design the physical organization of an analytical space

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 80 credits included

Ingestion and Transformation Pack 3 courses

🎓 Certificate : DMP — Ingestion and Transformation

📚 3 courses 📖 24 lessons ⏱ 9 to 15 h ⚡ 300 credits included

38,70 €

28,90 excl. VAT

Savings : 9,80 €

04 Level 2

Reliably ingest data from multiple sources

extract data from files, SQL databases, APIs and Cloud storage while controlling errors and replayability

Ingest CSV and JSON files Extract data from a SQL database Consume a paginated API to feed a pipeline Ingest from object or Cloud storage Manage encoding, date formats and types Protect credentials, keys and access secrets Control ingestion errors, schemas and replayability Workshop: consolidate three sources into a staging zone

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 100 credits included

05 Level 2

Design ETL and ELT transformations

organize readable, testable and traceable transformations between raw data and analytical models

Design the raw, staging, intermediate and marts layers Clean and standardize raw data Normalize types, dates and conventions Deduplicate and handle inconsistent records Enrich and reconcile multiple sources Formalize business rules in transformations Build aggregations and analytical datasets Workshop: transform raw data into a usable model

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 100 credits included

06 Level 2

Build incremental loads and reliable recovery

update data efficiently without duplicates or loss, and know how to replay processing after an incident

Compare full load and incremental load Use timestamp, watermark and progress key Implement upsert and MERGE logic Understand Change Data Capture and its use cases Handle late-arriving data and late corrections Design an idempotent process Prepare backfill, checkpointing and incident recovery Workshop: make an incremental load replayable without duplicates

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 100 credits included

Pipeline Industrialization Pack 3 courses

🎓 Certificate : DMP — Pipeline Industrialization

📚 3 courses 📖 24 lessons ⏱ 9 to 15 h ⚡ 360 credits included

47,70 €

35,90 excl. VAT

Savings : 11,80 €

07 Level 3

Transform, test and document data with dbt

industrialize analytical transformations with explicit dependencies, tests, documentation and lineage

Understand the role of dbt in an ELT architecture Declare sources and organize a dbt project Build models with source() and ref() Choose table, view and incremental materialization Track history of changes with snapshots Add generic tests and business checks Document models, dependencies and lineage Workshop: build a tested and documented mini dbt project

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 120 credits included

08 Level 3

Orchestrate pipelines with Apache Airflow

schedule, chain, replay and monitor data processing with explicit orchestration

Understand DAG, Task and dependencies in Airflow 3.x Create a workflow and separate orchestration from processing Schedule runs and configure tasks Manage retries, timeouts and failure dependencies Organize connections, variables and secrets Replay periods with a controlled backfill Understand assets and data-aware scheduling Workshop: orchestrate and monitor a multi-step pipeline

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 120 credits included

09 Level 3

Ensure data quality, contracts and evolution

detect incorrect data and protect consumers from uncontrolled structural changes

Define data quality dimensions Test nullability, uniqueness, relationships and accepted values Monitor freshness, volumes and drift Write unit tests on transformation logic Define and enforce data contracts Manage schema evolution and breaking changes Integrate quality and checks into a CI pipeline Workshop: block the publication of a non-compliant dataset

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 120 credits included

Reliability, Governance and Scaling Pack 3 courses

🎓 Certificate : DMP — Reliability, Governance and Scaling

📚 3 courses 📖 24 lessons ⏱ 9 to 15 h ⚡ 420 credits included

56,70 €

42,90 excl. VAT

Savings : 13,80 €

10 Level 4

Manage metadata, catalog, lineage and impact analysis

make data understandable, traceable and governable from source to use

Understand technical and business metadata Define ownership, description and classification Understand the role of a data catalog Build the dataset → job → run lineage Trace dependencies between sources and data products Analyze the impact of a schema change Use OpenLineage as an open traceability model Workshop: carry out the impact analysis of a critical change

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 140 credits included

11 Level 4

Design batch, micro-batch and event-driven pipelines

choose the right processing mode based on latency, volume, complexity, cost and business requirements

Compare batch, micro-batch and streaming Understand events, producers and consumers Understand queues, event logs and offsets Distinguish processing time and event time Manage ordering, duplication and late events Understand at-least-once delivery and the exactly-once goal Choose an architecture based on latency, cost and complexity Workshop: decide whether a need truly justifies real time

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 140 credits included

12 Level 4

Optimize storage, processing, performance and costs

reduce processing time and resource consumption without degrading quality or maintainability

Measure volumes, processing time and costs Optimize partitioning and pruning Use columnar formats and compression Avoid the small files problem Choose the right materializations Leverage parallelism and pushdown where available Balance freshness, performance, cost and simplicity Workshop: diagnose and optimize a slow pipeline

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 140 credits included

Professional Data Engineering Mastery Pack 3 courses

🎓 Certificate : DMP — Professional Data Engineering Mastery

📚 3 courses 📖 24 lessons ⏱ 9 to 15 h ⚡ 480 credits included

74,70 €

48,90 excl. VAT

Savings : 25,80 €

13 Level 5

Design a reliable, governed data platform

bring together ingestion, storage, transformations, quality, orchestration, security and governance into an operable architecture

Define the components of a data platform Structure DEV, TEST and PROD environments Organize identities, roles, secrets and data access Define conventions, ownership and responsibilities Integrate tests, contracts and publication criteria Integrate catalog, lineage and observability Define Git strategy, CI and promotion between environments Workshop: produce the architecture of a governed platform

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 160 credits included

14 Level 5

Industrialize an end-to-end Analytics pipeline

build and operate a multi-source pipeline through to a reliable BI dataset with Git, CI, tests and monitoring

Scope the Analytics dataset and its commitments Ingest files, APIs and SQL data with Python Build staging and dbt transformations Create a star schema for BI Add incremental loading, tests, contracts and quality Orchestrate, replay and monitor with Airflow Version with Git and automate CI checks Workshop: publish an industrialized, observable BI dataset

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 160 credits included

15 Level 5

Full professional Data Engineering project

design, build, operate and defend a professional data chain end to end

Scope needs, sources, consumers and service levels Design the architecture, storage and analytical model Build the ingestions and the staging zone Industrialize transformations and incremental loads Set up quality, contracts and schema evolution Orchestrate, monitor, manage lineage and recovery Document security, operations and the runbook Final workshop: present and defend the Data Engineering platform

📚 8 lessons ⏱ 3 to 5 h 🎯 Quiz included ⚡ 160 credits included