Durga Analytics/ClickHouse - Data Engineer Track

  • $999

ClickHouse - Data Engineer Track

  • Course
  • 59 Lessons

Kafka & S3 Integration ETL Pipelines using Airflow Data Visualization & BI Tools

Contents

Module 8 — Kafka & S3 Integration (Chapters 201–220)

Module 8 — Kafka & S3 Integration.pdf
216 Schema evolution.m4a
207 Kafka Connect integration.m4a
210 PostgreSQL ingestion pipelines.m4a
209 CDC pipeline design.m4a
202 Batch vs streaming pipelines.m4a
211 MySQL ingestion pipelines.m4a
215 Data lake integration.m4a
218 Ingestion failures handling.m4a
220 Backpressure management.m4a
203 Kafka integration overview.m4a
219 Retry mechanisms.m4a
217 Data validation pipelines.m4a
204 Kafka engine tables.m4a
213 Object storage integration.m4a
205 Kafka ingestion pipelines.m4a
208 Event-driven architectures.m4a
214 Parquet ingestion.m4a
201 Data pipeline architecture.m4a
206 Streaming ingestion.m4a
212 S3 data ingestion.m4a
08_CLICKHOUSE_KAFKA_S3_INTEGRATION_PART2_Durga.mp4
08_CLICKHOUSE_KAFKA_S3_INTEGRATION_PART1_Durga.mp4

Module 9 — ETL Pipelines using Airflow (Chapters 221–240)

Module 9 — ETL Pipelines using Airflow.pdf
226 Scheduling workflows.m4a
240 Pipeline architecture review.m4a
222 Spark ingestion pipelines.m4a
221 Python ingestion pipelines.m4a
231 Streaming aggregations.m4a
230 Data quality checks.m4a
233 Pipeline optimization.m4a
235 Data platform architectures.m4a
237 Real-time data engineering.m4a
224 Airflow architecture.m4a
234 Large-scale ingestion systems.m4a
223 Airflow orchestration basics.m4a
227 Automated ETL pipelines.m4a
229 Incremental ingestion pipelines.m4a
232 Pipeline monitoring.m4a
228 Data transformation pipelines.m4a
239 Data engineering best practices.m4a
236 Streaming analytics systems.m4a
225 Building Airflow DAGs.m4a
238 Pipeline troubleshooting.m4a
09_CLICKHOUSE_ETL-PIPELINES_AIRFLOW_PART2_Durga.mp4
09_CLICKHOUSE_ETL-PIPELINES_AIRFLOW_PART1_Durga.mp4

Module 12 — Real-Time Ingestion Project (Chapters 291–300)

Module 12 — Real-Time Ingestion Project.pdf
12_CLICKHOUSE_REAL-TIME_INGESTION_PROJECT_Durga.mp4
294 Kafka table engines.m4a
291 Kafka environment setup.m4a
296 Real-time aggregation queries.m4a
292 Streaming event generation.m4a
293 Kafka topic configuration.m4a
297 Dashboard creation.m4a
295 Streaming ingestion pipeline.m4a
300 Project review.m4a
299 Scaling ingestion pipelines.m4a
298 Monitoring ingestion pipelines.m4a
clickhouse-streaming-project.zip