Specialist – Data Engineering

November 19, 2026
Urgent

Job Description

GCP Core Data Stack Handson production experience building maintaining and supporting scalable batch and streaming data pipelines on Google Cloud Platform specifically BigQuery and Google Cloud Storage GCSCloud Composer Apache Airflow Proven ability to author schedule troubleshoot and optimize complex Airflow DAGs in a managed Cloud Composer environment custom operators task dependencies retries backfills log diagnostics and runtimeSLA tuningGoogle Cloud Dataflow Java Handson experience building maintaining and debugging Apache Beam pipelines written in Java on Google Cloud Dataflow including job monitoring and performance troubleshootingDataform SQLX Practical experience developing and debugging SQLX ELT transformations data quality assertions and dependency graphs in DataformAdvanced BigQuery SQL Optimization Deep SQL proficiency in BigQuery including partitioned PARTITIONTIME and clustered tables query performance tuning slotcost optimization and querying operational metadatatelemetry tablesPython for Data Engineering Strong python3 skills for writing and debugging productiongrade Airflow tasks API integrations and automation scriptsProduction Support RCA Data Validation Demonstrated ability to own production reliabilitymonitoring daily DAGtask runs performing deep rootcause analysis RCA on failures or data discrepancies building automated data validationreconciliation checks and deploying permanent fixes within SLAData Modelling OnshoreOffshore Collaboration Solid grasp of dimensional modelling and modern ELT patterns for highvolume datasets eg ecommerce or consumeraudience data paired with clear communication for daily onshoreoffshore handoffs and stakeholder alignment