Senior Data Engineer
Design and build dependable data pipelines and analytical platforms for enterprise transformation programmes across multiple industry contexts.
Job description
The Senior Data Engineer will design, implement and operate data pipelines, transformation layers and analytical data products used by client delivery teams and business stakeholders.
The role requires strong engineering judgement around data quality, lineage, performance, security, orchestration and operational support rather than pipeline development in isolation.
Key responsibilities
- Design batch and streaming ingestion patterns, transformation pipelines and reusable data components.
- Build and maintain data models, validation controls, orchestration, monitoring and failure-recovery patterns.
- Work with architects, analysts, application teams and client stakeholders to define data contracts and ownership boundaries.
- Review code, deployment pipelines and data-quality evidence before production release.
- Support production diagnosis and continuous improvement of data-platform reliability and cost.
Qualifications
- 5–8 years of professional data-engineering or closely related software-engineering experience.
- Strong SQL and Python skills with hands-on experience building production ETL/ELT pipelines.
- Experience with Spark/PySpark and at least one modern cloud data platform.
- Working knowledge of data modelling, data quality, orchestration, version control and CI/CD.
- Ability to explain technical trade-offs clearly to engineering and non-engineering stakeholders.
Preferred qualifications
- Experience with Azure Data Factory, Databricks, Microsoft Fabric, dbt or equivalent platforms.
- Experience in regulated, high-volume or multi-system enterprise environments.
- Knowledge of data lineage, observability, governance and secure data-access patterns.
Benefits & employment terms
- Compensation, leave, pension and any role-specific benefits are confirmed during the recruitment process and stated in the written offer.
- Any client-site, travel, security-screening or right-to-work requirements are confirmed before appointment.
Nature of working style
- Work is organised around project outcomes, engineering standards, peer review and client delivery commitments.
- Hybrid attendance and client-site presence vary by engagement and are confirmed for the assigned project.
- Engineers are expected to document decisions, communicate delivery risk early and participate in technical review.
Location
Primary employment location is London. Some engagements may require travel to a UK client location; the requirement will be confirmed before assignment.
