Senior Data Engineer

We're seeking an experienced Senior Data Engineer to join a leading global organisation on a contract basis, helping to design and deliver scalable, enterprise-grade data solutions. This role will focus on building and optimising modern data platforms using Python, Databricks and Spark, enabling advanced analytics, reporting and data-driven innovation across the business. Client Details Our client is a leading international financial institution with a long-established presence across major global markets. Serving a diverse client base that includes corporates, financial institutions and investors, the organisation delivers a broad range of banking, financing and capital markets services. With significant investment in digital transformation and data-led innovation, the organisation is modernising its technology estate and expanding its enterprise data capabilities. Data plays a critical role in supporting business operations, regulatory obligations, analytics and strategic decision-making, making this an exciting opportunity to contribute to large-scale, business-critical data initiatives within a complex global environment. Description • Design, build and maintain scalable data pipelines using Python and Databricks • Develop and optimise ETL/ELT processes leveraging Spark and Delta Lake • Create robust data models and data architectures within modern Lakehouse environments • Implement and manage data workflows across the Databricks ecosystem • Ensure data quality, governance, reliability and performance across platforms • Optimise distributed data processing workloads at scale • Collaborate closely with data scientists, analysts and stakeholders to support analytics and machine learning initiatives • Implement monitoring, logging and alerting capabilities across data solutions • Champion engineering best practices and mentor less experienced team members Profile You will bring: • 10+ years' experience in Data Engineering • Experience delivering data engineering solutions within Banking, Financial Services, Capital Markets, Insurance, or other highly regulated enterprise environments. • Strong hands-on expertise in Python • Proven experience with Databricks, including notebooks, workflows, jobs and Delta Lake • Strong knowledge of Apache Spark / PySpark • Experience designing and delivering large-scale ETL/ELT pipelines • Advanced SQL skills and experience with relational databases • Experience working with cloud technologies such as AWS, Azure or GCP • Knowledge of modern data warehousing platforms such as Snowflake, Redshift or BigQuery • Understanding of data modelling principles and Lakehouse architecture • Excellent communication, stakeholder management and problem-solving skills Desirable experience includes: • Databricks certifications • Streaming technologies such as Kafka or Structured Streaming • CI/CD and DevOps practices • Docker and Kubernetes • Exposure to machine learning pipelines Job Offer • Competitive day rate of £550-£880 Inside IR35 (Umbrella) • Initial 6-month contract • Hybrid working model with flexibility • Opportunity to work on cutting-edge data engineering projects • Exposure to modern cloud and data technologies • Collaborative and high-performing engineering environment • Chance to make a tangible impact on enterprise-scale data transformation initiatives