Data Engineer - Geospatial Data

Data Engineer – Demographic & Geospatial Data About the Role We are seeking a hands-on Data Engineer to build Databricks pipelines that combine demographic data with geographic reference data, delivering reliable, reconciled datasets for population analysis and service planning. Key Responsibilities Design and deploy pipelines using Databricks, Python, PySpark, SQL and Delta Lake Standardise postcodes and enrich records using NHS and ONS postcode products and ODS reference data Implement spatial joins and point-in-polygon matching, handling edge cases and multiple matches Version lookups and boundaries so historical outputs stay reproducible Automate data quality checks and reconcile counts before and after joins Optimise Spark and spatial processing as data volumes grow Apply access, pseudonymisation and disclosure controls to sensitive data Essential Skills Strong Databricks, Python, PySpark and SQL in production Geospatial engineering: CRS (BNG, WGS84), geometry validation, GeoJSON, WKT/WKB, GeoParquet Apache Sedona or native Databricks spatial functions Git, CI/CD, automated testing and clear communication with analysts Desirable NHS demographic or registration data; LSOAs, MSOAs, ICBs; UPRNs GeoPandas, Shapely or QGIS; regulated data environments