The Successful Data Engineering Lead will have the responsibility of:
· Build and develop the organisations data engineering capability and practice, providing professional people and technical leadership.
· Take technical responsibility for all stages and/or iterations of a data engineering project, providing method-specific technical advice and guidance to stakeholders.
· Implement best practice and set standards for data engineering, tools, techniques and methods.
· Advise on the application of standards and methods and ensure compliance.
· Lead work to define test conditions based on a review of requirements and specifications.
· Lead the design, development and implementation of complex data flows to connect and transform data from a range of data sources within, and external to, the Organisation.
· Lead work to bring together multiple data sources to a conformed model for analysis and, where required, reverse-engineer data models from live systems.
· Establish enterprise-scale data integration procedures across the data development life cycle and ensure that teams adhere to these.
· Identify and respond to/develop opportunities to re-use existing data flows between and across teams
· Investigate emerging trends in data-related approaches, performing horizon-scanning for the organisation and introducing innovative ways of working.
· Proactively lead work and identify opportunities for data quality improvements across the organisation.
· Work with senior members of the Data and Insight Service to identify, plan, develop and deliver data engineering projects across the organisation.
· Champion data engineering across the organisation and with partners.
· Build strong and effective working relationships with your peers across the Data and Insight Service to identify opportunities for cross-Service/Directorate/Partnership collaboration.
The Successful Data Engineering Lead will have:
Essential
· Experience of leading a data engineering team/function supporting the data engineering needs of a large and complex organisation within the public sector.
· Significant experience of the data engineering tools and services within Microsoft Azure.
Highly desirable
· In-depth knowledge of the services and functions delivered within a public sector organisation.
· One or more of the following Microsoft Azure certifications - Azure Developer Associate; Azure AI Engineer Associate; Azure Data Engineer Associate; Azure Data Scientist Associate; DevOps Engineer Expert.
Desirable
· Experience of working with spatial data and spatial databases.
