Our client is a global leader in Commodities Trading, with over $50 billion in revenue annually. They're looking for a Lead Data Engineer to join their global trade surveillance team and help to manage the impacts from new business initiatives.
Title: Lead Data Engineer
Salary: £100,000-£110,000
Hybrid: 2-3 x a week in Central London office
They're looking for a Lead Data Engineer to join this newly established Trade Surveillance team, to help them grow this important business area. You will managing a team consisting of local, offshore, and 3rd party resources.
Key Requirements:
- Strong Python and Pyspark experience
- Extensive experience with both Data Warehouse and Data Lakehousing is a must, in particular DataBricks, SQL, Azure Data Factory (ADF)
- Experience working within a Azure environment is essential
- Development of ETL Pipelines, working with Big Data technologies, and data architectures is required
- Automation experience e.g., PyTest
- Experience with containerized environments
Nice to Have:
- Capital Markets/Commodities Trading experience
If you have the above experience and would like to be considered for this position, please click apply now.
Please Note: Unfortunately, sponsorship is not an option for this role.
