Skip to content

Lead Data Engineer

Job Introduction

What you’ll do
At NHG (Notting Hill Genesis), we are committed to digitally transforming services for our residents. We use some of the most advanced technologies to create great experiences for our customers and augment the services provided by our colleagues across our businesses.  
We are looking for a Lead Data Engineer to join our growing Software Engineering Team. You will be responsible for leading the technical design and implementation of data projects for data retrieval, ingestion, transformation and presentation in an Azure environment. You will collaborate effectively with cross-functional teams, data stakeholders, and business units to understand data requirements and deliver data products that meet business needs.
How you’ll do it

  • Lead the Engineering Team in the development of data and integration solutions leveraging the latest Azure technologies, tools, processes, and best practice.
  • Design and develop data products following the data development lifecycle that meet the quality and security standards within the specified project deadlines.
  • Design, model, develop and maintain data pipelines to ingest, store, process, and transform data smoothly across different systems and platforms.
  • Perform data transformation tasks from structured and unstructured data ensuring compatibility and alignment with data models and business requirements.
  • Collaborate with data architects and data scientists to design and implement data models, schemas, and structures.
  • Develop and uphold the best practice standards, design patterns and documentation for data processing,  integration, data storage and data monitoring.
The Ideal Candidate
We believe great service starts with great people, and we are committed to recruiting and developing passionate, enthusiastic, and talented individuals who can add value to our thriving organisation.

Pending confirmation of legislative changes, this role may require a qualification to demonstrate competence. If not already qualified, there may be an expectation to study towards a professional qualification.

  • Bachelor’s degree in either computer science/Information Systems or equivalent experience
  • Excellent communication and problem solving skills, with the ability to influence internal and external stakeholders
  • Proven experience in designing, developing, and deploying data solutions based on Azure
  • Experience working with relational and non-relational databases to build data solutions, such as Azure SQL Server/Oracle/Cosmos DB, experience with relational and dimensional data structures.
  • Proficiency in designing and developing data pipelines on Azure Data services and Azure Integration Services (Azure Data Factory, Databricks, Synapse, Azure Function Apps, Azure logic Apps, Azure APIM).
  • Experience of working with Data Lakes, Delta Lake and applying the appropriate architectural design as per requirements
  • Strong knowledge of data structures, algorithms, software design, design patterns and core programming concepts
  • Best practice coding/scripting experience developed in a commercial setting (Python, SQL, Spark, Scala or .NET)
  • Experience with or developed understanding of the application of ETL/ELT tools
  • Experience in Test Driven Development (TDD) and Behaviour Driven Development (BDD)
  • Evidence of working with Agile/Scrum methodology
  • Experience in Continuous Integration and Continuous Delivery (CI/CD)
  • Experience leading teams and mentoring other engineers
What’s in it for you?
Once you join us, you’ll find plenty of opportunities to grow within our organisation. You’ll also have access to a wide range of learning opportunities to help you achieve and maximise your potential.  
Benefits include:  
  • Excellent annual leave allowance and flexible working opportunities (qualifying period may apply)  
  • Generous pension scheme  
  • Enhanced maternity, paternity, and adoption pay in addition to statutory entitlements (qualifying period may apply)  
  • Employee assistance - free confidential advice and counselling services provided by independent specialist organisations.  
  • Health cash plan  
  • Staff discounts - we give our staff access to discounts at hundreds of major retailers, gyms, restaurants, entertainment, days out, insurance, and much more.  
  • Interest free loans - season ticket loan, tenancy deposit loan, and training loan  
  • Cycle to work scheme.  
  • Life Assurance x 4 annual salary

All about us
Notting Hill Genesis is a not-for-profit organisation providing affordable homes for Londoners and it is now one of the largest housing associations in London. We are both a landlord and a developer, with more than 60,000 existing homes and 10,000 more in our pipeline and we employ around 1,500 staff.  
For more information on what we do and what makes us different please visit:
We welcome applications from everyone. We actively monitor the diversity of our workforce and strive to show equal representation throughout all levels of the organisation. We are a Stonewall Diversity Champion, a Disability Confident employer amongst other diversity commitments. To find out more about our approach to equality, diversity and inclusion please visit: 
Selection Process
Step 1: If you are interested, please send your application now! Closing date is Wednesday 22nd May at 23:59
Step 2: Successful candidates will be asked to do an assessment  
Step 3: Successful candidates will be invited to interview  
Please apply for this role online. If you are not able to apply online or if you have any reasonable adjustment requirements arising from a disability or medical condition to fully participate in the recruitment process, please discuss this with our hiring team via  
NHG reserves the right to close this vacancy early if we receive sufficient applications for the role, so we advise you to submit your application at your earliest opportunity.  

This website is using cookies to improve your browsing experience and to enable social media functionality. By clicking “Turn cookies on”, you agree to such purposes. Read more about cookies.