Data Engineer

 

The Technical Delivery team are currently transitioning from hosted SQL server to the cloud (Azure) and the Technical Delivery team is currently looking for a Data Engineer to join their team on a permanent basis. The Data Engineer will be tasked with providing technical solutions to business problems. The Data Engineer will have good knowledge with of traditional Data Engineering capabilities, such as execution of stored produced (T-SQL), data integration (SSIS), data reporting (SSRS), development of database design and creation and as well as able to move over to new technology stack in Microsoft Azure (data factory, Power BI and pipelines)

 

Accountabilities
Breakdown of the duties/tasks/responsibilities of the role

 

  • The Data Engineer will be responsible for using best practice in the creation and management of data in the companies data bases. They will follow and guide best practice.
  • Responsible for creating or guiding the low-level design of data solutions, taking high level solutions, and translating them into workable designs and work packages to deliver themselves or in other members of the team.
  • Responsible for the quality of the overall data platform(s), ensuring that data ETL and database solutions are implemented effectively from a re-use and performance optimisation perspective.
  • Develop high complexity, secure, governed, high quality, efficient data ETL from a variety of on and off premise, internal and external data sources.
  • The design and build of data observability and data quality by design into all Data ETL, promoting self-testing pipelines that proactively identify processing issues or discrepancies.

 

Measures
How the tasks/responsibilities will be measured/achieved

 

  • Performance of imports and routines
  • Accuracy of business logic and ETL conversion
  • Speed of delivery

 

Experience (essential/desirable)

 

Essential:

  • Up to one years designing and deploying business data ETL packages and designing data based systems.
  • Strong T-SQL, SSIS and traditional MS-Stack technical skills.
  • Strong analytical and problem-solving skills.
  • Strong data quality and governance skills.
  • Strong teamwork, interpersonal and collaboration skills with colleagues and clients.
  • Experience with Unit and Integration testing.

Preferred:

  • Data Lake – Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low level permissions management.
  • Azure Active Directory – for Managed identities creation and usage or for generating service principles for authentication and authorisation.
  • Version Control – Experience in building Data Ops i.e., CICD pipelines in Azure DevOps with managed identity.

 

Key Knowledge and Behaviours

Knowledge:

  • Microsoft SQL stack

Behaviour:

  • Passion for all things data and embracing new technology.
  • Passion for solving datateam challenges and commitment to best practice.
  • A growth mindset and proven desire for continuous learning and improvement.
  • Confident communicator, who can articulate problems and solutions just as clearly to the executive team as to engineering teams.

 

Please email your CV to: recruitment@perchgroup.co.uk

 

Back to Careers page