Data Engineer

We are currently recruiting for one of our trusted clients who are look for a Data Engineer. Join our client, a leading player in the pet health services and insurance industry, as they aim to secure the coveted position of the UK's #1 Pet Insurer.

Our client is embarking on an exhilarating journey, backed by substantial funding that will propel them to the forefront of global product leadership. This pivotal moment includes a dynamic company rebrand, extensive departmental expansion, a sweeping transformation, and substantial investments in cutting-edge technologies.

What You Can Expect

• Work Type - Permanent
• Location - Borehamwood (Hybrid model - once a week in the office)
• Industry - Insurance
• Salary - £80,000

Main Responsibilities as a Data Engineer

• Establish and oversee the creation of new data storage systems, managing both unstructured and semi-structured data.
• Monitor and enforce the use of our Azure platform to ensure that users adhere to agreed-upon processes and practices for code, data, and model governance.
• Deploy policies and quotas to optimize the usage and spending on the Azure platform and its instances.
• Maintain and provide support for our Azure platform for Machine Learning, ensuring its continuous availability.
• Develop engineering solutions for model training, such as ML Pipelines and parallelization.
• Assist in project and model lifecycle management and packaging using MLFlow.
• Support the transition of products to higher environments through productionizing and deployment (e.g., promoting ML Pipelines to Production), leveraging MLOps practices and technologies.

Experience & Skills Required

• Skilled in EDW and big data storage, data provisioning, processing, and pipeline orchestration.
• Comprehensive understanding of data modeling, possessing expertise and experience in data architecture.
• Proficient coding abilities in Python, SQL, following best software development practices such as code versioning, code reviews, unit testing, documentation, and use of collaboration tools.
• Extensive experience in scripting, batch processing, and stream processing.
• Experience with or at least an interest in Machine Learning and widely used technologies, such as NumPy, Pandas, Matplotlib, Scikit-learn, TensorFlow, and PyTorch.
• Knowledgeable about key MLOps concepts such as CI (including data aspects), CD (specific to ML), CT (Continuous Training), feature stores, automated CI/CD, and ML pipelines.
• Solid experience in source and version controls (Git), as well as linking versions of code, data, and pipelines to ensure reproducibility.
• Expertise in application infrastructure, including experience with containers, Docker, and Kubernetes.

For further information on this Data Engineer role apply below

We are an equal opportunity employer and value diversity at our company. We do not discriminate based on race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

By applying, you confirm you are happy to be added to the Addition mailing list regarding future suitable positions. You can opt out of this at any time simply by contacting one of our consultants.