Data Engineer

The Role

Design and maintain scalable data pipelines that power real-time price comparisons across 183+ sellers. You'll work closely with our ML and analytics teams to deliver accurate, fast pricing data to millions of UK consumers.

Responsibilities

• Build and maintain robust ETL pipelines processing 95,000+ daily price points
• Design and optimise data warehouse schemas for analytical workloads
• Implement data quality monitoring and alerting systems
• Collaborate with ML engineers on feature engineering for price prediction models
• Develop real-time streaming solutions for live price updates
• Create and maintain data documentation and lineage tracking
• Participate in on-call rotation for critical data infrastructure

Essential Requirements

• 3+ years experience with Python, SQL, and ETL frameworks
• Experience with AWS (Redshift, Glue, S3) or similar cloud data tools
• Strong understanding of data modelling and warehouse design
• Proficiency with version control (Git) and CI/CD pipelines
• Excellent problem-solving skills and attention to detail

Nice to Have

• Familiarity with Apache Airflow, Spark, or Kafka
• Experience with web scraping and price aggregation systems
• Knowledge of PHP and MySQL in production environments
• Exposure to machine learning pipelines and feature stores

What We Offer

• Remote flexibility – work from anywhere 3 days a week
• 5% employer pension contribution
• £1,500 annual learning & development budget
• Private health insurance (after probation)
• 25 days annual leave + bank holidays
• Latest MacBook Pro or equivalent setup
• Monthly team socials and quarterly offsites
• Cycle-to-work scheme

Hiring Process