- Position Title: Advanced Data Engineer
- Contract Type: Contract (6-month initial duration, with potential for extension)
- Location: Cardiff, UK
- Work Arrangement: Onsite
- Hours: 37.5 hours per week
Job Description
Core Technical Skills
- Strong proficiency in programming languages such as Python, SQL, and R (experience with R is desirable).
- Proven experience working with relational database management systems and data warehousing architectures.
- Hands-on expertise using Git-based version control tools (e.g., GitHub, GitLab, Azure DevOps) within collaborative software development environments.
- Demonstrated experience operating effectively within Agile delivery frameworks.
- Background in designing and deploying cloud-native data architectures, with a preference for Google Cloud Platform (GCP).
- Proven track record of migrating legacy on-premises data platforms, pipelines, and services to cloud infrastructure.
- Solid grasp of data modeling concepts across conceptual, logical, and physical levels.
- Proven capability to design, construct, test, and maintain robust, scalable data pipelines and data products.
- Experience establishing CI/CD automation and streamlined deployment workflows.
- Experience leveraging container technologies such as Docker.
- Skilled in architecting and implementing robust ETL and ELT data pipelines.
- Familiarity with modern workflow orchestration frameworks (e.g., Airflow, Cloud Composer, Prefect, Dagster).
- Experience processing large-scale datasets using distributed computing engines (e.g., BigQuery, Spark, Dataproc).
- Proficiency in monitoring, troubleshooting, and optimizing platform performance and data pipelines.
- Solid understanding of DataOps and DevOps methodologies.
- Experience integrating systems via APIs and standard data integration techniques.
Data Architecture and Engineering Practices
- Understanding of how enterprise data platforms interoperate with broader organizational systems.
- Practical experience utilizing metadata management solutions, data lineage tools, and data catalogs.
- Experience implementing comprehensive data quality profiling, assessment, and validation frameworks.
- Demonstrated capability to design, develop, test, document, and support production-ready code and end-to-end data pipelines.
- Adept at leading code reviews and applying software engineering best practices, including unit testing, refactoring, and comprehensive technical documentation.
Governance, Compliance and Ethics
- In-depth understanding of information governance, data protection laws (including the Data Protection Act 2018 and UK GDPR), and secure data management standards.
- Awareness of ethical standards and considerations related to data processing and analytics.
Communication and Stakeholder Collaboration
- Strong interpersonal and communication skills for working effectively across cross-functional teams and engaging both technical and non-technical stakeholders.
- Proven skill in translating complex business requirements into scalable technical solutions and explaining technical details to non-technical audiences.
Qualifications & Experience
- Bachelor's degree in Computer Science or a related quantitative field, or equivalent practical industry experience.
- Professional certification as a GCP Data Engineer or Cloud Architect is highly desirable.
Randstad Technologies is acting as an Employment Business in relation to this vacancy.
...
