The Role: Join our client as a Lead PySpark Engineer to modernize legacy data workflows. You will lead the hands-on transition of complex SAS environments into scalable, AWS-native PySpark pipelines for a major financial services project.
What You'll Do
- Modernize: Convert legacy SAS code into production-ready PySpark using automated tools and manual refactoring.
- Build: Design and fix high-performance ETL/ELT pipelines and data marts on AWS.
Your Technical Profile
- PySpark (Expert): 5+ years of hands-on experience. Deep knowledge of Spark optimization (partitioning, tuning) and Data Warehousing (SCDs, Facts/Dimensions).
- AWS (Expert): Strong proficiency in S3, EMR, Glue, Athena, and IAM. Experience with Git-based CI/CD.
- SAS (Working Knowledge): Ability to read and debug Base SAS/Macros to translate logic into Python.
- Engineering: Strong Python skills with a focus on clean code, modular design, and exception handling.
Preferred Experience
- Background in Banking or Financial Services.
How to Apply:
If you are ready to start a new contract please share your updated CV on yogeshwari. sen@ randstaddigital .com or click on "apply"
Randstad Technologies is acting as an Employment Business in relation to this vacancy.
...
