Senior PySpark Developer

About the role

You will join a Regulatory Reporting Platform within a large US investment bank, responsible for processing massive data volumes to produce regulatory reports for 240 jurisdictions.

Key responsibilities

• Design, develop and maintain large‑scale data pipelines using Java and Apache Spark.
• Implement scalable logic for data ingestion, transformation, aggregation and enrichment from multiple internal sources.
• Develop and optimise batch jobs to generate regulatory reports across many jurisdictions.
• Ensure high standards of data quality, validation, reconciliation and consistency throughout the reporting lifecycle.
• Collaborate with analysts, QA engineers and cross‑functional teams in an agile, globally distributed environment.

Required profile

• 6+ years of commercial experience with Python.
• 2+ years of hands‑on PySpark experience.
• Strong problem‑solving skills and ability to work effectively in a global distributed team.

Required skills

• Python
• PySpark
• Java
• Apache Spark
• SQL
• CI/CD practices
• Cloud environments

What we offer

• Global relocation options and experience in an international environment.
• Annual holiday of 20–26 days, plus various parental and special leave benefits.
• Access to Luxoft Training Center, cloud academies and leadership programs.
• Well‑being benefits such as Multisport card, private healthcare, life insurance and social activity programs.
• Internal mobility, rotation between projects and new career opportunities.