Senior PySpark Developer – Regulatory Reporting Platform

About the role

You will join a Regulatory Reporting Platform within a large US investment bank. The platform processes massive data volumes from multiple internal systems to produce regulatory reports for 240 jurisdictions worldwide.

Key responsibilities

• Design, develop and maintain large‑scale data pipelines using Java and Apache Spark.
• Implement scalable logic for data ingestion, transformation, aggregation and enrichment.
• Develop and optimise batch processing jobs that generate regulatory reports across many jurisdictions.
• Ensure high standards of data quality, validation, reconciliation and consistency throughout the reporting lifecycle.
• Collaborate with business analysts, QA engineers and cross‑functional teams in an agile, globally distributed environment.
• Investigate and resolve data and application issues in development, test and production environments.

Required profile

• 6+ years of commercial experience with Python.
• 2+ years of hands‑on experience with PySpark.
• Strong knowledge of SQL and working with large, multi‑source datasets.
• Proven ability to design and develop high‑performance backend applications.
• Experience working effectively in a global, distributed team.

Required skills

• Python
• PySpark
• Java
• Apache Spark
• SQL

What we offer

• Global relocation options and cross‑cultural experience.
• Annual holiday of 20–26 days plus various special leave allowances.
• Access to Luxoft Training Center, cloud academies and external learning platforms.
• Well‑being programmes including Multisport card, private healthcare, life insurance and social benefit fund.
• Company events, internal mobility and career development opportunities.