Jobiglo

No results.

Mid/Senior Data Engineer (Kraków / GCP)

Capco · Poland - Cracow

New
Senior 🇬🇧 English
Python Apache Spark Hadoop Linux Google Cloud Platform SQL ETL Git BigQuery Apache Airflow CI/CD Docker Kubernetes

Job description

About the role

Capco Poland, a global technology and management consulting firm, is looking for a Mid/Senior Data Engineer to join its data engineering team and build scalable, reliable data solutions for financial services clients. The engagement is a flexible B2B collaboration, working on AI and automation initiatives for leading banks, payment providers, capital markets, wealth and asset management firms. The role suits someone with hands-on commercial experience who wants to grow in Python, Apache Spark, Hadoop, Linux and Google Cloud Platform.

Key responsibilities

  • Design, develop and maintain scalable data pipelines and data processing solutions.
  • Build data transformation and processing workflows in Python and Apache Spark.
  • Process large datasets in distributed environments with Hadoop and related technologies.
  • Build and support cloud-based data solutions on Google Cloud Platform (GCP).
  • Create reliable ingestion processes from multiple source systems and implement validation rules and data quality checks.
  • Troubleshoot pipeline issues and optimise performance.
  • Work in Linux environments, including scripting, deployment and operations.
  • Collaborate with engineers, architects and analysts to turn business requirements into technical solutions, and take part in code reviews.
  • Maintain technical documentation and support deployment, testing, stabilisation and maintenance.

Required profile

  • 4-6+ years of commercial experience in Data Engineering or a similar role.
  • Good hands-on Python and practical Apache Spark experience.
  • Experience with Hadoop or distributed data processing ecosystems.
  • Good knowledge of Linux and command-line environments.
  • Commercial experience with GCP and relevant data services.
  • Understanding of ETL/ELT, data pipelines, data quality, monitoring and troubleshooting.
  • Agile mindset, ability to work with distributed teams, and English at least at B2 level.

Required skills

  • Python, Apache Spark, Hadoop, Linux, SQL and relational data concepts
  • Google Cloud Platform (GCP)
  • Nice to have: BigQuery, Cloud Storage, Dataproc, Dataflow, Pub/Sub, Apache Airflow, CI/CD, Docker or Kubernetes, data modelling and data warehouse concepts

The online process includes a recruiter screening call, a hiring manager technical interview, a client interview, feedback and an offer. The position is listed as hybrid (#LI-HYBRID).

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec Capco.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:greenhouse

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 2 hours ago

Expires 1 month from now

2 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

Capco

Poland - Cracow