Mid/Senior Data Engineer (Kraków / GCP)
Capco · Poland - Cracow
Job description
About the role
Capco Poland, a global technology and management consulting firm, is looking for a Mid/Senior Data Engineer to join its data engineering team and build scalable, reliable data solutions for financial services clients. The engagement is a flexible B2B collaboration, working on AI and automation initiatives for leading banks, payment providers, capital markets, wealth and asset management firms. The role suits someone with hands-on commercial experience who wants to grow in Python, Apache Spark, Hadoop, Linux and Google Cloud Platform.
Key responsibilities
- Design, develop and maintain scalable data pipelines and data processing solutions.
- Build data transformation and processing workflows in Python and Apache Spark.
- Process large datasets in distributed environments with Hadoop and related technologies.
- Build and support cloud-based data solutions on Google Cloud Platform (GCP).
- Create reliable ingestion processes from multiple source systems and implement validation rules and data quality checks.
- Troubleshoot pipeline issues and optimise performance.
- Work in Linux environments, including scripting, deployment and operations.
- Collaborate with engineers, architects and analysts to turn business requirements into technical solutions, and take part in code reviews.
- Maintain technical documentation and support deployment, testing, stabilisation and maintenance.
Required profile
- 4-6+ years of commercial experience in Data Engineering or a similar role.
- Good hands-on Python and practical Apache Spark experience.
- Experience with Hadoop or distributed data processing ecosystems.
- Good knowledge of Linux and command-line environments.
- Commercial experience with GCP and relevant data services.
- Understanding of ETL/ELT, data pipelines, data quality, monitoring and troubleshooting.
- Agile mindset, ability to work with distributed teams, and English at least at B2 level.
Required skills
- Python, Apache Spark, Hadoop, Linux, SQL and relational data concepts
- Google Cloud Platform (GCP)
- Nice to have: BigQuery, Cloud Storage, Dataproc, Dataflow, Pub/Sub, Apache Airflow, CI/CD, Docker or Kubernetes, data modelling and data warehouse concepts
The online process includes a recruiter screening call, a hiring manager technical interview, a client interview, feedback and an offer. The position is listed as hybrid (#LI-HYBRID).
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Polska.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Une question sur cette offre ?
Posez-la ici : vous recevrez le récapitulatif de l'offre par e-mail, tout de suite.
Published 1 godzina temu
Expires za 1 miesiąc
1 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Capco
Poland - Cracow