Senior Big Data Engineer
iqvia · Warsaw
Job description
About the role
The Systems Engineering team, part of the Global Infrastructure & Operations group, is looking for an experienced, independent Senior Big Data Engineer to design, develop and support data engineering solutions. The platform processes and maps healthcare drug and diagnosis data to standard coding frames, and the engineer will build a pipeline that loads and processes millions of electronic medical records into Databricks. The team works with architects and the QA team, and is passionate about Agile, DevOps and test-driven development.
Key responsibilities
- Oversee and mentor junior and mid-level engineers, delegating tasks and owning workstreams for quality and timeliness
- Build pipelines for processing large volumes of medical data
- Take part in analysis, system design, development, deployment and maintenance
- Conduct peer code reviews and contribute to technical standards
- Create comprehensive automated unit and integration tests
Required profile
- 6 years of experience in data engineering and 6 years with SQL, Python and Scala
- Strong understanding of the Databricks platform
- Experience with TB-scale data processing and database design and modelling
- Agile environment experience; previous healthcare or pharmaceutical data experience is an advantage
- Excellent analytical and troubleshooting skills, strong collaboration and presentation skills, and familiarity with Agile/Scrum
- Understanding of cross-cultural communication and remote delivery
Required skills
- SQL, Python, Scala
- Databricks, Apache Spark (Delta, Parquet), ETL design and CI/CD (Jenkins/GitLab)
- Data profiling, integration, quality, warehousing and reporting
- Algorithms and design patterns; FastAPI for production APIs is a plus
What we offer
- Base pay range of zł188,700 to zł350,200 per year, depending on qualifications, location and schedule
- Work in a company with offices in over 100 countries, listed on the NYSE
- Quartely work planning with goals and progress reviews every 90 days
- Technical training and the chance to attend local technical conferences
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Poland.
Salaries by job title
- Praca dodatkowa w sklepie – obsługa kasy i klienta 14
- Praca dodatkowa w sklepie 13
- Pracownik/Pracownica restauracji 8
- Pracownik Produkcji 7
- Lider / Liderka Zmiany Sklepu Dealz 7
- Mechanik – naprawa i konserwacja pojazdów 6
- Praca dodatkowa w sklepie Dealz 6
- Praca dodatkowa w Sklepie Dealz (pomoc świąteczna) 5
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 1 week ago
Expires 1 month from now
16 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
iqvia
Warsaw