305 King St W
Suite 1100
Kitchener, ON N2G 1B9
Canada
Senior Data Engineer with Databricks Latvia or Remote
Senior Data Engineer with Databricks Description
Job #: 87575
Looking for an opportunity to get into a diverse team and work with a leading retail client in Europe with ongoing businesses in numerous countries? Join our community of Data professionals and take part in Data Products pipelines migration from Oracle workloads to Databricks.
In this role, you will assess and implement new database technologies: from hybrid cloud and local infrastructures to replication, scalability, resiliency & redundancy.
Take the freedom to work remotely from anywhere across the country or meet with teammates in our office.
#LI-DNI
#LI-DNP
#data-specialists-lv-4
In this role, you will assess and implement new database technologies: from hybrid cloud and local infrastructures to replication, scalability, resiliency & redundancy.
Take the freedom to work remotely from anywhere across the country or meet with teammates in our office.
#LI-DNI
#LI-DNP
#data-specialists-lv-4
What You’ll Do
- Develop, monitor and operate the most used and critical curated data pipeline - Sales Order Data (with Post-order information: shipment, return, payment)
- Work closely with engineering teams to build and improve "Single Source of Truth" KPI for business steering (central Profit Contribution measurement)
- Redevelop old legacy pipelines to new, advanced and standard versions that are easy to maintain and scalable for future demands
- Leverage and improve a cloud-based tech stack (AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala)
What You Have
- Background in Apache Spark along with Spark streaming
- Hands-on experience with Databricks
- Expert knowledge in Scala programming language
- Expertise in GitHub + CI/CD
- Fluency in English, both written and verbal
Nice to have
- Knowledge in Delta-Lake
- Expertise in SQL
- Fluency working with AWS landscape
- Ability to build Apache Airflow pipelines
- Experience in Presto, Superset, Starburst, Oracle & Exasol
We offer
- Outstanding career development roadmap to accelerate your journey
- Engineering community of 59,250+ industry’s top professionals
- Certification and mentoring programs, training, and unlimited access to LinkedIn Learning
- Innovative solutions delivery to the world’s industry leaders
- Regular assessments and salary reviews
- Bonuses for participating in the referral program
- Flexible schedule and opportunity to work remotely from any place in Latvia
- Friendly team and enjoyable working environment
- Relocation within offices in 50+ countries with throughout support for you and your family
- Four trust days a year (sick leave without a medical certificate)
- High-quality medical services in terms of corporate health insurance
About EPAM
- We are a team of 59,250+ technologists, strategists, and designers in 50+ countries. EPAMers help leading brands transform their business through our engineering expertise, design thinking, and business consulting. We foster creativity and unconventional ways of doing things welcoming like-minded professionals. Our newly opened office in Latvia is growing fast and offering myriad challenges for you to explore
