Senior / Lead Data DevOps Engineer (AWS, Databricks) Georgia or Remote

What You’ll Do

• In the area of Operational Excellence:
  • Troubleshooting user issues related to Databricks (Spark) and suggesting optimizations for long-running or resource-intensive jobs
  • Guiding users on best practices of Databricks cluster management
  • Consult and help our diverse teams to develop, implement and maintain sustainable, high-performance, growth-ready data-processing and data integration systems
• In the area of Delivering New Features:
  • Implementing services that improve the CI/CD experience of users by emphasizing self-service
  • Working together with other teams in Customer’s Data Infrastructure to deliver services that serve as a backbone for Customer’s central datalake
• In the area of Compliance & Security:
  • Improving data access methods to provide bulletproof, secure and by default compliant self-service platform
• In the area of Cost Savings:
  • Guiding users and supporting them to find cost-effective setups while keeping high efficiency
  • Implementing observability solutions in Databricks to reduce slack costs
  • Driving users to adopt edge Databricks features like Photon and Graviton instances
  • Reviewing current infrastructure to find cost-saving opportunities
  • Analyzing, designing and developing solutions in an Agile team to support essential business needs for the platform search application

What You Have

• Proficient knowledge in working with distributed data processing frameworks like Apache Spark and a good understanding of relational database management systems
• Strong hands-on experience with Databricks
• Practical knowledge of Python and Scala combined with SQL knowledge
• Hands-on experience in cloud technologies (AWS services like IAM, S3, Lambda, EC2)
• Engineering craftsmanship with an expertise in software development processes focusing on testing, continuous integration/continuous delivery (CI/CD), monitoring and writing documentation
• Advanced English skills

Nice to have

• AWS Networking or Basics of Networking on AWS cloud
• Hands-on experience with Terraform

We Offer

• We connect like-minded people:
  • Delivering innovative solutions to industry leaders, making a global impact 
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home 
  • Opportunity to work abroad for up to two months per year 
  • Relocation opportunities within our offices in 50+ countries
  • Corporate and social events     
• We invest in your growth:
  • Leadership development, career advising, soft skills and well-being programs 
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to LinkedIn Learning, Get Abstract, O'Reilly, Cloud Guru 
  • Free English classes with certified teachers    
• We cover it all:
  • Participation in the Employee Stock Purchase Plan 
  • Monetary bonuses for engaging in the referral program 
  • Comprehensive medical & family care package   
  • Five trust days per year (sick leave without a medical certificate)   
  • Benefits package (sports activities, a variety of stores and services)

About EPAM

• EPAM Georgia is a team of innovators united by a passion for technology. The dynamic and inclusive culture we embrace helps positively impact our communities, customers, and employees. Here you will collaborate with multi-national teams, contribute to numerous cutting-edge projects, deliver the most creative solutions, and have an opportunity to learn. Our people are at the heart of our success, and we are proud to provide talents with a solid ground to develop and grow