Skip navigation EPAM

Key Big Data Engineer Colombia

  • hot

Key Big Data Engineer Description

Job #: 55093
EPAM is committed to providing our global team of 36,700+ EPAMers with inspiring careers from day one. EPAMers lead with passion and honesty and think creatively. Our people are the source of our success and we value collaboration, try to always understand our customers’ business, and strive for the highest standards of excellence. In today’s new market conditions, we continue to support operations for hundreds of clients around the world remotely, with the vast majority of our teams working from home. No matter where you are located, you’ll join a dedicated, diverse community that will help you discover your fullest potential.

DESCRIPTION



You are curious, persistent, logical and clever – a true techie at heart. You enjoy living by the code of your craft and developing elegant solutions for complex problems. If this sounds like you, this could be the perfect opportunity to join EPAM as a Key Big Data Engineer. Scroll down to learn more about the position’s responsibilities and requirements.

Looking for a seasoned Key Data Engineer who can help drive a data migration project for our final client this is a migration for customer sales, provisioning and usage data collected by the client across a number of products. EPAM data team will be working on Core KPI's and Stats platforms that are hosted in AWS (S3, EMR, Spark/PySpark etc). There is some complex business logic in ETL jobs and the goal is to migrate and optimize data flows while focusing on improving data quality. This is potentially a long-term engagement but it depends on the delivery results for the initial scope.

You will collaborate with Data Scientists, Product Managers, Executives, and other key stakeholders around the world. In this role, you will leverage your vast knowledge, skills, and experiences to understand data requirements and build the systems and platform that help unleash insights. You will have a direct impact on the insights that are used to create delightfully smart, personalized, and revolutionary customer experiences.

Responsibilities

  • Apply your broad knowledge of technology options, technology platforms, design techniques and approaches across the data warehouse lifecycle phases to design an integrated quality solution that address requirements
  • Ensure completeness and compatibility of the technical infrastructure required to support system performance, availability and architecture requirements
  • Design and plan for the integration for all data warehouse technical components
  • Provide input and recommendations on technical issues to the team
  • Responsible for data design, data extracts and transforms
  • Develop implementation and operation support plans
  • Lead architecture design and implementation of next generation BI solution
  • Build robust and scalable data integration (ETL) pipelines using AWS Services, EMR, Python, PiG and Spark
  • Mentor and develop other Junior Data Engineers
  • Build and deliver high quality data architecture to support Business Analysts, Data Scientists and customer reporting needs
  • Interface with other technology teams to extract, transform, and load data from a wide variety of data sources
  • Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers

Requirements

  • Bachelor's degree in Computer Science required, Master’s degree preferred
  • 7+ years of relevant experience in one of the following areas: Big Data Engineering, Datawarehouse ,Business Intelligence or Business Analytics
  • 7+ years of hands-on experience in writing complex, highly-optimized SQL queries across large data sets
  • Demonstrated strength in data modelling, ETL development, and Data Warehousing
  • Experience with AWS services including S3, EMR, Kinesis and RDS
  • Experience with big data stack of technologies, including Hadoop, HDFS, Hive, Spark, Pig, Presto
  • Experience with delivering end-to-end projects independently
  • Experience with using AirFlow, creating and maintaining DAGs, Operators, and Hooks
  • Knowledge of distributed systems as it pertains to data storage and computing
  • Exceptional Problem solving and analytical skills
  • Knowledge of software engineering best practices across the development lifecycle; including, Agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations

Equal Employment Opportunity

EPAM Systems, Inc. is an equal opportunity employer.  We recognize the value of diversity and inclusion in creating success for our customers, business partners, shareholders, employees and communities. We are committed to recruiting, hiring, developing and promoting employees without discrimination. As a global employer, this commitment includes complying with all laws in the countries in which we operate. Nevertheless, we believe equal employment practices should not be limited to what the law requires. Equal opportunity and inclusion are essential to motivate, empower and recognize the best in everyone.

At EPAM, employment actions are based on individual qualifications, without regard to race, color, religion, creed, gender, pregnancy status, sexual orientation, gender identity, gender expression, marital or familial status, national origin, ancestry, genetics, age, disability status, veteran status, citizenship status when otherwise legally able to work, or any other characteristic protected by law.

Pay Transparency Non-Discrimination Provision

EPAM will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor’s legal duty to furnish information. 41 CFR 60-1.35(c)

Affirmative Action Obligations as a U.S. Government Federal Contractor

As a U.S. federal government contractor, EPAM is committed to meet its affirmative action obligations to make good faith efforts to expand the recruiting pool of women, minorities, individuals with disabilities, and protected veterans through outreach, targeted recruitment, training opportunities and other activities. We affirm this commitment annually in EPAM’s Affirmative Action Plans. The full text of our Affirmative Action Plan for Persons with a Disability and Protected Veterans is available for inspection in the People Operations Department during normal business hours. Email the People Operations Department to schedule an appointment.

Accessibility for Applicants with Disabilities

EPAM is committed to working with and providing reasonable accommodation to individuals with disabilities. If you require an accommodation at any stage of the employment application process, please send an email to the People Operations Department including your name, a detailed description of your requested accommodation, and the best method to contact you. If you have already reviewed a job posting or submitted an application for a job, please include the requisition number. We will assist you and make a determination on your accommodation request on a case-by-case basis.

EEO is the Law. Applicants to and employees of EPAM Systems Inc., are protected under Federal law from discrimination.

EPAM Systems, Inc. participates in eVerify.

A day in the life

SALMAN TALAT
Account Manager
Toronto, Canada

IRYNA KOVALENKO
Delivery Manager
Kyiv, Ukraine

JAN MAZUREK 
Senior Business Analyst
Gdansk, Poland

DANIELLA KOROSSY
Project Manager
Budapest, Hungary

Hello. How Can We Help You?

Get in touch with us. We'd love to hear from you.


Our Offices