Senior Data Engineer

Job Description

We are seeking an experienced Data Engineer to architect, build, and lead scalable data platforms. This role requires strong hands-on experience in AWS, Spark, Databricks, and Airflow, along with technical leadership capabilities to guide teams and establish best practices.

Key Responsibilities

• Lead the design and implementation of end-to-end data engineering solutions
• Architect and optimize large-scale data pipelines using Spark, Python, and SQL
• Design and manage orchestration frameworks using Apache Airflow
• Build scalable and cost-efficient solutions on AWS ecosystem
• Drive development and optimization of Databricks-based data platformsEstablish best practices for data engineering, coding standards, and governance
• Mentor and guide data engineering teams
• Collaborate with cross-functional stakeholders to deliver business value
• Implement and drive CI/CD practices, including GitHub Actions
• Ensure data platform scalability, performance, and reliability
  
  

Required Skills & Experience

• Strong expertise in SQL, Python, and Apache Spark
• Extensive hands-on experience with Apache Airflow
• Deep experience with AWS cloud services
• Strong experience building solutions on Databricks platform
• Proven experience in data architecture, modeling, and big data systems
• Experience leading engineering teams and projects

Looking to advance your Data Science career with relocation support? Explore Data Science Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.

• Strong analytical, problem-solving, and communication skills
  
  

Good to Have

• Experience with CI/CD tools, especially GitHub Actions
• Knowledge of Pharmaceutical / Life Sciences domain
• Experience with real-time/streaming pipelines (Kafka, etc.)
• Exposure to ML/data science workflows
  
  

Education & Experience

• Bachelor’s/Master’s degree in Computer Science or related discipline
• Typically 8+ years of experience in data engineering
  
  

Required Skills

Amazon Web Services (AWS), Apache Airflow, Apache Spark, Databricks Platform, Python (Programming Language), Structured Query Language (SQL)

Preferred Skills

CI/CD, GitHub Actions

Current Employees apply HERE

Current Contingent Workers apply HERE

Search Firm Representatives Please Read Carefully

Merck & Co., Inc., Rahway, NJ, USA, also known as Merck Sharp & Dohme LLC, Rahway, NJ, USA, does not accept unsolicited assistance from search firms for employment opportunities. All CVs / resumes submitted by search firms to any employee at our company without a valid written search agreement in place for this position will be deemed the sole property of our company. No fee will be paid in the event a candidate is hired by our company as a result of an agency referral where no pre-existing agreement is in place. Where agency agreements are in place, introductions are position specific. Please, no phone calls or emails.

Employee Status

Regular

Relocation

No relocation

VISA Sponsorship

Yes

Travel Requirements

10%

Flexible Work Arrangements

Hybrid

Shift

Not Indicated

Valid Driving License

No

Hazardous Material(s)

N/A

Job Posting End Date

07/12/2026

• A job posting is effective until 11 59 59PM on the day BEFORE the listed job posting end date. Please ensure you apply to a job posting no later than the day BEFORE the job posting end date.
  
  

Requisition ID R406777