Senior Data Engineer

LHH • United State
Remote
Apply
AI Summary

Design and develop data pipelines, data marts, and schemas to support data warehousing environments and analytical requirements. Develop ETL/ELT pipelines using Python, PySpark, and AWS Glue. Collaborate with data consumers, analysts, and platform engineers.

Key Highlights
Design and develop data pipelines, data marts, and schemas
Develop ETL/ELT pipelines using Python, PySpark, and AWS Glue
Collaborate with data consumers, analysts, and platform engineers
Key Responsibilities
Design and develop data pipelines, data marts, and schemas to support data warehousing environments and analytical requirements
Develop ETL/ELT pipelines using Python, PySpark, and AWS Glue
Collaborate with data consumers, analysts, and platform engineers
Design and implement scalable data Lakehouse architectures using AWS S3, Delta Lake, and Redshift
Build and maintain high-performance data pipelines to ingest, transform, and curate large datasets
Define best practices for data modeling, partitioning, and storage optimization in a Lakehouse/medallion environment
Develop and maintain data cataloging and metadata management solutions
Work closely with data consumers, analysts, and platform engineers to support self-service analytics through well-structured datasets and semantic models
Technical Skills Required
AWS Python PySpark AWS Glue Apache Airflow DBT Redshift Delta Lake S3 SQL
Benefits & Perks
Medical
Dental
401K

Job Description


Role: Senior Data Engineer

Location: United States - Must live in USA now

Office: Fully remote

Salary: $150,000-170,000

Benefits: Medical, Dental, 401K


Requirements: Coding Assessment and final onsite interview

MUST HAVE CURRENT AWS experience


NOT OPEN TO C2C, Sponsorship, or any Visas


As a Senior Data Engineer, you will be working on our data systems and services with other data engineers to deliver projects and systems critical to Platform Ventures business. We expect our data engineers to be versatile, display leadership qualities and be enthusiastic about taking on new problems across our businesses as we continue to build great things for our customers.


Job Description

The candidate will design and develop data pipelines, data marts, and schemas to support our data warehousing environments and analytical requirements


Data Platform & Architecture

  • Design and implement scalable data Lakehouse architectures using AWS S3, Delta Lake, and Redshift.
  • Build and maintain high-performance data pipelines to ingest, transform, and curate large datasets.
  • Define best practices for data modeling, partitioning, and storage optimization in a Lakehouse/medallion environment.
  • Develop and maintain data cataloging and metadata management solutions.


Data Engineering & Processing

  • Develop ETL/ELT pipelines using Python, PySpark, and AWS Glue.
  • Build robust batch and streaming data pipelines.
  • Implement transformation workflows using DBT.
  • Optimize performance for Spark workloads and Redshift queries.


Workflow Orchestration

  • Design and maintain workflow orchestration using Apache Airflow.
  • Monitor pipeline performance and implement alerting and failure recovery.


Data Governance & Quality

  • Implement data validation, lineage, and monitoring frameworks.
  • Maintain data documentation and data catalog integration.
  • Ensure data reliability, consistency, and security across platforms.


DevOps & Automation

  • Implement CI/CD pipelines for data workflows.
  • Automate testing, deployment, and monitoring of data pipelines.
  • Use infrastructure-as-code where possible to maintain reproducible environments.


Collaboration

  • Work closely with data consumers, analysts, and platform engineers.
  • Support self-service analytics through well-structured datasets and semantic models.


Minimum Qualifications:

  • 7+ years of data warehousing / OLAP experience
  • 7+ years multidimensional database architecture, data modeling, and design experience
  • 5+ years of SQL Experience
  • 3+ years of Python Experience
  • 2+ years of Redshift Experience
  • 2+ years of NoSQL Experience
  • Team and vendor partner management
  • Clear understanding of principles and techniques of Web development
  • Experience with AWS Glue, Lambda, Step Functions, and Airflow
  • Experience with data ingression from APIs
  • Dimensional database architecture experience
  • Formal systems life cycle methodology experience
  • Experience implementing CI/CD pipelines for data workflows
  • Experience working with data catalogs and metadata management


Desired Qualifications:

  • AWS Data Warehouse operations experience
  • Tableau, Quicksight, Looker, big data and Realtime BI experience
  • Experience with data streaming


Equal Opportunity Employer/Veterans/Disabled

Military connected talent encouraged to apply

To read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to https://www-uat.lhh.com/us/en/candidate-privacy

The Company will consider qualified applicants with arrest and conviction records in accordance with federal, state, and local laws and/or security clearance requirements, including, as applicable:

  • The California Fair Chance Act
  • Los Angeles City Fair Chance Ordinance
  • Los Angeles County Fair Chance Ordinance for Employers
  • San Francisco Fair Chance Ordinance

Massachusetts Candidates Only: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.


Similar Jobs

Explore other opportunities that match your interests

Senior Principal AI/ML Engineer

Data Science
•
11h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

palo alto networks unit 42

United State

Clinical Data Scientist

Data Science
•
13h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Associate

netrolynx ai

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

pipe

United State

Subscribe our newsletter

New Things Will Always Update Regularly