Senior Data Engineer - Data Quality & Transformation

leverage technologies, inc • United State
Relocation
Apply
AI Summary

Collaborate cross-functionally to enhance data models and accessibility. Design and develop data transformations using PySpark on AWS Databricks. Create real-time data ingestion systems with AWS Lambda and S3. Requires travel within the US.

Key Highlights
Improve data models for business intelligence tools
Monitor and ensure data quality
Troubleshoot data-related issues
Work closely with diverse teams
Key Responsibilities
Collaborate with analytics and business teams to improve data models
Implement processes and systems to monitor data quality
Perform data analysis to troubleshoot data-related issues
Design and develop data transformations using PySpark on AWS Databricks
Create real-time data ingestion systems with AWS Lambda and S3
Technical Skills Required
Python PySpark AWS (Databricks, Lambda, S3)
Benefits & Perks
Medical
Life Insurance
401k

Job Description


Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.

Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.

Perform data analysis required to troubleshoot data related issues and assist in there solution of data issues.

Work closely with a team of front end and backend engineers, product managers, and analysts.

Design and develop data transformations using P y Spark on AWS Databricks, enhancing the analytics capabilities for financial datasets.

Create a real-time data ingestion system with AWS Lambda and S3, which facilitated efficient data storage and processing.

  • Position Requirements:** Master's degree or a foreign equivalent degree in computer science, Information Technology, Information Systems, Mechanical Engineering, Computer Applications, Electrical and/or Electronics Engineering, Engineering (any) or related field.

Special Skills, Other Special Skills Or Requirements

Position requires travel/relocation to various unanticipated client locations throughout the U.S. with expenses paid by the employer.

The employer is in the field of Information Technology implementing projects for clients in various states throughout the country. Depending on the scope of the project, these implementations could sometimes take days, weeks, months, or years. Hence, the beneficiary may have to either travel or relocate to these client sites depending on the duration of the

project. Therefore, the employer has indicated that the position requires travel/relocation to various unanticipated client locations throughout the U.S. with expenses paid by the employer.

Since this is a future position, providing a timeline and the frequency of travel for a project that will be assigned at a later stage is currently not possible. Therefore, the employer has indicated that the position requires travel/relocation to various unanticipated client locations throughout the U.S. with expenses paid by the employer.

Benefits: Medical, Life Insurance and 401 k.

Similar Jobs

Explore other opportunities that match your interests

Data Engineer

Data Science
•
1h ago
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Not Applicable

The Intersect Group

United State

Senior Director, Analytics

Data Science
•
1h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Tombras

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Dexian

United State

Subscribe our newsletter

New Things Will Always Update Regularly