Senior Data Engineer

cormac United State
Remote
Apply
AI Summary

CORMAC seeks a Senior Data Engineer to build and maintain scalable data processing pipelines, ensuring data integrity, security, and accessibility for business-critical applications. The role involves developing data processing applications using Apache Spark and Scala, monitoring database performance, and optimizing data infrastructure on AWS. The ideal candidate will have experience with cloud platforms, data warehousing, and machine learning algorithms.

Key Highlights
Build and maintain scalable data processing pipelines
Develop data processing applications using Apache Spark and Scala
Optimize data infrastructure on AWS
Key Responsibilities
Develop and maintain data processing applications using Apache Spark and Scala
Monitor and optimize database performance
Design and implement robust, scalable, and efficient database structures
Deploy and manage data infrastructure on AWS
Assist in the migration of data between systems
Leverage cloud-native services for data processing and storage
Optimize costs while maintaining performance and scalability
Apply various transformations like data cleansing, aggregation, and enrichment
Monitor data quality metrics and perform data cleansing as necessary
Technical Skills Required
Apache Spark Scala AWS Cloud platforms Data warehousing Machine learning algorithms ETL processes Data modeling techniques REST APIs Data integration techniques
Benefits & Perks
100% remote work
Flexible work schedule
US Citizenship Required/E-Verify Participation/EEO
Nice to Have
Airflow
DBT
Postgres
Databricks
Amazon EMR & RDS

Job Description


CORMAC is seeking a skilled Data Engineer to manage and optimize our data for powerful analytics and reporting. You will play a key role in building and maintaining scalable data processing pipelines while ensuring data integrity, security, and accessibility for business-critical applications.


Responsibilities:


· Develop and maintain data processing applications using Apache Spark and Scala to process large-scale datasets efficiently.


· Monitor and optimize database performance, including indexing, query optimization, and load balancing, to ensure high availability and low-latency data access.


· Design and implement robust, scalable, and efficient database structures to support applications and data analytics.


· Deploying and managing data infrastructure on AWS.


· Assist in the migration of data between systems, including database upgrades, platform changes, and ETL processes for data integration.


· Leveraging cloud-native services for data processing and storage.


· Optimizing costs while maintaining performance and scalability.


· Applying various transformations like data cleansing, aggregation, and enrichment.


· Monitor data quality metrics and perform data cleansing as necessary.


· Work with Product Owners and Business Analysts to refine user stories for data ingestion, processing, and reporting features


Required Skills & Experience:


· Bachelor’s in Computer Science, Computer Engineering, Information Systems, or related field.


· 3+ years of experience as a Data Engineer or similar role.


· 2+ years of experience working with Apache Spark, Scala, and Spark SQL.


· Must have the ability to obtain a Public Trust (Tier 1) Security Clearance.


· Experience with cloud platforms such as AWS, Google Cloud, or Azure, utilizing cloud services for data storage, processing, and retrieval.


· Knowledge of data warehousing, data lakes, and cloud computing.


· Familiarity with machine learning algorithms.


· Knowledge of ETL processes and data modeling techniques.


· Familiarity with ETL tools, REST APIs, and data integration techniques.


· Understanding of data security and compliance best practices.


· Ability to develop clear, efficient, scalable solutions for complex problems.


· Understanding of data warehousing solutions and database architecture principles.


· Effective communication and teamwork abilities.


· Strong problem-solving skills and attention to detail.


Preferred Skills:


· Experience using Airflow, DBT, Postgres, Databricks, Amazon EMR & RDS


· Working experience on an Agile/Scrum or SAFe development team


Location: Leesburg, VA


Work Arrangement: 100% Remote


Why CORMAC? 


At CORMAC, we leverage the power of data management and analytics to enable our customers to achieve their strategic goals. With over 20 years of experience in health information technology (HIT), human-centered design principles, and Agile development methodologies, CORMAC delivers complex digital solutions to solve some of the most challenging problems facing public healthcare programs today. 


As a US Federal Government contractor in the public healthcare sector, our work is impactful and cutting-edge while being performed in a supportive, collaborative, and welcoming environment. We offer flexible work schedules with remote, hybrid, or fully in-person workplace options to empower our employees to decide the workplace most suitable for them. At CORMAC, we have a highly diverse workforce and believe a work environment is a place where creativity, collaboration, enthusiasm, and innovation happen, regardless of location. 


US Citizenship Required/E-Verify Participation/EEO 


As an Equal Employment Opportunity employer, CORMAC provides equal employment opportunity to all employees and applicants without regard to an individual's protected status, including race/ethnicity, color, national origin, ancestry, religion, creed, age, gender, gender identity/expression, sexual orientation, marital status, parental status, including pregnancy, childbirth, or related conditions, disability, military service, veteran status, genetic information, or any other protected status. 


Similar Jobs

Explore other opportunities that match your interests

Hands-on Data Scientist

Data Science
32m ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Entry level

pipe

United State

Junior Data Analyst

Data Science
1h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Associate

pipe

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

phoenixteam

United State

Subscribe our newsletter

New Things Will Always Update Regularly