Senior Software Engineer - Big Data

Jobgether • United State
Remote
Apply
AI Summary

Design and build scalable data lake architecture and cloud-native data platforms. Develop distributed backend systems, APIs, and event-driven services. Collaborate with cross-functional teams to translate business requirements into scalable technical solutions.

Key Highlights
Design and build scalable data lake architecture
Develop distributed backend systems and APIs
Collaborate with cross-functional teams
Key Responsibilities
Design, develop, and maintain scalable data lake architecture and cloud-native data platforms
Build and optimize high-volume data ingestion, transformation, and integration pipelines
Develop distributed backend systems, APIs, and event-driven services
Collaborate with product, analytics, business intelligence, and engineering teams
Ensure data quality, integrity, governance, and security
Technical Skills Required
AWS cloud services S3 Glue Athena Lake Formation Lambda Step Functions API Gateway Kinesis Python SQL TypeScript Node.js Snowflake Redshift BigQuery Athena Data quality frameworks Entity resolution Data cleansing Anomaly detection Governance practices CI/CD pipelines Infrastructure automation Serverless architectures Containerized services Deployment best practices
Benefits & Perks
Competitive salary ranging from $120,000 to $150,000 annually
Fully remote work environment
Comprehensive health, dental, and vision coverage
401(k) plan with company matching contributions
Internet or mobile phone reimbursement subsidy
Generous paid time off program
Paid holidays
Half-day Summer Fridays
Professional development and career growth opportunities
Nice to Have
Exposure to AI-assisted development tools, machine learning workflows, or generative AI technologies

Job Description


This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Sr. Software Engineer - Big Data, Data Lake based in the United States.

This is an exciting opportunity for an experienced software engineer to help shape the foundation of a next-generation data platform powering large-scale, data-intensive applications. In this role, you will design and build scalable data ingestion, transformation, and integration solutions using modern cloud-native technologies. Working at the intersection of data engineering and backend development, you will contribute to the architecture of a robust data lake ecosystem that supports APIs, analytics, machine learning initiatives, and customer-facing products. You'll collaborate closely with cross-functional teams while driving technical excellence across distributed systems, event-driven architectures, and high-volume data pipelines. The position offers significant ownership, technical influence, and the flexibility of a fully remote environment.

Accountabilities

  • Design, develop, and maintain scalable data lake architecture and cloud-native data platforms that support enterprise applications and analytics initiatives.
  • Build and optimize high-volume data ingestion, transformation, and integration pipelines for structured and semi-structured data from multiple internal and external sources.
  • Develop distributed backend systems, APIs, and event-driven services using modern programming languages and cloud technologies.
  • Architect and implement reliable data workflows leveraging AWS-native services, serverless technologies, and orchestration frameworks.
  • Collaborate with product, analytics, business intelligence, and engineering teams to translate business requirements into scalable technical solutions.
  • Ensure data quality, integrity, governance, and security through effective monitoring, cleansing, validation, and anomaly detection processes.
  • Design and maintain high-availability systems capable of supporting multi-tenant environments and large-scale workloads.
  • Participate in on-call rotations, troubleshooting efforts, incident response activities, and operational excellence initiatives.
  • Create technical documentation, architecture diagrams, and implementation plans that support long-term platform scalability and maintainability.
  • Contribute to continuous improvement initiatives, cloud infrastructure optimization, deployment automation, and engineering best practices.

Requirements

  • 7-10 years of professional software engineering experience, preferably within data-rich applications, big data environments, or SaaS platforms.
  • Strong expertise with AWS cloud services, including S3, Glue, Athena, Lake Formation, Lambda, Step Functions, API Gateway, Kinesis, and related technologies.
  • Advanced experience designing and implementing large-scale data pipelines, ETL processes, and data lake architectures.
  • Expert-level proficiency in Python and SQL for distributed systems, data engineering, and backend development.
  • Strong experience building backend services and APIs using TypeScript and Node.js.
  • Deep understanding of event-driven architectures, orchestration frameworks, asynchronous processing, and distributed systems design.
  • Experience working with cloud data warehouses such as Snowflake, Redshift, BigQuery, Athena, or similar platforms.
  • Knowledge of data quality frameworks, entity resolution, data cleansing, anomaly detection, and governance practices.
  • Hands-on experience integrating cloud-based data platforms with reporting, analytics, and third-party business systems.
  • Familiarity with CI/CD pipelines, infrastructure automation, serverless architectures, containerized services, and deployment best practices.
  • Strong understanding of security principles related to data storage, API access, permissions, and cloud infrastructure.
  • Excellent communication, documentation, collaboration, and problem-solving skills.
  • Proven ability to lead technical initiatives while remaining highly hands-on with implementation and delivery.
  • Experience supporting production environments and participating in on-call rotations.
  • Exposure to AI-assisted development tools, machine learning workflows, or generative AI technologies is considered a plus.

Benefits

  • Competitive salary ranging from $120,000 to $150,000 annually.
  • Fully remote work environment within approved U.S. locations.
  • Comprehensive health, dental, and vision coverage for eligible employees.
  • 401(k) plan with company matching contributions.
  • Internet or mobile phone reimbursement subsidy.
  • Generous paid time off program.
  • Paid holidays, including additional cultural and heritage celebration days.
  • Half-day Summer Fridays.
  • Professional development and career growth opportunities.
  • High-autonomy environment with meaningful ownership of technical decisions.
  • Collaborative and supportive engineering culture focused on innovation and continuous learning.
  • Inclusive workplace committed to diversity, equity, and belonging.

How Jobgether Works

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.


Similar Jobs

Explore other opportunities that match your interests

Senior Clinical AI Quality & Safety Physician

Data Science
•
1h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Included Health

United State

Technical Business Analyst

Data Science
•
1h ago
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Mid-Senior level

Accion Labs

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Associate

CNO Financial Group

United State

Subscribe our newsletter

New Things Will Always Update Regularly