Senior Scala Software Engineer - Data Processing Platform

GlobalLogic • Slovakia
Relocation
Apply
AI Summary

Design, develop, and maintain scalable Scala-based data processing services for large-scale data ingestion and transformation. Build and orchestrate data pipelines using Apache Beam, BigQuery, and Airflow on AWS and GCP cloud infrastructure. Collaborate with cross-functional teams to implement resilient, observable solutions with strong emphasis on functional programming and distributed systems.

Key Highlights
Scala expertise with sbt build management
Data pipeline development using Apache Beam and BigQuery
Cloud infrastructure integration with AWS and GCP
Airflow workflow orchestration for data processing
Key Responsibilities
Design, develop, and maintain robust, scalable services that process and manage large volumes of data
Implement data processing pipelines using Apache Beam and BigQuery to efficiently process and transform data across various channels and destinations
Configure and manage workflows using Airflow to orchestrate complex data processing tasks and ensure smooth operation of the system
Collaborate with cross-functional teams to drive architectural design discussions and implement scalable, maintainable solutions
Participate in code reviews, debugging, and troubleshooting to ensure high-quality, reliable software solutions
Stay updated on industry trends, emerging technologies, and best practices related to Scala, BigQuery, Apache Beam, and Airflow
Technical Skills Required
Scala Apache Beam BigQuery Airflow
Benefits & Perks
Empowering Projects with 500+ clients across diverse industries
Empowering Growth through dedicated Learning & Development team
Comprehensive Benefits package prioritizing overall well-being
Flexible Opportunities including relocation and rotation options
Nice to Have
Experience with Finagle or similar RPC frameworks
Familiarity with containerization and deployment in Kubernetes environments

Job Description


Description

We are seeking a skilled Software Engineer to join our team working on a Scala-based data processing platform. The ideal candidate will have experience building distributed systems and working with cloud infrastructure. You will be responsible for designing, developing, and maintaining

robust, scalable services that process and manage large volumes of data.

This role will involve working with a modern Scala stack, integrating with AWS and GCP, and building resilient, observable services for data ingestion and processing.

Requirements


  • Work on the intersection of both data and software engineering.
  • Utilize your expertise in Scala to design, develop, and maintain software features and functionalities for the Standalone Activations Audience Delivery Products.
  • Implement data processing pipelines using Apache Beam and Bigquery to efficiently process and transform data across various channels and destinations.
  • Configure and manage workflows using Airflow to orchestrate complex data processing tasks and ensure smooth operation of the system.
  • Collaborate with cross-functional teams to drive architectural design discussions and implement scalable, maintainable solutions.
  • Foster a culture of excellence and teamwork, promoting values such as collaboration, accountability, and continuous improvement.
  • Participate in code reviews, debugging, and troubleshooting to ensure high-quality, reliable software solutions.
  • Stay updated on industry trends, emerging technologies, and best practices related to Scala, BigQuery, Apache Beam, and Airflow.


Job responsibilities


  • Bachelor’s degree in Computer Science or related field, or equivalent experience
  • 3+ years of professional software engineering experience, preferably in data engineering or backend systems 
  • Proficiency in Scala, with experience using sbt for build management
  • Strong understanding of functional programming concepts
  • Experience with JSON serialization/deserialization (e.g., Circe)
  • Familiarity with cloud platforms (AWS and/or GCP), including authentication and authorization mechanisms (IAM, STS, AssumeRole, WebIdentity)
  • Experience integrating with AWS SDKs (S3, STS) in Scala
  • Experience with Google BigQuery and Dataflow for data processing and analytics
  • Experience with SQL and PostgreSQL for data storage and querying
  • Experience with asynchronous and concurrent programming (e.g., using FS2, cats-effect)
  • Familiarity with distributed messaging systems (e.g., Google Pub/Sub)
  • Ability to test and validate code effectively, with experience in unit, component, and integration testing
  • Ability to troubleshoot and resolve issues in distributed, cloud-based environments
  • Experience with version control systems (Git) and collaborative development workflows
  • Strong problem-solving and debugging abilities
  • Effective communication and collaboration in a team setting
  • Ability to write clear, maintainable, and well-documented code


Preferred Skills:


  • Experience with Finagle or similar RPC frameworks
  • Familiarity with data pipeline orchestration and workflow management
  • Knowledge of containerization and deployment in Kubernetes environments


What we offer

Empowering Projects: With 500+ clients spanning diverse industries and domains, we provide an exciting opportunity to contribute to groundbreaking projects that leverage cutting-edge technologies. As a team, we engineer digital products that positively impact people’s lives.

Empowering Growth: We foster a culture of continuous learning and professional development. Our dedication is to provide timely and comprehensive assistance for every consultant through our dedicated Learning & Development team, ensuring their continuous growth and success.

DE&I Matters: At GlobalLogic, we deeply value and embrace diversity. We are dedicated to providing equal opportunities for all individuals, fostering an inclusive and empowering work environment.

Career Development: Our corporate culture places a strong emphasis on career development, offering abundant opportunities for growth. Regular interactions with our teams ensure their engagement, motivation, and recognition. We empower our team members to pursue their career goals with confidence and enthusiasm.

Comprehensive Benefits: In addition to equitable compensation, we provide a comprehensive benefits package that prioritizes the overall well-being of our consultants. We genuinely care about their health and strive to create a positive work environment.

Flexible Opportunities: At GlobalLogic, we prioritize work-life balance by offering flexible opportunities tailored to your lifestyle. Explore relocation and rotation options for diverse cultural and professional experiences in different countries with our company.

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.


Similar Jobs

Explore other opportunities that match your interests

Orchestration Engineer

Devops
•
8m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

arizona state university

United State

Senior Kubernetes Platform Engineer

Devops
•
1h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Trade Republic

Germany

Senior Cybersecurity Engineer - National Security Directorate

Devops
•
1h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

pacific northwest national lab...

United State

Subscribe our newsletter

New Things Will Always Update Regularly