Senior Data Platform Engineer

XFactor Talent • India
Relocation
Apply
AI Summary

Design and maintain data pipelines from edge cloud data platform. Build ETL pipelines using AWS Glue and cloud-native data services. Ensure data quality, observability, lineage, and reproducibility across pipelines.

Key Highlights
Design and maintain data pipelines
Build ETL pipelines using AWS Glue
Ensure data quality and reproducibility
Key Responsibilities
Design and maintain data pipelines from edge cloud data platform
Build ETL pipelines using AWS Glue and cloud-native data services
Integrate data streams from event-based edge systems
Process and structure motion tracking data from camera-based arena systems
Develop and maintain datasets for ML model training and evaluation
Build reliable data products and curated datasets for researchers and engineers
Support ad-hoc analysis, experimentation, and exploration by data scientists
Collaborate with embedded, edge, ML, and software teams to ensure high-quality data capture
Improve the data infrastructure used to analyze and optimize swarm behavior and system performance
Technical Skills Required
Python SQL AWS Glue AWS S3 AWS Athena Data modeling Data product design Machine learning
Benefits & Perks
Relocation to Germany or Netherlands
Nice to Have
Experience processing IoT, robotics, or telemetry data
Experience with time-series or sensor data pipeline
Familiarity with SageMaker or ML data platform
Experience with computer vision datasets or motion tracking system
Experience designing data lakes or lakehouse architecture

Job Description


Relocation to Germany or Netherlands:



Responsibilitie

  • sDesign and maintain data pipelines from edge cloud data platfor
  • mBuild ETL pipelines using AWS Glue and cloud-native data service
  • sIntegrate data streams from event-based edge system
  • sProcess and structure motion tracking data from camera-based arena system
  • sDevelop and maintain datasets for ML model training and evaluatio
  • nBuild reliable data products and curated datasets for researchers and engineer
  • sSupport ad-hoc analysis, experimentation, and exploration by data scientist
  • sEnsure data quality, observability, lineage, and reproducibility across pipeline
  • sCollaborate with embedded, edge, ML, and software teams to ensure high-quality data captur
  • eImprove the data infrastructure used to analyze and optimize swarm behavior and system performanc

eYour Profil

eYou enjoy turning complex system data into clean, reliable datasets that power real-world AI system

sMust-have

  • s3+ years experience as a Data Platform Engineer or in a similar rol
  • eStrong experience with Python and SQ
  • LExperience building cloud-based data pipeline
  • sFamiliarity with AWS data services (S3, Glue, Athena, etc.
  • )Experience working with streaming or event-driven data system
  • sUnderstanding of data modeling and data product desig
  • nExperience supporting ML workflows and data scientist
  • sStrong attention to data quality, validation, and reproducibilit
  • yComfortable working with complex multi-system datasets (hardware, sensors, logs, telemetry



)

Nice-to-h

  • aveExperience processing IoT, robotics, or telemetry
  • datExperience with time-series or sensor data pipel
  • ineFamiliarity with SageMaker or ML data platf
  • ormExperience with computer vision datasets or motion tracking sys
  • temExperience designing data lakes or lakehouse architect


ure

Similar Jobs

Explore other opportunities that match your interests

Senior Backend Engineer

Programming
•
4h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Agoda

India

Senior Software Engineer

Programming
•
6h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Applied Systems

India

Full-Stack Web Developer

Programming
•
1d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Associate

fetchjobs.co

India

Subscribe our newsletter

New Things Will Always Update Regularly