Senior DataOps Engineer (DevOps)
Relocation
Job Description
Salary up to €100,000
Location: Braunschweig
One of the largest clothing retailers in Europe is looking for a Senior DataOps Engineer. They have over 1,000 stores across Europe & Asia, grossed +€4 billion last year and are looking to continue their success with you.
The position:
- Collaborate with data engineering and platform teams to maintain, operate, and improve data infrastructure on an on-prem Cloudera cluster.
- Monitor and operate key data science pipelines relying on Apache Spark.
- Analyse runtime behaviour, including resource usage and error rates in distributed systems.
- Maintain operating systems, proactively monitor the cluster, and resolve outages and hardware issues.
- Install and manage software environments required by the data science team.
- Support network optimization and collaborate with infrastructure and datacenter teams.
- Drive the implementation of a logging and monitoring strategy to ensure pipeline transparency and performance.
- Define and enforce HDFS usage policies, including retention, block size monitoring, and avoiding over-partitioning.
- Manage and monitor Impala databases and tables.
- Actively participate in code reviews, team mentoring, and regular feedback exchanges.
- 5+ years of experience in a DevOps, DataOps, SRE, or similar data infrastructure role.
- Strong foundation in software development and automation, with experience in Python, Bash, or similar scripting languages.
- Experience working with big data technologies like Hadoop, HDFS, Impala, Hive, Kafka, Airflow, or NiFi.
- Familiarity with cluster orchestration and monitoring tools such as Kubernetes, Prometheus, Grafana, or Cloudera Manager.
- Comfortable with Linux-based systems, version control, and CI/CD practices.
- Solid understanding of distributed systems, relational databases, and data modeling
- Up to €100,000 Salary
- Modern Braunschweig office with cafeteria (relocation supported)
- Annual contribution to capital-forming schemes (pension, savings, etc.)
- 2 Stage Interview Process
- Individual progression plan with allocated learning and development budget
- 30 Vacation Days
- Employee Discounts on company products
For more information, apply or contact Norman Cistovas