Data Engineer - Python, ADF, Databricks, Scala and Kafka

Job Title: Data Engineer

Location: Mexico (100% Remote)

Duration: 6+ Months contract.

Must have: Python, ADF, Databricks, Scala and Kafka

Good to have: Spring Boot and UI Development

Key Responsibilities:

Provide production support for data pipelines and applications using Python, ADF, Azure Databricks, and Kafka.

Monitor, troubleshoot, and resolve issues in a timely manner to ensure system reliability and performance.

Support Kstreams consumers and understanding and debugging Java and Scala code.

Collaborate with development and operations teams to implement fixes and improvements.

Maintain documentation of support activities and solutions.

Ensure data quality and integrity across various data sources.

Qualifications:

Proficiency in Python.

Experience with Azure Data Factory (ADF).

Strong knowledge of Azure Databricks.

Advanced SQL skills.

Experience with Kafka.

Ability to read and understand Java and Scala code.

Nice-to-Have Skills:

Experience with Spring Boot.

Knowledge of Scala.

Familiarity with UI development.

Qualifications:

Bachelor’s degree in Computer Science, Engineering, or a related field.

Experience in production support or a related role.

Strong problem-solving skills and attention to detail.

Excellent communication and teamwork abilities.