Job Description
Senior/ Lead Data Engineer - Azure Databricks
Fully remote
Freelance - EU/UK (Outside IR35 if UK)
450-550 Euros per day
About the Role
We are seeking a talented Data Engineer with a strong foundation in Big Data systems. The ideal candidate will thrive in a dynamic environment, working across data engineering, event-driven architectures, and infrastructure management within a regulated industry.
Key Responsibilities
- Big Data Systems Development: Design, implement, and optimize scalable data architectures. Build systems leveraging tools like Databricks and Apache Spark to process and analyze large datasets efficiently.
- Database Design & Management: Design and implement robust SQL and NoSQL database schemas. Ensure high performance and scalability in database interactions.
- Event-Based Systems: Develop and manage event-driven architectures using messaging queues or related frameworks.
- Infrastructure as Code (IaC): Manage cloud infrastructure with Terraform, ensuring reliability and scalability.
- Collaboration: Work closely with cross-functional teams, including software engineers and data scientists, to align data systems with business needs.
Key Requirements
- Data Engineering Expertise: Proven experience in designing and implementing big data systems, especially using Databricks
- Event-Driven Architectures: Knowledge of event-based systems and messaging queues (e.g., Kafka, RabbitMQ).
- Infrastructure Knowledge: Proficiency in Terraform for managing cloud infrastructure.
- Database Skills: Strong experience with both SQL and NoSQL databases, including schema design and query optimization.
- Data-Intensive Systems: Experience working with large datasets and solving complex data challenges.
Preferred Qualifications
- Experience in startups or dynamic, fast-paced environments.
What We Offer
- Opportunity to work on cutting-edge data systems in a growing Insurtech environment.
- Collaboration with a team of innovative and passionate professionals.
- Competitive rate and fully remote role.
If you’re a data engineering expert who’s ready for a new remote freelance project please get in touch by making an application!