Senior/Lead Data Engineer - Data Pipelines & Data Warehousing (Azure, Databricks) - Remote

vedan technologies United State
Remote
Apply
AI Summary

Lead design, development, and implementation of scalable data pipelines and data warehousing solutions. Collaborate with cross-functional teams to translate business requirements into robust data platforms, mentor junior engineers, and stay current with emerging data engineering technologies. Requires 12+ years IT experience, 8+ years data engineering, and hands-on Azure stack and Microsoft Fabric experience.

Key Highlights
Role focuses on designing and implementing data pipelines and data warehousing solutions using PySpark, SQL, and Azure stack technologies.
Responsibilities include collaboration across teams, mentorship of junior engineers, and continuous adoption of modern data engineering practices.
Must-have qualifications: 12+ years IT experience, 8+ years data engineering, 4+ years Azure stack, 1-2 years Microsoft Fabric, SAP exposure.
Key Responsibilities
Design, development, and implementation of data pipelines and data solutions using PySpark, SQL, and related technologies.
Collaborate with cross-functional teams to understand business requirements and translate them into robust data solutions.
Design and implement data warehousing solutions, ensuring scalability, performance, and reliability.
Stay up to date with modern technologies and trends in data engineering and apply them to improve the data platform.
Provide guidance and mentorship to junior data engineers, ensuring best practices in coding, design, and development.
Technical Skills Required
SQL PySpark Azure Microsoft Fabric Azure Data Factory Databricks Azure Functions
Benefits & Perks
Fully remote (100% remote, PST hours)
Expenses-paid travel to Fremont, CA (every 2 months for 3 days)
Contract – 12 months
Nice to Have
Some exposure/experience in SAP constructs

Job Description


Title: Senior/Lead Data Engineer

Location: 100% Remote – PST Hours – Travel to Fremont, CA once every 2 Months for 3 Days (Expenses Paid)

Job Type: Contract – 12 Months

Key Skills: Sql, PySpark, Azure, Microsoft Fabric, ADF, and Databricks.


Key Responsibilities:

  • Data Engineering : Design, development, and implementation of data pipelines and solutions using PySpark, SQL, and related technologies.
  • Collaboration: Work closely with cross-functional teams to understand business requirements and translate them into robust data solutions.
  • Data Warehousing: Design and implement data warehousing solutions, ensuring scalability, performance, and reliability.
  • Continuous Learning: Stay up to date with modern technologies and trends in data engineering and apply them to improve our data platform.
  • Mentorship: Provide guidance and mentorship to junior data engineers, ensuring best practices in coding, design, and development.


Must-Have Skills & Qualifications:

  • Minimum 12+ years of overall experience in IT Industry.
  • 8+ years of experience in data engineering, with a strong background in building large-scale data solutions.
  • 4+ years of hands-on experience developing and implementing data pipelines using Azure stack experience (Azure, ADF, Databricks, Functions)
  • 1-2 years of experience in Microsoft Fabric
  • Some exposure/experience in SAP constructs


Similar Jobs

Explore other opportunities that match your interests

Senior Data Engineer

Data Science
40m ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

orijin

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

movement labs

United State

Senior Data Engineer

Data Science
11h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Boulevard

United State

Subscribe our newsletter

New Things Will Always Update Regularly