Big Data Engineer

Job Title: Big Data Engineer

Job Type: Full-Time

Location: Remote

About Us:

At micro1, we’re all about connecting skilled remote professionals with some of the best companies in Silicon Valley. Our mission is to offer a stable, competitive income, along with access to top industry opportunities—all in a flexible work setting with a range of great benefits. We’re here to help you grow in your career. We're proud to work with trusted partners such as Deel, Immutable, O’Gara, and LegalSoft.

What We Offer:

• Work from anywhere,
• Healthcare reimbursement,
• Wi-Fi reimbursement,
• Unlimited learning, and more!

Job Summary:

Join our dynamic team at micro1 as a Big Data Engineer, where you'll be at the forefront of handling and processing large-scale data. As part of our mission, you'll enjoy a flexible work setting that empowers you to grow in your career while being a key player in designing and managing data pipelines.

Key Responsibilities:

• Design and implement robust data pipelines to facilitate seamless data flow.
• Work with industry-leading big data frameworks such as Hadoop and Spark.
• Ensure data integrity and security across all platforms.
• Collaborate with cross-functional teams to understand data requirements.
• Optimize data processing and storage for efficiency and performance.
• Maintain up-to-date documentation of data processes and systems.
• Continuously explore new technologies and methods to improve data management.

Required Skills and Qualifications:

• Proven experience with Hadoop and Spark frameworks.
• Strong knowledge of data warehousing principles and practices.
• Excellent written and verbal communication skills.
• Ability to work independently in a remote environment.
• Detail-oriented with a commitment to data integrity and quality.

Preferred Qualifications:

• Experience with cloud-based data solutions.
• Background in collaborating with Silicon Valley tech companies.