Senior Big Data Engineer - Apache Spark

Remote
This Job is No Longer Active This position is no longer accepting applications
AI Summary

Design high-quality deliverables, develop scalable data transformation applications using Apache Spark, and integrate code with CICD. Work with a team on big data problems and review code modules. Required skills include Java, Scala, Apache Spark, and Unix Shell scripting.

Key Highlights
Design high-quality deliverables adhering to business requirements
Develop and maintain highly scalable, high-performance data transformation applications
Integrate code adhering to CICD using Spark Framework in Scala/Java
Provide solutions to big data problems dealing with huge volumes of data
Create Junit tests and ensure code coverage is met as per agreed standards
Technical Skills Required
Java Scala Apache Spark Unix Shell scripting Maven Hive MPP Impala JUnit Oracle SQL HBase SQOOP KAFKA Eclipse IDE Tectia Client Oracle SQL Developer
Benefits & Perks
Competitive salary
Opportunity to work with a global company
Chance to work on big data projects
Potential for career growth and development

Job Description


Inclusion without Exception


Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our people’s stories across our workforce and implemented through equitable workplace policies and processes.


TCS is an IT services, consulting, and business solutions organization that has been partnering with many of the world’s largest businesses in their transformation journeys for over 55 years. Its consulting-led, cognitive-powered portfolio of business, technology, and engineering services and solutions is delivered through its unique Location Independent Agile™ delivery model, recognized as a benchmark of excellence in software development. A part of the Tata group, India's largest multinational business group, TCS operates in 55 countries and employs over 607,000 highly skilled individuals, including more than 10,000 in Canada. The company generated consolidated revenues of US $30 billion in the fiscal year ended March 31, 2025, and is listed on the BSE and the NSE in India. TCS' proactive stance on climate change and award-winning work with communities across the world have earned it a place in leading sustainability indices such as the MSCI Global Sustainability Index and the FTSE4Good Emerging Index.



Job Description:


Role Description:


  • Design high quality deliverables adhering to business requirements with defined standards and design principles, patterns
  • Develop and maintain highly scalable, high performance Data transformation applications using Apache Spark framework
  • Develop
  • Integrate the code adhering to CICD, using Spark Framework in Scala Java
  • Provide solutions to Big data problems dealing with huge volumes of data using Spark based data transformation solutions, Hive, MPP processes like IMPALA.
  • Create Junit tests and ensure code coverage is met as per the agreed standards
  • Should be able to work with a team who might be geographically distributed. Review the code modules developed by other juniors.


Required Skill Set:

  • Hands on development experience in programming languages such as JAVA, SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting
  • Should be comfortable with Unix File system as well as HDFS commands
  • Should have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase
  • Should have good communication and customer management skills
  • Should have knowledge on Big data Data Ingestion tools such as SQOOP and KAFKA.
  • Should be aware of the components in Big Data ecosystem.
  • Should have worked on building projects using Eclipse IDE, Tectia Client, Oracle SQL Developer.



Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodation during the recruitment and selection process, please inform Human Resources.

Thank you for your interest in TCS. Candidates that meet the qualifications for this position will be contacted within a 2-week period. We invite you to continue to apply for other opportunities that match your profile.


Subscribe our newsletter

New Things Will Always Update Regularly