Specialist - Data Engineering

Overview

LTIMindtree Limited is an Indian multinational information technology services and consulting company. A subsidiary of Larsen & Toubro, the company was incorporated in 1996 and employs more than 90,000 people.

Job Description

# Create Scala/Spark jobs for data transformation and aggregation. # Shall be able to understand and modify the underlying Scala framework as needed. # Should be able to understand Spark Streaming jobs and how to work with in-memory Spark state and process messages for near-real time system. # Spark query tuning and performance optimization. # SQL database integration especially with Postgre and Couchbase. # Knowledge of Oozie, Nifi and Kafka is as an added advantage. # Solve various technical problems in the project in a collaborative manner under specified timeline with minimal guidance and review. # Responsible for implementing diverse engineering tasks including gap, data, and impact analysis. # Independently perform low-level design configuration, code customization, refactoring and review. # Gain expertise and demonstrate high levels of skills in design, review, development, testing, build and deployment stages of the software life cycle. # Ensure adequate documentation and provide assistance as a reliable engineer to all stakeholders.

Skills & Requirements

Spark Scala knowledge is very important for a big and complex engagement currently being handled. The client is currently setting up Disaster Recovery instance and we are in Implementation phase. The underlying tools are Spark/Scala, Oozie, Postgre and Couchbase. Technical team member should have hands-on experience of 4-8 years.