Senior Data Engineer

Hiring for Product Company

From 3 to 6 year(s) of experience
₹ Not Disclosed by Recruiter

Job Description

Seeking individuals with demonstrated experience in data engineering for developing and
maintaining data engineering modules and pipelines for our SAAS offering. Your primary focus
will be to develop/enhance/optimize data engineering pipelines. You will also be responsible for
supporting customers proof of validations and implementations from a data engineering

Skills required:
• Experience of working on public clouds (AWS / Azure)
• Good Coding skills in Python, Pyspark and SQL is a must.
• Experience of writing/maintaining Spark code base in a production environment.
• Big Data Experience - Spark, Relational Databases (Postgres, etc.)
• Worked with orchestration technologies like Airflow, Kube Flow etc.
• Build & support scalable data engineering pipelines (ETLs etc.). This will entail
extract, load and transform of ‘big data’ from a wide variety of sources, both batch &
streaming, using latest data frameworks and technologies, along with real time
monitoring dashboards and alerting.
• Essential experience of working with distributed systems software development.
• Demonstrated experience of production experience in big data infrastructure and
data modelling.
• Critical experience performance optimization for both data loading and data
• Know-how of critical tools, in a developer’s toolkit such as GitHub, Dockers,
• Ability to work in a fast-paced and deadline driven environment.

• Build & support scalable data engineering pipelines (load, extract, cleaning,
transform, ingest etc.) for our SaaS AI Applications and Predictions-as-a-Service
Implementations and Product.
• Build and Deploy the Data Engineering pipelines for scale using Kubeflow
• Have ownership of multiple data pipelines.
• Review, audit and improve the Data Engineering pipelines
• Document and communicate technical and functional design (HLD, LLD), timelines
and plans
• Work closely with AI/ML, DevOps, MLE, other engineering and product team
• Work with the engineering and implementation team to understand business
problems and implement efficient software solutions
• Follow configurable programming practices (config files, modular programming,
parameterization, etc.)
• Support Maintenance/enhancement of deployed pipelines. This includes bug-fixes
and performance improvement.

Role:Data Engineer

Salary: Not Disclosed by Recruiter

Industry:IT Services & Consulting

Functional Area:Data Science & Analytics

Role Category:Data Science & Machine Learning

Employment Type:Full Time, Permanent

Key Skills
Skills highlighted with ‘‘ are preferred keyskills


UG:B.Tech/B.E. in Any Specialization

Company Profile

Mount Talent Consulting Private Limited


Value Innovation Labs is a Technology Firm focussing on: Connected Machines Connected People Connected Thinking. We do Technology & Digital Transformation with a Human free Automation approach. The methodology includes Concept, Design, Develop, Artificial Intelligence & Digital marketing for iterative growth. Products: SAAS Based HR technology Platform for B2B & B2C Markets Smart City product platform Growth Hacking Automation Tools Exhibition Automation

Company Info
View Contact Details+

Contact Company:Mount Talent Consulting Private Limited

Reference Id:J0001