Senior Data Engineer

Hiring for Product Company

From 3 to 6 year(s) of experience
₹ Not Disclosed by Recruiter

Job Description


Summary:
Seeking individuals with demonstrated experience in data engineering for developing and
maintaining data engineering modules and pipelines for our SAAS offering. Your primary focus
will be to develop/enhance/optimize data engineering pipelines. You will also be responsible for
supporting customers proof of validations and implementations from a data engineering
perspective.

Skills required:
• Experience of working on public clouds (AWS / Azure)
• Good Coding skills in Python, Pyspark and SQL is a must.
• Experience of writing/maintaining Spark code base in a production environment.
• Big Data Experience - Spark, Relational Databases (Postgres, etc.)
• Worked with orchestration technologies like Airflow, Kube Flow etc.
• Build & support scalable data engineering pipelines (ETLs etc.). This will entail
extract, load and transform of ‘big data’ from a wide variety of sources, both batch &
streaming, using latest data frameworks and technologies, along with real time
monitoring dashboards and alerting.
• Essential experience of working with distributed systems software development.
• Demonstrated experience of production experience in big data infrastructure and
data modelling.
• Critical experience performance optimization for both data loading and data
ingestion.
• Know-how of critical tools, in a developer’s toolkit such as GitHub, Dockers,
VSCode
• Ability to work in a fast-paced and deadline driven environment.

Responsibilities:
• Build & support scalable data engineering pipelines (load, extract, cleaning,
transform, ingest etc.) for our SaaS AI Applications and Predictions-as-a-Service
Implementations and Product.
• Build and Deploy the Data Engineering pipelines for scale using Kubeflow
• Have ownership of multiple data pipelines.
• Review, audit and improve the Data Engineering pipelines
• Document and communicate technical and functional design (HLD, LLD), timelines
and plans
• Work closely with AI/ML, DevOps, MLE, other engineering and product team
• Work with the engineering and implementation team to understand business
problems and implement efficient software solutions
• Follow configurable programming practices (config files, modular programming,
parameterization, etc.)
• Support Maintenance/enhancement of deployed pipelines. This includes bug-fixes
and performance improvement.




Role:Data Engineer

Salary: Not Disclosed by Recruiter

Industry:IT Services & Consulting

Functional Area:Data Science & Analytics

Role Category:Data Science & Machine Learning

Employment Type:Full Time, Permanent

Key Skills
Skills highlighted with ‘‘ are preferred keyskills

Education

UG:B.Tech/B.E. in Any Specialization

Company Profile

Mount Talent Consulting Private Limited

About

Value Innovation Labs is a Technology Firm focussing on: Connected Machines Connected People Connected Thinking. We do Technology & Digital Transformation with a Human free Automation approach. The methodology includes Concept, Design, Develop, Artificial Intelligence & Digital marketing for iterative growth. Products: SAAS Based HR technology Platform for B2B & B2C Markets Smart City product platform Growth Hacking Automation Tools Exhibition Automation

Company Info
X
View Contact Details+

Contact Company:Mount Talent Consulting Private Limited

Reference Id:J0001