Sourcing / loading / transforming and storing data:
Managed data pipelines consist of a series of stages through which data flows (for example, from
data sources or endpoints of acquisition to integration to consumption for specific use cases).
These data pipelines have to be created, maintained and optimized as workloads move from
development to production for specific use cases. Architecting, creating and maintaining data
pipelines will be the primary responsibility of the data engineer.
Drive Automation through effective metadata management:
The data engineer will be responsible for using innovative and modern tools, techniques and
architectures to partially or completely automate the most-common, repeatable and tedious data
preparation and integration tasks in order to minimize manual and error-prone processes and
improve productivity. The data engineer will also need to assist with renovating the data
management infrastructure to drive automation in data integration and management.
Learning and using modern data preparation, integration and AI-enabled metadata management tools and techniques.
Tracking data consumption patterns.
Performing intelligent sampling and caching.
Recommending and automating — existing and future integration flows.
Data compliance and governance:
Experience
3 - 7 Years
No. of Openings
20
Education
M.C.A, M.Sc, Any Bachelor Degree
Role
Data Analyst
Industry Type
Recruitment Consulting / Staffing Services
Gender
Female
Job Country
India
Type of Job
Full Time
Work Location Type
Work from Office