Job Description
The Lead Data Engineer is responsible for finding trends in Data sets and Developing Algorithms to help make raw data more useful to the Organization. This role requires a significant Set of Technical Skills, including a deep Knowledge of SQL Database Design and Multiple Programming languages along with team management skillsiSOCRATES is look
ing to add a Lead Data Engineer to its growing Analytics team. The Lead Data Engineer will lead the team that is responsible for finding trends in Data sets and Developing Algorithms to help make raw data more useful to the Organization. The Lead Data Engineer will report directly to the Senior Director
Qualifications
• Overall, 8-12 years of experience in data & analytics
• Have strong experience in SQL/NoSQL databases
• Design and build production data pipelines from ingestion to consumption within a big data architecture, using Python/Scala/Java
• Design, build and operationalize large-scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with Mandatory - Redshift, S3, Athena, Good to have - Glue, Snowflake
• Design and implement data engineering, ingestion, and curation functions on AWS cloud using AWS native or custom programming
• Perform detailed assessments of current state data platforms and create an appropriate transition path to AWS cloud
• Should be able to understand the data very well, create a pattern on structured /non-structured data
• Strong knowledge of Data warehouse, Data Modelling (Preferably Dimensional Modelling – Kimball)
• Proficiency in both ETL & ELT
• AWS Certified Data Analytics Specialist / AWS Certified ML Specialist will be an added advantage
• Exposure to Media & Marketing is a plus
• Having knowledge of GCP is a plus
• Having knowledge of 1 or more visualization tools is a plus