We are looking for a highly skilled AWS Glue Developer with a minimum of 5-10 years of experience in the industry to join our team at IBM India. The ideal candidate will be responsible for developing and maintaining data integration solutions using AWS Glue, building ETL pipelines, and working on data lakes.
Responsibilities:
Develop and maintain ETL pipelines using AWS Glue.
Design and develop data integration solutions using AWS Glue.
Develop and maintain data ingestion, transformation, and integration solutions.
Work on data lakes and build efficient data models.
Collaborate with cross-functional teams to understand business requirements and design solutions accordingly.
Optimize ETL performance and troubleshoot issues.
Develop and maintain technical documentation.
Stay up to date with the latest AWS Glue developments and incorporate new features and functionality into existing solutions.
Requirements:
Bachelor's degree in Computer Science or a related field.
Minimum of 5-10 years of experience in AWS Glue development.
Strong experience with ETL development using AWS Glue.
Proficient in Python, Spark, and SQL.
Experience with AWS services such as S3, Athena, and Redshift.
Familiarity with data modeling and designing data lakes.
Experience working with cross-functional teams and collaborating on projects.
Excellent communication and documentation skills.
Ability to troubleshoot and optimize ETL performance.