Job Title: Data Engineer
Location: Coimbatore (work from office)
Exp: 7-12Yrs
Np: Immediate to 15 Days
Skills: ETL, Sql, Hadoop, Spark, Data warehousing, Scripting language, cloud.
Responsibilities:
Design, develop, and maintain data pipelines, ETL processes, and data integration workflows to ensure efficient and reliable data extraction, transformation, and loading.
Collaborate with cross-functional teams to gather requirements and understand data needs, and translate them into scalable and robust data solutions.
Implement and maintain data warehousing systems and structures, ensuring data quality, integrity, and security.
Develop and optimize SQL queries, stored procedures, and functions for data retrieval, manipulation, and analysis.
Perform data profiling, data cleansing, and data transformation activities to ensure data accuracy and consistency.
Identify and troubleshoot data-related issues, and provide timely resolutions to minimize impact on business operations.
Collaborate with data scientists and analysts to understand data requirements and support their data exploration and analysis efforts.
Requirements:
Expertise in ETL (Extract, Transform, Load) processes, tools, and best practices.
Strong proficiency in SQL and relational databases, with the ability to design, optimize, and maintain complex SQL queries, stored procedures, and functions. In-depth understanding of data warehousing concepts, methodologies, and best practices.
Experience with data modelling, data integration, and data pipeline development.
Familiarity with data governance, data quality, and data security principles.
Solid understanding of data management principles and practices, including data profiling, data cleansing, and data transformation.
Proficient in programming languages such as Python, Java, or Scala.
Experience with cloud-based data technologies, such as AWS Redshift, Google BigQuery, or Azure SQL Data Warehouse.
Experience with big data technologies, such as Hadoop or Spark