Data Engineer

  • icon job experience 4 - 9 Years
  • icon job opening 2 Openings
  • icon salary 22.5 - 25.0 Lac/Yr
  • icon job location Ahmedabad
  • Face-to-Face interview Face-to-Face interview

Job Description

Job Location is Bangalore not Ahmedabad

Responsibilities:

Collaborate with cross-functional teams to define the data architecture, data models, and data flow in our data warehouse, and to understand their data requirements and provide technical support as needed.

Design, develop, and maintain scalable data pipelines using PySpark and AWS

Implement data quality assurance practices to ensure data accuracy, reliability, and integrity by implementing data validation, cleansing, and transformation processes.

Create and maintain documentation of the data architecture, data models, and data pipelines to ensure understanding and efficient collaboration among team members.

Maximise the performance and scalability of the data warehouse in AWS for each unit of computation and storage cost.

Optimise and tune data pipelines for performance and scalability.

Implement data governance policies, data security and privacy best practices to protect sensitive information and comply with relevant regulations.

Work closely with other team members to troubleshoot and resolve data-related issues.

Continuously monitor the performance of the data infrastructure and make improvements as needed to ensure optimal efficiency and reliability.

Stay up-to-date with the latest industry trends and advancements in data architecture and technologies to drive innovation and maintain a competitive edge.

Requirements:

Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field.

5+ years of experience in data architecture and data engineering roles, preferably on AWS.

Strong proficiency in PySpark, Python, SQL, or other big data technologies.

Strong experience with Data Warehouses

Experience with DevOps and version control practices and tools such as Jenkins or GitLab
  • Experience

    4 - 9 Years

  • No. of Openings

    2

  • Education

    B.E

  • Role

    Data Engineer

  • Industry Type

    IT-Hardware & Networking / IT-Software / Software Services

  • Gender

    [ Male / Female ]

  • Job Country

    India

  • Type of Job

    Full Time

  • Work Location Type

    Work from Home

About Optimhite

We are specialize in employment services and Man Power Services.
Read More...
Similar Jobs
Apply Now

Register to Get Relevant Jobs

Get Noticed By Top Recruiters

Become a Premium Job Seeker

  • Higher Boosting
  • Resume Highlighter
  • Verified Stamp
  • Resume Exposure

499/- for 3 months

Pay Now

We use cookies to improve your experience. By continuing to browse the site, you agree to our Privacy Policy Terms & Conditions [Seeker]

Got it