Data Engineer

Smart Stream Technologies

Senior Data Engineer:

10+yrs

NP immediate preferred, max 1month

Coimbatore Location (Work From Office Only)

Given Budget 15 to 20LPA

Key Accountabilities:

Design, develop, implement, and support data management solutions.

Develop, maintain, test, and evaluate large-scale data processing solutions (in both batch and real-

time modes).

Ongoing development and support of the data infrastructure (Cloud Platform, Data Lakehouse and

Dashboards)

Provide expertise and practical support in developing data platform solutions.

Implement ETL processes/pipelines, using CI/CD processes.

Support the development and implementation of Solution Design (developing/ system

integration/pre-production/ production /support).

Mandatory Skills:

Solid exposure in end-to-end implementation of data solutions using AWS (including S3, Lambda,

Database Migration Service, Glue , Kinesis , Step Function, Athena), PySpark and SQL.

Experience in spatial, semi-structured, and unstructured data manipulation.

Strong proven experience working as a Data Engineer leading with complex environments.

Good understanding on Data Modelling / Data warehousing. Experienced in Entity Relationship

Modelling.

Experience with designing, building, operating, and deploying scalable data pipelines.

Experience with CI/CD tools: Github Actions or Jenkins

Optimize data pipelines and processes for efficiency, scalability, and cost-effectiveness in the AWS

environment.

Ensure data security, encryption, and compliance with data governance policies and industry

regulations.

Nice to have:

AWS Experience (Sagemaker, EMR, Quicksight)

Data Bricks / Snowflake

Azure

GCP

• Experience

  7 - 10 Years

• No. of Openings

  3

• Education

  Professional Degree

• Role

  Data Engineer

• Industry Type

  IT-Hardware & Networking / IT-Software / Software Services

• Gender

  [ Male / Female ]

• Job Country

  India

• Type of Job

  Full Time

• Work Location Type

  Work from Office