Senior/Lead Data Engineer - Databricks

Harp Technologies & Services PVT LTD

Location : Remote/Hybrid

Responsibility:

Plan, configure, deploy, and optimize Microsoft Azure based Data solutions.

Collaborate with other team members to develop and enhance deliverables.

Continuously improve team processes to ensure information is of the highest quality, contributing to the overall effectiveness of the team.

Seast of industry changes, especially barely in the areas of cloud data and analytics technologies.

Ability to work on multiple areas like Data pipeline ETL, Data modelling & design, writing complex SQL queries etc.

Capable of planning and executing on both short-term and long-term goals individually and with the team.

Provides best practices, direction for data engineering and design across multiple projects and functional areas.

Partner with Data Engineers, Data architects, domain experts, data analysts and other teams to build foundational data sets that are trusted, well understood, aligned with business strategy and enable self-service

Qualifications:

3+ years of experience Developing, deploying data solutions using Power BI, Azure platform and pyspark.

Experience on designing Data pipelines (ETL/ELT), Datawarehouse and Data marts

Hands-on expert with real-time data processing and analytics, data ingestion (batched and streamed), and data storage solutions

Hands on Azure Analysis Services & Power BI and good to have experience on other tools

Hands on experience with Data Factory, Data Lake Storage, Databricks, Data Explorer, Machine Learning, and Azure Synapse Analytics is good to have.

Expert at creating data dissemination diagrams, data flow diagrams, data lifecycle diagrams, data migration diagrams, and data security diagrams etc.

Demonstrated strength in data management, orchestration, access control, etc

A proven expert in writing optimized SQL to deal with large data volumes.

Hands on knowledge on Python along its main data libraries like Pandas, Numpy, Beautiful soup etc.

• Experience4 - 10 Years
• No. of Openings2
• EducationDiploma, Any Bachelor Degree
• RoleData Engineer
• Industry TypeIT-Hardware & Networking / IT-Software / Software Services
• Gender[ Male / Female ]
• Job CountryIndia
• Job TypeWork from Office