Looking For Immediate Joiner for a Product based US MNC company for the
Role - Data Engineer
Location - Balewadi, Pune (Hybrid)
Required Skills - Python/Pyspark coding , Data Factory, Data Bricks
Min Exp - 5 Years
Technical Requirements
- Must be hands-on/well-verses in Python/PySpark coding and scripting
- Strong expertise and hands-on experience with Azure Data Factory and Azure Databricks
- Experience with Agile Methodology and Azure Devops
- Databricks Lakehouse architecture experience strongly preferred
- Programming/Coding Skills with familiarity with software and
system engineering design principles & standards (., TDD)
- Foundational knowledge of data management architectures like
Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management
- Ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, data quality and observability, schemas, metadata, and job management
- Understanding of structured, semi-structured, and unstructured data sources
- Experience with data integration technologies such as ETL/ELT, data replications/CDC, message-oriented data movement, API design and access, stream data integration, and data virtualization
- Basic understanding of machine learning algorithms and
approaches
- Knowledge of/proficiency using one or more popular languages
and frameworks such as SQL, Python, Scala, Spark, Command
Line, etc.
- Familiarity with Open-Source and Commercial (., Azure Cloud
Services) technology
- Ability to automate development via CICD patterns and
processes
- Experience leveraging version control and repository
management systems (Git experience recommended)
- Experience leveraging IDE and source code editors (., Visual
Studio Code)
- Data visualization (., Power BI, Tableau, QlikSense)