Strong experience with Microsoft Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure SQL Database.
Proficiency in ETL processes, data pipeline design, and automation within the Azure ecosystem.
Experience with big data technologies such as Apache Spark, Hadoop, Azure HDInsight, and Databricks.
Solid understanding of data modeling, data warehousing concepts, and relational and non-relational databases.
Strong knowledge of SQL and experience with scripting languages like Python, R, or Scala.
Experience with Azure Storage services, such as Blob Storage, Data Lake Storage, and Azure Cosmos DB.
Familiarity with Data Governance, Data Lineage, and Data Security practices in the cloud.
Hands-on experience with Azure DevOps for CI/CD pipeline management, version control, and deployment automation.
Familiarity with Azure Active Directory (AAD) and role-based access control (RBAC) for managing permissions and security.
Experience with RESTful APIs and integrating with third-party systems for data ingestion and export.
Strong problem-solving and analytical skills, with the ability to work with large datasets and derive actionable insights.
Ability to collaborate effectively with stakeholders and communicate complex data engineering concepts in simple terms.
Preferred Qualifications:
Azure certifications such as Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect Expert.
Experience with real-time data processing using Azure Stream Analytics or Apache Kafka.
Knowledge of machine learning and AI concepts for data-driven decision-making.
Familiarity with Power BI or other reporting tools for data visualization.
Experience with Agile methodologies in a data engineering environment.