Role: Azure Data Engineer
Experience Required: Minimum 1+ Years of experience as a Azure Data Engineer.
Skills Required:
●As a Data Engineer, you will collaborate with a team of business domain experts, data scientists and application developers to identify relevant data for analysis and develop the Big Data solution.
●Analyze business problems and help develop solutions for near real-time stream processing as well as batch processing on the Big Data platform.
●Set up and run Hadoop development frameworks.
●Explore and learn new technologies for creative business problem solving.
●Experience in Azure Data Engineer.
●Ability to develop and manage scalable Hadoop cluster environments
●Experience in Big Data technologies like HDFS, Hadoop, Hive, Yarn, Pig, HBase, Sqoop, Flume, etc
●Working experience in Big Data services on any cloud based environment.
●Experience in Spark, Scala, Kafka, ADF, Akka and core or advance Java and Databricks
●Experience in NOSQL technologies like Hbase, Cassandra, MongoDB, Cloudera or Hortonworks Hadoop distribution (good to have)
●Familiar with data warehousing concepts, distributed systems, data pipelines and ETL
●Good communication and interpersonal skills
●Minimum 5 years of professional experience with 3 years of Big Data project experience