Hadoop Lead Role
Experience 9+ years
- Strong architectural experience with Hortonworks, Cloudera Hadoop distributions on Appliance based and on-premise clusters.
- Expertise in providing technical solutions for data lakes design and data ingestion in Hadoop.
- Expertise in data modelling, data governance and architecture of large size databases.
- Expertise in understanding complex data models, large scale data migrations and application development.
- Expertise in designing data pipelines solutions for structured, semi-structured and unstructured data in Hadoop.
- Expertise in Developing solutions for batch and real time processing data processing in Hadoop.
- Hands on experience in query writing using HiveQL, Impala QL and HBase commands.
- Able to provide technical guidelines assistance to development team if they face any problems related to environment
- Able to coordinate with cloudera team for trouble shooting, OS / network related problems with respective teams.
- Proficiency in Cloudera Manager architecture, cloudera cluster environment and cloudera manager.
- Proficiency in data ingestion tools like Sqoop, Flume, Kafka, Nifi(HDF), UNIX shells scripting and python
- Proficiency in building data warehouse on top of Hadoop in Hive. Defining data models and data mapping from the source
to enterprise model.
- Proficiency in creating solutions in Spark (Scala/Pyspark) for batch and real time processing.
- Proficiency in developing solutions for NoSQL databases like HBase, Cassandra and MongoDB.
- Knowledge of Data Security / Governance and Data Lineage handling on Hadoop clusters.
- Strong experience on SQL Server and Oracle, MySQL.
- Expertise in understanding Java , REST API concepts and troubleshooting java based services.
Experience
8 - 11 Years
No. of Openings
1
Education
Any Bachelor Degree, B.E, M.C.A, M.Tech
Role
Hadoop Developer
Industry Type
IT-Hardware & Networking / IT-Software / Software Services
Gender
[ Male / Female ]
Job Country
India
Type of Job
Full Time
Work Location Type
Work from Office