We are CliqHR® Recuritment services , an executive search firm managed by a team of experienced professionals, committed to help you find a job and company you love.
We are currently looking for a Data Engineer / Spark Developer
Required Experience: 4-6 years of Data Engineering experience
Notice period: Immediate to 15 Days
Job Location : Hyderabad
Notice period: Immediate to 15 Days
Required Skill:
• Expertise in Spark & SQL and should have worked with high amounts of data
• Excellent in OOPS and languages like Java / Python
• Well versed with knowledge of Data warehousing concepts including: SCDs, star schema, hierarchy, aggregation.
• Knowledge of DeltaLake (Databricks or open source) is an advantage
• Good understanding of Kafka, Kafka brokers, connect and cluster processing
• Experience with Big data ecosystem (Hadoop, Hive, Sqoop, Pig, Streaming), relational DBs (MS SQL, PostgreSQL, DB2, Oracle) and NoSQL databases
• Write effective, scalable code. Experience in writing solid unit tests and integration tests.
• Considerable experience in Testing activities like creating system / integration / performance test plan, performance testing, defect tracking, root cause analysis of defects, support user acceptance testing (UAT) and facilitate UAT sign off.
• Knowledge of Google Cloud Platform – GCS, BigQuery, Dataproc, Pub/Sub is a plus
• Experience developing solutions hosted within key major cloud providers such as GCP and AWS or private cloud using Mesos, Kubernetes
• Develop technical specifications and design documents
• Work independently in a fast paced, Agile environment
• Experience in using modern product development tools and concepts including Agile/SAFE, Continuous Integration, Continuous Delivery, and/or DevOps
• Proven track record of building relationships across cross-functional teams
Desired Skill:
• Participation in client interactions/meetings is desirable.
• Good understanding of Microse