We are searching for an accountable, multitalented data engineer to facilitate the operations of our data scientists. The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while remaining familiar with dominant programming and deployment strategies in the field. During various aspects of this process, you should collaborate with coworkers to ensure that your approach meets the needs of each project.
Job Description
Basic concepts of Data Engineering, Hadoop, Data Warehousing, Designing & Implementing large-scale Distributed Data platforms.
Building distributed platforms or services.
SQL, NoSQL, Query Tuning & Performance Optimization.
General advanced Scala or Java or python experience (Design, Code review, build, unit testing, integration & regression testing).
Knowledge of Data Analysts and provide the data they need and guide them on the issues.
Knowledge of high-level JavaScript concepts like asynchronous programming, closures, promises, data-binding, async-await, etc.
DevOps experience in Jenkins, Maven, GitHub, Artifactory/Jfrog, CI/CD, TDD & BDD.
Big Data Processing: Hadoop, Sqoop, Spark.
Data Streaming: Experience with Kafka and Spark Streaming.
Data Validation & Data Quality.
Aggregate and clean raw data from different sources.
Explore ways to enhance data quality and reliability.
Collaborate with data scientists and architects on projects.
- Experience0 - 5 Years
- No. of Openings50
- EducationAny Bachelor Degree, B.C.A, B.E, M.C.A, M.Tech
- RoleData Engineer
- Industry TypeIT-Hardware & Networking / IT-Software / Software Services
- Gender[ Male / Female ]
- Job CountryIndia
- Job TypeWork from Home