Data Engineer- Python

Gigmos

Desired candidate profile:

• Design, develop, and maintain web scraping scripts using Python.

• Use web scraping libraries like Beautiful Soup, Scrapy, Selenium and other scraping tools to extract data from websites.

• Write reusable, testable, and efficient code to extract structured and unstructured data.

• Develop and maintain software documentation for web scraping scripts.

• Collaborate with other software developers, data scientists, and other stakeholders to plan, design, develop, and launch new web scraping projects.

• Troubleshoot, debug, and optimize web scraping scripts.

• Stay up-to-date with the latest industry trends and technologies in automated data collection and cleaning

• Help maintain code quality and organization of projects

• Participate in code reviews and ensure that all solutions are aligned with standards.

• Create automated test cases to ensure the functionality and performance of the code

• Integration of data storage solutions like SQL/NoSQL databases, message brokers, and data streams for storing and analyzing the scraped data.

Experience with Python development and web scraping techniques.

Familiarity with web frameworks such as Django and Flask, as well as other technologies like SQL, Git, and Linux, is also required.

Strong analytical and problem-solving skills, as well as good communication and teamwork abilities, are also important for the role.

• Experience

  3 - 9 Years

• No. of Openings

  1

• Education

  B.C.A, B.E, B.Sc

• Role

  Data Engineer

• Industry Type

  IT-Hardware & Networking / IT-Software / Software Services

• Gender

  [ Male / Female ]

• Job Country

  India

• Type of Job

  Full Time

• Work Location Type

  Work from Office