Python Developer - Web Crawling

Python Web Crawling Developer

We are seeking a highly skilled and motivated Python Web Crawling Developer with 5 to 10+ years of hands-on experience in web scraping and data extraction. The ideal candidate should have a solid background in Python-based scraping tools and libraries, and a proven track record of working on dynamic websites.

Responsibilities :

- Design, develop, and maintain scalable web crawlers and scrapers.

- Extract and process data from various static and dynamic websites.

- Work with tools and libraries like Scrapy, Requests, BeautifulSoup, and Selenium.

- Maintain and optimize existing full-stack web scraping applications.

- Write and maintain automation scripts for data gathering and processing.

- Ensure data quality, performance, and reliability of scraping solutions.

- Collaborate with cross-functional teams for integration and analytics use cases.

Requirements :

- Strong proficiency in Python programming.

- In-depth experience with web scraping frameworks (Scrapy, Requests, BeautifulSoup, Selenium).

- Experience in handling dynamic content scraping (JavaScript-rendered pages).

- Working knowledge of SQL and database programming.

- Good analytical and problem-solving skills.

- Strong verbal and written communication skills.

- Experience in Python automation scripting.

Good to Have :

- Exposure to Natural Language Processing (NLP) tools like NLTK.

- Basic understanding or hands-on experience with Machine Learning.

- Experience with Python web frameworks like Django, Flask, or FastAPI.