Attached is the scraper which finishes its work after ~15 hours. We need a way to speed it up and the possible way is to make multiple threats in order to scrape data simultaneously in different threats.
Use a framework like Scrapy and fit our scraper within it, or the other way is to do some custom multithreading code. Scrapy seems like a quicker solution for someone who already knows the framework.
Also keep the bounding box of polygon and if coordinate's x and y lies within range of bounding box then your function should check if it falls inside polygon or not. This way you can skip couple of records and save effort to create an actual polygon object and a call to [login to view URL]
이 프로젝트의 입찰 현황은 다음과 같습니다. 입찰자: 12명, 평균 입찰가: $36
As a Python and Django, web scrapping expert, I am glad to place the bid on your project. I read your requirements, it is not difficult for me. I want to discuss more via chat. Regards.
Hii Sir, We are the group of professionals. We assure the completion of the work within 10 days, and you will be getting updates on daily basis. Thank you !!!