Golang WebCrawler

Hi there, my name is George and I'm the perfect fit for your Golang WebCrawler job! With 6 years of experience in developing web crawlers, I am confident I can create a scalable solution for your job that meets all your requirements. I've already successfully developed a custom web scrapping tool and am confident that I could achieve your goals as well. 1. What type of input will be used to enter URLs into the crawler? 2. What are the expected input/output formats? 3. Are there any restrictions on the crawling? 4. How shoul

Nice to meet you Yogi Network, My name is Anthony Muñoz, I express my interest in working on your project after carefully reading the requirements and concluding that they match my area of knowledge and skills. I am currently the lead engineer for the IT agency DSPro and I have more than 10 years of experience in the field. I have successfully completed a large number of similar jobs and I consider your project to be a challenge in which I would like to work and be able to make it a reality. Please feel free to contact me, it will be my pleasure to help you. I greatly appreciate the time provided and I remain attentive to any questions or concerns. Greetings

Hello I am a professional python developer. My main specializations are automation, web scrapers and bots development. I have already developed over 200 scrapers. From the simplest (for example, a competitor's price collector) to complex parsers (with authorization, bypassing captcha, rotating ips and others) which can collect millions of products from amazon. I have done web scrapers for: - Amazon - Instagram - Facebook - Google - Twitter - LinkedIn - Pinterest - Walmart - And many others For scraping I use: - Python - Requests - BeautifulSoup - Selenium - Scrapy - Pyautogui - Undetected Chromedriver - Rotating ips I can bypass: - CloudFlare - IP blocking - Captcha - Authorization required - Other limitations Django / PostgreSQL For big scraping projects I usually use Django with PostgreSQL. This allows us to store information in a database for further processing and use. I also set up an administration area which allows us to check the data and set up scraper configs. If you need a professional solution in this area - I am ready to cooperate. I am ready to make a sample script before we start Regards, Oleg

Hello, I hope this message finds you well. As an experienced web and software developer with over 7 years in the industry, I am excited to bid on your freelance project. After carefully reviewing your project details, I am confident that I meet all of your requirements and have a clear understanding of your vision. My commitment to you is that I will deliver a professional, clean, fast, and SEO-friendly code that is fully responsive across all platforms. In addition to completing your project on time and to the highest standards, I offer ongoing support and maintenance to ensure that your website or software runs smoothly even after completion. To ensure that I provide you with the best possible service, I do have a few questions. What is the purpose of the project? Are there any specific preferences or requirements you have for the build? What is the deadline and budget for this project? And finally, could you please share all of the project's features and details with me? If you would like to view my portfolio, please feel free to check out my personal website at https://www.pouyasadri.com. I look forward to the opportunity to work with you on this project. Thank you!

Making related projects golang , react-native • Implement planned progress report control • Understand deeply in software development process in a big project • Experience of using Mysql and firebase • Experience in handle batch processing with more than 100000 recore at the same time

Dear I can create a GoLang web crawler to collect data from a given website and store it in a MySQL database hosted on AWS. The crawler will gather User ID, Website, URL, Page Title, Linked pages (URLS), Linked Page (title) and be scalable. I will include an API to receive website inputs and prevent IP blocking through a rotating proxy service. I can deliver within 3 weeks Thank you for considering my services. Tabeed