Find Jobs
Hire Freelancers

Website scraper

$750-1500 USD

진행 중
게시됨 11개월 전

$750-1500 USD

제출할때 지불됩니다
The task is to identify a total of 350 products pre-selected by the client on the websites of nine Internet data sources (Hungarian-language online stores of retail chains), some of which are offered by several retailers and some of which are sold by only one retailer. The parameters of the identified products have to be provided in a structured format to the background database manager. The data updates should be synchronised with the update time of the relevant data source, in terms of price and availability of the product, probably on a daily basis, in order to ensure that the offers are as accurate as possible. The data should be updated on a daily basis over a two-week testing period to ensure accuracy (apart from products that become unavailable during the day due to stock depletion.) Based on the product URLs, the following product data should be provided to the backend database: - Product name - Product description - Product image - Product packaging (unit and quantity) - Product price In the case of a promotional price, the start and end of the promotion If available, also the non-special price - Other product attributes (ingredients, vegan not vegan, etc.) - Product unique identifier (if any) The implementation should not give the impression of a "bot" to avoid possible flagging, e.g.: properly configured "real life" web client (user-agent, etc.), proxy configuration from list (if you want to run the scraper from multiple IP addresses). It would be an advantage to develop a solution that can efficiently handle product data for the entire portfolio of the given sources in the future, if the test is successful (up to 60-70E products per source). The sponsor considers a timeframe of 2 weeks as sufficient to complete the task. The 2-week update period will start thereafter at a date agreed with the client. The programming language and framework are optional. Proposed budget 800-1200 USD. Bids should be submitted by 05.07.2023! The contracting authority will contact the bidders of interest and is expected to finalise the agreement in the form of further Q&As.
프로젝트 ID: 36813036

프로젝트 정보

97 제안서
원격근무 프로젝트
활동 중 10개월 전

돈을 좀 벌 생각이십니까?

프리랜서 입찰의 이점

예산 및 기간 설정
작업 결과에 대한 급여 수급
제안의 개요를 자세히 쓰세요
무료로 프로젝트에 신청하고 입찰할 수 있습니다
프로젝트를 수여된 사용자:
사용자 아바타
$0 USD 14일에
5.0 (95 건의 리뷰)
6.8
6.8
97 이 프로젝트에 프리랜서들의 평균 입찰은 $1,089 USD입니다.
사용자 아바타
hello, How are you? Thanks for sharing information yes i am ready to Scrap website data as per given your data . lets do chat? Thanks Shweta
$1,125 USD 7일에
4.9 (309 건의 리뷰)
9.2
9.2
사용자 아바타
Hello Good afternoon , I hope you are doing great. Just finished reading the brief details of your job . I see you have been looking for a freelancer who has experience with Data Entry, PHP, MySQL, Software Architecture and Web Scraping. Upon the first look I feel confident about getting it done because of having experience doing similar jobs My Experience? I have 9 years of experience working with those technologies. Its been 8 years since I have been working on freelancer.com, Please review my profile. Check: Skills, Portfolio, Customer Feedbacks. Why Choose Me? 1. I have done more than 250 major projects only on freelancer.com. 2. I have not received a single bad feedback since last 5-6 years. 3. You will find 5 star feedback on last 100+ major projects which shows my clients are happy with my work. Portfolio: https://www.freelancer.com/u/AwaisChaudhry Timings: 9am - 9pm Eastern US Time I would like you to start the chat so we could discuss it in detail and we will continue from there. Thanks! Awais
$1,500 USD 16일에
4.9 (123 건의 리뷰)
8.6
8.6
사용자 아바타
I have reviewed the project requirements and I am confident in my ability to successfully complete this task. Based on my expertise, I propose developing a web scraping solution using Python and the Beautiful Soup library to extract the required product data from the specified Hungarian-language online stores. This solution will be implemented in a "real life" web client configuration to avoid flagging and will include proxy configuration from a list to enable scraping from multiple IP addresses. The extracted data will be structured and provided to the backend database manager. The data updates will be synchronized with the update time of the relevant data source, ensuring accurate and up-to-date product information on a daily basis. A two-week testing period will be conducted to ensure accuracy, with daily updates except for products that become unavailable due to stock depletion. The following product data will be included in the structured format provided to the backend database: - Product name - Product description - Product image - Product packaging (unit and quantity) - Product price, including promotional prices and non-special prices - Other product attributes (ingredients, vegan/non-vegan, etc.) - Product unique identifier (if available) The proposed solution is scalable and can efficiently handle product data for the entire portfolio of the specified data sources in the future, allowing for up to 60-70E product...
$1,350 USD 10일에
5.0 (307 건의 리뷰)
8.7
8.7
사용자 아바타
Top 1% in Freelancer.com Hi, Greetings! ✅checked your project details: ✅Completed Time: In project deadline We have worked on 900 + Projects. I have 6 + years of the experience in same kind of projects. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly. My Portfolio Items: https://www.freelancer.com/u/schoudhary1553 I would really like to work with you on this project. If interested, Kindly contact me via chat for further details and discussion. Thank you Sandeep
$1,200 USD 10일에
4.9 (514 건의 리뷰)
8.5
8.5
사용자 아바타
Hello, Hope you are doing great, i am expert in web scraping , I can easily scrape all the target data from the website using Python or any other script so you don't have to spend any time or effort doing it manually. Plus, I provide quality results quickly and efficiently within your budget. Lets connect through chat for further detailed discussion, i can start the work right after the discussion., thank you Gaurav D.
$1,125 USD 7일에
4.9 (292 건의 리뷰)
8.1
8.1
사용자 아바타
Hello! I am George, a web crawler expert with experience in custom web scraping solutions. As an example, I can cite our previous project which involved scraping in a similar field: product data from 17 different internet resources was provided to a background database manager in a structured format. I feel confident that my team and I can complete the task comfortably in the given two-week timeframe and deliver the product data you need. In addition, I am sure that our solution can handle the entire product portfolio in the future if the test is successful. We can use any programming language and framework that is fit best for the job. I have the following questions about the task: 1. Does the client follow any specific names, unique identifiers or product descriptions that must be requested? 2. Are there any particular sources or websites from which the product data should not be taken? 3. Are any security measures in place to protect the data we are using? 4. Is it necessary to register in the websites prior to scraping the product data? 5. Is there a particular structure and format that the data should be provided in? I am looking forward to further discussions and thank you for such interesting project proposal!
$1,500 USD 3일에
5.0 (114 건의 리뷰)
8.0
8.0
사용자 아바타
Hello there, I am experienced in web scraping and to build script or a windows desktop application by using python. I am also experienced in large data scraping from the given website, by pass IP, Captcha, and anti bot or cloud flair protection. Please message me to discuss more regarding this project. Best Regards
$750 USD 7일에
4.9 (370 건의 리뷰)
8.1
8.1
사용자 아바타
Hey, ----keen eye for detail and outstanding observational abilities----Let’s get started to achieve your goals on this specific task.I am talented solution oriented Web scarpper/Full stack developer. Please ping me to get started and provide you great results. Thanks
$1,200 USD 7일에
4.9 (108 건의 리뷰)
7.9
7.9
사용자 아바타
Hi, I am a experienced web scraping, and wordpress web developer am verified by freelancer.com you can visit my profile to verify it. https://www.freelancer.com/u/rehmatclick I have read your project details that's pretty simple for me am sure I can do this but I have some questions to ask so please message me for other details thanks Am Muhammad Ghaffar professional freelancer before 8 years. You can check the profile link below for previous feedbacks and portfolio. https://www.freelancer.com/u/rehmatclick Regards, Muhammad Ghaffar.
$800 USD 3일에
4.9 (288 건의 리뷰)
7.6
7.6
사용자 아바타
Hello, my name is Hossein and I am a qualified freelancer. I have extensive experience in data entry, software architecture, web scraping and mobile software development. I understand that you are looking for a website scraper and need data updates to be made daily over a two-week testing period to ensure accuracy (apart from products that become unavailable during the day due to stock depletion). My skillset allows me to complete this project efficiently. Please feel free to contact me if you would like any further information or if you would like me to submit a bid for this project. Thank you for considering me for this position!
$1,125.01 USD 7일에
5.0 (59 건의 리뷰)
7.0
7.0
사용자 아바타
Hello I have read your project details that's pretty simple for me am sure I can do this but I have some questions to ask so Please send me a message so that we can discuss more. Thank you Azad
$1,200 USD 15일에
4.9 (168 건의 리뷰)
7.3
7.3
사용자 아바타
Dear Sir, Are you looking for a reliable and efficient solution to identify and provide 350 pre-selected products from nine Hungarian-language online stores of retail chains? I am confident that I can deliver a successful solution that meets your project requirements. My experience in data entry, MySQL, PHP, software architecture, and web scraping makes me the right fit for this project. My proposed steps to complete the project are as follows: 1. Identify the 350 pre-selected products from the nine Hungarian-language online stores of retail chains. 2. Provide the parameters of the identified products in a structured format to the background database manager. 3. Ensure the data updates are synchronised with the update time of the relevant data source. 4. Develop a solution that can efficiently handle product data for the entire portfolio of the given sources in the future. 5. Configure a “real life” web client (user-agent, etc.) and proxy configuration from list (if you want to run the scraper from multiple IP addresses). I am offering a free demonstration of the solution even before the project is awarded. I look forward to hearing from you and discussing the project further. Thank you for your time and consideration. Sincerely, Smith
$1,125 USD 7일에
4.9 (54 건의 리뷰)
7.0
7.0
사용자 아바타
Hello, My name is Sandeep and I am part of the team at ESOLUTIONS SS. We understand that you are looking for a website scraper and we believe our skillset makes us the perfect fit for this project. Our team has extensive data entry, web scraping, data processing and other services that will be invaluable when it comes to working on your website scraper project. We also offer 24/7 availability so that you can always reach us if necessary. With our extensive experience in data entry, web scraping and data processing we are confident that we can provide the required 350 products pre-selected by you on the websites of nine Internet data sources in an accurate manner within the timeframe of 2 weeks.
$750 USD 1일에
4.9 (246 건의 리뷰)
7.0
7.0
사용자 아바타
Hello there, Hope you are doing well. As you are looking for a website scrapper to identify a total of 350 products pre-selected by the client on the websites of nine Internet data sources (Hungarian-language online stores of retail chains), some of which are offered by several retailers and some of which are sold by only one retailer. We have the skill set you need to make this project. Given our substantial 8 years of experience with the website and Application development and data scraping, If you have any questions and/or suggestions, feel free to reach out. Looking forward to a fruitful collaboration. Thanks & Regards Gopal
$800 USD 8일에
4.5 (127 건의 리뷰)
7.7
7.7
사용자 아바타
Hello, I have over 9 years of experience in extracting data and I have a long history of successfully completed projects and positive feedback. I am a full-time freelancer and do Web Scraping, Web Crawler, Data Scraping, Web Automation, Django, Data Mining, Custom bot development, Building Business Lists, Email list generating, Lead Generation, Data Extraction, Data entry and many more. I am creating automated data extraction systems for more than six years now. I have already scraped millions of records out of dozens of websites. I can scrape any kind of websites like - E-Commerce - Business Directories - Listing site - any public website My Technical skills are as follows - Languages: Python, PHP, JAVA, MySQL, HTML - Libraries: Selenium, Scrapy, Requests, Regex, BeautifulSoup4, Multiprocessing, Pandas - OS: Windows, Ubuntu Linux 16.04 - Browsers: Chromedriver, Firefox driver You can expect fast and accurate results. Try to describe your needs as much as possible (exact site URL + the fields you need). Thank you
$1,000 USD 12일에
5.0 (13 건의 리뷰)
6.5
6.5
사용자 아바타
Dear Client, We are delighted to have the opportunity to present our proposal for the Website Scraper project. With over 20 years of experience in the IT industry, our company, N&T Negocios y Tecnologias s.r.l., has a proven track record in developing web, mobile, blockchain, and AI projects. Based on the project description provided, we have identified several solutions to meet your requirements effectively. Our proposed architecture and technology include the use of a web scraping tool that will systematically extract the desired product data from the specified Hungarian-language online stores. This tool will be configured to mimic a genuine web client, preventing any potential flagging issues. Additionally, the tool will support proxy configuration to enable scraper operation from multiple IP addresses. To ensure accuracy, the data updates will be synchronized with the update time of the relevant data sources, focusing on price and product availability. Daily updates will be carried out during a two-week testing period, allowing us to verify and maintain data accuracy. The extracted data, including product name, description, image, packaging details, price, attributes, and unique identifier, will be then structured and stored in a backend database. In anticipation of future scalability, we aim to develop a solution that can efficiently handle the entire product portfolio of the given sources, with a capacity of up to 60-70K products per source. We estimate a timeframe of two weeks to complete the project, followed by a two-week update period as agreed upon with your team. The programming language and framework for the implementation are flexible and can be tailored to your preferences. In terms of budget, our proposed range is $800-1200 USD, subject to final agreement upon further discussions and Q&As. We believe this budget is appropriate considering the complexity and scope of the project. We kindly request all interested parties to submit their bids by 05.07.2023. We assure you that the contracting authority will reach out to selected bidders for further discussions and to finalize the agreement. Thank you for considering our proposal. We look forward to your positive response. Best regards, N&T Negocios y Tecnologias s.r.l.
$1,500 USD 30일에
4.9 (8 건의 리뷰)
6.6
6.6
사용자 아바타
Hello, my name is Furqan and I am writing to you regarding your project for Website Scraper. I understand that you are looking for someone who can identify 350 products on the websites of nine Internet data sources that are offered by several retailers and sold by only one. I believe I am the perfect fit for this project as I have extensive experience in data entry, MySQL, PHP, web scraping and more. Additionally, I have experience in developing systems using CodeIgniter, Cakephp and Dotnetnuke as well as platforms such as Odoo and Magento. This gives me the knowledge necessary to effectively complete the task at hand within the timeframe agreed upon between us. I would be more than happy to discuss this project further with you if given the opportunity. Please feel free to reach out if you have any additional questions or would like to discuss further.
$1,125 USD 7일에
4.9 (21 건의 리뷰)
6.2
6.2
사용자 아바타
Hi, Greetings for the day! My name is Apurva and have experience of more than 6 years in writing robust Python utility Scripts for Scraping, Automation, and Importing. so I can help you to identify a total of 350 products pre-selected by the client on the websites of nine Internet data sources. I can write custom code to crawl and extract different sorts of data and provide the Best Web Scraping and Data Extraction Services. I can efficiently scrape data from websites, aggregate them, and report for business operations. I can automate the task while performing the following steps- - Access data behind user authentication by solving captcha in some cases. - Pull together transaction records by navigating to various characters, numeric fields, calendars. - Iterate to complete transactions for a time period. - Prepare the data from each website to a set schema ready for BI ingestion. My expertise lies in- • Scraping websites with bare-bones structures and complex to parse • Regular expression( regex) to extract data • Selenium scripts to automate activities on the web • Bot development • ETL Rest I assure you about the quality work and delivery of the project on time. Response Awaiting! Regards
$1,000 USD 12일에
4.9 (26 건의 리뷰)
6.2
6.2
사용자 아바타
Hello Employer, I can build up a project to handle searches of the selected products from different retail sources along with IP & User Agent rotations to avoid being flagged as a Bot. I am interested to know theoratical design and the complete requirements. I am available for meetings to discuss the project. From the description, I clearly understood that you need a web crawler to identify selected products from integrated Nine data sources ( all in hungarian ). So the workload according to me, is to develop 9 scrapers to pull data of selected products received by the client and handed over to Database manager once scraping is complete. Good news is that I have a team of web scrapers that can make these 9 scrapers. Otherwise, it will take longer to develop 9 scrapers, a integrated system and fully functioning db in 14 days. You can leave me a message and I can all the queries that you might have regarding my team, my work and deliverables of the project. I will work on this project for 1000 USD and it will delivered on promised deadline. Thank you, Mubashir A.
$1,000 USD 14일에
5.0 (31 건의 리뷰)
6.1
6.1
사용자 아바타
Hello Gábor J., We would like to grab this opportunity and will work till you get 100% satisfied with our work. We are an expert team which have many years of experience on PHP Please come over chat and discuss your requirement in a detailed way. Thank You
$1,100 USD 7일에
5.0 (12 건의 리뷰)
5.7
5.7

고객에 대한 정보

국기 (HUNGARY)
Budapest, Hungary
5.0
1
결제 수단 확인
1월 19, 2023부터 회원입니다

고객 확인

감사합니다! 무료 크레딧을 신청할 수 있는 링크를 이메일로 보내드렸습니다.
이메일을 보내는 동안 문제가 발생했습니다. 다시 시도해 주세요.
등록 사용자 전체 등록 건수(일자리)
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
미리 보기 화면을 준비 중...
위치 정보 관련 접근권이 허용되었습니다.
고객님의 로그인 세션이 만료되어, 자동으로 로그아웃 처리가 되었습니다. 다시 로그인하여 주십시오.