Youtube search result scraper & aggregator (No API usage) -- 2

종료 등록 시간: 8 달 전 착불
종료 착불

Hey folks!

I need an app with a simple GUI that scrapes and collects Youtube search results. In detail:

Input:

- Multiple Youtube search result URLs + Option to remove or add more lines with more URLs as needed

- Refresh time for each URL

- Minimum video length to be scraped

- Delay time option field between actions (opening URL, scrolling down to load all results, saving and finish scrape for URL 1, start URL 2....). For example "wait X seconds between each action"

Examples: (youtube com....)

/results?search_query=news&sp=CAISAggB

/results?search_query=let%27s+play&sp=CAISBAgBEAE%253D

/results?search_query=sport

Result: Scrapes the search result pages and collects all results in one big HTML file while filtering out all duplicates. Repeats process every few minutes

> Example file of how the result HTML could look is added as attachment. Feel free to copy the layout

> Example GUI layout added as attachment

Condition: Must be able to run on Windows 10. Does not use Google API or other paid services.

-------------------

-------------------

Function:

1.) The program accesses the URLs at intervals that can be set (Every X seconds/minutes)

2.) Scrolls down to load all search results available and then saves all results, thumbnails, and links (links to video and channel) on the local hard drive (in a defined folder) and creates an HTML file for opening the list in the browser at a later time. One file for each input link. The HTML file has the option to sort the list content by video length, channel etc.

3) Waits a user-defined number of seconds to avoid the IP getting flagged as a bot, repeats the steps for the next URL until all URLs are scraped.

4.) Refreshes pages after a set number of minutes (which can be adjusted by the user for each link)

5.) Automatically repeats steps 1-4 and adds new results to the previous local file. (Does not save duplicates.)

6.) The local file should look like a long search result list if opened. Links should be clickable, same as on Youtube and sortable by video length. See attachment example

Needed data:

- Video Thumbnail (Largest available size. static image file)

- Video length

- Channel name & Link

- Video name & Link

- Video description (Optional)

Features:

- Being able to sort the list after opening it in the browser by: Video length, Video title, Channel title, Time added

- Channel URL link is changed to the videos pages by adding "/videos" to the end. See the attached file for example.

- An option to define minimum video length for being added. (Example: "Add no videos shorter than 5 seconds")

- An option to set wait times between scraping of each URL to prevent being IP banned for accessing results too fast

- Wait time between scraping actions so it works fine on slow PCs

- Important: An auto-skip function in case of internet disconnects. "If scrape for URL 1 has not finished after 10 minutes, skip this time, start URL 2"

Requirements:

- Must work on Windows 10

- Does not use Google API

- Has sorting arrows in the HTML file for video length, channel name, video title, and time added (Please look at the attachment files blue arrows.)

- The final result must be .html so a browser can open it. (Not .csv or similar.)

- The result looks similar to the attachment file, please make the thumbnail as the maximum size youtube provides it as.

Please tell me what you would charge for creating this software :)

웹 스크랩핑 PHP Python 소프트웨어 아키텍처 JavaScript

프로젝트 ID: #37084255

프로젝트 소개

26 건(제안서) 재택 근무형 프로젝트 서비스 이용 중: 7 달 전

이 일자리에 대한 프리랜서 26 명의 평균 입찰가: $250

techplusintl

Hi there, ★★★ Scrapping / Python / Selenium Expert ★★★ 10+ Years of Experience ★★★ I've read requirements and ready to build GUI that scrapes and collects Youtube search results. Some major works we do: ✔️ Product Web 기타

$750 USD (7일 이내)
(356 리뷰)
8.2
chirgeo

Hello, I'm George, a web crawler expert. I have extensive experience with creating custom web scraping tools and scrapers for data extraction from websites in various industries. I understand that you need an app wit 기타

$500 USD (3일 이내)
(166 리뷰)
8.1
uumarkhalid31

Hello! You need an app with a simple GUI that scrapes and collects Youtube search results. What kind of data do you want to collect? If you are interested, let us discuss this project further and do your job. Thank you 기타

$120 USD (4일 이내)
(263 리뷰)
7.3
datascientist90

I'm a senior Python & ML developer and owner & founder of Dedeoglu Dev Company. Kindly send me a message to get in touch with me, Thanks, Yusuf

$750 USD (7일 이내)
(27 리뷰)
6.6
simonklemp

Hello Markus, I hope this message finds you well. I will be able to help you with your project. I read through the description and it sounds like I am just the right person for it. I have the right ski 기타

$200 USD (3일 이내)
(25 리뷰)
6.0
josanta

Hello, I'm excited about the opportunity to develop the YouTube search results scraper app with the specified functionalities and features. Your detailed outline provides a clear understanding of the project scope. M 기타

$250 USD (1일 이내)
(55 리뷰)
5.9
dataspro

Nice to meet you Lea1234, It is a pleasure to communicate with you. My name is Anthony Muñoz, I am the lead engineer for DSPro IT agency and I would like to offer you my professional services. I have more than 10 yea 기타

$452 USD (7일 이내)
(8 리뷰)
5.9
kaantepeli

Hello. I am fullstack web developer and python developer. Also I am web scrapper expert. I am developing international projects for a while time. I was inspect your request and If we can discuss further details I can 기타

$250 USD (7일 이내)
(11 리뷰)
4.3
image611

Hello there Markus K., Good afternoon! Your very project "Youtube search result scraper & aggregator (No API usage) -- 2" just caught my Attention. You'll be glad to know that I have already helped a lot of entrepren 기타

$30 USD (3일 이내)
(15 리뷰)
4.0
freelanceferif

⭐ hello, dear client ⭐ I am a professional php/javascript/python developer. My main specializations are automation, web scrapers and web extension development. I have written many(200+) scripts(scraper/extension) inc 기타

$200 USD (7일 이내)
(9 리뷰)
3.3
softnosol

Hello, good day to you I am owais. I have checked your job post. You require a Youtube search result scraper & aggregator (No API usage) . I can assist in it. I feel 100% confident in accomplishing this job in time, wi 기타

$140 USD (7일 이내)
(4 리뷰)
2.2
maxota940601

Hi . I do same project not along time ago. I'm do YouTube search with a telegram bot . It's not using Google api . I'm confident that my experience and skillset make me the best fit for this project. If you have any 기타

$30 USD (2일 이내)
(1 리뷰)
1.5
fivezeroinfo

Hey there! I've got the perfect solution for your Youtube search result scraping and aggregation needs. I'll develop a quirky app with a user-friendly GUI that will scrape and collect all those search results for you, 기타

$120 USD (1일 이내)
(0 리뷰)
0.0
ValeShmit

Hi, Client Scraping expert here! I have carefully reviewed your job description and I am confident to complete your project perfectly. Please leave a message here for the best results. Thanks, Valerii

$150 USD (2일 이내)
(0 리뷰)
0.0
imumermalik

Dear valued client, I hope this message finds you well. I have carefully reviewed your requirements for the app that scrapes and collects YouTube search results, and I am confident that I can provide you with an excel 기타

$225 USD (5일 이내)
(0 리뷰)
0.0
andreistalbe

Dear customer, My name is Andrei Stalbe and I am an experienced web crawler expert (Python, Scrapy, Selenium). I've read your job description and seen that you need a program to scrape and collect Youtube search res 기타

$500 USD (3일 이내)
(0 리뷰)
0.0
techindia999

Hi Greetings! We are team of software developers. We have developers working on almost all the technologies. We will assign you a project manager who will assist you during entire process of project completion. We wil 기타

$250 USD (7일 이내)
(0 리뷰)
0.0
alimuhtashim

Hello, my name is Ali, and I am a software engineer with four years of experience. My portfolio can be found here: www.freelancer.com/u/alimuhtashim. I understand that you require an app with a simple GUI for scraping 기타

$250 USD (20일 이내)
(0 리뷰)
0.0