Python web scraper using ec2 and S3. Files rewritten by a text rewriter api.

완료 등록 시간: 7 달 전 착불
완료 착불

Create a python scraper that scrapes web pages, stores scraped files on S3 as text. The files are then rewritten by a rewriter api tool.

key steps are:

- Scrape links based on keywords, dates and number of requested articles from specfic websites

- Create the a source list of urls on a text file from this

- From this source list of urls on the text file extract the text contents of the web pages and output in text format

- Write these source articles to an S3 bucket folder

Once all article are retrieved

- run article through an text rewriter api

- place rewritten articles into a different S3 bucket and folder.

The article text file will have in its content

* The article url

* content of the article

The rewritten article text file will have just

* rewritten content of the article

The format of rewriting article should be

s3/folder/[login to view URL]

eg. s3/20230912/[login to view URL]

Required implementation tools:

Use a scraping api such as [login to view URL] to act as a proxy to grab links and articles.

Use an article paraphrase api such as [login to view URL] to rewrite articles.

These have free trial or low cost options for development

You need expertise in:

Python

EC2

S3

IAM

Linux

You will use your AWS account for development

On conclusion of the project you will supply:

1. Python code for the solution

2. Documentation describing how to implement the solution

3. Demonstration of code working

4. Assist with any implementation issues

Python 웹 스크랩핑 Amazon S3 리눅스 아마존 웹 Services

프로젝트 ID: #37230224

프로젝트 소개

58 건(제안서) 재택 근무형 프로젝트 서비스 이용 중: 7 달 전

수상자:

serazummunirz

Hi There, I am capable of doing the above-mentioned job effectively and efficiently without any hassle. I have the required expertise and have worked on very similar projects in the past. I am confident that I am the 기타

£200 GBP (1일 이내)
(71건의 리뷰)
6.1

이 일자리에 대한 프리랜서 58 명의 평균 입찰가: £170

chirgeo

Hi! I'm George, a web crawling expert with proven experience in scraping, rewriting and extracting data from web pages using Python, EC2 and S3. Having created a custom web scrapper myself, I'm confident that I can bu 기타

£408 GBP (3일 이내)
(155 리뷰)
8.1
sonus21

Hello Obs! I hope you're well. I'm a senior Scraper developer with experience in developing scraper using scrappy and headless browsers. I can deal with bypassing IP throttling limit, ban and captcha solve, storing the 기타

£250 GBP (14일 이내)
(55 리뷰)
6.2
anayapallavi

I can make web scrapper as per your requirement. Please initiate a message for further discussion.

£100 GBP (4일 이내)
(17 리뷰)
5.3
QASIM7862001

I can make you a smart system which will perform the described task in 48 hrs Hey there, i am developer from the UK with over 9 years experience in web development. Upon reading your project description this seems lik 기타

£500 GBP (1일 이내)
(14 리뷰)
5.4
akhilvl1302

"Hi, I am an expert in Python, AWS and scraping. Can create features based on your requirement Skills: NodeJs, Python, PHP Please message me for further discussion. Thanks!"

£225 GBP (7일 이내)
(74 리뷰)
5.8
prdraco

Feel free to contact me for Python web scraper using ec2 and S3. Files rewritten by a text rewriter api .shoot me message to discuss further more details .i provide the comments,images,videos,demos and live sessions i 기타

£150 GBP (7일 이내)
(17 리뷰)
5.6
techplusintl

Hi there, ★★★ Scrapping / Python / Selenium Expert ★★★ 10+ Years of Experience ★★★ I've read requirements and ready to scrape web pages, stores scraped files on S3 as text. Some major works we do: ✔️ Product Websites 기타

£250 GBP (2일 이내)
(32 리뷰)
6.1
carina0530

Hello, ✵✬✭✮ As senior scraper developer, I can complete your project perfectly!✵✬✭✮⚝ I have much experiences in EC2 field.(i have installed nodejs and python on ec2) I can get this done at short time, because i have a 기타

£135 GBP (7일 이내)
(19 리뷰)
5.1
shrec

Dear, hello. I've rich 7+ years of experience in Python Web scraping and AWS, I have an AWS account, I just finished a job that was like that. I am certain that I can complete your project exactly as you require it b 기타

£135 GBP (7일 이내)
(6 리뷰)
5.1
merinsinha

Python expert. I can do it. As 9+ years experiences in these field. I can give good quality work. I have read the guidelines of your work.I believe that i can provide you the best quality works you are anticipating fro 기타

£155 GBP (3일 이내)
(54 리뷰)
5.6
Techalchemy

Hi Sir, As a highly skilled and experienced, I am confident that I can provide the high-quality work you need, but i have some doubts regarding the same, lets discuss in detail make it clear & then i am ready to start 기타

£135 GBP (7일 이내)
(15 리뷰)
4.8
prateekhighskyit

I understand that you are looking for a Python web scraper that scrapes web pages, stores scraped files on S3 as text, and then rewrites the files using an article paraphrase API tool. I am confident that I can help y 기타

£135 GBP (7일 이내)
(3 리뷰)
4.5
NadMax

Hi. Experienced Python Developer here with 8+ years of hands-on experience. I can assist you in creating a Python scraper for web pages, storing scraped files on S3, and implementing a text rewriting API. To proceed f 기타

£135 GBP (7일 이내)
(3 리뷰)
4.7
dataspro

Nice to talk you Haktermast, After reading in detail the requirements of your project and concluding that they match my areas of knowledge and skills, I would like to introduce myself. My name is Anthony Muñoz and I 기타

£380 GBP (7일 이내)
(4 리뷰)
4.1
AmazingEngr76386

I understand that you are looking for someone to create a Python web scraper that scrapes web pages, stores scraped files on S3 as text, and then rewrites these articles using an article paraphrase api tool. With my ex 기타

£200 GBP (7일 이내)
(10 리뷰)
5.8
soramaru

Hello As a Python expert with 5 years of experience, I have mastered Python frameworks such as Django and Flask. I am familiar with building SaaS, booking, ecommerce, ERP/CRM, and backend(admin panel) using REST API. 기타

£120 GBP (3일 이내)
(2 리뷰)
4.0
Dhawan8787

Hi sir. I'm excited about your project and confident in my ability to deliver your project . I'm committed to exceeding your expectations and ready to start from right away . Let's connect and discuss the next steps! T 기타

£135 GBP (7일 이내)
(7 리뷰)
3.7
Demenntor

Dear Client, I am writing to express my interest in your project to create a Python web scraper that scrapes web pages, stores scraped files on Amazon S3, and utilizes a text rewriter API to rewrite articles. With my 기타

£220 GBP (7일 이내)
(17 리뷰)
3.7
MohmedAbdelwahab

Hello there, I am mohamed and I am a highly experienced Python developer with extensive experience in machine learning, AWS, and data scraping technologies. With a deep understanding of Python programming, I have devel 기타

£135 GBP (7일 이내)
(7 리뷰)
3.4
Rubi64420

Hello, I possess the skills and proficiency to perform the job mentioned above with ease and efficiency. I have the necessary expertise and a track record of successfully handling projects of a similar nature. I have 기타

£300 GBP (4일 이내)
(2 리뷰)
3.1