Scraping Yahoo Headlines

완료 등록 시간: Jan 12, 2014 착불
완료 착불

We are looking for a freelancer to create a mongo database of financial news articles by polling the feeds at [url removed, login to view], given a CSV file of tickers.

Please view the attached [url removed, login to view] to see the intended output. For the "ticker" subdocument, the position is the Nth 'p' element inside the article.

For the example stock SPY:

You would be saving the headlines at [url removed, login to view] (using the rss feed [url removed, login to view]).

This RSS feed links to external sources such as:

1) [url removed, login to view]

2) [url removed, login to view]

3) [url removed, login to view]

4) [url removed, login to view]

5) [url removed, login to view]

6) [url removed, login to view]

7) [url removed, login to view]

..Among others. For this project, you will only be concerned with these 7 websites, but the project should provide be extensible for other websites.

Each website page's structure is different, so experience with xpath/jquery selectors may be necessary to accomplish parsing the articles.

The end result should be an insert request into a mongo database. A sample JSON is attached. We are interested in seeing bids using node.js and python, but we may consider a competitive bid outside these languages.

Node.js NoSQL 카우치 및 몽고 Python 웹 스크랩핑

프로젝트 ID: #5311952

프로젝트 소개

19 건(제안서) 재택 근무형 프로젝트 서비스 이용 중: Jan 13, 2014

수상자:

robinsjp

Hi, I work as a project manager for an online retailer. A large part of my job involves writing data scrapers to scrape information from various sources. I've had a look at the feed you want to process, and if I 기타

$370 USD (0일 이내)
(5건의 리뷰)
4.0

이 일자리에 대한 프리랜서 19 명의 평균 입찰가: $548

uumairkhalid

Hi.. Expert web scraper/Data Minor here. I have done too many similar project in past. I assure you 100% accurate and good quality work. I have too too scraping experience. you can see my experience here: https://www. 기타

$315 USD (10일 이내)
(66 리뷰)
5.9
nekhbet

Hi, If you accept PHP solutions (with mongoDB or MySQL, whichever you want) please let me know. Regards Sorin

$526 USD (10일 이내)
(22 리뷰)
5.5
uumarkhalid31

hi, i am expert in web scraping and interested in this project, let me do this work with perfection, accuracy and according to your requirements, i assure you that all work will be according to your requirements thanks

$315 USD (10일 이내)
(37 리뷰)
5.4
M5L2764K

Hi, I have experience scraping Yahoo finance and some rss news feeds as well. i can do this project using Python Scrapy framework. I also have finished mongodb for developers course and have a certificate from 10gen.

$277 USD (10일 이내)
(10 리뷰)
4.8
eightsl

Hello. I have just read the project description, I'm willing to do this using Python 2 with the help of the Beautifulsoup and requests librairies. I still have trouble understanding the purpose of the "ticker" entr 기타

$500 USD (10일 이내)
(1 리뷰)
2.9
ibisREDibis

Hello there. I have lots of experience writing PHP applications of this nature. I see you tagged python in the advertisement but hope PHP is also acceptable - whatever gets the job done? Please message me if you have a 기타

$420 USD (7일 이내)
(3 리뷰)
2.1
cyruszargar

A proposal has not yet been provided

$526 USD (15일 이내)
(0 리뷰)
0.0
petermacclellan

Greetings, My name is Peter and I am an expert at web scraping, with background in .NET/network engineering and web development. I am new to Freelancer and looking to get a positive reputation for myself as a consu 기타

$277 USD (5일 이내)
(0 리뷰)
0.0
Crazometer

G'day, I'd have no trouble building the scraper in node.js and outputting a JSON string for mongo like the sample. I've worked with both node and mongo in the past and are comfortable with both. A conservative e 기타

$350 USD (5일 이내)
(0 리뷰)
2.0