Web Scrap Medical Website

Status: Closed
Prize: $110
Entries Received: 3
Winner: Verz1Lka

Winner

Contest Brief

I need to scrap a website that contains professional information.

The final product is a .csv (or excel) file with all information along with the python script that you used to scrap the website.

The website is in portguese (brazilian)

url: http://portal.cfm.org.br/index.php?option=com_medicos&Itemid=59

You will find a form to search for healthcare professionals.

First line: leave it blank

Second line: The first box should be left blank. The second box is a list of states (loop through all states).

Third line: List of cities. Once you have selected a State, it will show the list of all cities of that state. (loop through all cities)

Fourth line: choose 'ativo'

Fifth line: choose 'todos'

Sixth line: (CIRURGIA DO APARELHO DIGESTIVO) and (CIRURGIA GERAL)

The database should contain all information for every name:

State (UF)
City (município)
Specialty (especialidade)
Name (Nome do Médico)
Situation (situação)
CRM
Tipo de inscrição
Especialidade/Area de atuação (1)
RQE (1)
Especialidade/Area de atuação (2)
RQE (2)
Especialidade/Area de atuação (n)
RQE (n)

p.s.: 'Todos' means 'All'

The website breaks the results in pages, please be aware of that.

I have attached an example of the result I need

Recommended Skills

Winner

Post a Contest Like This

Employer Feedback

“Great job! Other people took days to scrap the website, while he took only hours.”

victorarakawa, Brazil.

Public Clarification Board

knowledgeexcavat
- 11 years ago
wow... just attached 3 files and it is closed :(
- 11 years ago
1. knowledgeexcavat
  - 11 years ago
  and there are 18499 entries...
  - 11 years ago
knowledgeexcavat
- 11 years ago
What about AREA_ATUACAO_3 RQE_3 ? Some persons have 3.
- 11 years ago
1. Contest Holder
  - 11 years ago
  Yes, you should create AREA_ATUACAO_n for n=1,2,3...
  - 11 years ago
hwanghendra
- 11 years ago
Hi are you open to using other language, eg php ?
- 11 years ago
thenamescarlos
- 11 years ago
Is there a known issue or specific reason with having "Todos" being the option selected for the box in the second line?
- 11 years ago
1. Contest Holder
  - 11 years ago
  Because I want all options. You can do it by each option, but I dont need that.
  - 11 years ago
clackkensmith
- 11 years ago
Hi !
i am a scraper, bellow is project of my last customer :
demo file : https://mega.co.nz/#!91YXDTzJ!hQOtqZzptKMJhcfKJSu5q120intcp9_0qgUD-xNLpoM or attach file
Link get : http://www.gassaferegister.co.uk/registersearch/checkbusiness.aspx
You can check by accountNumber at that page and check information.
Bid me or message with me for detail about job.
thank you !
- 11 years ago
knowledgeexcavat
- 11 years ago
Could you #increaseprize if work be done in 1 day?
- 11 years ago
talhamunir2002
- 11 years ago
hi cane we made script in c#
- 11 years ago
View 1 more message
1. talhamunir2002
  - 11 years ago
  okz....i can provide you data if needed and script in c#,if needed,ping me
  - 11 years ago
2. MEDIAPRONET
  - 11 years ago
  scrape price:20$ per 1000 records,also,if you want a bot,i can make it for 200$(without code)
  - 11 years ago
TECHRONYX
- 11 years ago
# sealed plz
- 11 years ago
braedon213
- 11 years ago
is the search working right now? it was working for me earlier but now anytime i search i get "Não existe nenhum resultado para essa busca"...
- 11 years ago
1. Contest Holder
  - 11 years ago
  Maybe you are trying a combination that has no results to show. E.g., there is no professional in the city with that specialty.
  - 11 years ago
braedon213
- 11 years ago
i don't see "CIRURGIA DO SISTEMA DIGESTIVO" under Especialidade.
- 11 years ago
1. Contest Holder
  - 11 years ago
  OK, I have just fixed that, you are right
  - 11 years ago
2. Contest Holder
  - 11 years ago
  CIRURGIA DO APARELHO DIGESTIVO is the right option
  - 11 years ago
braedon213
- 11 years ago
I see "CIRURGIA DO APARELHO DIGESTIVO" and "CIRURGIA GERAL" however. Is SISTEMA the same as APARELHO?
- 11 years ago