Find Jobs
Hire Freelancers

Build automated data load from websites (automation) & APIs to Postgresql/MS-SQL

₹37500-75000 INR

종료됨
게시됨 거의 6년 전

₹37500-75000 INR

제출할때 지불됩니다
We are a startup focussing on blockchain products. One of our project details are as below for which we are looking for a team of freelancers with various skill set who can together build the product. Phase 1 (Duration: 7 days): IT solution to collect, load and process data from various websites. Data will be available : 1. Standard APIs of those websites (json format) 2. Websites crawls (by Automation to collect tabular data) Need to build batch automated processes to collect these data and load in Postgresql/MS-SQL on defined interval of time. This would require setting of PostgresqlMS-SQL server on Ubuntu latest version and further processing to consolidate collected data in desired tables' format. Which requires processing via stored procedures. Parameters, like, frequency of batch run and hyperlink of the API/Website to crawl should be read from a database table. Solution should be generalised, such that, similar pattern websites are read similarly. Ex: 1. Standard APIs (samples): [login to view URL] [login to view URL] [login to view URL] 2. Websites Data Crawl (samples): [login to view URL] [login to view URL] [login to view URL] Once data is collected directly from these websites, it needs to be processed and collated in target summary tables based upon few business logics. Phase 2 (duration: 4 weeks) & 3 (duration: 3 weeks): To be discussed once approaching finish of phase 1. Skills needed for phase 1: JSON processing, API processing, Automation to crawl websites and collect data, Postgresql/MS-SQL scripting, database knowledge etc.
프로젝트 ID: 17387188

프로젝트 정보

11 제안서
원격근무 프로젝트
활동 중 6년 전

돈을 좀 벌 생각이십니까?

프리랜서 입찰의 이점

예산 및 기간 설정
작업 결과에 대한 급여 수급
제안의 개요를 자세히 쓰세요
무료로 프로젝트에 신청하고 입찰할 수 있습니다
11 이 프로젝트에 프리랜서들의 평균 입찰은 ₹69,924 INR입니다.
사용자 아바타
Dear ukrblockchains, I have experience with these skills. I do have similar experience doing something similar to yours "Build automated data load from websites (automation) & APIs to Postgresql/MS-SQL" therefore I am looking forward to discuss and move ahead. Relevant Skills and Experience I have 10+ years of experience in API, JSON, Microsoft SQL Server, Selenium Webdriver, Website Design I can do this within your budget too ₹37500 - ₹75000 INR please check more from here https://www.freelancer.com/u/mmadi.html?page=portfolio I am ready to work with you,kindly waiting for your response. Thanks & Regards, Mmadi
₹52,500 INR 24일에
5.0 (16 건의 리뷰)
6.3
6.3
사용자 아바타
Looking for Mobile App Solutions, we've got you covered. Contact us today, our developers are eager to solve your problems.. We specialize in Hybrid and Native Mobile Apps. Our prices are affordable. Contact us today.
₹62,500 INR 20일에
0.0 (0 건의 리뷰)
0.0
0.0
사용자 아바타
I can do your job.
₹66,666 INR 20일에
0.0 (0 건의 리뷰)
0.0
0.0
사용자 아바타
Hello! This appears to be similar to work I did to build data marts hence loading data and writing stored procedures is not an issue
₹62,500 INR 20일에
0.0 (0 건의 리뷰)
0.0
0.0
사용자 아바타
Hi, I have work experience related to Web Crawling, Data Extraction. Currently Working as Data Science. Have knowledge of Postgress, Distributed System.
₹62,500 INR 24일에
0.0 (0 건의 리뷰)
0.0
0.0

고객에 대한 정보

국기 (INDIA)
India
0.0
0
7월 18, 2018부터 회원입니다

고객 확인

감사합니다! 무료 크레딧을 신청할 수 있는 링크를 이메일로 보내드렸습니다.
이메일을 보내는 동안 문제가 발생했습니다. 다시 시도해 주세요.
등록 사용자 전체 등록 건수(일자리)
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
미리 보기 화면을 준비 중...
위치 정보 관련 접근권이 허용되었습니다.
고객님의 로그인 세션이 만료되어, 자동으로 로그아웃 처리가 되었습니다. 다시 로그인하여 주십시오.