Database and web scraping Project

$250-750 AUD

완료함

게시됨

5년 이상 전

$250-750 AUD

제출할때 지불됩니다

Hi All, I have an existing Microsoft Access database that I would like either upgraded or converted to a quicker and less buggy database. It is currently cumbersome and often produces errors. The current database, which I will provide, downloads event related CSV files from one website, creates a unique Id for each row of the CSV file, and combines this file with a results file I download manually. The code for this is included in the database I will provide, as is the lookup table that matches the two files as they have different identifiers for location, e.g. Sydney = Syd. For this upgrade project I am happy to use a program other than Access, at your recommendation, and I would like the following improvements: - automate download of results files as well as just event files, - combine files, and once event and results files are combined, have them readily available for future analysis - ability to apply filters to database quickly and easily - easy download to CSV or excel format post application of filters (or in entirety) - additional columns, or a seperate database, that applies excel formulas to the raw database. These are generally sumifs/averageifs or one field minus another field. These formulas can be provided, and essentially compare one competitor to other competitors within that event. I would need to be able to amend the relevant excel formulas over [login to view URL] ADVISE IF YOU DON'T BELIEVE THIS IMPROVEMENT IS POSSIBLE. I am happy with any database format that is user friendly on windows, and can continue to use Access if preferred. Note the database would be large with 400,000+ rows so not suited to excel. I would propose to pay 25% upfront, 25% at a milestone, 25% upon completion and a further 25% 3-6months later subject to your ongoing support. I would like the end product to include 1 year of recent data already completed. Please ensure you comment on how you would achieve the outcome of the project in your bid. Many thanks!

프로젝트 ID: 17959776

프로젝트 정보

25 제안서

원격근무 프로젝트

활동 중 6년 전

돈을 좀 벌 생각이십니까?

이메일 주소

프리랜서 입찰의 이점

예산 및 기간 설정

작업 결과에 대한 급여 수급

제안의 개요를 자세히 쓰세요

무료로 프로젝트에 신청하고 입찰할 수 있습니다

프로젝트를 수여된 사용자:

@srsumitroy

Hi, Quiet a interesting project. I have done this kind of work before. But mine was transporting data from Foxpro to Oracle (with code and UI). About me: I am having over 20 years of experience in IT field and last 10 years in large scale Data warehousing project and 6 years in Big Data implementation. Quiet proficient in Java, Scala, Python, R, Groovy languages and ETL tool like Pentaho and Talend. Database Postgresql Oracle, Mysql This can be done in Postgresql Database with Python at backend. 1. Data download and combining files can be done in Python. 2. Data can be uploaded to postgresql using python. Python has a very good interface with postgresql. 3. Postgresql has a very rich sql interface and complex algo can be implemented in pgplsql. 4. If you have any UI interface it can be implemented in wxPython. 5. Running your excel formulas on Postgresql is possible with ADO and ODBC. 6. Python seamlessly can ingest data from csv, Excel, TSV, JSON, YAML, XML On the sideways, if you have a hadoop implementation reading from CSV is more simpler in Hive. Just create an external table in Hive pointing to a hadoop folder. And drop all the csv files in that hadoop folder. Excel sheet can be converted to CSV file using python. And on the External hive table you execute your filters and queries. Hope to work with you in this project. Thanks and Regards Sumit Kumar Roy

$555 AUD 20일에

5.0

(2 건의 리뷰)

3.6

25 이 프로젝트에 프리랜서들의 평균 입찰은 $523 AUD입니다.

@ramzitra

Hi, I am interested in your project related to build a scraper for events data from one website and put data to a local database. Please send me a message so that we can discuss all the details. Thanks, Ramzi

$750 AUD 10일에

5.0

(465 건의 리뷰)

8.4

@seaanddream

Hi, my name is Selim. I will write a java-based desktop app with a simple UI, which will perform the tasks and export the outcome into an access database, as you prefer... I read your "Database and web scraping Project" project descriptions carefully before bidding. I checked your requirements as well... I got what you need and ready to go ahead as soon as we can clarify further project details. I am 5-star web scraping & automation expert here at freelancer.com. Pls check my profile and feedbacks first to have some idea about the quality of my previous businesses. I had many similar web scraping tasks, including extraction of large product databases from various ecommerce websites, all achieved with 5/5 rating. Kindly get back to me if you wish to proceed with a top-rated and reliable partner here...pls note that I only deliver best quality at a reasonable price, and I am open for longterm partnerships, if you wish too... I bid my best for you to start business, and I am ready to prepare a sample task for you to check & validate, once you give me a reply...regards.

$555 AUD 10일에

5.0

(376 건의 리뷰)

8.2

@schoudhary1553

I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without changing my bid or playing games. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly and at my FIRST BID. I promise to deliver 100% Satisfaction.I have more than 5 year of experience in Database Development, Excel, Microsoft Access, Software Development, Web Scraping. Please ping me for more discussion.

$400 AUD 5일에

4.9

(371 건의 리뷰)

8.1

@mirniyazuddin92

Hi there, I can do database and web scraping for you. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir

$555 AUD 10일에

4.9

(365 건의 리뷰)

8.0

@zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within the agreed deadline. Check out my profile, portfolio and former clients feedback - that'll let you know everything about me. Please feel free to contact me so that we can discuss further details. Thank you for taking the time to read my proposal.I am looking forward to hearing from you. Best regards, Miljan

$493 AUD 10일에

4.9

(187 건의 리뷰)

7.8

@mhmhz

Hi I can create a desktop application that scrapes the data and store it in Access or Mysql db. Can work on a demo if you like. Thanks

$1,000 AUD 10일에

5.0

(113 건의 리뷰)

7.6

@fabest

Dear, we are Team of French + US. I checked your project description, and I confirm I can develop your MS-Access program. Please give me more details about your project. I will focus on user friendly interface. As you can see I have very good rate, you can be sure I am serious. Regards, Fabrice

$277 AUD 10일에

4.7

(90 건의 리뷰)

7.4

@VladimirLilenko

Hello, dear sir! I registered at the forum not so long ago, but I already have several completed projects on www.freelancer.com. I am ready to carry out your project in the reasonable price and in the shortest possible time and with the highest quality! I can offer assistance in correcting errors and updating the Access database. Give me a chance to show what I can do!

$500 AUD 5일에

5.0

(203 건의 리뷰)

6.8

@osmanaydin

Hello sir, I have completed web/data scraping jobs many times. I am interested in your project as well. I would like to discuss details via pm. I look forward to hearing from you soon. Best Regards,

$599 AUD 10일에

5.0

(44 건의 리뷰)

5.7

@mladenbiz

Greetings I am python developer and i have all the right tools for sorting yout your database. 1. Python a rich csv libary called pandas, that can be used for fixing existing database 2. When it comes to webscraping python has few libaries bs4, selenium and scrapy. 3. For excel sorting python has openPyxl. I think i am perfect candidate for this job. Sincerely Mladen

$722 AUD 10일에

4.8

(65 건의 리뷰)

5.8

@sonarkaushik

Sir, I am well versed in these kind of jobs and can do your project as per requirement. I have over 12 years of experiences. I am very much able to work on this. ***I am ready to start Waiting to hear from you. with thanks and regards

$489 AUD 14일에

4.7

(59 건의 리뷰)

5.8

@Proolancer

hello, Im a database administrator engineer with 8 years of experience in this industry, I already worked on big database and developed many websites and desktop apps, I can do what you want just get in touch wth me to discuss more the project. best regards Fouad

$250 AUD 20일에

5.0

(5 건의 리뷰)

4.7

@RemonRamzy04

Manual data scraping sir . Hello, sir! (First Bidder to offer this) I hope I will be awarded from you. ************I agree for any price you will set ** You can test me over chat before you award me! give it a try over chat before you award me! .. you will be %100 satisfied I saw your project and I would like to work on it . I am available 24 hours a day and I have fast response, I will be always there to fulfill your requirement. I always offer low cost and good perfect quality (Just try and see by yourself), I will make you get 100% satisfaction with the best quality service. I will be very happy to work with you, and I hope you too. Thank you

$250 AUD 3일에

5.0

(19 건의 리뷰)

4.4

@dionisiotumbaga

Hi, I am interested. I have considerable expertise in the design and development of MS Access databases. I would be happy to discuss about your requirement. Regards.

$490 AUD 6일에

5.0

(8 건의 리뷰)

4.4

@dataexplorer

"Hi, I have just gone through your project description and reviewed everything. Yes, I’m able to work as per your instructions in your and able to provide accurate and quick service. You know! I’m efficient and experienced data entry worker. If you consider me for this job, I will try my level best to complete your project within our committed deadline. I look forward to hearing from you about the project. Regards"

$250 AUD 3일에

5.0

(20 건의 리뷰)

4.3

@alhassanlatif

Hi, I am a professional Access developer I have done many great projects in Access have a look at my profile Send me more details about the work

$611 AUD 10일에

5.0

(7 건의 리뷰)

3.8

@novepi

Hi there, The requiremens look quite clear. Rather than relying on Access I suggest you to create a program utilizing an embedded database(db). In this scenario, you don't have to deal with the db directly. The application will expose the features you need via a simple UI and drive the embedded db in the background. You mention that there'll be as much as 400,000+ rows but I don't know yet what each row composed of like how many fields are there, how long, its type, ect. We have several options for embedded db but it's better if we pick one after I take a look at your current db and possibly running some small tests on it. That'd also depend on your performance expectations like how quick would be quick enough for you, e.g for filtering - 1 sec. , 5 sec., ect. Excel formulas feature is another story. Obviously, we can't simply transfer the data into excel and apply the formulas, that'd be terribly slow. If there was only predefined formulas, not to be amended later, things'd be rather easy. To make that possible the program should at least understand a subset of excel formula directives. If there're not many you plan to use and/or the formulas are not too complex that's doable otherwise not, at least not within the scope of this project. No need to mention other requirements, it's all good and straightforward. I am planning to create this as a winforms application using c# to implement and expect this to take 15 days, thanks.

$1,500 AUD 15일에

5.0

(4 건의 리뷰)

3.6

@Rstanjim

-----Hello Sir,I can do that your full project .Ready to start Now and completed ASAP "----------- Thanks Reply

$250 AUD 10일에

5.0

(2 건의 리뷰)

2.6

@inforajes

Hi, I will convert all your access data into sql server then you can store large number of data and easy to maintain and use. I will do the Web scrapping using selenium in Windows applications. So it will be easy to use for you. I will also add option to merge, delete, insert data and download reports in excel or csv format. Let me know if you are interested Thanks, Rajesh

$722 AUD 5일에

4.9

(3 건의 리뷰)

2.6

@pinesucceed01

Hi there, I can convert this database in MYSql, if you prefer then please come on the chat to discuss, and i am okay with your payment terms as well. Thanks

$555 AUD 10일에