Hi I'm looki g for some one that can provide the following
1. A database which I can run on my desk top which allows me to scrape x number of sites and extract product data In a structured format from all of these. I don't want to be limited fixed number if sites so please don't ask questions such as which url and how many products. I'm happy to share these details with winning party but it should not matter as I don't want this fixed or restricted.
2. A data base of suppliers which also captures all products the supplier sells and those that map back to the scraped database. Again if the supplier has a website then we should be able to scrape it in order to extract all information easily rather than manual entry. In most cases suppliers will provide us with password details to access product pages. Please take this into consideration.
The intent is that we want to mange our suppliers. Those that we doe business with and those that have products in line with our scraped database. The scared database is our intelligence in the type of products we would like to sell. The supplier data base are the companies that can supply us similar goods. We will obviously not be doing business with all suppliers but where we are the database should be able to track transaction history.
The database should be user friendly and easy to use. Very visual with product images appearing clearly.
The scraping data base should have some level of intelligence built in so that it can suggest which suppliers may be ae to provide similar products.
There should be a dash board page which is able to provide some key over arching stats / mamsgemr information in a nice infographic style similar to power BI if possible. Should be able to capture QR barcode and product sku codes.
I'm particularly interested in hearing from those people have already implemented supplier and customer databases along with tslanted scrapers. For those of you that have a back ground in AI I'm interested in Scrapping techniques where bots are not rejected but cleaver to adapt when they find broken links. E. G. If products are updated and url changes its dynamic in its approach.