Scraper eCommerce

We would need an application that retrieves data from the a.m. site: 1. the ability to set the start time of the scraper loop, i.e. I set that every day at 21:00 the loading starts 2. division into food and non-food items (two separate files with data (xml with tables of cdata parameters would be great, or csv with sensibly separated columns, so that it was mega easy to make a table in the import to woocommerce) 3. the ability to choose which data we want to save in the csv file (some checkbox or other simple solution) 4. csv file construction ideally as if it was according to wp all import plugin documentation [login to view URL] 5. how would it be possible to make the file also contain "variants" i.e. Prices on chefsculinar there are usually two and sometimes three or one ( unit pack, bulk and sometimes probably a kilogram or something similar unfortunately I can not find the one with the need for prices :( and if you could import these two prices in the form of a product with variants it would be meeega! Generally the price is always just multiplied by the quantity (which is indicated) rally so it can be read or somehow calculated simply 6. it would be great if the file with the data was uploaded to ftp (update automatically when the scraper is finished - it is important that the file has the same name each time) and in parallel in a separate directory (then the files added with dynamic values such as date and time of scraping to archive prices and the ability to analyze price changes over time) 7. the Sceaper can run in the cloud and it can run on Windows or Linux locally on a computer that is always on and has access to the network 8. unfortunately, the site is not very properly built and is relatively slow (I think) and unfortunately there may be some modifications in the query so we would need a tool that will have the options to "adjust" to the conditions dictated by the chefs - it is known that we are unlikely to solve this by automation In a nutshell - the tool can be clumsy, ugly (although if you want I can make a nice graphic interface) as long as it performs the basic function - downloading data - above I have listed the ideal functions of the tool, but if it will be a problem, please skip it and propose a basic tool, attached I send a sample csv from the now sadly defunct scraper, the exe file of the same I also throw in