멀티 스레딩 프로그램으로 웹스크랩핑을 하는데 프록시 아이피를 셋팅해서 여러 아이피로 접속해수 수집함
웹스크랩해서 얻은 빅데이터를 인공지능 분석 기능을 사용해서 Block chain으로 데이터를 관리하는 시스템
php, mysql, word press, bootstrap, jquery , ajax, html5 (모바일웹, 앱) 기술 우대
I'm in need of a skilled programmer to create an automation code page for me. This code page will be focused on text processing, so a strong understanding of working with textual data is essential. Key Requirements: - Proficient in JavaScript: The automation code should be written in JavaScript to ensure compatibility with other platforms. - Automation Experience: The primary function of this code will be automating tasks. A proven track record in building automated processes is highly desirable. - Text Processing: The code must be able to accurately and efficiently process textual data. Experience in this field will be a huge advantage. If you have experience in JavaScript, a background in automation, and a strong fami...
I need a professional who can extract data from a website on a daily basis. Key Responsibilities: - Extracting data from a specified website - Ensuring the data is accurate and ...who can extract data from a website on a daily basis. Key Responsibilities: - Extracting data from a specified website - Ensuring the data is accurate and up to date - Delivering the data in a specified format Skills and Experience: - Proficient in web scraping and data extraction - Experience in automating data extraction processes - Ability to maintain data accuracy and consistency - Knowledge of relevant data formats for delivery - Strong attention to detail and reliability This is an ongoing project, and I need someone who can commit to daily extractions. Be sure to include r...
...essential that the software is designed to run on Windows OS. Website Accessibility: - Restricted access: Websites that require restricted access or login should be identified and reported separately. The software should skip such pages and indicate them as inaccessible. Ideal candidates should possess: - Proficiency in software development and experience in creating similar tools. - Familiarity with web scraping, data extraction, and bulk processing. - Prior experience in creating Windows-compatible software. - Strong attention to detail and the ability to accurately handle and report inaccessible URLs. As the client, I am open to the choice of programming language(s), as the final product is more important to me. The primary goal is to have a rel...
I'm in need of a proficient PHP developer to take on a range of responsibilities for my project. You'll be handling both the front and back-end development, as well as maintaining the website. I'm looking for someone who has a strong background in PHP, not just with creating and managing dynamic and interactive web pages, but also maintaining them for optimised performance. Key Responsibilities: - Handling front-end and back-end development - Carrying out website maintenance You must provide examples of your past work in your application. We appreciate attention to detail and a deep understanding of PHP. Since I will provide all the content needed for the website, you can focus solely on the programming side of the task. Y...
I'm looking for an experienced NodeJS and JavaScript programmer to help me with a school project focused on exploring cybersecurity concepts. Key Requirements: - The task involves writing a client request to obtain a flag from a vulnerability site with advanced complexity (e.g., bypassing security measures). - The project involves emphasizing on Remote Code Execution (RCE) and pollution while interacting with the vulnerability site, so experience in these areas is a plus. --- Challenge Name: Emu Apothecary Category: Vulnerabilities Description has just opened up their potion brewing website for other Emus to create new potion recipes! However, they are afraid that one of the human hackers will pollute their ingredients. Can you get Remote Code Exec...
...of organizations. The ideal freelancer for this project should have: - Experience in web scraping, particularly with LinkedIn data - Ability to extract data at scale - Proficiency in organizing and structuring data for clear analysis - Strong attention to detail to ensure data accuracy The project involves: - Using the provided list of target companies to source employees' data - Identifying individuals who have previously worked at the provided specific companies - Compiling the data in a spreadsheet format for delivery The successful applicant should not only have the required technical skills but also the capability to deliver quality and timely results. Please showcase your experience in web scraping and the relevant tools you...
I'm looking to develop an end-to-end HRMS PHP application that can efficiently manage a large workforce of over 100 employees. Project Details $30.00 – 250.00 USD HRMS Portal Development - Employee Management, Payroll Management, Time and Attendance Management We are looking for a skilled developer to build a customized HRMS portal with the following features: - Employee Management: ability to manage employee data, records, and information - Payroll Management: ability to manage payroll processing and payments - Time and Attendance Management: ability to manage employee attendance and time tracking The preferred technology stack for this project is PHP. We require moderate customization of the HRMS portal, including customizing the user interface and adding...
I'm looking to create a website using Codeiner PHP. The website will be a platform for showcasing my work, sharing information, and possibly more features in the future. Key Requirements: - Development of a website using Codeiner PHP Ideal Skills: - Proficiency in Codeiner PHP - Experience with website development, particularly with portfolio websites
i have one php script which used to load in a few seconds now takes 4 minutes not sure why it suddenly lags need optimised - the mysql query hittin some bottleneck somewhere by looks of it
I'm in need of a skilled individual who is proficient in both PHP and Google Gemini. The primary task is to integrate this platform with my PHP website. Key requirements include: - Basic data syncing: The main goal is to ensure that the PHP website and Google Gemini can share important data seamlessly. This includes basic data such as user information, clicks, and impressions. The ideal candidate must have: - Demonstrated expertise in PHP and Google Gemini. - Prior experience in integrating Google Gemini with websites. - Strong communication skills to understand my requirements and provide updates on the integration process.
...Content Management (Articles, Quizzes, Categories) - Feedback Management - Notification System (In-App, Push) Other Key Features: - Secure Admin Authentication - User Management (Roles, Permissions) - Content Packaging & Distribution - Content Localization - Import & Export Functionality - Settings & Integrations - Security & Compliance - Performance Monitoring & Optimization The ideal candidate should have: - Proven experience developing admin dashboards - Expertise in Flutter, Firebase, PHP - Strong design sense for clean UI/UX - Knowledge of user management, data viz, content systems - Ability to ensure security, performance, compliance Your role will be to implement these features using PHP (or else) and Firebase. I'm ope...
I need a Python developer to create a bot that scrapes data from APIs on an hourly basis. - The bot's primary function is to scrape data - The data will be sourced from APIs - The bot needs to run on an hourly basis Ideal candidate: - Proficient in Python and API data scraping - Familiarity with creating bots - Able to ensure smooth hourly operation, possibly using a scheduling library such as APScheduler
I'm looking for a proficient professional who can effectively scrape leads from LinkedIn, Facebook, and Instagram and all over the internet Key responsibilities...* Collecting specific data - Name, Job title, Company, and Location, email and phone numbers Ideal freelancers for this project should have: * Extensive experience in data scraping, especially on the platforms mentioned above. * Proficiency in data mining techniques and possessing advanced analytical skills. * Understanding of ethical data scraping practices. * Strong attention to detail - ensuring all data is accurate and up-to-date. * Proven track record of delivering quality leads in a short timeframe. Get in touch if you're up for the task. I value clear communication an...
I need a professional who can analyze the logs of my Apache PHP-FPM server and help me troubleshoot errors. The main focus of this task is to identify and resolve any issues that might be impacting the performance of the server. Key Requirements: - The ideal candidate should have a solid understanding of Apache PHP-FPM logs and their structure. - Good troubleshooting skills are necessary to pinpoint the root causes of the errors. - Ability to present the analysis results in a detailed report is crucial. The main goal is to ensure the server is running smoothly and efficiently. The server use Centos 7, Apache and PHP 5.6
I will pay no more than 30 dollars for this work. Please do not send a bid if you are going to offer a higher price. I'm seeking a skilled PHP programmer proficient with Cora. The goal is to automate the sharing of articles from my website to my business Facebook page. Key requirements: - Automate sharing: I want the programmer to ensure that whenever a new article is uploaded to my website, it's automatically shared to my business Facebook page. - Cora PHP programming: The ideal candidate should have experience with Cora PHP programming, specifically related to integrating website content with Facebook. - Facebook page sharing: The articles should be shared only on my business page, ensuring they reach my target audience. Your duties ...
necesito persona que me ayude a hacer scripting en PHP- I need someone to help me do PHP scraping
Es necesario realizar una migración la versión 5.6 de PHP a la 8.3. Tiempo aproximado de contratación dos meses.
I am seeking a PHP developer to bring my interactive website vision to life. Key Project Requirements: - The website will require interactive features, enhancing user engagement and experience. - The project demands a high level of proficiency in PHP, as this language will be the backbone of the site. - Skills in HTML, CSS, and potentially JavaScript will also be required to ensure a seamless and visually appealing interface. Ideal Candidate: - Proven experience in developing interactive websites using PHP. - Strong knowledge of front-end technologies to ensure a responsive and visually appealing design. - Excellent communication skills and the ability to understand and translate my vision into a functional website.
...proficient in Angular and PHP, with previous experience in integrating new features. This is for a project that involves: - Frontend Development: Enhancements and integration of Angular components into an existing website/application. - Backend Development: Implementation of necessary PHP functionalities to support the new features and ensure smooth operation of the site/application. - Database Integration: Synchronization of the updated features with the database, and ensuring consistent data flow and storage. The primary goal is to integrate CMS features into the existing system. Your role will include planning, execution, and testing to ensure that the new features are successfully integrated. Ideal candidates should have: - Strong knowle...
I need a PHP expert to help me fix a translation bug in my system. - The issue specifically affects the English language version of my website, disrupting various interface labels. - It's essential the freelancer is proficient in identifying and rectifying translation bugs in PHP. Your expertise will be invaluable in ensuring my platform is user-friendly and accessible to all English speakers.
I'm in need of a PHP page that helps our agents to send an order. This page should be intuitive and user-friendly while ensuring all necessary information is captured. The platform should be interactive and user-friendly, ensuring a smooth order submission process for our agents. Ideal Skills: - Proficient in PHP - Strong experience in web development - Knowledge in creating secure web forms - Experience in agent-based systems would be a plus Please bid for this project if you believe you have the skills and experience needed to deliver a high-quality, efficient, and secure PHP page for our agents. Our customer sells products (not online, but in shop). He wants to receive orders from agents. I have an excel file cont...
...Web Scraping specialist to write code in Python (preferably) that scrapes a specific table from a website for me (Website: ). The table contains WNBA player statistics, The goal is to extract all columns of this table, which is approximately 7 columns and write it to a CSV file (in the same column format). I'm a beginner level coder, and noticed that the table was created with that looks like a Shiny App in R. (I'm not even sure if extracting the table is possible). If it was only possible to use R, then I could potentially work with that. Website: I would like the data to go from the year 2020 to current. Regular Season data. Key Requirements: - Scraping Tables on websites If you're confident in your
I am looking to establish a long-term relationship with a talented person to scrap thousands of dating profiles from popular dating websites. This person should have years of experience dealing with the various countermeasures these sites will employ to discourage scraping. The use of proxies may be needed to achieve satisfactory results. The end goal to to have a system capable of delivering 20K - 40K profiles per day.
I need a VRBO scraper to extract property details, pricing, and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. - The scraper should be able to handle multiple URLs at once. - The code should be well-structured and commented for easy maintenance. Ideal skills: - Proficiency in Python - Experience in web scraping - Understanding of VRBO website structure - Ability to handle and store data in CSV format
I need a web scraping professional to create a script to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) - Twitter activity per card View Views+ Likes Likes+ Retweets Retweets+ Replies Replies+ Quotes Quotes+ Bookmarks Bookmarks+
I'm seeking a Python developer experienced with web scraping. This job involves setting up a Python script that can scrape a popular review site. Key details to extract: - Review text - Star rating - Date of review - Reviewer name - Star-ratings for sub-categories - Review ID - Reviewed person - Reviewed product name The site does not use captchas, so it should be reasonably straightforward. All reviews for a given provider should be scraped. It would be good to have an option to start with the newest and stop at a certain date. The specific review site can be seen in the sample URL in the attached PDF. I can send further details in a private message including screenshots. Preferred frameworks would be Beautifoulsoup 4 / Scrapy if suffic...
...for more money. The Project: Develop the project in NodeRed Monitoring specific "HTML div elements" from different web pages using Node-Red (different flows). Objective: Identify when there is any change in the DIV section of the webpages (every "x" seconds) and notify me of the change. It is not necessary to show what the change was. Just send the hyperlink by Telegram, including the subject of the flow. Requirements: Create a Node-Red project that can detect changes on multiple websites by creating flows. Include 2 example flows to demonstrate how the monitoring works. Provide detailed instructions on how to create a new flow for a different webpages, indicating what needs to be extracted/copied to set up the new flow bymyself in the ...
...one-time data scraping project completed on multiple websites. - TASK: The task involves scraping text content from: Google searches: Commercial Real estate agency Saudi Arabia Commercial Real estate agency UAE Commercial Real estate agency Qatar Commercial Real estate agency Kuwait Commercial Real estate agency Bahrain I have made a start to the spreadsheet with a template for each of the regions which can be continued to be filled in. In the Google searches, just take the first 3 pages with the main agent listings and see what agent names/ email addresses you can find. - DATA REQUIRED: The primary data needed is text content. - TIMELINE: This is a one-time task, with no ongoing scraping requirements. Skills/Experience...
I need a developer who send me the php code to contruct a php proyy to embed a m3u8 file with CORS restriction. I can provide you some url examples with m3u8 file which initially you can't embed in other domains, but i've seen that some website with some php code avoid this restriction. Send "I HAVE READ IT" in you bid. I only will pay if you send me the code and it works fine. Note: I need the code in php
I have this proyect and I am looking for a developer that has time available to work on the proyect. It is a long term proyect. I need someone with experience in PHP, Laravel, HTML I need to create a copy of a product page. Here is the info needed on the page;
I'm looking to test database scraping on a website to extract names and potentially contact emails (if available). The data doesn't necessarily need to be organized or cleaned post-extraction. Ideal Skills: - Proficiency in web scraping tools - Understanding of database structures - Familiarity with handling contact information The data should be organized in an excel and csv based on the desired layout.
Help me with existing project to optimize the performance of core functionality and add some basic new functionalities. If you're genuine bidder then please write "php&python" in starting of your bid. This is kind of urgent and need to do it in around 1-2 weeks.
I require a specialized web scraping professional with experience in extracting text and images from multiple websites. Your task will involve the following: - Scrape data from Sephora, Cult Beauty, Space nk - Extract specifically the Text, Images, Titles, Descriptions, and Prices A strong background in web scraping, data extraction, and working proficiently across different websites is critical for this project. Knowledge in web parsing methods and ability to bypass potential anti-scraping tools or blocks set up on these websites will be highly advantageous. Your goal is to accurately scrape the necessary information without causing disruption to the target websites, and ensure the data is comprehensible and ready for further use. I w...
I need an experienced Python developer to assist with a project. The specific tasks will be discussed directly with the successful bidder. I am looking for someone who is well-versed in Python and has a strong foundation in programming. Expectations: - Ability to work independently and problem-solve - Can communicate effectively and provide updates - Previous experience with Python is a must - Familiarity with data analysis, web scraping, or automation is a plus.
Start your offer with the word in the attachment, otherwise we dropp you out. We are looking for a database with websites, HAVING EMBEDDED YOUTUBE Videos on their sites. Prepare a list with : Name of the company, youtube Channel, Link to the first youtube video you find on the site, PLZ, City, State, Phone, Mail, Website Niches: Construction Systems in Austria, Germany and Switzerland Phsiotherapeuts in Austria, Germany and Switzerland I would like to have at least 2000 websites with top-quality data. Delivered in 1 day. Delivery in one Excel file. Time of delivery is a key element in our decision. Offer a price for 2.000 data entries. We extend our partners for this kind of task´s. With all of them we ...
I have a PHP site hosted, but it's unfortunately not going live as intended. I need a skilled PHP developer to troubleshoot the site, identify the issue, and implement the necessary fixes to ensure it functions correctly. Key Deliverables: - Diagnose the issue causing the site to not go live - Implement the necessary fixes to ensure the site functions as intended - Provide me with the corrected file for future installation I'm experiencing error messages when I attempt to access the site. So it's crucial to not only fix the issue but also ensure it doesn't reoccur, making the site deployment-ready. Ideal Freelancer: - Experienced PHP developer with a proven track record of troubleshooting and fixing website issues - Strong problem...
scrape data from darty site and export it into excel file.
I'm looking for a Python developer to assist with a variety of tasks on a medium-scale project. This would include web development, data analysis, automation scripting, and web scraping. Your responsibilities would cover: - Web Development: Creating and maintaining web applications using Python frameworks. - Data Analysis: Handling and analyzing data to derive insights. - Automation Scripting: Developing scripts to automate manual tasks. - Web Scraping: Extracting and structuring data from websites. Communication is key, and I'd prefer to receive regular updates and progress reports via email. The ideal candidate for this position will have experience with each of these tasks and be able to work on a medium-sized project.
I need a Python Selenium application that can scrape blog posts from Site A and post them on Site B. Key Requirements: - The Python app should be built using Selenium for web scraping and automation. - It should be able to extract blog posts from Site A, specifically. - The extracted data must be posted on an existing blog section of Site B. Ideal Skills & Experience: - Proficient in Python, with experience in building web scrapers. - Strong knowledge of Selenium for web automation. - Previous experience with data extraction and manipulation. - Understanding of web protocols and site structures. - Familiarity with blog post formatting and publishing is a plus.
Hello All, We are an established IT services provider with 13 years of experience and a team of 25 in-house developers. Currently, we are looking to hire some freelancers because we are at full capacity and do not have sufficient resources to handle some of our work. We are seeking a long-term partnership and are willing to provide 20-30 hours of work per week. We welcome both experienced freelancers and those new to this platform who have significant prior experience, such as working in a company before starting their freelance career. This job post is open to all qualified candidates. Now, let's discuss the job requirements, which are urgently needed: We require an expert Laravel Developer who is well-versed in third-party APIs. The candidate must hav...
I'm in need of a skilled freelancer who can perform daily scraping of job titles from Indeed. Ideal Skills and Experience: - Proficient in web scraping, particularly from Indeed - Able to automate the scraping process on a daily basis - Competent in delivering data in CSV format Data Update Frequency: - It's essential that the scraping is carried out daily Delivery Format: - The scraped data should be provided in a CSV file Looking forward to your proposals.
...site which needs a complete makeover. I'm looking for a developer with strong PHP skills to implement the necessary changes. Specifically, I need a talented individual to customize the theme of my WordPress website, focusing on the color scheme, layout structure, and font styles. Key Responsibilities: - Customize the color scheme of the website to align with our brand identity. - Implement changes to the layout structure of the site for improved user experience. - Modify the font styles across the website to achieve a consistent aesthetic. Ideal Skills and Experience: - Strong proficiency in PHP, with experience in WordPress. - A portfolio demonstrating successful customization of WordPress themes. - A good eye for design, with...
I'm seeking a skilled freelancer to assist in collecting email addresses for an upcoming email marketing campaign. The ideal candidate will have experience and expertise in web scraping, particularly from social media profiles, professional networking sites, and company websites. Key Responsibilities: - Collect email addresses from social media profiles, professional networking sites, and company websites. - Ensure the collection is accurate and up-to-date. - Provide the email addresses in a well-organized manner, making it easy to integrate into our marketing campaign. Target Industries: The primary focus for this collection is media, video production, photo production, TV production, film production, and music production. This means that your understan...
