Web Scraping Jobs

We are looking for someone who has knowledge in web scraping and building mobile apps. Please do not apply if you don't have experience in both. As we are in the final stretch of our MVP (native iOS and Android mobile app), this individual will help us finish a critical feature in the app (i.e., web scraping) + other small features and help us launch in app stores. Please take a look at the attached high level SOW before you submit the bid AND include your time commitment (hours/week) and hourly rate. We will select candidates based on the bids. The detailed SOW will then be shared with the selected candidate/s before finalizing timeline & budget. Acceptance criteria will be provided once we move forward with the selected candidates. Tech stack: Frontend: React Nativ...

I'm seeking an experienced and knowledgeable data scraping professional to collect specific information from three major platforms - RERA websites (specifically Maharashtra, Telangana, Haryana, and Delhi), Google, and Justdial. Here's what I am looking for: Details to Scrape: - Name - Mobile Numbers - Locality - City - Address - Pincode Platforms: - RERA Websites (Maharashtra, Telangana, Haryana, Delhi) - Google (DSA and Loan Agents data) - Justdial (DSA and Loan Agents data) The ideal freelancer for this job will be highly experienced in data scraping and will be able to deliver the results in an organized manner. Proficiency in scraping from Google, RERA websites, and Justdial is particularly important. Delivery Format: - The data should be delivered in an excel file fo...

Hello I am looking for a python code to scrape a large number pages and save them as html. In order to get to the page to save, you must click a radio button, submit, and then enter a string of numbers, then submit and then save the html. If the string entered provides an error then you must skip to the next iteration. There is no human verification. I already have a version I made myself that works with Selenium, however I need to increase the speed, so I am looking for someone to see if its possible to do this without even opening a browser and possibly using direct call methods (get, request, cURL, response, JSON?). It should be a simply project for someone who knows how to do this. Please enter the result of 3+2 for your message to be received.

I'm looking for a skilled data scraping professional to assist me with a project. I had a working script in Python using an API, but the company implemented a Cloudflare protection that is always blocking me. You would need to find a solution how this could be circumvented (e.g. proxies) and large amounts of data be scraped. If you are interested, I am happy to provide more details privately.

I'm currently seeking a skilled freelancer for a data entry job concerning primarily text data. The data to be entered will be provided in an Excel spreadsheet and will need to be accurately transferred to an online database. Ideal candidates should have: - Proficiency in Microsoft Excel - Experience with data entry into online databases - Attention to detail and accuracy Please place your bid based on the information provided, and get ready to embark on an engaging and fulfilling data entry task.

I'm seeking a Python developer with experience in Playwright to complete my existing code. Key tasks include: - Reviewing the existing codebase. - Identifying and fixing bugs. - Completing partial functionalities if any. Ideal candidate should have: - Prior experience with Python (Playwright). - A strong understanding of web scraping and UI automation. Please provide examples of your past work in Python (Playwright) along with your bid.

I need a tool that can search multiple sheets in an Excel workbook and copy specific rows to a new sheet based on manual selection. The core requirements of the tool are: - Searching across multiple sheets to find specific data. - Allowing me to manually select a specific number of rows from the search results for copying. Given these criteria, the ideal tool would be: - Capable of working with Excel files. - Providing a user-friendly interface for easy manual selection. If you have experience with these requirements, please reach out.

I’m looking for some help doing a bit of automation with headless browsers. I have some scripts working already using node.js and playwright but need some support and help with the scripts. I'm also open to using puppeteer or selenium if needed. Will pay hourly for support. Thanks!

I'm in need of a skilled programmer to assist me in automating daily pricing updates from a specific website. The script should pull the pricing information and update it into our system. Key Requirements: - Develop a script that can extract data from a website and automate the pricing update process - The script should be able to run daily, without manual intervention - Ensure the script is robust and can handle occasional changes in the website's layout without breaking Ideal Skills and Experience: - Proficient in web scraping and data extraction - Experienced in script automation, particularly on a daily basis - Familiarity with handling data within a business context - Ability to create a reliable and sustainable solution, accommodating for potential changes in the website...

I require a professional data scraper to scrape multiple websites. Key tasks include: - No limitation on type of data scraped as this was not specified. - Scraping must be done across multiple websites, specifics will be provided upon project commencement. - All data should be delivered in Excel spreadsheet format. Ideal skills and experience: - Prior experience in web scraping across multiple diverse websites. - Proficient in using different scraping tools. - Strong understanding of Excel and data parsing. - Attention to detail and commitment to high quality, error-free work.

We are in search of an experienced Web Scraper to uncover price points across multiple websites and categories for us. Key Requirements: * Compile pricing information from the following platforms: Amazon, , , , , , , , , , nykaaman.com. * The scraping project should cater to several products and categories rather than specific ones. * Implement scraped data directly into the backend of our website using PHP. Ideal Skills: * Proficiency in web scraping scripts and tools * Deep knowledge and experience in PHP programming * Familiarity with the aforementioned websites' structures and processes * Ability to handle data scraping projects from a wide range of product categories Your work will streamline our price comparison efforts and significantly contribute to our decision-making ...

I'm in need of a custom automation tool that can fill forms on about 10 different websites. The tool will need to be able to input the following information: - Username and password - Contact information (name, email, phone) - Address -A Couple more details (Text me for full list of any possible data it would need to fill) its about 10 websites and they are all rather simple & its only 2-3 websites with a captcha out of the 10 and for those I would like for the bot to pause let me enter it then continue. A Couple forms input must be randomly generated, Most of the forms should be entered from the data I inputted for this run and a couple boxes will stay completely static with the same info across every run. I would like to start with these 10 sites then once we have the automati...

I need a wide range of details about accommodations on , downloaded for analytical purposes. This data should include room availability, pricing, customer reviews, accommodation rate variances, photos, addresses, and phone numbers. - Essential Skills and Experience: 1. A strong understanding of web scraping tactics and data extraction. 2. Proficiency with 's platform and data structures. 3. Data organizing skills to deliver finalized data in CSV format. The outcome I envision is a well-organized CSV file that can further my research and analysis goals. A successful delivery will require attention to detail to ensure all requested information is included. Please bring forward your innovative solutions and reliable data handling methods.

I'm looking for an experienced Python programmer to help me build a custom script for data extraction. - Data Extraction: The script will be primarily focused on extracting information from articles and publications. Specifically, I'm interested in acquiring author information, publication date, title, and URL. The extraction needs to be driven by SEO searches. - Usage: The data that is extracted will be used for content creation purposes. Therefore, I need the script to be able to provide a clean and easy-to-use output that can be utilized in this context. Please include examples of your past work in your application. The ideal freelancer for this job will be proficient in Python, have experience in data extraction, and be able to deliver a script that is reliable, efficien...

Seeking freelancer(s) who can assist in lead generation, setting up appointments, subsequent follow-up within the process control automation industry. - Industry: Process Control Automation & subsidiaries - Task: Appointment Setting - Type: Lead Generation & follow up Your primary task will be finding, connecting with potential clients within this specific industry. You shall have to find the clients data & then update it in our CRM as you identify potential persons. We shall provide some training & mock sessions. We shall take care of all the technical items, conduct the meeting and we shall encourage you to attend the meeting also, if OK. Eventually we may have you focus on a specific wing of this industry. Ideal Skills: - Strong communication and negotiation skills -...

I need a professional who can scrape product prices from Starbucks and Dunkin Donuts' websites. The main focus will be Coffees, Beverages, and Food items. Key Requirements: - Scraping: Extract product name and price from two apps/websites. - Data Organization: Provide the scraped data in a clean and organized format. Ideal Skills: - Proficient in Web Scraping: Experience in scraping data from various websites. - Data Management: Ability to organize and present scraped data efficiently. This project will require attention to detail in maintaining the data integrity throughout the scraping process. The scraped information should be accurate and up-to-date.

I need emails from these companies of CEO ot anyone else working in financials, sales, or partnerships. Data scraping from rocketreach of the emails of the people that you can find with relevance from these companies in the image. Excel sheet with company name in the rows and in the 3 columns full name, email and position in the company

Data entry operator and my work very clear

I'm looking for a skilled developer to create a one-time scraper for the TruePeopleSearch website. The scraper should focus on extracting addresses and phone numbers, and the output should be in CSV format. Key Requirements: - Develop a scraper for TruePeopleSearch - Extract addresses and phone numbers - Output the data in CSV format Ideal skills and experience for this project: - Proficient in web scraping - Experience with scraping tools and techniques - Proficient in CSV formatting - Understanding of data extraction from websites

Hello, We are currently seeking a talented freelance professional proficient in SCO OpenServer, Python, Progress, and ideally with a grasp of the Microsoft Power platform. Our recent project, conducted in collaboration with an external consultant, involved setting up a data extraction system from print files using a Python script, subsequently transferring them to a Power Automate flow. With the conclusion of our collaboration, we're now seeking to establish a sustainable solution for the ongoing maintenance and development of this system. If you're proficient in SCO OpenServer, Python, Progress, and ideally the Microsoft Power platform, we want to talk to you! Our team is looking for a freelance professional to maintain and develop our data system.

I’m seeking a data expert to scrape a specific database and transfer all available fields into an Excel (.xls) file. The database consists of approximately 150,000 entries. Each record includes data such as name, business name, contact information, date of foundation, etc. Ideal Skills: - Strong experience in Web Scraping - Proficiency in transferring data into .xls format - Attention to detail to ensure all available fields are captured Purpose and Deliverable: - The objective of this project is to use this information for data analysis. - The final output will be an Excel (.xls) formatted file containing each scraped database entry. Operation Specifics: - You would be required to locate and scrape the database by Zip codes. - A full export of all accessible information per ...

I need an assistive hand in a data extraction task that requires sharp focus and meticulous attention to detail. The task involves: - Extracting email addresses from an Excel spreadsheet - Maintaining accuracy and precision during the data entry process, ensuring no data is missed or inaccurately entered Proficiency in Microsoft Excel is a must for this task. Previous experience in data extraction or data entry is highly desirable. You should be adept at handling large volumes of data, have a keen eye for detail, and are able to keep track of your progress systematically. Let me know your capacity per day/week as this can be an ongoing project. Please dont negotiate on the price beyond the Bid provided

You will need to extract information from two mobile apps and place them into an excel spreadshet for the purpose of market analysis. You will need to create a list of locations shown on each app within a specific geographical location. This list must include: app, name, address, location type, borough.

We are looking for an individual to collect data and place into a spreadsheet. You will need to extract information from two mobile apps and place them into an excel spreadshet for the purpose of market analysis. You will need to create a list of locations shown on each app within a specific geographical location. This list must include: app, name, address, location type, borough.

I'm looking to hire an experienced data scientist or researcher to gather data on trending topics from Twitter. Here's what you'd do: - Leveraging Twitter's API or any robust scraping tool, you'll gather and record data around trending topics globally or as requested. - After collection, these data will need to be organized in a clear, concise and easy-to-read format. Skills & Experience: - Experience with data collection on social media platforms, particularly Twitter - Strong understanding of Twitter's API or proficient in web scraping techniques - Ability to interpret and analyze collected data effectively Please only bid if you're comfortable and experienced with large-scale social media data collection and analysis. The specific data poin...

I am seeking an expert in Google Cloud's Pub/Sub service. My Python application needs to publish and subscribe to text data messages. Knowledge in message encoding and decoding, as well as Pub/Sub client libraries, is crucial. Therefore, a strong background in Python and Google Cloud Platform is required. Take a look a example image attached. Key responsibilities include: - Assisting with publishing text data messages - Helping with subscribing to these messages Please have proven experience in Google Cloud's Pub/Sub and Python programming for processing text data.

I need a Python 3 script developed that continuously operates with the Lauterbach Trace32 system. This script must perform automated actions which include: - Reading data: It must access and read global variables from Lauterbach Trace32. - Modifying data: It should also make changes to the data in the Trace32 system as required. Ideal skills and experience: - Strong knowledge of Python 3 programming essential - Good understanding of Lauterbach Trace32 to ensure seamless integration. - Experience with scripts that operate in real time or continuously. Looking forward to working with skilled and experienced developers. Creating this intricate continuous script will greatly optimize my workflow.

I'm in need of an experienced professional who can develop a search engine to cater to specific multimedia content requirements. Key Requirements: - The search engine should be capable of web crawling and indexing multimedia content (images and videos) from various online sources. - Prioritization of multimedia content: The engine should prioritize multimedia content in its search results. - Handling multimedia metadata: The engine is expected to extract metadata from images and videos, and also perform image/video recognition. I'm open to suggestions on the best approach to implementing these features, but the end goal is a user-friendly and efficient multimedia search engine. Ideal Skills and Experience: - Proven experience in developing search engines, especially those th...

I'm in need of a skilled freelancer to scrape data from car Website . The specifics of the data extraction are as follows: - I require product details and price information from the site. - The main task involves capturing a comprehensive car database, including all car brands and models present on the site. The focus here is on the complete car directory, not just specific brands or models. If you have experience in web scraping, particularly in the automotive sector, this project is for you. Accuracy and completeness are key, as the success of the project hinges on the comprehensive nature of the dataset. I attached RAR file (Scraping code). by running this script, fetching yourself full database of cars. pocketbase queries to supoprt filters and run them on pocketbase server...

Please Sign Up or Login to see details.

python chrom headless script which will visit given list of URLs/websites aftear each config delay in seconds. script will use different ip in each iteration of list urls visit. it will keep running untill ip list end and start from 1 again. You will suggest from where i will buy rotating ip proxies which not blocked by the urls. Purpose of this script. visit given list of urls with different ip proxies. rotating ip proxies will be fine these are example urls: one is this link : second is this link: third is this link: 4th link:

python chrom headless script which will visit given list of URLs/websites aftear each config delay in seconds. script will use different ip in each iteration of list urls visit. it will keep running untill ip list end and start from 1 again. You will suggest from where i will buy rotating ip proxies which not blocked by the urls. Purpose of this script. visit given list of urls with different ip proxies. rotating ip proxies will be fine these are example urls: one is this link : second is this link: third is this link: 4th link:

I need help in extracting or scraping customer data from Telegram channels and Groups. The main goal is to invite these subscribers to my own channel. Key Results: - Extract or scrape customer data from specified Telegram channels or Groups - Provides a complete list of extracted customers - Ensure customer data is ready to easily import into my channels for invitations Ideal Skills & Experience: - Proficiency in web scraping tools and techniques - Experience with Telegram algorithms - Experience with Telegram API or similar platforms - Proven track record in handling and managing large amounts of data - Strong communication skills to provide detailed project proposals Please ensure that your application contains a detailed project proposal. Note: I'm not an admin, I'm ju...

Read messages on WhatsApp, parse selected message for specific data and then update a website page with scraped information. This needs to be for Windows 11 and, if possible, quote also for apple apps (iPhone and iPad). Must include include piracy protection for windows and must be able to publish on apple store. It will have a free trial period (3 day at the moment). I do not expect more than 200 users max but they all know each other.

I'm in need of an experienced web scraper, proficient in Python, to gather pricing data from a range of websites. Key Requirements: - The scraper must specifically target and extract pricing information. - The project involves scraping data from a moderate amount of websites (between 1 to 5), so the ability to efficiently manage multiple sources is a must. - The final delivery should be not just raw data, but organized and cleaned data. Ideal Skillset: - Proficient in web scraping tools and techniques, especially with Python. - Experience with handling and cleaning data. - Ability to manage multiple sources of data effectively. - Experience in working with pricing data is a plus. Please bid if you meet these requirements and can deliver efficient and well-structured results. Than...

Hello, can I make a chatbot like that feature, how much would it cost. M-Jarvis Keyword Analysis Tool Features 1. Multiple keyword search volume at the same time (up to 5 possible!) - Enter comma between keywords ex.) Keyword 1, Keyword 2, Keyword 3, Keyword 4, Keyword 5 2. Inquiry of detailed data on Naver keyword search volume - Put * after keyword ex.) Keywords* 3. Naver Advertising Power Link Unit Price (CPC) Inquiry - Put a keyword after a keyword ex.) Keywords 4. Naver Keyword Top Exposure Blogger Top 5 Inquiry - Keywords followed & pasted ex.) Keywords & 5. Search online shopping mall-related search terms including Naver shopping - after a keyword ex.) Keywords/ Applicable functions

I am in need of an expert who has access to Rocket Reach for email procurement. Unfortunately, I do not have information on industry targeting or the exact number of emails needed at the moment, but this will be provided during the project process. Important skills: - Experience with Rocket Reach - Attention to detail - Experience in lead generation and email mining Please be prepared to discuss your approach to these tasks.

I'm in need of a skilled Python developer proficient in a variety of tasks. Tasks: - Web Development: Creating a responsive website using Django. - Data Analysis: Working with various data sources like Databases, APIs, and Spreadsheets. - Automation Scripts: Developing scripts to automate specified tasks. The ideal candidate should have: - Strong experience in web development with Django. - Proficiency in data analysis and integration from various sources. - Excellent skills in script automation. Please apply with your relevant experience in Python, particularly in these specified areas. Thank you.

I am in search of skilled data miners to assist with a project that involves extracting employer information from Indeed.com. The focus is on identifying businesses hiring in three specific categories: CDL drivers, accounts, and healthcare, located within the Bucks County addition to basic details, I require the extraction of contact numbers, email addresses, and website links for these businesses. If you have experience in similar data extraction projects and are interested in this opportunity, please respond with your availability and any relevant examples of your past you for your consideration.

I'm looking for a professional who can develop a standalone web scraper for Envato Requirements as provided here - Looking for someone who can begin immediately and finish this within 24 hours. Please only bid, if you're able to finish this in 24 hours

I'm in need of a developer skilled in Python or a similar language to create a program that will scan multiple websites for broken links. Here are specific requirements: - The focus should be on external links; internal links are not of interest in this project. - The program must be able to detect and report Dead external links and Error 404 links. - The output should be provided in a text file format. Experience in website crawling and parsing, and a strong understanding of web protocols and formats (HTTP, HTML) are needed for this job. Experience working with similar projects would be a major bonus.

I'm seeking a skilled creator to develop a Chrome-compatible web extension that mimics the functionality of but specializes in scraping AI data from the web. Key features required: - Able to scrape AI data efficiently from various sources on the internet. - Streamlined and user-friendly, optimizing for the best user experience. Ideal candidate should have: - Experience in building Chrome extensions - Understanding of web scraping techniques - Familiarity with functionality - Robust knowledge of artificial intelligence.

I'm in need of a skilled professional who can diligently carry out a large volume of data entry involving text, numbers, and images. The data is to be accurately entered into an Excel spreadsheet. Ideal Skills: - Proficiency in Excel - Accuracy in data entry - Ability to handle large volumes of data - Familiarity with processing text, numeric, and image data The right freelancer should have substantial experience handling this type of project and able to demonstrate precision and attention to detail.

I need a professional who can scrape product prices from Starbucks and Dunkin Donuts' websites. The main focus will be Coffees, Beverages, and Food items. Key Requirements: - Scraping: Extract product name and price from two apps/websites. - Data Organization: Provide the scraped data in a clean and organized format. Ideal Skills: - Proficient in Web Scraping: Experience in scraping data from various websites. - Data Management: Ability to organize and present scraped data efficiently. This project will require attention to detail in maintaining the data integrity throughout the scraping process. The scraped information should be accurate and up-to-date.

I am in need of a developer who can create: -A web scrapping process extract text content from (initially) a single ecommerce website. -A web/mobile application that read the extracted data and inform on data change. This app will have: -A control panel to administer the pages to be scrapped and the details (like filters). -A page to display the extracted that with action buttons to discard the element or to add new filters (based on this element). - The task involves scraping text content and related images. - The scraping process should be automated to run every X minutes (to be configured) Ideal skills for this job include: - Proficient in web scraping techniques and tools. - Ability to create and maintain an automated scraping process. - Ability to create custom mobile applicatio...

Hello, searching for real Telegram Members. U need to Scrape and Add them from specific Groups/Niche Groups, active Members only! Stay away with ur SMM Panels and fake sh**! Cheers

The Doordash driver app called Dasher requires a zip code for registration. Right now, in most states, a large portion of drivers are placed on a waiting list because there are more drivers than needed. I need to find several zip codes (5 - 10) for the Dasher application that, when entered, would prevent new drivers from being waitlisted (that is, they would be taken to the next page, and not to the page with a message that they have been added to the waitlist).

I am looking for skilled freelancers to develop an AI-powered marketplace and social media search platform with the main aim of providing personalized recommendations to its users. details of your AI-Powered Marketplace and Social Media Search Platform. With this application, users will have a comprehensive tool to search and analyze various online marketplaces, social media platforms, and advertising libraries. By leveraging AI technology, users can upload product photos or use keywords to discover where products are being sold or advertised

I am looking for a developer who can design a data uploader for my website. The primary purpose of this tool is to allow me to upload different types of files such as Excel spreadsheets, CSV files and Text files into my website's backend. Key Requirements: - Support for multiple file types: The uploader should be able to accept a variety of file formats, including Excel spreadsheets, CSV files, and Text files. - Basic Data Validation: Before the data is uploaded, I need this tool to perform basic data validation. This would involve checking for field completeness to ensure that all necessary fields are populated before the upload is allowed. Ideal Skills and Experience: - Proficiency in web development: The ideal candidate should have a strong background in web development, particu...

: logo with display menu: select option: Subdomains Directories sensitive parameters 4. SQL Testing 5. xss Testing 1- : (use this open source code) Options: -d, --domain: Specify the target domain. -b, --bruteforce: Enable subdomain bruteforcing. -o, --output: Specify the output file path. -h, --help: Display help information. example subdomain -d -o /home/Desktop/ This option leverages various search engines like Google, Bing, Yahoo, DNSDumpster, VirusTotal, SSL, etc., to discover subdomains associated with the target domain. 2- find Directories: (use this open source code) Options: -u, --url: Specify the target URL. -o, --output: Specify the output file path. -L, --WordList: Specify the directory wordlist. -h, --help: Display help information. ...