Data Extraction Web Scraping Data Mining jobs
...Java or python3 programmer to create a sensor-data generator for the website www.voeazul.com.br. The objective is to send a POST request to the site with valid sensor-data in order to obtain a particular cookie (_abck) for data analysis purposes. The sensor data to be simulated includes mouse movements, keyboard interactions, and browser interactions. Key Requirements: - Create a sensor-data generator in Java or python3 - The generator should simulate mouse movements, keyboard interactions, and browser interactions - The sensor-data should be valid enough to trigger the generation of the _abck cookie upon sending a POST request to Ideal Skills and Experience: - Proficiency in Java/python3 programming - Experience in web scraping...
I'm in need of a skilled builder who can create a powerful cross-platform crypto mining app. The app should not only facilitate the mining of a new crypto every hour, but also give users the option to purchase premium packages using a variety of crypto wallets. Key Requirements: - Development for both iOS and Android platforms - User-initiated mining process - Support for mining of a new, specific cryptocurrency - Inclusion of secure transactions for premium package purchases Your role in this project will be to design and implement a user-friendly interface that enables seamless navigation and functionality across both iOS and Android. You'll also need to integrate secure and reliable crypto wallet options to facilitate premium package purchases. ...
I need a tool that extracts specific content (text and images) from PDF files and adds this data into a CSV file under designated headers. Key Requirements: - The tool should be designed specifically for Windows OS. PDF Data Extraction: - Need the tool to extract both text and images from the PDFs. CSV Insertion: - The extracted data should be sorted correctly under their respective column headers in a CSV file. Consistent PDF Structure: - It is important that the tool can handle data extraction from PDFs with a consistent structure. Ideal Skills and Experience: - Proficiency in developing Windows-based tools. - Experience with PDF data extraction. - Familiarity with CSV file manipulation in Python or related languages.
Looking for help in modifying an existing python script and related sql database table The current script - (1) scrapes company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardcoded in the script Requirement- (1) Company names/urls/keywords (will be provided) to be put in master table in the database (2) The script to loop through and scrape the relevant data and put in database
I'm looking for a freelancer who's great at web scraping to help with a project involving a specific website initially, with potential for more. I'll give you the specific data fields to extract. It'd be great if you: Are really good at web scraping and or Python. Know your way around MS SQL Server databases, not essential but definately an advantage. Understand how to extract data effectively. Understand the need for security and captcha integration if needed. Can work quickly since this project is a priority and needs to be done ASAP. Ultimately, I want to be able to manage the code with your ongoing help, so this could lead to a long-term partnership. I'll share the full details when needed. You will provide source code...
We are seeking a skilled AI developer to create a custom AI script capable of generating answers based on specific datasets for multiple products. This AI model will provide accurate responses using only the data provided for each product. If the model cannot find a matching answer, it should prompt the user to contact us for further assistance.
I'm looking to have a new website created. The key task involved in this is harvesting photos and data from Website A, and using this to create our site. The following details outline the project requirements: - Downloading photos and data from Website A. - Upload these photos and data to the corresponding sections on our website. The new site should mirror the content placement of Website A. Ideal skills for this job include website creation, data extraction, and efficient data input methods. Experience with content migration is highly desirable. Deadline for completion is within a month from the project start date. All data need to be updated each day
I'm looking to compile a comprehensive list of e-mail addresses from various companies. This list will serve as our contact database for marketing outreach purposes. The ideal candidate for this task should have the following qualifications: - Proficiency in internet research and data mining. - Previous experience in compiling e-mail lists for marketing purposes. - Strong organizational skills to categorize the e-mail addresses by company name. - Ability to cross reference collected e-mail addresses against our existing list of company names to ensure no duplication. The e-mail addresses should be those of general contacts within the companies, rather than specific executive or departmental level personnel.
I'm in need of a concert ticket bot that can operate on several platforms, including Ticketmaster, Live Nation, ThaiTicketMajor, and BookMyShow Malaysia. The ideal bot should be able to perform sev...solving techniques or third-party captcha services if there is any available captcha yet to be solve, ensure scalability to handle high request volumes - Session tracking : the bot should extract and log the link for any session that successfully passes the queue The bot should be smart enough to navigate through the ticketing process of these platforms and complete the purchase. Experience in web scraping, automation, and ticketing bots, as well as knowledge of the mentioned platforms, is a must. If you can build a robust, reliable bot that meets these requirements, I�...
Key Requirements: - Need an expert in Python programming - Familiarity with Pandas and Beautiful Soup - Experience in data analysis The job mainly involves reviewing the existing code, fixing any issues that may hinder the data extraction, and ensuring that the extracted table is ready for analysis. Please note that no additional data preprocessing is required. (feel free to rewrite code if you have better idea) --- name "iXBRL" , inside folder contain multiple html file(hundreds to thousands), each html file contain multiple tables(vary from 15-35, depend on each html file). Python to extract specific table and vertically stack them together to create an Excel file.(first column add html filename.) inside html file is encoded in chinese, so must ...
...project is to handle data extraction from websites, dealing particularly with nested or hierarchical data. Key Responsibilities: - Collaborating with the team to define the scope of the project and identify the data requirements. - Design and implement data extraction scripts using the Scrapy framework. - Handle complex, nested or hierarchical data structures. - Ensure the accuracy and efficiency of the data extraction process. Ideal Skills and Experience: - Proven experience in Python development. - Expertise in working with the Scrapy framework. - Strong understanding of web technologies and data structures. - Excellent problem-solving and analytical skills. - Experience with handling nested or hierarchical...
...expert, specializing in web scraping. I require someone who can proficiently extract data from various websites. The specifics of the data may vary from text content, images, links, to contact information. Your key responsibilities will include: - Writing effective and efficient Python scripts to scrape data - Ensuring the data is extracted accurately and in a structured format - Delivering the data in a timely manner The ideal candidate should have: - Proficient experience in Python and web scraping - A strong understanding of data extraction techniques - Proven experience in handling and parsing a variety of data types - Excellent communication skills and the ability to meet deadlines Please be p...
I'm looking for someone to convert a PDF document into a Word document. The main purpose of this conversion is to extract ...PDF content which has complex formatting, including elements such as tables and footnotes. Key Requirements: - Accurate Extraction: The primary goal here is to ensure that all text is accurately extracted from the PDF file and transferred to the Word document without any loss or distortion. - Formatting Preservation: While the layout may be complex, I'm looking for the freelancer to maintain the font styles and sizes as they appear in the original document. The ideal candidate for this job would have: - Proficiency in PDF and Word processing tools - Experience with maintaining formatting during content transfer - Attention to detail to ensure accu...
I'm looking for an experienced hacker who specializes in database scraping to assist with lead generation. My main aim is to get detailed contacts to grow my business. - Specific Tasks: - Database scraping - Extract contact details - Contact Information: - Email addresses - Phone numbers Ideal candidates should have previous experience in the field. Proficiency in data mining and scraping is a must, along with an understanding of lead generation strategies. Strong grips and successful track records on obtaining accurate contact details are key to perform this job efficiently.
...principles. Key Responsibilities: - Crafting comprehensive reports on humidity measurements and cooling towers - Ensuring that the content is structured, informative, and provides an overview of the topics - Incorporating fundamental principles of mass transfer operations in the reports Ideal Skills & Experience: - Proven experience in mass transfer operations, distillation, absorption, and extraction - Strong research skills and the ability to present complex concepts in a clear and concise manner - Previous work on humidity measurements and cooling towers will be a plus - Capable of delivering high-quality content within deadlines Your deliverables will be essential in helping me understand these subjects better. If you believe you have the necessary expertise, I look fo...
I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping run...
Introduction We are seeking proposals from experienced web scraping and data analysis firms to conduct a comprehensive data collection and analysis project. The purpose of this project is to gather detailed information on menu items, pricing, customer ratings, promotions, and deals from various food delivery mobile apps operating within our city. The goal is to mine this data for actionable insights to inform our advertising, promotional strategies, and competitive benchmarking. 2. Project Scope The selected vendor will be responsible for developing and implementing a solution to: • Subscribe to and navigate through multiple food delivery mobile apps. • Collect data on menu items including descriptions, pricing, customer ratings, and ass...
Title: Automated Data Retrieval from Websites Using CRM and CID Numbers Description: We are looking for an experienced developer to automate the process of retrieving data from specific websites using CRM and CID numbers. The goal is to develop a script or tool that will: Look up Doctor's Specialization: Use CRM numbers to search on the website: CFM Doctors Search Extract doctor's information including their specialization. Look up Disease Descriptions: Use CID numbers to search on the website: MedicinaNet CID10 Search Extract the disease description. Deliverables: ( ) A script or tool that can take a list of CRM and CID numbers as input. Automate the search process on the specified websites. Extract
I have a web application that runs on PHP and I'm looking to integrate it with APIs provided by multiple suppliers. These suppliers will send us three specific types of data through their APIs - customer information, product information, and order information. Key Requirements: - Connect the webapp with Supplier A, Supplier B, and Supplier C APIs. - Extract and process customer information, product information, and order information sent by these suppliers. - Display this data on the webpages of the application. - Store this data efficiently in a database. Skills and Experience: - Proficient in PHP and API integration. - Strong understanding of database management. - Experience in handling customer, product, and order data. - Detail-oriented to ens...
...find the contact name, position, email and LinkedIn account for each and every recruitment/HR/Headhunting person within each company. This could be anywhere between 10 to 30 people per company. - The information should be accurate and up to date. - If you have a strategy for obtaining this data, please share it in your bid. Skills/Experience: - Strong research skills - Data entry and data mining expertise - Proficient in Saudi Arabian business landscape - Attention to detail and accuracy - Web scraping - Web search - Leads Results should be in an excel sheet format, outlining the name, position, email address for each contact. Contacts for each company should be grouped together, end file should be in 1 sheet, not separate sheets. Sen...
I'm looking for a developer to create a Chrome extension that will communicate with a server. The extension should be able to: - Extract the first value from the first document that is loaded - Select the second value from the second document that is loaded The communication between the Chrome extension and the server should be seamless and efficient. The server should be a...document Click on 1st value which I had entered in server If second loaded document click on second value Ideal skills and experiences include: - Proficiency in developing Chrome extensions - Thorough understanding of Python for server-side development - Experience with creating APIs for efficient communication between client and server - Strong problem-solving skills to ensure seamless data extracti...
I'm looking for a developer to create a Chrome extension that will communicate with a server. The extension should be able to: - Extract the first value from the first document that is loaded - Select the second value from the second document that is loaded The communication between the Chrome extension and the server should be seamless and efficient. The server should be a...document Click on 1st value which I had entered in server If second loaded document click on second value Ideal skills and experiences include: - Proficiency in developing Chrome extensions - Thorough understanding of Python for server-side development - Experience with creating APIs for efficient communication between client and server - Strong problem-solving skills to ensure seamless data extracti...
...consolidating and analyzing data from spreadsheets. • Creating dashboards, reports and charts in Analytics tools. • Working on financial and other types of modeling projects. • Having knowledge Dashboard Creation, Mainframe automation through VBA. • Good Technical knowledge of VBAs, Macro, MS Office skills to drive automation opportunities. • Well-versed with dynamic loops, data extraction from images. • Work with users and team members at all levels for performance improvement and suggestions. • Understand and prepare Ad hoc reports. • Identify the opportunities of automating reports, snapshots and dashboards using advanced formulas, Advanced Excel, Python and other techniques • Consolidate, sort, organize and summarize ...
...specialized WordPress developer with experience in Excel operations and data showcasing. Key tasks: - Create a WordPress page that extracts numeric and text data from an Excel sheet. - Implement highlights and color-coded information on the webpage for better readability and understanding. - The data on the Excel sheet will be updated on a monthly basis, hence the website should be able to fetch the data automatically upon any modifications. Ideal skills: - Proficiency in WordPress and Excel integration - Experience in creating visually appealing data showcases or infographics - Strong understanding of data extraction and display technologies The aim is to have a user-friendly webpage that accurately represents the updated dat...
...Example of books and categories: Here are the suggested titles for the 15 ebooks/scripts on artificial intelligence. If you think something is missing or should be changed, please let me know. Theory Background History of AI Machine Learning and Data Mining Neural Networks Reinforcement Learning Speech-to-Text and Text-to-Speech (and Deep Learning in this Relation) Robotics Limits of AI, Deepfake, and Ethics Practical Guide - Tools ChatGPT for Beginners Image Creation Tools with AI (DALL-E, MidJourney, Assistants - Market Overview) & Computer Vision Data Analysis in Enterprises with AI Python - Introduction and First Overview Additional Books Natural Language Processing (NLP) AI in Healthcare Autonomous Vehicles and AI AI in Finance and Trading Please start yo...
I'm looking for someone to convert a PDF document into a Word document. The main purpose of this conversion is to extract ...PDF content which has complex formatting, including elements such as tables and footnotes. Key Requirements: - Accurate Extraction: The primary goal here is to ensure that all text is accurately extracted from the PDF file and transferred to the Word document without any loss or distortion. - Formatting Preservation: While the layout may be complex, I'm looking for the freelancer to maintain the font styles and sizes as they appear in the original document. The ideal candidate for this job would have: - Proficiency in PDF and Word processing tools - Experience with maintaining formatting during content transfer - Attention to detail to ensure accu...
I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively
I need to Extract followers of group members of the link I will provide
I am looking for a web-scraping expert to retrieve both images and text from a specific website for research purposes. The text data will need to be structured and saved in a CSV file, including paths to saved images. Key details to consider: - Knowledge of web scraping tools and techniques is essential to accomplish this task. - Quality control to ensure accurate data extraction and image quality is critical. - Structure page information and freeform descriptions should be made available in a CSV file. - The images should be saved in their original resolution and quality settings. Please provide any relevant experience you have in web scraping, including free and paid services you have used before to help with your work. ...
I need a professional who can help me with scraping data API from a specific website or platform. I'm looking to extract specific data points or information and potentially set up a regular scraping process. Key Requirements: - Proficiency in Web Scraping: I need someone who has experience with web scraping tools and techniques. - Data Mining Skills: The ability to identify and extract the specific data points I require is crucial. - Automation Expertise: If you have experience setting up automated scraping processes, that would be a huge advantage.
I'm in need of a comprehensive marketing list for Charlotte, NC that specifically targets businesses, particularly within the following industry sectors: dentist offices, chiropractor offices, restaurants, gyms, warehouses, lawyer offices, and doctor offices. Key requirements include: - Contact name - Phone number - Emai...within the following industry sectors: dentist offices, chiropractor offices, restaurants, gyms, warehouses, lawyer offices, and doctor offices. Key requirements include: - Contact name - Phone number - Email address - Address The ideal freelancer for this job would: - Have experience in compiling marketing lists. - Possess excellent data research and mining skills. - Demonstrate attention to detail for accuracy. - Understand the importance of GDP...
...specific details from Tally using ODBC. The required data fields include: Purchase date Invoice number Vendor name Product (inventory name) Product quantity Rate Amount SGST CGST IGST Freight charge Gross amount The task involves creating a TDL (Tally Definition Language) or TCP (Tally Compiled Program) file that will facilitate the extraction of this data from the Tally database using ODBC Requirements: Strong knowledge and experience with Tally and its database structure. Proficiency in TDL or TCP file creation. Familiarity with ODBC for database connectivity. Ability to automate the extraction process to ensure seamless and accurate data retrieval. Deliverables: A functional TDL or TCP file that successfully extracts the specified data fie...
I'm working on a school project that involves the development of a Coal Mining Security Alert System. I need someone who can code in Quarky to create this block code system. Unfortunately, I haven't gotten to the point of defining the complete scope of the project, but I'd like to start with the code development. I'm looking for someone who can: - Use Quarky to build a block code system - Understand and implement basic security alert functionalities - Be ready for subsequent feature additions and changes Key Features: = Face Detection: Implement face detection functionality to identify individuals within the mining area. = PPE Kit Verification: Utilize image processing techniques to ensure that miners are wearing proper PPE kits. The system should stop i...
...functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means that it's not just supposed to collect all messages or only new mes...
I require a skilled Matlab expert with a strong background in image processing techniques. Key requirements include: - Proficiency in image processing algorithms - Experience with feature extraction and object detection - Ideally, a track record of working with various image formats The successful candidate will need to understand the specific needs of my project and connect them with the most suitable image processing techniques available in Matlab. This may involve implementing and testing different solutions to meet project goals. Please note that as I have not specified the image format, experience with a range of formats would be advantageous. I look forward to reviewing your portfolio and discussing how you can support this exciting project.
...script that can scrape the Google Play store specific data from list of apps in the search result url of any keyword. Need data in Excel spreadsheet. Eg : if i search cat in playstore, i need the below mentioned details of first 100 apps shown in the search result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, d...
I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!
I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you
We are seeking a skilled developer or development team to create a comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product...
Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA
...process. As of now, I manually gather numerical data from a variety of unstructured sources like images, text, and PDFs. This data includes formulas and is stored both on my local computer and the web. At present, I get ChatGPT to convert this data into a table which I then paste into excel. I do calculations in excel to find out what percent each ingredient is of a total formula. Then I create a new entry into a table in Airtable and paste this data into a different table in Airtable which references the first table. I need someone to automate this data extraction process, calculations and entry into two separate Airtable tables so I can do it repeatedly myself. I work in a standardised operating environment for work so ideally I need a ...
Task at hand is to extract vocals from a highly distorted audio file OF APPROXIMATELY 8 MINUTES. I DO HAVE OTHER FILES I WOULD LIKE DONE AS WELL, IF EXTRACTION IS SUCCESSFUL. As a client, my ultimate target is related to: - Enhancing intelligibility within the dialogue to bring utmost clarity. - Identifying specific words or phrases that may prove crucial. - The file is from a criminal setup with the audio of a father setting up his son; thus every word could change the narrative. The audio clip has been intentionally distorted over crucial conversation. Do whatever it takes to make the conversation extremely clear irrespective of the overall audio quality. Those offering skills and experience in forensic audio analysis, audio software engineering will ideally match the job req...
I need historical stock prices and income statement data, deliver python script to collect this data for an arbitrary stock from google finance.
Hello, This is a $20 project. Looking for a freelancer to develop a python script to retrieve restaurant data from Google Maps using the Maps/Places API. The script should target restaurants that have a phone number and *do not* have a website. The inputs I need to enter are: - Location (latitude and longitude) - Search Radius (in meters) - Ensure the business/place is a restaurant, bakery, etc. Key Data to Retrieve, output in a .CSV: - Business Name - Address - Phone Number - Google Maps URL Thank you, trooper501
I'm in need of a skilled professional to help me create a data mining script. The task involves mining emails, data from a certain website and delivering the data in a raw text file format. Key Requirements: - Develop a data miner script that can effectively scrape email data from websites. - Ensure the script can handle multiple sources and is scalable for future needs. - Deliver the mined data in a raw text file format. Ideal Skills: - Proficiency in web scraping and data mining techniques. - Experience with developing scripts for text data mining. - Strong knowledge of scripting languages suitable for scraping like Python/BeautifulSoup, R, etc. Please provide samples of you...
I'm looking for an Indian Python developer to create a script that can retrieve specific data from Telegram. Key Points: - The script should be able to fetch phone numbers and migration of users from Telegram. The ideal candidate should: - Have a strong background in Python development - Be familiar with working with API's - Have experience in web scraping - Have a good understanding of data privacy and security - Be able to deliver the project on a monthly basis. Looking forward to hearing from Python developers with relevant experience.
I want a mobile application for iOS that can effectively extract text from images captured by the camera and then accurately highlights specific words. Key Features: - **Text Extraction:** Accurate OCR technology that can interpret and transcribe text from images with precision. - **Word Highlighting:** The app should be able to highlight certain words based on user input. I prefer these highlights to be done via color changes. - **Image Handling:** The app should allow users to take photos from within the application itself or upload from gallery Ideal Skills: - Proficiency in iOS app development. - Experience with Optical Character Recognition (OCR) technology. - Knowledge of effective text highlighting within a mobile app. - Familiarity with designing a user-friendly inter...
I require a professional data entry freelancer to help me with a PDF data extraction task. The project involves extracting and organizing information from a series of PDF files. The data to be extracted varies and includes both text data and numerical data, in addition to images or diagrams. The ideal freelancer for this project should be experienced in data entry and be comfortable working with PDF files. Key requirements for the project include: - Extracting text and numerical data from PDF files - Organizing the extracted data in an easily accessible format - Ensuring accurate extraction of information - Handling images or diagrams within the PDF files The extracted information will be used for further analysis and...
I'm in need of a skilled online data entry professional for a project involving the extraction of data from various websites and organizing it into a database. Key Responsibilities: - Conducting online data entry tasks from multiple websites. - Ensuring the accuracy and completeness of the data. - Organizing the entered data into database entries. Ideal Skills and Experience: - Proven experience in online data entry. - Proficiency in web browsing and data extraction. - Strong attention to detail and accuracy. - Experience with organizing data into database entries would be considered a plus. Please only apply if you have a strong track record in online data entry and can guarantee the quality of t...
