Web scraping projects github jobs
I need a freelancer with web scraping skills who can extract product prices and models from my 17 competitors. Ideally, the freelancer should be able to: Extract information accurately and comprehensively. Upload all the extracted information into an Excel sheet. Create a simple online website to facilitate this process. I have hosting and a domain. Enable me to update the extracted information with a single click. Complete this task within a maximum of 48 hours. Please include detailed proposals in your application on how you would approach this project.
...a highly skilled Front-End Developer with a strong focus in React(using Typescript) and a minimum of 12+ months of experience in creating web applications. You will be responsible for the development, design, and implementation of our new website's front-end aspects. This is a **6-month contract** position with a competitive hourly rate. **Key Responsibilities** - Developing new user-facing features using React.js and Typescript - Building reusable components and front-end libraries for future use - Familiarity with RESTful APIs and integrating front-end with back-end services. - Optimizing components for maximum performance across a vast array of web-capable devices and browsers - Implementing an intuitive user interface - Designing engaging website layouts - Tran...
...need of a proficient Python developer who can help compile a Python code, that I have acquired from GitHub, into an executable format for Windows. As the client, I expect: - Understanding the existing Python code and its dependencies - Transforming the Python code into a Windows executable file Successful freelancers should provide a detailed project proposal illustrating how they plan to compile the code to exe on a Windows operating system. Though no specific Python libraries or frameworks were mentioned, a background in Python coding and debugging is paramount. The ideal freelancer should have a deep understanding of Python code, dependencies, and experience dealing with code from GitHub. Experience in generating Windows executable files from Python code will be a s...
I need a Java or python3 programmer to create a sensor-data... Key Requirements: - Create a sensor-data generator in Java or python3 - The generator should simulate mouse movements, keyboard interactions, and browser interactions - The sensor-data should be valid enough to trigger the generation of the _abck cookie upon sending a POST request to Ideal Skills and Experience: - Proficiency in Java/python3 programming - Experience in web scraping and automation - Knowledge of cookies and their generation - Experience in simulating sensor data such as mouse movements and keyboard interactions Please note, the success of this project is heavily dependent on the ability to accurately simulate sensor data and trigger the generation of the _abck cookie on the specified website.
We are seeking an experienced developer to convert the SPM12 GUI interface, currently built on the MATLAB compiler, into a Python application. The source code for SPM12 is available at SPM12 GitHub repository Objectives: • Translate the entire SPM12 codebase from MATLAB to Python while maintaining functionality. • Develop a Python-based GUI that replicates the current MATLAB interface. • Ensure the converted application integrates well with Python scientific computing stacks. Key Deliverables: • A fully functional Python version of SPM12. • Source code with comments and documentation. • A user guide for the Python-based GUI. Skills Required: • Proficiency in MATLAB and Python programming languages. • Experience with GUI develo...
Project Description: We seek a highly skilled software developer to compile the ARM64 code from GitHub, based on Golang 'go'. Your role is crucial in ensuring the Velociraptor server operates flawlessly on the Odroid N2+ platform (4GB RAM) by creating an installer or Debian package (.deb) that functions flawlessly on Debian Ubuntu 20.04 (MATE Desktop). The ARM64 code is available online, and we wish to have it as a package so the user can run it and go through the setup of the velociraptor server seamlessly on the N2+, use the local webserver to create agents (sensors as MSI or exes) and analyse/collect remote endpoints using the open source tool on the box. This project involves adapting the Velociraptor software, an open-source security tool , to work seamlessly
Looking for help in modifying an existing python script and related sql database table The current script - (1) scrapes company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardcoded in the script Requirement- (1) Company names/urls/keywords (will be provided) to be put in master table in the database (2) The script to loop through and scrape the relevant data and put in database
I'm looking for a freelancer who's great at web scraping to help with a project involving a specific website initially, with potential for more. I'll give you the specific data fields to extract. It'd be great if you: Are really good at web scraping and or Python. Know your way around MS SQL Server databases, not essential but definately an advantage. Understand how to extract data effectively. Understand the need for security and captcha integration if needed. Can work quickly since this project is a priority and needs to be done ASAP. Ultimately, I want to be able to manage the code with your ongoing help, so this could lead to a long-term partnership. I'll share the full details when needed. You will provide source code, documentatio...
I'm in need of a concert ticket bot that can operate on several platforms, including Ticketmaster, Live Nation, ThaiTicketMajor, and BookMyShow Malaysia. The ideal bot should be able to perform sev...solving techniques or third-party captcha services if there is any available captcha yet to be solve, ensure scalability to handle high request volumes - Session tracking : the bot should extract and log the link for any session that successfully passes the queue The bot should be smart enough to navigate through the ticketing process of these platforms and complete the purchase. Experience in web scraping, automation, and ticketing bots, as well as knowledge of the mentioned platforms, is a must. If you can build a robust, reliable bot that meets these requirements, I�...
...expert, specializing in web scraping. I require someone who can proficiently extract data from various websites. The specifics of the data may vary from text content, images, links, to contact information. Your key responsibilities will include: - Writing effective and efficient Python scripts to scrape data - Ensuring the data is extracted accurately and in a structured format - Delivering the data in a timely manner The ideal candidate should have: - Proficient experience in Python and web scraping - A strong understanding of data extraction techniques - Proven experience in handling and parsing a variety of data types - Excellent communication skills and the ability to meet deadlines Please be prepared to provide examples of your previous work in ...
DotNet developers required for #Errors removal and Improvement work# in thenafter Host on server. Developers should also have knowledge about Merger of sourcecode and database of his done-work with other developer's done-work on GitHub. Website Address - User emailid- @gmail.c Password- kaspersky Errors removal and Improvement work which has to be done is explained in below link-
I'm looking for an experienced hacker who specializes in database scraping to assist with lead generation. My main aim is to get detailed contacts to grow my business. - Specific Tasks: - Database scraping - Extract contact details - Contact Information: - Email addresses - Phone numbers Ideal candidates should have previous experience in the field. Proficiency in data mining and scraping is a must, along with an understanding of lead generation strategies. Strong grips and successful track records on obtaining accurate contact details are key to perform this job efficiently.
...experienced developer or agency to create a custom assessment platform, similar to Coderbyte/ Hackerrank tailored to my specific needs not limited, but similar to . Here's what I'm looking for: 1. AI-Generated Code Assistance** - **Smart Code Suggestions**: Implement AI algorithms that provide real-time code suggestions and auto-completions similar to tools like GitHub Copilot. - **Code Snippets**: AI can suggest commonly used code snippets based on the problem statement and context. - **Problem Solving Hints**: AI can offer hints or guide candidates through difficult problems without giving away the solution. - **Adaptive Learning**: Use AI to adjust the difficulty of questions based on the candidate's performance in real-time. ### **2. AI-Based Cheat Detect...
this is a static page, i need to create dynamic add of posts from top box. top box is like facebook with a create button, then you should list the posts. in the first box you need to add category (an empty select with cat1 cat2 cat3) a calendar date and an autocomplete for searching country-city ok? i will provide you api and project on github so im here for anything that is related to backend - create post - retrieve post - edit a bit the card
More details: *What specific type of claims do you expect the expert consultant to identify? Delays, Cost overruns, Scope changes *How many projects do you need the expert consultant to review? 4 *Project documents will be supplied. *Reference Contract: FIDIC Red Book *How soon do you need your project completed? ASAP
I'm in need of many skilled freelancers based in Udupi, who can assist me with various projects. The main goal is to support me in various projects and build a strong company. Key Requirements: - Skilled in particular areas like web-development, Flutter, content creation, UI/UX etc. - Able to work out of home or co-working space - Able to provide long term commitment to projects I am building a panel of freelancers in Udupi to work out of my co-working space, who can support me in client projects as well as my own projects. I would also like to build a set of talent pool out of Udupi to cater to the local as well as global audience.
More details: Which specific UI change would you like to make to the app? Change color scheme What is the primary color you want for the app's color scheme? Blue Do you require any additional features to be added to the app? add logo
I'm looking for a...developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seamlessly and accurately in real-time. Prior experience with sim...
...night for data analysis purposes. However, after trying to upload the '' file to GitHub, I encountered an error due to the file size being too large for GitHub. I need to get the Python file running again, but with the '' file stored on an external service to work around the file size limitations of GitHub. Key requirements include: - Identifying and resolving the issue causing the Python file not to run - Storing the '' file on an external service and adjusting the Python code to access it from there Ideal Skills and Experience: - Proficiency in Python - Experience with data analysis and handling large datasets - Familiarity with version control, specifically using GitHub - Ability to troubleshoot and resolve file size issues ...
Introduction We are seeking proposals from experienced web scraping and data analysis firms to conduct a comprehensive data collection and analysis project. The purpose of this project is to gather detailed information on menu items, pricing, customer ratings, promotions, and deals from various food delivery mobile apps operating within our city. The goal is to mine this data for actionable insights to inform our advertising, promotional strategies, and competitive benchmarking. 2. Project Scope The selected vendor will be responsible for developing and implementing a solution to: • Subscribe to and navigate through multiple food delivery mobile apps. • Collect data on menu items including descriptions, pricing, customer ratings, and associated promotions or deals....
...Preferably Python. Libraries: Experience with web scraping libraries like BeautifulSoup, Selenium, and data processing libraries like Pandas. Output Format: Ability to export data into an Excel file using Pandas or similar libraries. Error Handling: Robust error handling to manage failed requests and parsing errors. Compliance: Adherence to the websites' terms of service and rate limits to avoid being blocked. Project Scope: Input: A list of CRM numbers and a list of CID numbers. Process: Automate the lookup and data extraction process. Output: An Excel file with the compiled data. Skills Required: Web Scraping Python Programming Data Processing Automation Excel File Generation To Apply: Please provide: Examples of similar automation projects ...
I'm looking for drafters experienced in both civil and telecommunications projects to join my team. You will need to be proficient in AutoCAD and Civil 3D, as these are the primary software we use. Key requirements include: - Proficiency in both Civil and Telecommunications drafting - Extensive experience using AutoCAD and Civil 3D This is an ongoing project with varying deadlines, so being able to manage your time efficiently is a must. Please highlight your experience in both fields and your software proficiency in your proposal.
...person within each company. This could be anywhere between 10 to 30 people per company. - The information should be accurate and up to date. - If you have a strategy for obtaining this data, please share it in your bid. Skills/Experience: - Strong research skills - Data entry and data mining expertise - Proficient in Saudi Arabian business landscape - Attention to detail and accuracy - Web scraping - Web search - Leads Results should be in an excel sheet format, outlining the name, position, email address for each contact. Contacts for each company should be grouped together, end file should be in 1 sheet, not separate sheets. Send me: 1- Your strategy in finding those companies and collecting names and emails of relevant employees, 2- Total number of expected V...
Overview: This application will enable Shopify store owners to collect and display customer reviews. However, only customers who have made a purchase will be able to leave a review. You can use the product reviews sample app from Shopify Github if you want, it is not a problem for me. Project Requirements: User Authentication: • Only customers who have made a purchase should be able to leave a review. • There should be no public option for writing a review on the store’s frontend. Review Collection: • After a purchase, customers should receive an invitation via email to write a review. Review Display: • Reviews submitted by customers should be displayed on the respective product page of the Shopify store. Webservice Integration:
I'm seeking a skilled freelancer to implement Continuous Integration and Continuous Deployment (CI/CD) using GitHub Actions, set up logging for each service, and configure an HTTPS domain for our web application hosted on Google Cloud Platform (GCP). The ideal candidate should have extensive experience with GCP, CI/CD pipelines, and HTTPS configuration. Scope of Work: 1. CI/CD Implementation: - Set up a CI/CD pipeline using GitHub Actions for automated testing, building, and deployment of both frontend and backend applications. - Integrate the pipeline with our GCP infrastructure, including Compute Engine, Cloud SQL, and Cloud Storage. 2. Logging Setup: - Configure logging for all services: -- Frontend (Nginx, ): Log HTTP requests, errors, and application logs...
I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively
I need to Extract followers of group members of the link I will provide
I am looking for a web-scraping expert to retrieve both images and text from a specific website for research purposes. The text data will need to be structured and saved in a CSV file, including paths to saved images. Key details to consider: - Knowledge of web scraping tools and techniques is essential to accomplish this task. - Quality control to ensure accurate data extraction and image quality is critical. - Structure page information and freeform descriptions should be made available in a CSV file. - The images should be saved in their original resolution and quality settings. Please provide any relevant experience you have in web scraping, including free and paid services you have used before to help with your work. I would like the proj...
I need a professional who can help me with scraping data API from a specific website or platform. I'm looking to extract specific data points or information and potentially set up a regular scraping process. Key Requirements: - Proficiency in Web Scraping: I need someone who has experience with web scraping tools and techniques. - Data Mining Skills: The ability to identify and extract the specific data points I require is crucial. - Automation Expertise: If you have experience setting up automated scraping processes, that would be a huge advantage.
I'm seeking a skilled Unity developer who can work on the development of a tower defense strategy game. The core mechanics of the game are ready. Your only job will be syncing the data across all clients in a match. Skills requirements: - Expertise in Unity game development - Experience in Photon Engine - Knowledge about Github will be a bonus In this project: - You will create a connection between multiple clients for multiplayer gameplay - Sync the data across all clients (Don't bid if you have no idea about Unity or Photon. AI proposals will be discarded too)
I am searching for a...minimal redundancies and maximum efficiency in its paths. Moreover, I'll provide a guide and a base GitHub repo, but will need you to skillfully integrate and customize the project according to requirements. I’m flexible regarding hardware choices and would appreciate suggestions. As for the environment, while it’s an indoor simulation, your solutions should be versatile enough to apply to various settings such as residential, commercial, or industrial. Ideal Skills and Experience: - Proficiency in DRL and LIDAR technologies - Experience in Robot Operating Systems (ROS) - Knowledge of various hardware platforms suitable for mobile robots - Excellence in integrating and customizing GitHub repos - Knowledge of various indoor environme...
...but it's not functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means that it's not just supposed to collect all messages or o...
I'm seeking a proficient freelancer to assist in setting up a comprehensive CI/CD workflow for my Flutter app. Key Responsibilities: - Establishing CI/CD with GitHub Actions: Your expertise in configuring and managing GitHub Actions for CI/CD is crucial. - Building for iOS: Experience with building Flutter apps specifically for iOS is a must. Ideal Skills and Experience: - Proficiency with CI/CD tools: Extensive experience with GitHub Actions, and customizing for Flutter. - Flutter Development: Proven track record of developing and building Flutter apps for iOS. Your role will be pivotal in ensuring the successful deployment of our Flutter app, and the seamless integration of CI/CD into our development process.
I need a script that can scrape the Google Play store specific data from ...result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, daily scraping solution - python experts, node.js experts If you think you're the right person for this job, please get in touch with your relevant experience and a brief overview of your proposed approach. The scrip...
I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!
...Enable SUBSCRIPTION payment for the app from the apple store – must facilitate the option to enable users to subscribe to a quarterly payment model. This is a must. 2. Error trapping - must be able to fail a call or function without crashing the app 3. All dates are in dd/mm/yyyy 4. The Search function must work across all prizes not just those currently calling 5. The code must be deposited in our github 6. Apple must accept the update 7. All drafts must use a version number on the front screen which are incremented for each version 8. Must use our new logo (to be supplied) Additional functions - A new section in the app to cover prize stats This section enables users to get finalists to each art prize using the api’s supplied. This includes: 1. Get finalists for a ...
I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you
We are seeking a skilled developer or development team to create a comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product category (inc...
Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA
I'm looking for a professional who can help me to run a software I downloaded from GitHub on my Windows system. Here's the main outline of what I require: - Understanding the program: I need someone who can navigate through the program and understand its functionalities. - Custom configurations: I'm looking for someone who can make custom configurations to the program. This would likely involve adjusting settings, modifying code, or integrating additional features. - Troubleshooting: If the program does not run as expected, I would need the freelancer to troubleshoot the issue and provide a solution. The ideal candidate should have: - Proficiency in the programming language of the software - Experience with running software on Windows - Ability to understand a...
I need historical stock prices and income statement data, deliver python script to collect this data for an arbitrary stock from google finance.
Hello, This is a $20 project. Looking for a freelancer to develop a python script to retrieve restaurant data from Google Maps using the Maps/Places API. The script should target restaurants that have a phone number and *do not* have a website. The inputs I need to enter are: - Location (latitude and longitude) - Search Radius (in meters) - Ensure the business/place is a restaurant, bakery, etc. Key Data to Retrieve, output in a .CSV: - Business Name - Address - Phone Number - Google Maps URL Thank you, trooper501
I'm in need of a skilled professional to help me create a data mining script. The task involves mining emails, data from a certain website and delivering the data in a raw text file format. Key Requirements: - Dev... Key Requirements: - Develop a data miner script that can effectively scrape email data from websites. - Ensure the script can handle multiple sources and is scalable for future needs. - Deliver the mined data in a raw text file format. Ideal Skills: - Proficiency in web scraping and data mining techniques. - Experience with developing scripts for text data mining. - Strong knowledge of scripting languages suitable for scraping like Python/BeautifulSoup, R, etc. Please provide samples of your previous similar projects or portfolio that de...
I'm looking for an Indian Python developer to create a script that can retrieve specific data from Telegram. Key Points: - The script should be able to fetch phone numbers and migration of users from Telegram. The ideal candidate should: - Have a strong background in Python development - Be familiar with working with API's - Have experience in web scraping - Have a good understanding of data privacy and security - Be able to deliver the project on a monthly basis. Looking forward to hearing from Python developers with relevant experience.
If you read it start your message with 'REACT'. I'm looking for a React specialist to help me deploy a wallet connect feature on my server. This is a React project that I need to deploy on my server. The project is for a wallet connect feature for crypto. There is already a working example from GitHub and I need it deployed on my server. Experience in the following areas would be ideal: - Proficiency in React - Experience with deploying projects on servers
I'm looking for someone who can...for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to s3 storage. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Speed during sc...
...construction and marketing projects, ensure effective team communication, manage the budget, and deliver the projects to our clients on time. Key Responsibilities: - Planning and scheduling: Develop project timelines, set milestones, and allocate resources efficiently. - Team coordination and communication: Maintain clear communication channels among team members, contractors, and clients. - Budget management: Responsible for ensuring projects stay within budget, and identifying cost-saving opportunities. - Fulfill client projects: Deliver projects in a timely manner that meets or exceeds client expectations. I'm particularly looking for a professional with a background in multiple tier management over contractors and a proven track record of d...
I need a seasoned professional who can provide me with comprehensive support on major projects and tasks completion. The role involves assisting in project planning, task management, and troubleshooting, along with other related activities that could improve my efficiency and productivity. The ideal candidate should be proficient on following:- Task would related to this :- Load testing architecture Created infra in azure (VM's, synapse load balancer, DNS mapping) Internal VM configuration Nginx conf files change (private IP, domain) Azure VM network security group rules DNS mapping in Cloudflare Majorly daily daily work would be on :- Jenkins build, And Deploy in Azure (VMs, Tomcat) and Azure Devops Interaction with CloudFare, Azure Redis Site 24x7 and Mongo...
I'm in need of a professional who can consistently extract data from a specific website on a daily basis. Key Requirements: - Data Extraction: Extracting various forms of data from a website. - Ongoing basis: This is not a one-time job. I'm looking for long-term cooperation, with the extraction ideally happening on a daily schedule. Ideal Skills and Experience: - Web Scraping: Proficiency in web scraping tools and techniques is a must. - Automation: Experience with automating the extraction process to make it efficient. - Consistency: Ability to maintain a daily extraction schedule accurately is crucial. Please include in your bid how you plan to approach this sort of ongoing data extraction.
