Django web scraping project jobs
I'm looking for a freelancer to help m...getting the python code as i can run the code myself in the future or integrate it to another system. Key Requirements: - I need approximately 300 data points extracted. - The output for these data points should be organized into a PDF or Word. This project is about creating an automated system to generate instant reports about a company. Only difficulty is the website has drops downs to select the period involved and in those 300 data points actually many come from the same source. Ideal Skills and Experience: - Experience in web scraping (Python) - Proficient in creating PDF documents from extracted data - Adept at handling large amounts of data - Familiarity with tax websites would be a plus but is not neccesary beca...
I need a freelancer with web scraping skills who can extract product prices and models from my 17 competitors. Ideally, the freelancer should be able to: Extract information accurately and comprehensively. Upload all the extracted information into an Excel sheet. Create a simple online website to facilitate this process. I have hosting and a domain. Enable me to update the extracted information with a single click. Complete this task within a maximum of 48 hours. Please include detailed proposals in your application on how you would approach this project.
I need a Java or python3 programmer to create a sensor-data generator for the website www.voeazul.com.br. The objective is to send a POST request to the s...simulate mouse movements, keyboard interactions, and browser interactions - The sensor-data should be valid enough to trigger the generation of the _abck cookie upon sending a POST request to Ideal Skills and Experience: - Proficiency in Java/python3 programming - Experience in web scraping and automation - Knowledge of cookies and their generation - Experience in simulating sensor data such as mouse movements and keyboard interactions Please note, the success of this project is heavily dependent on the ability to accurately simulate sensor data and trigger the generation of the _abck cookie on the specified we...
Looking for help in modifying an existing python script and related sql database table The current script - (1) scrapes company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardcoded in the script Requirement- (1) Company names/urls/keywords (will be provided) to be put in master table in the database (2) The script to loop through and scrape the relevant data and put in database
I'm looking for a freelancer who's great at web scraping to help with a project involving a specific website initially, with potential for more. I'll give you the specific data fields to extract. It'd be great if you: Are really good at web scraping and or Python. Know your way around MS SQL Server databases, not essential but definately an advantage. Understand how to extract data effectively. Understand the need for security and captcha integration if needed. Can work quickly since this project is a priority and needs to be done ASAP. Ultimately, I want to be able to manage the code with your ongoing help, so this could lead to a long-term partnership. I'll share the full details when needed. You will provide source code...
It is necessary finish a web application in python + django regard the statistic of stocks. So it is necessary: some fetaures of some filter; -. make some change to mysql database and api to datafeed. -. verify the formulas and add some features; -. make better the design. - create an admin page with security login and import stocks manually. Please answer only if you can show similar experiences
...looking for an experienced Python coder to tackle two key aspects of my project - data analysis and automation. Here's a breakdown of the requirements: - **Data Analysis**: The primary task involves analyzing datasets in CSV format. The selected candidate should be adept with NumPy, able to make sense of the data and derive meaningful insights. - **Automation**: The second crucial aspect is automation. I'm looking to automate certain processes in my project that involve database queries. Proficiency in Django will be necessary here. Ideal candidates for this project would have: - **Strong Python Skills**: You should be well-versed with working on data analysis and automation tasks using Python. - **Experience with NumPy & Django**: Pr...
I'm in need of a concert ticket bot that can operate on several platforms, including Ticketmaster, Live Nation, ThaiTicketMajor, and BookMyShow Malaysia. The ideal bot should be able to perform sev...solving techniques or third-party captcha services if there is any available captcha yet to be solve, ensure scalability to handle high request volumes - Session tracking : the bot should extract and log the link for any session that successfully passes the queue The bot should be smart enough to navigate through the ticketing process of these platforms and complete the purchase. Experience in web scraping, automation, and ticketing bots, as well as knowledge of the mentioned platforms, is a must. If you can build a robust, reliable bot that meets these requirements, I�...
I'm looking for an experienced Django developer to work on the backend of my project. Key Project Goals: - The primary focus of this project is on backend development. You should have a strong understanding of Django and be able to handle complex backend tasks. Ideal Skills and Experience: - Extensive experience with Django is a must. - Strong understanding of backend development. - Ability to work on complex backend tasks. - Good communication skills. - Previous experience with similar projects is a plus. Please note that the project is already defined and the focus will be solely on backend tasks. Your role will be to improve the backend of the website. Feel free to ask any questions for more information.
I'm looking to develop a Software as a Service (SaaS) website specifically for the legal industry. Here's what I need: - User Registration and Login system. - Pa...Recognition) system. - Both Frontend and Backend development are necessary. - Seamless integration of the AI chatbot, OCR, and payment processing into the website. - A well-documented API to allow for future expansion. The ideal candidate for this project should be proficient in Python (Django/Flask), laravel, node js, vue js, AI programming, and API development. Experience with building SaaS platforms, payment processing integration, and chatbot development would be a great advantage. Accuracy, scalability, and security are top priorities for this project. Immediate availability and good commun...
...expert, specializing in web scraping. I require someone who can proficiently extract data from various websites. The specifics of the data may vary from text content, images, links, to contact information. Your key responsibilities will include: - Writing effective and efficient Python scripts to scrape data - Ensuring the data is extracted accurately and in a structured format - Delivering the data in a timely manner The ideal candidate should have: - Proficient experience in Python and web scraping - A strong understanding of data extraction techniques - Proven experience in handling and parsing a variety of data types - Excellent communication skills and the ability to meet deadlines Please be prepared to provide examples of your previous work in ...
I'm looking for an experienced hacker who specializes in database scraping to assist with lead generation. My main aim is to get detailed contacts to grow my business. - Specific Tasks: - Database scraping - Extract contact details - Contact Information: - Email addresses - Phone numbers Ideal candidates should have previous experience in the field. Proficiency in data mining and scraping is a must, along with an understanding of lead generation strategies. Strong grips and successful track records on obtaining accurate contact details are key to perform this job efficiently.
I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seamlessly and accurately in real-time. Prior e...
Objective of the project The goal of the project is to develop an automated system that generates high-quality content related to beauty, cosmetics, skin and hair products, and makeup. This system must: Collect content from various sources (URL, RSS, XML) configurable by a Super User. Filter and process such content using artificial intelligence (AI) to improve it. Automatically publish enhanced content to a WordPress blog and various social networks. Provide an intuitive administration panel for managing system sources and configurations. Technologies and Tools Used Backend: Django Frontend: React Database: MySQL or PostgreSQL Monitoring: Prometheus and Grafana Containers and Orchestration: Docker and Kubernetes This project is already validated by AI tools ...
Introduction We are seeking proposals from experienced web scraping and data analysis firms to conduct a comprehensive data collection and analysis project. The purpose of this project is to gather detailed information on menu items, pricing, customer ratings, promotions, and deals from various food delivery mobile apps operating within our city. The goal is to mine this data for actionable insights to inform our advertising, promotional strategies, and competitive benchmarking. 2. Project Scope The selected vendor will be responsible for developing and implementing a solution to: • Subscribe to and navigate through multiple food delivery mobile apps. • Collect data on menu items including descriptions, pricing, customer ratings, and associated...
...Libraries: Experience with web scraping libraries like BeautifulSoup, Selenium, and data processing libraries like Pandas. Output Format: Ability to export data into an Excel file using Pandas or similar libraries. Error Handling: Robust error handling to manage failed requests and parsing errors. Compliance: Adherence to the websites' terms of service and rate limits to avoid being blocked. Project Scope: Input: A list of CRM numbers and a list of CID numbers. Process: Automate the lookup and data extraction process. Output: An Excel file with the compiled data. Skills Required: Web Scraping Python Programming Data Processing Automation Excel File Generation To Apply: Please provide: Examples of similar automation projects you have completed....
...person within each company. This could be anywhere between 10 to 30 people per company. - The information should be accurate and up to date. - If you have a strategy for obtaining this data, please share it in your bid. Skills/Experience: - Strong research skills - Data entry and data mining expertise - Proficient in Saudi Arabian business landscape - Attention to detail and accuracy - Web scraping - Web search - Leads Results should be in an excel sheet format, outlining the name, position, email address for each contact. Contacts for each company should be grouped together, end file should be in 1 sheet, not separate sheets. Send me: 1- Your strategy in finding those companies and collecting names and emails of relevant employees, 2- Total number of expected V...
...using GitHub Actions, set up logging for each service, and configure an HTTPS domain for our web application hosted on Google Cloud Platform (GCP). The ideal candidate should have extensive experience with GCP, CI/CD pipelines, and HTTPS configuration. Scope of Work: 1. CI/CD Implementation: - Set up a CI/CD pipeline using GitHub Actions for automated testing, building, and deployment of both frontend and backend applications. - Integrate the pipeline with our GCP infrastructure, including Compute Engine, Cloud SQL, and Cloud Storage. 2. Logging Setup: - Configure logging for all services: -- Frontend (Nginx, ): Log HTTP requests, errors, and application logs. -- Backend (Gunicorn, Django): Log application errors, access logs, and system logs. -- Celery and Beat: Log t...
I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively
I'm seeking a Django/ Java Script with Bootstrap expert who can assist with the layout and design of my website atplands.com. The primary goal of this project is to update the site's visual appearance. My website: Reference downloadable Theme code: Key tasks include: - Reviewing the current website and providing recommendations for improvements - Collaborating with the team to create a new, fresh look for the site - Ensuring the new design is functional and user-friendly Ideal skills for this project include: - Strong experience with Django/ Java Script with Bootstrap - Proven track record of working on front-end development using JavaScript/Bootstrap - A good eye for design and layout - Ability to understand and implement JavaScript
I need to Extract followers of group members of the link I will provide
I am looking for a web-scraping expert to retrieve both images and text from a specific website for research purposes. The text data will need to be structured and saved in a CSV file, including paths to saved images. Key details to consider: - Knowledge of web scraping tools and techniques is essential to accomplish this task. - Quality control to ensure accurate data extraction and image quality is critical. - Structure page information and freeform descriptions should be made available in a CSV file. - The images should be saved in their original resolution and quality settings. Please provide any relevant experience you have in web scraping, including free and paid services you have used before to help with your work. I would like the p...
I need a professional who can help me with scraping data API from a specific website or platform. I'm looking to extract specific data points or information and potentially set up a regular scraping process. Key Requirements: - Proficiency in Web Scraping: I need someone who has experience with web scraping tools and techniques. - Data Mining Skills: The ability to identify and extract the specific data points I require is crucial. - Automation Expertise: If you have experience setting up automated scraping processes, that would be a huge advantage.
...looking for a highly skilled Django developer who can help me build a social networking site with a focus on user engagement, similar to Facebook. The site will have the following main features: - User Registration and Login: The registration and login process should be seamless. Users should be able to register using their email and a password. - News Feed: The news feed should display posts primarily from the user's friends. This is a crucial feature for the site, and it should be designed to encourage user engagement and interaction. - Messaging System: The site should have a robust messaging system that allows users to communicate with each other privately. Ideal Skills and Experience: - Proficiency in Django: I need someone who is well-versed in Django...
...but it's not functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means that it's not just supposed to collect all messages or o...
...keyword. Need data in Excel spreadsheet. Eg : if i search cat in playstore, i need the below mentioned details of first 100 apps shown in the search result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, daily scraping solution - python experts, node.js experts If you think you're the right person for this job, please get in touch wit...
I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!
I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you
We are seeking a skilled developer or development team to create a comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product category (inc...
Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA
I need historical stock prices and income statement data, deliver python script to collect this data for an arbitrary stock from google finance.
Hello, This is a $20 project. Looking for a freelancer to develop a python script to retrieve restaurant data from Google Maps using the Maps/Places API. The script should target restaurants that have a phone number and *do not* have a website. The inputs I need to enter are: - Location (latitude and longitude) - Search Radius (in meters) - Ensure the business/place is a restaurant, bakery, etc. Key Data to Retrieve, output in a .CSV: - Business Name - Address - Phone Number - Google Maps URL Thank you, trooper501
I'm in need of a skilled professional to help me create a data mining script. The task involves mining emails, data from a certain website and delivering the data in...and delivering the data in a raw text file format. Key Requirements: - Develop a data miner script that can effectively scrape email data from websites. - Ensure the script can handle multiple sources and is scalable for future needs. - Deliver the mined data in a raw text file format. Ideal Skills: - Proficiency in web scraping and data mining techniques. - Experience with developing scripts for text data mining. - Strong knowledge of scripting languages suitable for scraping like Python/BeautifulSoup, R, etc. Please provide samples of your previous similar projects or portfolio that demonstra...
I'm looking for an Indian Python developer to create a script that can retrieve specific data from Telegram. Key Points: - The script should be able to fetch phone numbers and migration of users from Telegram. The ideal candidate should: - Have a strong background in Python development - Be familiar with working with API's - Have experience in web scraping - Have a good understanding of data privacy and security - Be able to deliver the project on a monthly basis. Looking forward to hearing from Python developers with relevant experience.
...skilled web developer to improve and update our existing Django-based website. The project involves: Menu Bar: Update and ensure consistency with multilingual support (Swedish, Danish, English). Contact Form: Implement validation, translations, CAPTCHA, and backend management. Multilanguage Support: Set up inputs for Swedish, Danish, and English without auto-translation. Articles and Blogs: Improve layout, image handling, and formatting consistency. Search Function: Enhance search to include titles and body text. Main Picture: Add functionality to change the main picture with size guidelines. Home and About Pages: Ensure consistent formatting and editable content. DNS and Email Setup: Correct domain pointers and enable email functionality on server. Proven experien...
I'm seeking a skilled web developer to assist with the creation of an informational website. I have a strong background in web development myself but am currently swamped with other tasks, so I need someone to take the helm on this project. Here are a few pertinent details: - Expertise: As I too am knowledgeable in web development, I'm looking for someone who can not only develop a website from scratch but also brainstorm and come up with innovative ideas to make the website more engaging and user-friendly. - Flexibility: I didn't specify a preference for a specific framework, so whether you are skilled in Django, ReactJs, or AngularJS, you're welcome to apply. This means you have a certain amount of freedom to choose the tools you&#...
We are in the final stage of migrating an existing Django Project to a new machine in a docker compose stack. The database is already moved over. We are stuck with python dependency issues. You need to have good knowledge in - Django and Python3 - Docker, especially Compose stacks - Postgresql You will be working with a system admin who is in the middle of the migration and take over the dependency part, tmate will be used to work together. If you have read this, please add "HDJX34K" to your bid or it will be considered spam, ignored and removed. Your job: - docker compose build - have a look at the python dependency issues - try to resolve them and rebuild. - eventually adjust Django's accordingly. We want this work done now, and you must be able ...
...and user experience. - Maintain high standards of code quality and push for continuous improvement. **What You Need:** - BS/MS in Computer Science, Engineering, or related field. - 2-3 years of full-stack development experience, with significant focus on mobile apps. - Strong proficiency in Flutter or similar, front-end technologies (HTML5, CSS3, JavaScript), and backend development (Node.js, Django). - Experience with databases (SQL & NoSQL), cloud services (AWS, Google Cloud, Azure), and versioning tools like Git. **Why Join Us?** - Flexible working hours and a chance to work in a dynamic, fast-paced environment. - Continuous learning and professional development opportunities. ? **Apply Now!** Send your resume, a cover letter, and work samples/portfolio demonstrating ...
Hello, I'd like to correct an error I have on our Python/Django website hosted on PythonAnywhere. Here are the logs: If you think you can fix this bug, please contact me via Freelancer.
I'm looking for someone who can...for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to s3 storage. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Speed during sc...
...need of a competent Python Django developer who can handle complex backend development and database integration tasks and run code as offline. Key Responsibilities: Develop, test, and maintain robust, scalable, high-quality software solutions. Design and implement new features and functionality. Write clean, maintainable, and efficient code. Develop RESTful APIs to support front-end functionality. Integrate user-facing elements developed by front-end developers with server-side logic. - In-depth understanding and experience of backend operations using Python Django. - Managing and integration of the database with the application. - Maintenance and improvement of existing codebase for optimal functionality. Desirable Skills: - Proven experience in Python Django ...
I'm in need of a professional who can consistently extract data from a specific website on a daily basis. Key Requirements: - Data Extraction: Extracting various forms of data from a website. - Ongoing basis: This is not a one-time job. I'm looking for long-term cooperation, with the extraction ideally happening on a daily schedule. Ideal Skills and Experience: - Web Scraping: Proficiency in web scraping tools and techniques is a must. - Automation: Experience with automating the extraction process to make it efficient. - Consistency: Ability to maintain a daily extraction schedule accurately is crucial. Please include in your bid how you plan to approach this sort of ongoing data extraction.
Our project aims to enhance the Django website running on Ubuntu by addressing several key issues. We will streamline Google registration, fix email registration to avoid redundant data requests, and update the logo. We'll verify email confirmation, resolve logout errors, and ensure the machine names display fully. We'll adjust font sizes, reorganize dashboard boxes, correct console errors, and fix icon colors. Additionally, we'll refine machine information display, adjust button states, and update dropdown menu functionality. Finally, we'll correct API settings visibility and fix data display issues on the profile page and other sections.
I need a professional who can extract data from a website on a daily basis. Key Responsibilities: - Extracting data from a specified website - Ensuring the d...need a professional who can extract data from a website on a daily basis. Key Responsibilities: - Extracting data from a specified website - Ensuring the data is accurate and up to date - Delivering the data in a specified format Skills and Experience: - Proficient in web scraping and data extraction - Experience in automating data extraction processes - Ability to maintain data accuracy and consistency - Knowledge of relevant data formats for delivery - Strong attention to detail and reliability This is an ongoing project, and I need someone who can commit to daily extractions. Be sure to include relevant...
I'm looking for a skilled AI, Flutter, and Django, python, developer to work on a project with the following key aspects: - AI Integration: The primary focus will be on implementing machine learning technology in the application. You should have a solid understanding of AI principles and how they can be leveraged in a mobile application, in this case using Flutter. - Cross Platform Development: The Flutter application will be targeted for both Android and iOS platforms. You should have experience in developing cross-platform applications and understand the nuances of each platform. - Django for CMS: The Django framework will be used to create a robust Content Management System (CMS) for the project. You should be proficient in Django ...
...that the software is designed to run on Windows OS. Website Accessibility: - Restricted access: Websites that require restricted access or login should be identified and reported separately. The software should skip such pages and indicate them as inaccessible. Ideal candidates should possess: - Proficiency in software development and experience in creating similar tools. - Familiarity with web scraping, data extraction, and bulk processing. - Prior experience in creating Windows-compatible software. - Strong attention to detail and the ability to accurately handle and report inaccessible URLs. As the client, I am open to the choice of programming language(s), as the final product is more important to me. The primary goal is to have a reliable and efficient tool that c...
...at a specified set of organizations. The ideal freelancer for this project should have: - Experience in web scraping, particularly with LinkedIn data - Ability to extract data at scale - Proficiency in organizing and structuring data for clear analysis - Strong attention to detail to ensure data accuracy The project involves: - Using the provided list of target companies to source employees' data - Identifying individuals who have previously worked at the provided specific companies - Compiling the data in a spreadsheet format for delivery The successful applicant should not only have the required technical skills but also the capability to deliver quality and timely results. Please showcase your experience in web scraping and the releva...
I am in need of an experienced Django developer to debug and troubleshoot issues within my existing Django project. Specifically, I have been encountering issues with the nginx server. Key Responsibilities: - Debug and troubleshoot existing Django project - Resolve issues related to the nginx server Ideal Skills and Experience: - Proficient in Django web framework - Expertise in troubleshooting and debugging Django projects - Experience with nginx configuration and troubleshooting - Strong understanding of database models, views, and templates in Django - Ability to efficiently integrate third-party libraries if necessary Please note that this project is primarily focused on fixing issues within an existing project...
