Data scraping linux jobs
I urgently need assistance with installing a PHP application on my dedicated Linux server. Key requirements: - Expertise in server management, particularly dedicated servers - Proficiency in PHP application deployment - Strong knowledge of Linux operating systems Please only bid if you have significant experience in this area and can start immediately. Your prompt help is highly appreciated.
I urgently need assistance with installing a PHP application on my dedicated Linux server. Key requirements: - Expertise in server management, particularly dedicated servers - Proficiency in PHP application deployment - Strong knowledge of Linux operating systems Please only bid if you have significant experience in this area and can start immediately. Your prompt help is highly appreciated.
We have two sites on windows server that we would like to move to linux, without having to rewrite code for both sites. The current code is ASP and ASPX (vbscript) with Acess dbase. I am looking for someone that can make our ASP and ASPX pages to work on linux server with mysql dbase. We have a VPS on godaddy server, that we can host the two sites on. You are only qualified if you have done this many times before. You may not use our sites to "try" to do this after doing research, we only want experienced individuals on this.
...Java or python3 programmer to create a sensor-data generator for the website www.voeazul.com.br. The objective is to send a POST request to the site with valid sensor-data in order to obtain a particular cookie (_abck) for data analysis purposes. The sensor data to be simulated includes mouse movements, keyboard interactions, and browser interactions. Key Requirements: - Create a sensor-data generator in Java or python3 - The generator should simulate mouse movements, keyboard interactions, and browser interactions - The sensor-data should be valid enough to trigger the generation of the _abck cookie upon sending a POST request to Ideal Skills and Experience: - Proficiency in Java/python3 programming - Experience in web scraping and ...
Looking for help in modifying an existing python script and related sql database table The current script - (1) scrapes company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardcoded in the script Requirement- (1) Company names/urls/keywords (will be provided) to be put in master table in the database (2) The script to loop through and scrape the relevant data and put in database
I'm looking for a freelancer who's great at web scraping to help with a project involving a specific website initially, with potential for more. I'll give you the specific data fields to extract. It'd be great if you: Are really good at web scraping and or Python. Know your way around MS SQL Server databases, not essential but definately an advantage. Understand how to extract data effectively. Understand the need for security and captcha integration if needed. Can work quickly since this project is a priority and needs to be done ASAP. Ultimately, I want to be able to manage the code with your ongoing help, so this could lead to a long-term partnership. I'll share the full details when needed. You will provide source code, documentatio...
I'm looking for a JavaScript developer to add the interactions to an offline web page. I have 1 image. I need in several places on it to put buttons that start the "data flow" - dashed lines (they are supposed to be pseudo animated). E.g. I press button 1 - blue data flows from source to destination, I press button 2 - red data flows from source to destination, etc. There are to be ~20 buttons and the same number of "flows" in several colors. The buttons will have to have their own names, e.g. Windows, Linux, Syslog. The whole thing is supposed to work offline, that is, as an end result I am supposed to get a zip with a directory where is, and that's all I need to run.
...No specific error messages are being displayed when attempting to establish the RDP connection. - The remote desktop host is running on Linux. - There have been some issues previously with establishing RDP connections to this server before the Cloudflare tunnel was set up. Your role will involve: - Investigating the issue thoroughly to understand why RDP isn't working as expected. - Implementing necessary changes to the Cloudflare setup or the RDP configuration to ensure a successful connection. - Addressing any underlying issues that might be causing the problem. Ideal Candidate: - A proficient understanding of Cloudflare and RDP, particularly on Linux systems. - Prior experience in troubleshooting and resolving RDP connection issues. - Strong problem-solving skill...
I'm in need of a proficient developer to create a comprehensive computer (in a network) probe software compatible with Windows and Linux. The software should have the following key features: 1. find systems in a network and log details to a CSV file/db table. hostname, ip addresses , mac address etc along with hard disks ,os,version etc. 2. find applications installed in the computers Ideal Skills & Experience: - Prior experience in developing network monitoring and security auditing software. - Proficiency in programming languages suitable for cross-platform development. - Strong understanding of network protocols and security standards. - Experience with compliance monitoring tools and techniques would be an added advantage. Please include re...
I'm in need of a concert ticket bot that can operate on several platforms, including Ticketmaster, Live Nation, ThaiTicketMajor, and BookMyShow Malaysia. The ideal bot should be able to perform sev...solving techniques or third-party captcha services if there is any available captcha yet to be solve, ensure scalability to handle high request volumes - Session tracking : the bot should extract and log the link for any session that successfully passes the queue The bot should be smart enough to navigate through the ticketing process of these platforms and complete the purchase. Experience in web scraping, automation, and ticketing bots, as well as knowledge of the mentioned platforms, is a must. If you can build a robust, reliable bot that meets these requirements, I'd lo...
I recently encountered a sudden booting issue with my AlmaLinux system. The problem began without any known cause and now the system displays filesystem errors during the boot process. I am seeking a proficient freelancer to help me resolve this problem promptly. Ideal candidates for this project should have: - Expertise in Linux systems, especially AlmaLinux - Experience troubleshooting and resolving sudden booting issues - Proficiency in identifying and rectifying filesystem errors Your role will involve: - Diagnosing the sudden boot issue on my AlmaLinux system - Fixing the filesystem errors that are occurring during the boot process - Ensuring that the system can boot successfully without any errors I look forward to working with a skilled freelancer who can efficiently res...
Hi, I am looking for someone to setup a Linux VM for me. I have tried to do it myself but have failed. I want to setup a VM so that I can host my own on-premise cloud. I got filerun as software from to do it with. Unfortunately, their installation instructions are not working out for me due to a lack of Linux knowledge. Now I am at a point where someone do it for me and I can work from there. I would like to see you do it so that I can see where I went wrong. I would also like it if you can assist me in the future if and when there is problems.
...expert, specializing in web scraping. I require someone who can proficiently extract data from various websites. The specifics of the data may vary from text content, images, links, to contact information. Your key responsibilities will include: - Writing effective and efficient Python scripts to scrape data - Ensuring the data is extracted accurately and in a structured format - Delivering the data in a timely manner The ideal candidate should have: - Proficient experience in Python and web scraping - A strong understanding of data extraction techniques - Proven experience in handling and parsing a variety of data types - Excellent communication skills and the ability to meet deadlines Please be prepared to provide ex...
I'm looking for an experienced hacker who specializes in database scraping to assist with lead generation. My main aim is to get detailed contacts to grow my business. - Specific Tasks: - Database scraping - Extract contact details - Contact Information: - Email addresses - Phone numbers Ideal candidates should have previous experience in the field. Proficiency in data mining and scraping is a must, along with an understanding of lead generation strategies. Strong grips and successful track records on obtaining accurate contact details are key to perform this job efficiently.
We are building a financial application whereas you can put money hence our AI works on it through big data and automation. The project is about algorithmic auto-investing trading on world wide's financial market. Fixed Rate Job Paid based on success delivery per country. $10/country. Make about 5-10 API/country for installing python, setting SQL for our applications and Google Sheet. For each country may need API for such as : 1. Historical Data 2. Financial Scrapped Source 3. Financial Summary Scrapped Source 4. Interest rate 5. Some More Required Skill & Experience : 1. Php & SQL 2. Familiar with python installing & setting up environments 3. Experienced in Linux Debian & LNMP server by SSH 4. You need to know on how to run python scripts on ...
I'm seeking a freelance professional to handle computer-related tasks including data entry, spreadsheet creation, word processing and software applications assistance. Requirements: - Proficiency in Windows, MacOS, or Linux operating systems - Experience with various software applications, including Microsoft Office, Adobe Creative Suite, and OpenOffice/LibreOffice - Ability to handle tasks in a timely manner This project is ideal for someone with a strong computer background and excellent attention to detail. Please apply if you meet these qualifications.
I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seaml...
Introduction We are seeking proposals from experienced web scraping and data analysis firms to conduct a comprehensive data collection and analysis project. The purpose of this project is to gather detailed information on menu items, pricing, customer ratings, promotions, and deals from various food delivery mobile apps operating within our city. The goal is to mine this data for actionable insights to inform our advertising, promotional strategies, and competitive benchmarking. 2. Project Scope The selected vendor will be responsible for developing and implementing a solution to: • Subscribe to and navigate through multiple food delivery mobile apps. • Collect data on menu items including descriptions, pricing, customer ratings, and associated...
Title: Automated Data Retrieval from Websites Using CRM and CID Numbers Description: We are looking for an experienced developer to automate the process of retrieving data from specific websites using CRM and CID numbers. The goal is to develop a script or tool that will: Look up Doctor's Specialization: Use CRM numbers to search on the website: CFM Doctors Search Extract doctor's information including their specialization. Look up Disease Descriptions: Use CID numbers to search on the website: MedicinaNet CID10 Search Extract the disease description. Deliverables: ( ) A script or tool that can take a list of CRM and CID numbers as input. Automate the search process on the specified websites. Extract
...find the contact name, position, email and LinkedIn account for each and every recruitment/HR/Headhunting person within each company. This could be anywhere between 10 to 30 people per company. - The information should be accurate and up to date. - If you have a strategy for obtaining this data, please share it in your bid. Skills/Experience: - Strong research skills - Data entry and data mining expertise - Proficient in Saudi Arabian business landscape - Attention to detail and accuracy - Web scraping - Web search - Leads Results should be in an excel sheet format, outlining the name, position, email address for each contact. Contacts for each company should be grouped together, end file should be in 1 sheet, not separate sheets. Send me: 1- Your strateg...
I'm looking for an expert to set up Redis in a Rocky Linux podman container. The aim is to ensure that it communicates over TLS using a Let's Encrypt certificate. Key Tasks: - Configure Redis to communicate over TLS - Integrate a Let's Encrypt certificate Ideal Candidate: - Proven experience with Rocky Linux and podman - Strong understanding of TLS and Let's Encrypt - Excellent problem-solving skills The successful candidate will make sure the Redis instance is optimally secured and can communicate over an encrypted channel. I can provide the certificates and build process. podman run --name rediscontainer -it rockylinux:9.3-minimal bash microdnf -y update microdnf -y install redis
I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively
I need to Extract followers of group members of the link I will provide
I am looking for a web-scraping expert to retrieve both images and text from a specific website for research purposes. The text data will need to be structured and saved in a CSV file, including paths to saved images. Key details to consider: - Knowledge of web scraping tools and techniques is essential to accomplish this task. - Quality control to ensure accurate data extraction and image quality is critical. - Structure page information and freeform descriptions should be made available in a CSV file. - The images should be saved in their original resolution and quality settings. Please provide any relevant experience you have in web scraping, including free and paid services you have used before to help with your work. I would like the project to ...
I'm in need of a knowledgeable Linux and AWS expert to assist me with various tasks related to command-line operations, system administration issues, and application support using AEM admin console. Key Requirements: - Strong command-line skills: You should be proficient in using the Linux command line for a variety of tasks. - System Administration: Experience in Linux system administration is essential, as I need assistance with file management, user management, and package management. - AWS Services: Familiarity with AWS services, particularly the AEM admin console, is a must. The ideal candidate for this role should possess a deep understanding of Linux, system administration, and AWS services to provide timely and effective job support.
I need a professional who can help me with scraping data API from a specific website or platform. I'm looking to extract specific data points or information and potentially set up a regular scraping process. Key Requirements: - Proficiency in Web Scraping: I need someone who has experience with web scraping tools and techniques. - Data Mining Skills: The ability to identify and extract the specific data points I require is crucial. - Automation Expertise: If you have experience setting up automated scraping processes, that would be a huge advantage.
I need an experienced Linux admin who can help me set up a CentOS server to function as a web, database, and file server. The ideal candidate will be familiar with CentOS and have experience configuring a server with multiple services. Key Requirements: - Install and configure CentOS on a server - Set up Nginx as the web server - Configure the server to also function as a database and file server - Ensure the server is secure and optimized for performance - Provide documentation of the setup and configuration for future reference.
...functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means that it's not just supposed to collect all messages or only new mes...
I am on the lookout for a tech whizz who can streamline and boost our Squid and Linux configuration to more efficiently handle a large quantity of proxies, potentially using a /48 ipv6 for each, amounting to a massive number (~65k for a /32 and 512k for a /29). Currently, we are facing: - Proxy connection issues - Resource utilization problems We are working with an enormous number of proxies, way more than 50,000. Our current server is running on Ubuntu 20. Ideal Skills and Experience: - Proven track record with Linux (Ubuntu) server management - Thorough understanding of Squid protocols - Expertise in managing high-volume proxy servers - Solid capability to optimize system resources We need someone who can provide a smooth and superfast experience to our users by re...
...script that can scrape the Google Play store specific data from list of apps in the search result url of any keyword. Need data in Excel spreadsheet. Eg : if i search cat in playstore, i need the below mentioned details of first 100 apps shown in the search result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, daily scrapi...
I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!
I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you
...comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product category (including breadcrumbs for hierarchical structure) --Title --Price --Availability ...
Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA
I need an experienced Linux admin who can help me set up a CentOS server to function as a web, database, and file server. The ideal candidate will be familiar with CentOS and have experience configuring a server with multiple services. Key Requirements: - Install and configure CentOS on a server - Set up Nginx as the web server - Configure the server to also function as a database and file server - Ensure the server is secure and optimized for performance - Provide documentation of the setup and configuration for future reference.
I need historical stock prices and income statement data, deliver python script to collect this data for an arbitrary stock from google finance.
Hello, This is a $20 project. Looking for a freelancer to develop a python script to retrieve restaurant data from Google Maps using the Maps/Places API. The script should target restaurants that have a phone number and *do not* have a website. The inputs I need to enter are: - Location (latitude and longitude) - Search Radius (in meters) - Ensure the business/place is a restaurant, bakery, etc. Key Data to Retrieve, output in a .CSV: - Business Name - Address - Phone Number - Google Maps URL Thank you, trooper501
I'm in need of a skilled professional to help me create a data mining script. The task involves mining emails, data from a certain website and delivering the data in a raw text file format. Key Requirements: - Develop a data miner script that can effectively scrape email data from websites. - Ensure the script can handle multiple sources and is scalable for future needs. - Deliver the mined data in a raw text file format. Ideal Skills: - Proficiency in web scraping and data mining techniques. - Experience with developing scripts for text data mining. - Strong knowledge of scripting languages suitable for scraping like Python/BeautifulSoup, R, etc. Please provide samples of your previous similar projects or port...
I'm looking for an Indian Python developer to create a script that can retrieve specific data from Telegram. Key Points: - The script should be able to fetch phone numbers and migration of users from Telegram. The ideal candidate should: - Have a strong background in Python development - Be familiar with working with API's - Have experience in web scraping - Have a good understanding of data privacy and security - Be able to deliver the project on a monthly basis. Looking forward to hearing from Python developers with relevant experience.
I'm looking for a Linux developer experienced in firewall handling and know PHP Apache seriuos developer for long term Key Tasks: Ideal Candidate: - Proficient with Linux environment - Experience in system administration - Understanding of different system tasks
is New York based Ecommerce company involved in processing of online print orders since 2010. Key Responsibilities - We are looking for AWS Linux Web Administrator to set up new and modify the existing AWS EC2 instance running Laravel application on Bitnami LAMP stack. Set up new dev server on AWS or Digital Ocean. Skills and Experience: - Minimum 3 years verifiable experience as Linux Web Administrator in creating and managing existing and new LAMP EC2 instance. Laravel application hosting experience preferred. Duration: Permanent: assignment and based on completed work items
...installation, automatic backup once a day, DDOS attack prevention, system performance optimization, hacking prevention, encryption between data transmissions, real-time monitoring, data recovery, backdoor checking, backdoor checking and deletion of compromised files, attack root identification and blocking, suspicious process occupation identification and recovery, server hacking analysis, server access history tracking, password recovery and complexity setting, virus and malicious software checking,,data leakage prevention.....etc My current monthly budget is about $50, Please send me a proposal/chat with as much as you can about what you can do to secure your Linux server and I will check them all and get back to you. **You will be required to write a we...
I'm on the lookout for a skilled RHEL Engineer to assist in getting our server on the Certified Hardware List. The role will require expertise in the core language of RHEL. Although I'm unsure if proficiency in C is obligatory, having it would be a welcome advantage. Specifically, ...expertise in the core language of RHEL. Although I'm unsure if proficiency in C is obligatory, having it would be a welcome advantage. Specifically, the Engineer will: - Understand the requirements for RHEL certification - Prepare the server for the process - Perform the tasks and tweaks necessary to meet certification conditions I anticipate that a strong understanding of programming, RHEL, and Linux-based operating systems will be necessary. Experience with server certification will a...
I'm looking for someone who can...for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to s3 storage. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Speed during sc...
We are looking for candidate from Hyderabad City only. I'm in need of a skilled system administrator who can manage a small infrastructure across Windows, macOS and Linux operating systems. The key tasks include server maintenance, network troubleshooting, software installation and updates, and configuring our server. Key aspects of the project include: - Supporting multiple operating systems: You should be experienced in working with Windows, macOS, and Linux. - System maintenance: Regular maintenance of our servers is essential for smooth operations. This includes updates and ensuring all systems are secure. - Network troubleshooting: You'll be responsible for keeping our network up and running. Troubleshooting issues as they arise is crucial. - Software installa...
I'm in need of a professional who can consistently extract data from a specific website on a daily basis. Key Requirements: - Data Extraction: Extracting various forms of data from a website. - Ongoing basis: This is not a one-time job. I'm looking for long-term cooperation, with the extraction ideally happening on a daily schedule. Ideal Skills and Experience: - Web Scraping: Proficiency in web scraping tools and techniques is a must. - Automation: Experience with automating the extraction process to make it efficient. - Consistency: Ability to maintain a daily extraction schedule accurately is crucial. Please include in your bid how you plan to approach this sort of ongoing data extraction.
I need a professional who can extract data from a website on a daily basis. Key Responsibilities: - Extracting data from a specified website - Ensuring the data is accurate and up to date - Delivering the data in a specified format Skills and Experience: - Proficient in web scraping and data extraction - Experience in automating data extraction processes - Ability to maintain data accuracy and consistency - Knowledge of relevant data formats for delivery - Strong attention to detail and reliability This is an ongoing project, and I need someone who can commit to daily extractions. Be sure to include relevant experience in your bid.
...make you a suitable candidate for this project. Project Description I'm currently in a bit of a tight spot. A Windows Server 2016 web application () was recently moved from a US provider to the by a non-professional freelancer. Unfortunately, after less than a week, the system has stopped working. I found out recently he has installed the application in Centos 7 (Linux) instead of Windows against my guidelines. In light of this, I am seeking a highly skilled professional to help me reinstall the system from the copy to the Window Server 2016 environment. The job involves the following steps: 1) Change the OS from Linex to Windows Server 2016 or Higher Use the copies of the site and desktop (will be uploaded when you accept the job) 2) Download Windows Server
...the software is designed to run on Windows OS. Website Accessibility: - Restricted access: Websites that require restricted access or login should be identified and reported separately. The software should skip such pages and indicate them as inaccessible. Ideal candidates should possess: - Proficiency in software development and experience in creating similar tools. - Familiarity with web scraping, data extraction, and bulk processing. - Prior experience in creating Windows-compatible software. - Strong attention to detail and the ability to accurately handle and report inaccessible URLs. As the client, I am open to the choice of programming language(s), as the final product is more important to me. The primary goal is to have a reliable and efficient tool that can ha...
