vWorker.com - Google Scraper Wanted

Site Wide Message: Posted Jul 28, 2010 8:21:53 PM EDT.

Important info for Indian workers: Paypal is *stopping* electronic withdrawl after July 29th. Click here for more information (and a workaround offerred by Payoneer).
Workers, are you using pay-for-time? If not, you may be missing out on an easy way to increase your profits.
Entrepeneur magazine called us: "One of the 100 smartest, most innovative, hands-down brilliant companies on our radar" in their June issue.

Older items:Cloud computing update | Entrepreneur mag. poll results | 71 new work categories | Cloud computing

Show Project

Google Scraper Wanted
Project Id: 1249931

Bookmark in my 'To Do' list

Posted by:	ubaidabcd (24 ratings) (Employer rating 9.66)
Non-action Ratio:	Above Average - 25.00%
Employer Security Verifications:	Good
Approved on:	Sep 11, 2009 9:00:32 PM EDT
Bidding Closes:	Sep 25, 2009 8:59:42 PM EDT
Viewed (by workers):	402 times
Deadline:	Saturday Sep 19, 2009 1:03:26 PM EDT (5 days after 9/14/2009 1:03:26 PM)

Phase:

100% of work was accepted by employer. Worker account has been credited and paid.

Payment Model:

Pay-for-Deliverables

Max Accepted Bid:

Bidding is closed

Project Type:

Very Small Business Project: under $100(USD)

Bidding Type:

Open Auction

Accepted Bidder Economy Type(s):

All

Accepted English fluency(ies):

All

ExpertRating Requirement:

None

Shortcuts

Communication Messages summary Post first reply Chat log	During project work Status reports Escrow Log Work acceptance Assembla Tools Mediation / Arbitration	Other Contact info / receipts Project phase log Ratings
(Note:options without links are not enabled for this phase.)

Enter chat room for this project
(0 active users at Jul 30, 2010 12:31:55 PM EDT)

Brief Summary:

vWorker.com reminder: You MAY NOT post the final solution for this (and any) project before your bid is accepted and funds are fully escrowed. Anyone who does may have their account permanently suspended. However, you CAN post:

On programming projects: A prototype or functional demo...as long as source code is not provided.
On graphics projects: A watermarked and low-resolution version of the work.

I need a scraper that will scrape the organic and sponsored results in Google. This is how I would like the program to work:

I type a keyword in your program, for example: "dallas divorce lawyers". I should be able to specify, broad match and exact match.

Then I specify which page numbers in Google to scrape, for example I don't want to scrape the 1st or 2nd page in Google. I want to scrape pages 10 through 20. This can vary, this is the reason I need to specify the page range.

Then your program will scrape pages 10-20 in Google for the organic listings for "dallas divorce lawyers".

Then the final output is a list of websites (I need the url's) from organic listings pages 10-20. Any duplicates should be deleted.

Please make sure the scraper works correctly when scraping google and doesn't get my IP banned. There should be a delay between scrapes.

Scraper should export data into Excel format and work on Windows 7.

You should have previous experience in coding scrapers.

Requirements Interview Answers:
To help you bid more accurately, the employer was interviewed about the requirements for this project. Below are their answers. Untitled Page

Project Type:

What kind of work do you need done?
Software related (Includes desktop applications and internet websites)

Project Parts:

What do you want the worker to do on this project?

Requirements:	The worker will analyze the problem and propose a software-based solution to the problem.
Programming:	The worker will take the requirements and translate them into the language of the computer (and test it).
User installation:	The installer will move the software from the place it was created (which is called the development or QC environment) to where you will use it (which is called the production environment). The installer then tests the software to make sure that the installation was done properly and completely.

Req. Doc. Type:

What kind of documentation do you want for this project?
Informal documentation - As the employer talks back and forth about the project with the worker, those conversations become the requirements.Remember to communicate ALL of the details of your project on the vWorker.com site. If you don't, and there is a dispute, then important details of the contract will not be documented and cannot be taken into account in arbitration. If you feel you MUST go offsite (for example, using the phone or IM) then afterwards post everything onsite and get the other party to post that they agree to those contractual terms.

Program Type:

What kind of software should the worker create (and/or install)?

A desktop or server program: This software runs on a user's own PC/workstation, or on a server.

Desktop / server program info

Size of application:

How many screens/forms need to be created/edited in this application?
I don't know.

Programming Language:

What programming language(s) do you want your application written in?
I do know the language(s).
Languages(s):

C++ / C
Delphi
Visual Basic

Misc. details:
I prefer C language. I get scrapers coded from coders here in delphi or VB but, after a while they just stop working. If you can provide after support in this case (in a reasonable amount of time) or guarantee no bugs if you code in VB, I can consider you.

Operating system(s)

What operating systems(s) do you want your application to work on?
I do know the operating system(s):

Microsoft Windows -- version(s): win 7, xp

Database:

Will this project include a database?
I'm not sure (and need the worker to advise me).

Installation Program:

Does the worker need to create an installation program?
No. The worker needs to only give me instructions on how to install it.

Legal:

1) I require complete and fully-functional working program(s) in executable form as well as complete source code of all work done (so that I may modify it in the future).
2) Deliverables must be in ready-to-run condition as follows (depending on the nature of the deliverables):
2a) If there are any server-side deliverables (intended to only exist in one place in the Buyer's environment) then they must be installed by the Seller in ready-to-run condition (unless specified elsewhere by the Buyer).
2b) All other software (including but not limited to any desktop software or software the buyer intends to distribute) must include a software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request (unless specified elsewhere by the Buyer).
3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased.
3b) No part of the deliverable may contain any copyright restricted 3rd party components (including GPL, GNU, Copyleft, etc.) unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the seller's Seller Legal Agreement.

Other Requirements:

All deliverables must be uploaded to vWorker.com before the deadline(s) for this project...with no exceptions. If this contract makes it impossible for a competent person to do this, then do not start this project...but instead alert vWorker.com of an un-arbitratable, illegal project.
Remember that contacting the other party outside of the site (by email, phone, etc.) on all business projects < $500 (before the employer's money is escrowed) is a violation of both the employer and worker agreements. vWorker.com monitors all site activity for such violations and can instantly expel transgressors on the spot, so we thank you in advance for your cooperation. If you notice a violation please help out the site and report it. Thanks for your help.

Categories:
(Note: Like everything else on this page, these categories are part of the original contract for this project.)
Microsoft Windows, Languages, C++ / C, Requirements, Operating systems / platforms, Visual Basic, Delphi, Other (Technology), Software related (includes websites)

Messages summary

(

Back to shortcuts

)

All monetary amounts on the site are in United States dollars.
vWorker.com is a closed auction, so workers can only see their own bids and comments. Employers can view every posting made on their projects.

13 bids have been posted

Bidding/comment cannot be viewed until you are logged in.

Ratings

(

Back to shortcuts

)

Rating	Rated	Rated For	Rated By	Rated On
10 (Excellent)	pjpj	Google Scraper Wanted	ubaidabcd (who themselves is rated 9.66 - Excellent)	September 18, 2009 2:22:18 PM EDT
Quality work, quick and clear communication.

10 (Excellent)	ubaidabcd	Google Scraper Wanted	pjpj (who themselves is rated 9.9 - Excellent)	September 26, 2009 11:39:48 PM EDT
Clear requirements. Employer responded to all queries very promptly. Was very prompt in accepting the work.

Search

'All Workers' Competition.

Newest projects.

Help with configuring java servlet on Weblogic ser ...

Google OpenSocial

Android Image Editor

Android Audio Editor

Android Video Editor

Create a form for Sharepoint

Outlook Form

cloning 2 existing joomla webs

2 new addresses on 5 pages and coupons

a vampire tale

Develop a .NET interface build a SQL report engine ...

FIRMWARE(repost )

SharePoint 2010 Web.Config

iPad Google Earth module

Designer required to design homepage psd based on ...