Skip Navigation

Site Wide Message: Posted Sep 3, 2010 9:27:22 AM EDT.Dismiss this message
In observance of the United States Labor Day holiday the Rent A Coder office will be closed on Monday, September 6th. However, we will be approving projects and making payment verifications two time during the day; once early-morning and once in the early evening. We will resume our normal business hours on Tuesday, September 7th and wish everyone who celebrates it a happy Labor Day.

A big thank you to all site users for helping us win the 2010 Inc 5000 award for fastest growing private company, for the fourth year in a row!
Employers and workers: two universities are interested in how and why you use vWorker. (All information will be kept confidential and only reported in aggregate.)
  1. Employers: Louisiana State University wants to learn about the factors that influence your adoption of online sourcing. Click here to take the survey.
  2. Workers: Erasmus University wants to understand how you use the site. Contributors will receive a final copy of the aggregated data Click here to take the survey.


SERPS scraping
Project Id: 1465994

Bookmark in my 'To Do' list
Posted by: spainops (2 ratings)
(Employer rating 10)
Non-action Ratio: Very Good - 0.00%
Employer Security Verifications: Good
Approved on: Jul 30, 2010
12:42:43 PM EDT
Bidding Closes: Sep 13, 2010
6:27:04 PM EDT
Viewed (by workers): 792 times
Deadline: Sunday Aug 29, 2010 10:03:22 AM EDT
(14 days after 8/15/2010 10:03:22 AM)
Phase:
100% of work was accepted by employer. Worker account has been credited and paid.
Payment Model: Pay-for-Deliverables
Max Accepted Bid: Bidding is closed
Expert Guarantee: 10% minimum REQUIRED
Project Type: Unsure of Project Price (or Beginner Assistance)
Bidding Type: Open Auction
Accepted Bidder Economy Type(s): All
Accepted English fluency(ies): All
ExpertRating Requirement: None
Shortcuts

Communication

Messages summary
Post first reply
Chat log
During project work

Status reports
Escrow Log
Work acceptance
Assembla Tools
Mediation / Arbitration
Other

Contact info / receipts
Project phase log
Ratings

(Note:options without links are not enabled for this phase.)

Enter chat room for this project
(0 active users at Sep 5, 2010 10:04:18 PM EDT)

Brief Summary:
  • vWorker.com reminder: You MAY NOT post the final solution for this (and any) project before your bid is accepted and funds are fully escrowed. Anyone who does may have their account permanently suspended. However, you CAN post:
    • On programming projects: A prototype or functional demo...as long as source code is not provided.
    • On graphics projects: A watermarked and low-resolution version of the work.
<style> <!-- /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {mso-style-parent:""; margin:0cm; margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:12.0pt; font-family:"Times New Roman"; mso-fareast-font-family:"Times New Roman";} @page Section1 {size:595.3pt 841.9pt; margin:72.0pt 90.0pt 72.0pt 90.0pt; mso-header-margin:35.4pt; mso-footer-margin:35.4pt; mso-paper-source:0;} div.Section1 {page:Section1;} --> </style>

PLEASE NOTE THE CRITERIA IS NOW AS FOLLOWS

SERPS SCRAPER

Only one search engine www.google.co.uk Have the abilty to specify normal google search criteria eg accountant leeds -xxxxx etc

All I want is sites built by Wordpress (if you look at the 'page source' of the site in SERPS Wordpress sites will always contain wp-content) See example below that contains wp-content

eg http://seo.getonthenet.org/wp-content/plugins/google-ajax-translation/google-ajax-translation.css?ver=20100412' type='text/css' media='screen' /

To view the page source YOU DO HAVE TO MOVE AWAY FROM THE HEADER as that does not show all the source code normally. Does that make sense ?

Ideally the output would be in exl format or similar eg txt delimited

The URL is all I need and a way to know what I searched for eg if the output goes directly to a exl file the file should be called the same as the kw search eg leeds accountant.xls.

OR the xls file would contain both url and kw search phrase. Whichever is easiest.

I am serious about this.

I will have much more work which could be very profitable to us both.

Thanks

Si



Requirements Interview Answers:
To help you bid more accurately, the employer was interviewed about the requirements for this project. Below are their answers. Untitled Page
Project Type: What kind of work do you need done?
Software related (Includes desktop applications and internet websites)
Project Parts: What do you want the worker to do on this project?
Requirements: The worker will analyze the problem and propose a software-based solution to the problem.
Programming: The worker will take the requirements and translate them into the language of the computer (and test it).
User installation: The installer will move the software from the place it was created (which is called the development or QC environment) to where you will use it (which is called the production environment). The installer then tests the software to make sure that the installation was done properly and completely.
Req. Doc. Type: What kind of documentation do you want for this project?
Formal documentation - After talking back and forth, the worker creates a formal document and/or prototype, as follows:
  • Prototype: The analyst will create a non-working mockup of all pages/screens in the final software. Creating a prototype makes it easier for the user to visualize the final software, and reduces misunderstandings.
Program Type: What kind of software should the worker create (and/or install)?
  • A desktop or server program: This software runs on a user's own PC/workstation, or on a server.
Desktop / server program info
Size of application: How many screens/forms need to be created/edited in this application?
I don't know.
Other info:
Ubot or similar (SERPS output analysis) Scraping ?

I think this would be ideal for someone with Ubot skills or similar. This is my first posting here so if I miss stuff or confuse sorry !

This is a task I am performing repetitvely so I want it automated. And I need a bit of flexibility. This is for extracting output from SERPS listings

Here is a video of what I am doing ! Which hopefully shows what I am trying to achieve here. As you can see its not always a contact page !. You may need to scrape the whole site. And as you will see its not always possible to view the page source which is a bonus (as mentioned below).

Video http://www.screencast.com/users/spainops/folders/Jing/media/8f333c14-b699-400a-969f-d05e466cf79f

INPUT

This is a keywords search using whatever search engine (see note at bottom) and keywords I want to use and extraction of data from sites in the SERPS listings

1. Be able to specify a single search engine (MUST)

2. Be able to specify keywords for search (MUST)

OUTPUT From analysis of results ie each site has to be analyzed for - (Google Places sites should ideally be analyzed as well !)

1. The site must have a phone number or email address (MUST have one or the other) ie if not on Home page typically go to contact page and get information or trawl all pages. Webmaster email addresses are no good ! OR If it is a a site with no email or phone and there is a form to complete then set a flag for this (If that's too complicated please state that). What I Am trying to avod is ADSENSE SITES so the site that is output MUST have a phone number,email address or a contact form

2. Display how the site is displayed in SERPS (the search engine listing) ie Title and Description (ideal ie not a must)

3, Display 'source' of home page (I use firefox as my browser and I'm not sure if you need a plugin for this but there are loads available. When you have clicked on the site you scroll down ie away from the header and then right click and you get an option from the browser for page source. It shows the html etc.. This is available in IE as well. It is important to scroll away from the header ! ) (ideal ie not a must)

4. If you can achieve 3 above (page source) and then search for wordpress within the output of the page source and then in the output data flag this is a wordpress site ie you found an occurence of wordpress GREAT !

So the IDEAL results will look like this

website phone number (if found), email (if found), contact form (if only a contact form), page source, wordpress flag

IF no phone number or email or contact form I don't want to know !. As stated above page source and wordpress flag would be a great bonus

Output can be EXL or text comma deliminated (EXL best) or if you have a different option let me know.

IF USING DIFFERENT SEARCH ENGINES IS A PROBLEM LETS JUST FOCUS ON GOOGLE.COM,GOOGLE,CO.UK but I need that flexibility at least. Again please state what you can do.

Folks I will have more work (html) soon. Simple updates to clients sites. I would be interested in your hourly rates. Let me know if you are interested in that as well.

Si
Programming Language: What programming language(s) do you want your application written in?
I don't know what language (and need the worker's assistance to suggest it).
Other info:
Ubot or similar (SERPS output analysis) Scraping ?

I think this would be ideal for someone with Ubot skills or similar. This is my first posting here so if I miss stuff or confuse sorry !

This is a task I am performing repetitvely so I want it automated. And I need a bit of flexibility. This is for extracting output from SERPS listings

Here is a video of what I am doing ! Which hopefully shows what I am trying to achieve here. As you can see its not always a contact page !. You may need to scrape the whole site. And as you will see its not always possible to view the page source which is a bonus (as mentioned below).

Video http://www.screencast.com/users/spainops/folders/Jing/media/8f333c14-b699-400a-969f-d05e466cf79f

INPUT

This is a keywords search using whatever search engine (see note at bottom) and keywords I want to use and extraction of data from sites in the SERPS listings

1. Be able to specify a single search engine (MUST)

2. Be able to specify keywords for search (MUST)

OUTPUT From analysis of results ie each site has to be analyzed for - (Google Places sites should ideally be analyzed as well !)

1. The site must have a phone number or email address (MUST have one or the other) ie if not on Home page typically go to contact page and get information or trawl all pages. Webmaster email addresses are no good ! OR If it is a a site with no email or phone and there is a form to complete then set a flag for this (If that's too complicated please state that). What I Am trying to avod is ADSENSE SITES so the site that is output MUST have a phone number,email address or a contact form

2. Display how the site is displayed in SERPS (the search engine listing) ie Title and Description (ideal ie not a must)

3, Display 'source' of home page (I use firefox as my browser and I'm not sure if you need a plugin for this but there are loads available. When you have clicked on the site you scroll down ie away from the header and then right click and you get an option from the browser for page source. It shows the html etc.. This is available in IE as well. It is important to scroll away from the header ! ) (ideal ie not a must)

4. If you can achieve 3 above (page source) and then search for wordpress within the output of the page source and then in the output data flag this is a wordpress site ie you found an occurence of wordpress GREAT !

So the IDEAL results will look like this

website phone number (if found), email (if found), contact form (if only a contact form), page source, wordpress flag

IF no phone number or email or contact form I don't want to know !. As stated above page source and wordpress flag would be a great bonus

Output can be EXL or text comma deliminated (EXL best) or if you have a different option let me know.

IF USING DIFFERENT SEARCH ENGINES IS A PROBLEM LETS JUST FOCUS ON GOOGLE.COM,GOOGLE,CO.UK but I need that flexibility at least. Again please state what you can do.

Folks I will have more work (html) soon. Simple updates to clients sites. I would be interested in your hourly rates. Let me know if you are interested in that as well.

Si
Operating system(s) What operating systems(s) do you want your application to work on?
I do know the operating system(s):
  • Microsoft Windows -- version(s): 7
  • Database: Will this project include a database?
    No, it does not include a database.
    Installation Program: Does the worker need to create an installation program?
    Yes AND the program will be installed on only a single computer.
    Legal: 1) I require complete and fully-functional working program(s) in executable form as well as complete source code of all work done (so that I may modify it in the future).
    2) Deliverables must be in ready-to-run condition as follows (depending on the nature of the deliverables):
    2a) If there are any server-side deliverables (intended to only exist in one place in the Employer's environment) then they must be installed by the Worker in ready-to-run condition (unless specified elsewhere by the Employer).
    2b) All other software (including but not limited to any desktop software or software the employer intends to distribute) must include a software installation package that will install the software in ready-to-run condition on the platform(s) specified in this project (unless specified elsewhere by the Employer).
    3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Employer will receive exclusive and complete copyrights to all work purchased.
    3b) No part of the deliverable may contain any copyright restricted 3rd party components (including GPL, GNU, Copyleft, etc.) unless all copyright ramifications are explained AND AGREED TO by the employer on the site per the worker's Worker Legal Agreement.
    Other Requirements:
    • All deliverables must be uploaded to vWorker.com before the deadline(s) for this project...with no exceptions. If this contract makes it impossible for a competent person to do this, then do not start this project...but instead alert vWorker.com of an un-arbitratable, illegal project.
    • Remember that contacting the other party outside of the site (by email, phone, etc.) on all business projects < $500 (before the employer's money is escrowed) is a violation of both the employer and worker agreements. vWorker.com monitors all site activity for such violations and can instantly expel transgressors on the spot, so we thank you in advance for your cooperation. If you notice a violation please help out the site and report it. Thanks for your help.
    Categories:
    (Note: Like everything else on this page, these categories are part of the original contract for this project.)
    Microsoft Windows, Requirements, Operating systems / platforms, Other (Technology), Technology, Software Development, Desktop applications, Scripts and utilities, Tech details


    Expert Guarantee Required:

         It is crucial to the employer that this entire project be completed (100%) by the deadline of 14 days. They only want expert workers who will commit themselves to this deadline to bid. If you are not an expert or unable to commit completely to the deadline, then DO NOT BID on this project.

         If you are an expert and can commit, the employer would like you to demonstrate this by making an
    Expert Guarantee of at least 10% of your bid. (This would not need to be made now...but only if and when you are are selected as the winning bidder). If you complete the job (100% by the deadline), then your deposit would be refunded to you. If you do not, then you would forfeit the deposit and it would go to cover the employer's cancellation charge and the remainder donated to a non-profit charity.

         Please note that depending on how you choose to make the deposit, there may be a small, non-refundable processing fee. This fee can be reduced or eliminated by choosing a less expensive method of payment. Or, you may wish to ask the employer to cover the cost of the fee for you. You can do this in a number of ways such as: increasing the price of your bid, asking the employer to post a 2nd project to cover it (contingent on completion of the project), or by getting the employer to promise to pay the fee to you as a bonus (upon completion of the project). If you choose the bonus route, just remember that due to credit card/PayPal rules, vWorker.com CANNOT force an employer to pay a bonus involuntarily...even when promised on-site. So don't choose this option, unless you trust the employer, or are willing to take a small risk.

         This is just a very brief overview of how the Expert Guarantee works and there are many more details that you need to understand fully before you bid on this project. DO NOT BID on this project until you've read and fully understand everything about the Expert Guarantee (including reading the contract and the FAQs).



     
    Messages summary
    ( Back to shortcuts )
    All monetary amounts on the site are in United States dollars.
    vWorker.com is a closed auction, so workers can only see their own bids and comments. Employers can view every posting made on their projects.

    2 bids have been posted. Why can't I view bids from other workers who are bidding against me?
    Bidding/comment cannot be viewed until you are logged in.


     
    Ratings
    ( Back to shortcuts )

    Rating Rated Rated For Rated By Rated On  
      10
    (Excellent)
    spainops SERPS scraping divya.aradhya
    (who themselves is rated 9.95 - Excellent)
    August 19, 2010 7:17:14 AM EDT
      One of the nicest people I've worked with.
    Si is polite, professional and prompt.
    Thank you for everything.

      10
    (Excellent)
    divya.aradhya SERPS scraping spainops
    (who themselves is rated 10 - Excellent)
    August 19, 2010 7:12:58 AM EDT
      Divya is a pleasure to work with. Very fast and efficient. Kept me updated throughout the process and was very flexible. Really pleased with the software that was created.

    I would 100% recommend anyone to try Divya and will pass his details on to forums I am a member of.