Visual Web Ripper Logo Visual Web Ripper Logo
Welcome Guest Search | Active Topics | Log In | Register

Tag as favorite
Ajax issue...
TIRocks
#1 Posted : Tuesday, November 09, 2010 4:54:16 PM
Groups: Registered
Joined: 11/9/2010
Posts: 2
So I have made it this far on the website, http://www.versatiledogs.com/kdb/search.php

I select the radio button "Alphabetical" and then search button.

I get that far in web ripper, now I am trying to have web ripper click on the "More Info" button for each listing there and extract the business name and email. Then click on the Next Page button and get the rest of the contacts info, repeat for all 1,325 contacts. I am having trouble doing this, I guess because of the ajax on the site.

Any suggestions?
Sequentum Support
#2 Posted : Tuesday, November 09, 2010 7:46:34 PM

Groups: Administrators
Joined: 4/10/2010
Posts: 1,239
Location: Sydney, Australia
Web scraping can be an extremely difficult task on some websites, even for us. If you have none or very little web scraping experience, you will not be able to extract data from all websites.

We only provide limited free support. Read here for more details:

http://www.visualwebripp...om/Support/Default.aspx

Basically you need to attach a data extraction project in order for us to look at any specific issues you have with the project.
TIRocks
#3 Posted : Wednesday, November 10, 2010 10:04:15 AM
Groups: Registered
Joined: 11/9/2010
Posts: 2
Thank you for the reply. I have attached the project I am working on, if you don't mind taking a look at it.

As you can see I can get web ripper to search for all kennels in the USA and list them in alphabetical order in the search results.

Then I try to get web ripper to click on each "More Info" link to expand the listing so I can get the "Kennel Name" "Email" and "Contact/Phone info" it appears that it extracts some of the data from each listing on the first page but then when it goes to the "Next Page" it kind of freezes there and then stops running. I check the data it pulled and it seems to have extracted the kennel names on the first page and all the info for one of the listings. Never got any of the data from the second page it opened.

It looks to me that the ajax is causing the issue.

Any ideas?

Thanks,
Shelby



File Attachment(s):
Versatiledogs.rip (96kb) downloaded 22 time(s).
Sequentum Support
#4 Posted : Thursday, November 11, 2010 1:53:39 AM

Groups: Administrators
Joined: 4/10/2010
Posts: 1,239
Location: Sydney, Australia
Here is a demo project that works.

This website is very dynamic and you really need to be an expert web scraper in order to extract data from this website. Unfortunately, we cannot provide this level of support on an ongoing basis.
File Attachment(s):
Versatiledogs.rip (107kb) downloaded 40 time(s).
Users browsing this topic
Guest
Tag as favorite
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

Powered by YAF 1.9.4 RC1 | YAF © 2003-2009, Yet Another Forum.NET
This page was generated in 0.079 seconds.