Visual Web Ripper Logo Visual Web Ripper Logo
Welcome Guest Search | Active Topics | Log In | Register

Tag as favorite
project stops after the first form field entry
Options
Previous Topic Next Topic
Andrew78
#1 Posted : Tuesday, July 12, 2011 5:21:41 AM
Groups: Registered
Joined: 7/12/2011
Posts: 8
Hi everybody,

I think this is a very tricky question. I made a scraper to grab data from a formfield, which is very dificult to scrape. Its a very big dataset and virtual web scraper is able to identify it but stops after the first formfield entry. I dont have any idea how to resolve the problem.

Thanks a lot for helping me
Cheers
Andrew

File Attachment(s):
EinzugsgebieteII.rip (435kb) downloaded 28 time(s).
Back to top
Report?
Sequentum Support
#2 Posted : Tuesday, July 12, 2011 5:58:30 AM

Groups: Administrators
Joined: 4/10/2010
Posts: 1,239
Location: Sydney, Australia
Hi,

What is the name of the element that has problem?
Back to top
Report?
Andrew78
#3 Posted : Tuesday, July 12, 2011 9:24:23 AM
Groups: Registered
Joined: 7/12/2011
Posts: 8
Hi,

I think its the element: ddl Straßen. I attached the debugging report.

Thank you very much for helping me
Cheers
Andrew
File Attachment(s):
debugging.txt (23kb) downloaded 22 time(s).
Back to top
Report?
Sequentum Support
#4 Posted : Wednesday, July 13, 2011 5:30:21 AM

Groups: Administrators
Joined: 4/10/2010
Posts: 1,239
Location: Sydney, Australia
Hi,

I think the website is too slow. Sometime I need to wait for more than 10 minutes to get the next page. Maybe you can increase "Page load timeout". This should get a better result.
Back to top
Report?
Andrew78
#5 Posted : Wednesday, July 13, 2011 6:07:54 AM
Groups: Registered
Joined: 7/12/2011
Posts: 8
Hi,

thanks a lot. I increased the "page load time out", but it stops always after the first of 10857 entries, that means the step ibtnsuchen 2 is completed (39 of 39) and it normaly has to go to 2 of 10857. But always on this point my scraper stops. I dont think that this has to do with the page load time. So do you have any idea what the problem is?

Cheers
Andrew
Back to top
Report?
Sequentum Support
#6 Posted : Thursday, July 14, 2011 5:38:54 AM

Groups: Administrators
Joined: 4/10/2010
Posts: 1,239
Location: Sydney, Australia
Please share the log file.
Back to top
Report?
Andrew78
#7 Posted : Monday, July 18, 2011 3:50:01 AM
Groups: Registered
Joined: 7/12/2011
Posts: 8
Hi,

here is the log file.

Thanks a lot for helping me!

Cheers
Andrew
File Attachment(s):
EinzugsgebieteII_info_11_07_18_logfile.txt (1kb) downloaded 20 time(s).
Back to top
Report?
Sequentum Support
#8 Posted : Monday, July 18, 2011 7:37:10 AM

Groups: Administrators
Joined: 4/10/2010
Posts: 1,239
Location: Sydney, Australia
Hi,

I've tested your project on another PC and found the problem. I need more information.

How long does it take to run the project (until it fail)?
Please give me the full log file. Both log file is only partial log.
Does ddlStrassen shown in designer mode?
Please capture VWR screen after submiting lbtnsuchen template.

We will investigating this asap.
Back to top
Report?
Andrew78
#9 Posted : Monday, July 18, 2011 12:30:31 PM
Groups: Registered
Joined: 7/12/2011
Posts: 8
Sequentum Support wrote:
Hi,

I've tested your project on another PC and found the problem. I need more information.

How long does it take to run the project (until it fail)?
Please give me the full log file. Both log file is only partial log.
Does ddlStrassen shown in designer mode?
Please capture VWR screen after submiting lbtnsuchen template.

We will investigating this asap.



Hi,

it takes 00:10:25 until it fail.
Hopefully now I posted the full logfile.
I'm not sure if we both mean with disgn mode the same, but i think that "ddl straßen" is shown in designer mode.
The "screenshot1" is the normal view, the "screenshot2" is the "edit-view".

Thanks a lot guys

Cheers
Andrew
File Attachment(s):
EinzugsgebieteII_info_11_07_12.txt (25kb) downloaded 20 time(s).
Andrew78 attached the following image(s):
screenshot1.JPG
screeshot2.JPG
Back to top
Report?
Andrew78
#10 Posted : Monday, July 25, 2011 3:46:28 AM
Groups: Registered
Joined: 7/12/2011
Posts: 8
Hi guys,

I'm just wondering if you found something out yet or I just have to give you some more informations.

Cheers
Andrew
Back to top
Report?
Andrew78
#11 Posted : Wednesday, July 27, 2011 9:18:16 AM
Groups: Registered
Joined: 7/12/2011
Posts: 8
Hi guys,

can you give me a status info of your research?

Thanks a lot in advance
Greetings Andrew
Back to top
Report?
Sequentum Support
#12 Posted : Friday, July 29, 2011 5:28:46 AM

Groups: Administrators
Joined: 4/10/2010
Posts: 1,239
Location: Sydney, Australia
I think the site might not quite reliable. As I test from the designer mode, sometime the "ddl straßen" element isn't shown.
Back to top
Report?
Andrew78
#13 Posted : Friday, July 29, 2011 12:20:44 PM
Groups: Registered
Joined: 7/12/2011
Posts: 8
Thanks for your answer. But does that mean there is no way to scrape it?

Cheers
Andrew
Back to top
Report?
Users browsing this topic
Guest
Tag as favorite
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

Powered by YAF 1.9.4 RC1 | YAF © 2003-2009, Yet Another Forum.NET
This page was generated in 0.127 seconds.