Condition script example

added: 2/10/2010 Version: 2.31.0

This article deals with an unusual requirement to only extract data from the last web page in a search result.

I'll setup a project that uses a page area template to extract data from each page in a search result, but I'll cancel the page area template if it is not on the last page.

In order to cancel the page area template I add a condition script to the template. The condition script checks if there is a next page link on the web page and cancels the template element if the next page link is found. The last web page will not have a next page link, so the template will not get cancelled on the last web page.

using System;
using mshtml;
using VisualWebRipper;
public class Script
{
//See help for a definition of WrConditionArguments.
public static bool IsCondition(WrConditionArguments args)
{
try
{
if(args.DataRow["navigationLink"] != "")
return false;
return true;
}
catch(Exception exp)
{
args.WriteDebug(exp.Message);
return true;
}
}
}

You'll see the script uses the data column "navigationLink". I have added a content element that selects the next page link and reset the "Save content" option so the content doesn't appear in the output data. The content is still available during processing, so I can check if the element exists by checking the corresponding data column.

Download sample project and data extract Yellowpages.zip

Highlighted features

Condition script example

Comments