How to run a project with multiple start URLs

added: 2/28/2010 Version: 2.33.5

Visual Web Ripper can run a project from multiple start URLs. All start URLs must point to web pages with the same page structures, so all the pages can be processed with the same project.

Multiple start URLs are often used by resellers who have been given a list of product URLs and want to extract data from each product URL. The reseller may also have been given a list of product IDs, which he can then use to generate the correct product URLs.

To enter a list of start URLs, follow these steps:

1. Open the Start URLs options tab in the Project Options window.

2. Set the option List of start URLs.

3. Enter the list of start URLs.

Click the button Add/Edit URLs to edit URLs in a bigger window

To feed start URLs from an input data source, such as a database table or a CSV file, follow these steps:

1. Open the Start URLs options tab in the Project Options window.

2. Set the option Feed start URLs from input data source.

3. Press the button Configure Input Data Source if you have not already configured an input data source.

You can press the View Data button to view the input data.

4. Choose the data column that contains the URLs from the drop down box.

Highlighted features

How to run a project with multiple start URLs

Comments