Use case

Visual Web Ripper plays an important role for many business around the world. We have selected one example below where a company uses Visual Web Ripper as a key tool to collect content for their website.

IT Avenue

IT Avenue runs an IT collaboration web site linking to content on different IT web sites. They wanted a section on their web site showing the best prices for the most popular IT products.

They used data from two different web sites to build this section. One web site contained the most popular IT products and another web site could search for the best prices for a particular product.

Here is how they have set up Visual Web Ripper to achieve their goal.

• They have designed a Visual Web Ripper project to extract the product catalogue with the most popular IT products from the first web site.
• They use the Visual Web Ripper scheduler to run this project every night, so the extracted data is always up-to-date.
• They have designed another Visual Web Ripper project that submits a product name to the 2nd web site to retrieve the best prices for the product.
• They have build a custom post-processing module that uses the Visual Web Ripper API to run the 2nd project for each product they have collected.
• The custom post-processing module then takes all the product properties and the best prices for each product and saves them in the data structures belonging to the IT Avenue web site.
• The custom post-processing module is automatically triggered when the scheduler has finished running the first project, so the whole process completes without any manual steps required.

They are now extending the solution with information from a 3rd web site. They will use Visual Web Ripper to lookup the address of an IT shop providing a particular product price, so their users can see where in their area they can get the best price for a particular IT product.