Extracting the required data from YouTube is very easy. However, following all links in the bobvila catalogue is difficult, because the links are loaded on-the-fly while scrolling down the list, and Visual Web Ripper does not support this kind of AJAX functionality.
The easiest (and must reliable) way to extract the YouTube data is by first creating a projects that extracts all the video links and then use the extracted links as start URLs for another projects that extracts the YouTube data.
All the video links are displayed on this website URL:
http://www.youtube.com/profile?user=bobvila#g/u
I use a wait element to wait for the last link in the list. This element will not exist before you scroll down to the last element, so you should only set this element to wait while you are running the project.
To run the project do this:
1. Edit the waitElement content element and set the "Wait for element" option.
2. Run the project, but make sure you set the "View browser" option, so you can see the browser when the projects runs.
3. Visual Web Ripper will now open the web page and wait for the last link. You need to manually scroll down to the last element in the list, and Visual Web Ripper will then continue to extract all the links.
4. When the project has finished running, reset the "Wait for element" option, so the project will open without issues next time.
You now have all the start URLs for the next project. Copy the CSV file with the start URLs to the project folder and run the next project (Youtube2.rip), which will extract the title and embed code for the videos.
Download demo projects and sample data extracts
YouTube.zip