Excel VBA Introduction Part 48 - Web Scraping Across Multiple Pages

  • Loading...
  • Published on:  Monday, November 14, 2016
  • PLEASE NOTE: The design of the website used in this video has changed since the video was recorded. This means that the code shown will no longer work for the website used. You can download both the original code and a revised, working version from this link https://www.wiseowl.co.uk/videos/excelvba/scraping-multiple-web-pages.htm

    If you'd like to help fund Wise Owl's conversion of tea and biscuits into quality training videos you can click this link https://www.wiseowl.co.uk/donate?t=1 to make a donation. Thanks for watching!

    You can buy our Introduction to Excel VBA book here https://www.lulu.com/shop/andrew-gould/introduction-to-excel-vba/paperback/product-23301058.html

    By Andrew Gould
    Download example files here https://www.wiseowl.co.uk/videos/excelvba/scraping-multiple-web-pages.htm

    https://www.wiseowl.co.uk - What's better than scraping one web page? Scraping lots of them with the same procedure, of couse! This video explains how to loop over multiple pages using Microsoft's HTML and XML object libraries. You'll learn about HTML tags and classes, the Document Object Model and how to loop over elements on a page.

    Visit www.wiseowl.co.uk for more online training resources in Microsoft Excel, SQL Server, Reporting Services, Analysis Services, Integration Services, ASP.NET, C#, Visual Basic, Microsoft Access, Microsoft PowerPoint, Microsoft Word, Microsoft Project, Microsoft Publisher, Microsoft Visio and more
  • Source: https://youtu.be/sGw6r5GVA5g


  • Clifton Sett

     (Nov 15, 2016)

    I don’t know why the other Youtube videos covering Excel VBAlack the degree of knowledge or expertise that WiseOwl has displayed over andover again, but all I can say is WOW!!! Parts 46 to 48 of the Excel VBAIntroduction course are the epitome of excellence in presentation and execution oneducational material. I have watched all the WiseOwl videos repeatedly andevery time I learn something new and interesting and for that reason I say THANKYOU! I have spent hours looking for Youtube videos to enh...

  • Ogonna Anaekwe

     (Jun 18, 2017)

    Agree 100 per cent!

  • WiseOwlTutorials

     (Nov 15, 2016)

    Hi Clifton, many thanks for taking the time to write such lovely feedback, it's genuinely appreciated! I'm so happy to hear that you've found the videos so useful and that you think we're doing a good job. We'll do our best to maintain those high standards and hope that you'll find just as many useful tips in the videos still to come. Thank you again for the comments and for watching!

  • Excel y VBA - José Santos

     (Nov 23, 2016)

    Your Videos are amazing and the way you are teaching is really good.Will you prepare any example to use "POST" method?I love this kind of videos when we can use Excel with other different applications.I discovered Web Scraping with Excel time ago and the technique is the most usefull thing that I have seen in much timeThanks for the time that you dedicate to create the videos I know that it takes long...

  • WiseOwlTutorials

     (Nov 23, 2016)

    Thanks José, happy to hear that you've found the videos useful! I hadn't planned a video on using POST but I'll add it to the list. Thanks for watching!

  • Wai Chan

     (Jul 22, 2018)

    Is it anyway to scraping Android Application content using python or VBA?That content are not accessible in website.We can only read that content through Android Application.I know using Team Viewer to control Android phone through PC, but I not able to automate it like using VBA or Python. I need to do manually every time.

  • Abdullah Quhtani

     (May 7, 2018)

    Hi. I need a modified version of this his code. Could you do that Plz.I’ll pay you for that. Kindly reply if you are interested.ToThank you.

  • vinay kumar

     (May 1, 2018)

    Thanks for all your videos it is really amazing and unparalleled. Would you please cover the topic of how to take screenshots and paste it in word document.And another video on Iframe handling

  • mustafa bakkal

     (Jun 16, 2018)

    dear david , some websites using java scrip is it possible to log this kind of webpage , can we write a destructer metod to ovecome the java script thx

  • Dylan Jones

     (Dec 31, 2016)

    Hello! I have found your videos hugely helpful. I am having one issue that I cannot seem to figure out. I have been using the IE browser method you cover in the first half of the previous video. In order to access the site I would like to pull data from, I need to log into 2 different websites. For the first website, I am able to set htmldoc as the IE.document, and input my username and password via the "getelementsbyname" method. However, when I do the same for the second website, I ge...

  • WiseOwlTutorials

     (Jan 1, 2017)

    Hi Dylan, I don't know if this is an issue with a particular version of IE but the most common suggestion for this type of issue is to introduce some sort of delay before getting the next page such as here http://stackoverflow.com/questions/24701118/vba-excel-pulling-new-webpage-data-after-clicking-on-submitHope that helps!

  • Piotr Lorenc

     (Apr 17, 2017)

    I don't leave comments usually but this time I couldn't resist: "Your videos are truly epic!!!" and Getting Data from Web playlist is simply a mastership. This is exactly what I was looking for recently. THANK YOU for all the knowledge you share in such accessible manner

  • WiseOwlTutorials

     (Apr 18, 2017)

    Thanks Piotr, happy to hear that you're finding the videos so useful and thank you for watching!

  • Federico Soberanes

     (Nov 17, 2016)

    AN AMAZING JOB! i didn't even knew that you can go straight forward to the html document without opening the internet explorer a lot of improvement in performance.. my god i wish I'd learned this before. Thanks for your dedication it's really apreciated. greetings from México.

  • WiseOwlTutorials

     (Nov 17, 2016)

    Thank you Federico! It's a pretty cool technique and, like you say, so much quicker than using Internet Explorer! Happy that you found it useful and thanks for watching!

  • Ted Montoia

     (Jan 8, 2018)

    Your video series is unparalleled. Terrific work!I’m following along line by line and learning quickly. Thank you!Now, just one issue. I get this error “User-defined type not defined” on this line: Dim HTMLDoc As New MSHTML.HTMLDocumentWhat did I do wrong? Ted

  • Ryan Bein

     (Feb 1, 2018)

    Make sure you have the reference Library enabled. @3:12 he starts to show you how to enable this.