All Questions
Tagged with vba web-scraping
33
questions
2
votes
1answer
316 views
Excel VBA code that displays a 14 day weather forecast
I am trying to see if anyone can help me in making this Excel VBA code a little faster in rendering the data from the weather site I am using. Maybe instead of getting all 14 days it includes in the ...
3
votes
0answers
61 views
Taking time off of taking time off
In my ongoing quest to automate everything I have to do at my job, I've decided to learn how to do webscraping with VBA. I wanted to start with something easy, so the following simply fills out a ...
1
vote
1answer
514 views
Downloading latest monthly files VBA - HTML [closed]
Situation:
I am trying to download files, for the latest available month, from the webpage NHS Delayed Transfers of Care. I am unable to locate these files, within the HTML, with confidence that my ...
3
votes
1answer
970 views
Web scraping data from US postal zip codes
Web scraping county, population and median home value from United States postal zip codes.
I switched from using InternetExplorer.Application to New MSXML2....
1
vote
1answer
4k views
Handling lazy-loading webpages using vba
After a long try I've been able to create a script in vba which can successfully handle webpages with lazy-load. It can reach the bottom of a slow loading webpage if the hardcoded number of the loop ...
1
vote
1answer
120 views
Parsing a website, saving tables in Excel
This program parses a website. The program works well, but is too long. I want to simplify/speed it up.
How program works:
First , the program finds needed hyperlink in Excel
Then by the hyperlink ,...
4
votes
2answers
5k views
Scraping webpage elements with VBA script
With some help I've put together a macro to scrape webpage elements by tag ID from URLs (indicated in column A of an Excel sheet) and insert the text into columns B, C and D. The code loops from 1st ...
2
votes
1answer
531 views
A recursive web-crawler created using vba
I had a desire to make a recursive web crawler in vba. As I don't have much knowledge on vba programming, so it took me a while to understand how the pattern might be. Finally, I've created one. The ...
2
votes
1answer
2k views
Web scraping using proxy in vba
I've written a script in vba to parse movie names and year from a torrent site. The script is doing just awesome. Although the scraper is leaving no room for complaint, I'm still dubious about how the ...
1
vote
1answer
2k views
Making a dynamic parser to collect data from a javascript enabled webpage
I've written a scraper in VBA in combination with selenium to parse product names and prices from a javascript enabled webpage. The thing is that I just used selenium to get the page source (as it was ...
3
votes
0answers
4k views
Fetching data from a website using “POST” request
I've written some code in vba for the purpose of making twofold "POST" requests to get to the destination page and harvest name and address from there. There are two types of structures within which ...
2
votes
1answer
114 views
Scraping information from a webpage not knowing it's last page number
I've written some code in vba to scrape names and phone numbers from a webpage that has spread across some pages I don't wish to know of. The main interesting thing with this scraper is that It only ...
2
votes
1answer
6k views
Scraping table contents from a webpage using vba with selenium
My script is able to harvest full contents of a table from a webpage with javascript encrypted using vba in combination with selenium. The table has got a drop-down option from where the full contents ...
5
votes
0answers
378 views
Scraper for parsing, downloading, and setting images beside each link in an Excel file
I've written a script in VBA which is able to parse image links from a website, download and store them in a local folder and finally set those images beside each link in an Excel file.
As the script ...
3
votes
1answer
4k views
Scraping images from a webpage and saving it to a customized folder using vba
I've written a script in VBA which is able to scrape images from a webpage and save it to a customized folder successfully. Firstly, it scrapes the image link then downloads the image and rename it ...
5
votes
1answer
205 views
Crawler for scraping and approving friend requests in Facebook
I've made a Facebook scraper using VBA in combination with selenium which is able to parse the name from friend request list.
It is necessary to do one thing manually, though. After running this ...
7
votes
1answer
1k views
Scraper for a lazy-loading webpage
I've written a script in VBA in combination with selenium which is able to scrape all the 1000 links from a lazy-loading webpage which displays it's content 20 at a time and doesn't display the full ...
2
votes
0answers
126 views
Scraping data from json response using twofold request
I've written a script which is able to get javascript encrypted links from a webpage and then using those newly produced links by making another request It can reach the target page and going there it ...
4
votes
1answer
256 views
Web scraper for Yell
I have created a scraper for yell.com in vba. The scraper is efficient enough to pull data from that site, whatever the search parameter is. If any link from that site is given to my parser, it is ...
1
vote
0answers
1k views
Scraping json data using vba
I've created a scraper using vba which is able to parse json response. When I was thinking of using scripting dictionary or json converter to scrape json data I could notice that applying split ...
3
votes
0answers
1k views
Scraping table data from websites
I've written a script in vba to parse table from any website if the html elements are not encrypted in javascript. There is a table index in my script in which inputting the right number it is ...
2
votes
1answer
54 views
Parsing Title from any given website
I've created a very small script in vba to parse Title from almost any website. I've checked it with few websites and it is providing with the accurate results. I used split function on responsetext ...
4
votes
1answer
812 views
Scraping a whole site using vba
I've created a parser which is able to parse the full content of houzz.com. After going to the given address, it parses the sub-category links from the left sided bar. Each sub-category links spreads ...
2
votes
2answers
242 views
Scraper for Redmart.com
I've written a script which is scraping a webpage encrypted within javascript. The scraper is extracting name, price and image link of certain products from that page. I used selenium in combination ...
3
votes
2answers
4k views
VBA - XMLHTTP web scraping
I navigate with IE, do various things, then select all results option from a list and fire on click event. Once all results have been listed, I loop through their URLs, using the following code to ...
5
votes
1answer
2k views
Web scraping VBA - Internet Explorer
The code below extracts data from one web page - I emulate search, select all results from the list and when the list appears (42000 items) I loop through these items.
I get an id value from their ...
6
votes
1answer
3k views
Web scraping VBA and VB Script
I am working on a project on VBA where the objective is to have a "program" that fetches rates from a website called X-Rates, and outputs to excel the monthly averages of a chosen country.
Initially ...
2
votes
1answer
375 views
Web scraping with VBA
I have this code that fetches rates from a website called X-Rates, and outputs to excel the monthly averages of a chosen country.
The code runs quite fast, but I still think there's improvements to ...
8
votes
2answers
10k views
Fast(er) web scraping with VBA
I have a code that fetches rates from a website called X-Rates, and outputs to excel the monthly averages of a chosen country.
The code runs quite fast, but I still think I could improve the code a ...
9
votes
3answers
2k views
Web Scraping with VBA
I wrote this to scrape album review data from AOTY into a spreadsheet. Check it out and let me know what I could've done better.
...
10
votes
2answers
402 views
Financial Data From Webqueries in Excel
I'm new (to CR and to programming in general). I wrote my first VBA on Monday. This is my first working project. It Takes a bunch of financial data from a company called Financial Analytics and a ...
5
votes
2answers
2k views
Downloading stock information from Yahoo! Finance
The program downloads stock information from Yahoo! Finance and displays it in the spreadsheet. On my Mac the program takes 10 minutes to get data for approximately 4000 stocks and on the PC it takes ...
6
votes
2answers
2k views
Retrieving stock prices
It takes around 5-8 seconds for me to retrieve a previously-closed stock price and a dividend rate from US Yahoo! Finance. If I wanted to retrieve 10+ stock prices, it would take me more than a minute ...
