Scrapping HLTB

|

~155 words, 1 min read

|

If you had a peek in my Now page, you may have seen I have a list of games categorized by state of play at the moment. This page is made thanks to a JSON Data File I generate by webscrapping my public How Long To Beat profile, and then use it to populate the HTML.

While I wanted to use an API to access HLTB data, I found a forum thread asking for the same, and found out there's no public API available at the moment. So as a temporary measure, I made a small Node script using Puppeteer to scrape the data I need and save it in my files from time to time.

It's fairly specific to my use case and it's not particularly performant or thought out, but if it can be of use to you, here you have it:

Download the script here.