Web Crawler for a "hidden API" website

• This crawler scrapes the "All products" page of the website on-running.com
• The crawling is a lot of different as the website works on sending requests to hidden APIs and hence normal web crawling techniques won't work here.
• Instead we'll have to directly access those APIs that are being called when we do something like reload a page or press the "Show more" button on a page.