Crawljax

Crawljax is a free and open source web crawler for automatically crawling and analyzing dynamic Ajax-based Web applications.

{{cite journal | url=https://dl.acm.org/doi/10.1145/2109205.2109208 | doi=10.1145/2109205.2109208 | title=Crawling Ajax-Based Web Applications through Dynamic Analysis of User Interface State Changes | year=2012 | last1=Mesbah | first1=Ali | last2=Van Deursen | first2=Arie | last3=Lenselink | first3=Stefan | journal=ACM Transactions on the Web | volume=6 | pages=1–30 | s2cid=1351916 }}

One major point of difference between Crawljax and other traditional web crawlers is that Crawljax is an event-driven dynamic crawler, capable of exploring JavaScript-based DOM state changes.

Crawljax can be used to crawl and create a static mirror of any Ajax web application.{{Cite web|url=https://developers.google.com/search/docs/advanced/javascript/javascript-seo-basics?csw=1|title=Understand JavaScript SEO Basics | Google Search Central}}