Browsertrix features, functions and limitations

Help! Browsertrix
1

Greetings, Browsertrix is fully automatic and cloud based crawler right ? unlike archive webpage which is totally manual and requires users to visit the site, scroll the pages which saves the data to browser using the ram and can be extremely limited if large sites or pages are involved.

  1. can Browsertrix fully archive Instagram, reddit, x.com profiles/pages which contains 1million posts on each pages/profiles requires infinite scrolling the page to achieve all. the contents will be mostly photos and texts.

  2. what will the cost of using Browsertrix for archiving 100 profiles each having 1 million posts. mostly photos and texts on x.com, Instagram, reddit.

  3. no matter which tool users uses like Browsertrix or archive webpage does the final output always be in Wacz and needs to always use replay webpage tool to view them. Isn’t there any other alternatives to export them in .html instead.

  4. can Browsertrix archive entire forums sites that uses cloudfare, ddos protection which contains 1 million posts and 300k individual pages.

what are the limitations of Browsertrix ? , what are its advantages and disadvantages ?

2

I don’t think we’ve ever attempted archiving an Instagram page with a million posts. The pro tier ($120 / month) currently has a limit of 10,000 pages per crawl, so that seems well under your requirements unfortunately. Social media is always a moving target!

Browsertrix does only output WACZ files, but WACZs contain WARCs which can be replayed with other replay engines such as PYWB. If HTML output is a hard requirement, you may want to look at SingleFile.