Wait for page to render before taking screenshot

[peterchanws]

Here are PURLs that show thumbnails that have not been generated properly as part of the wasSeedPreassemblyWF workflow:

• https://purl.stanford.edu/yy557dd2022
• https://purl.stanford.edu/mm403wp3215
• https://purl.stanford.edu/db487vd5915

If you look closely you can see that there is a "loading" message being displayed instead of the page content.

Instead of navigating to the page and taking a screenshot immediately we should give the page some time to load. Otherwise we might get a loading page, a partial screenshot or no screenshot at all.

In screenshot.js we can try using gotoUrls's timeout and/or waitUntil options. Although we will want to upgrade from puppeteer v3 (which is a few years old) to v14.

Testing this can be difficult because some URLs may have loaded slowly for various reasons, and may load differently from pywb compared to openwayback. We will mostly want to ensure that the process takes longer, and that it is not broken.

Below are are some instructions for creating a Seed Object in Argo to help in testing:

To test you will need to create a Seed Object and see what thumbnail gets created. The steps for creating a Web Seed Object in Argo are, in the menu select Register and then Register Items. Then fill out the form with the following values:

Admin-Policy: Web Archive Seed Object
Collection: Test Web Archive
View Access: World
Initial Workflow: wasSeedPreassemblyWF
Content-Type: webarchive-seed

Add a row, and enter:

Source ID: sul:someuniquevalue
Label:

Then click Register and view the DRUID that has been created in Argo by searching for it.