Getting “Error creating WACZ” on a number of crawls.
Error: socket hang up
at TLSSocket.socketOnEnd (node:_http_client:528:25)
at TLSSocket.emit (node:events:530:35)
at endReadableNT (node:internal/streams/readable:1698:12)
at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
S3Error: An internal error occurred. Please retry your upload.
at parseError (file:///app/node_modules/minio/dist/esm/internal/xml-parser.mjs:24:13)
at Module.parseResponseError (file:///app/node_modules/minio/dist/esm/internal/xml-parser.mjs:71:11)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Client.makeRequestStreamAsync (file:///app/node_modules/minio/dist/esm/internal/client.mjs:485:19)
at async Client.makeRequestAsyncOmit (file:///app/node_modules/minio/dist/esm/internal/client.mjs:416:17)
at async file:///app/node_modules/minio/dist/esm/internal/client.mjs:1440:26
at async Promise.all (index 1)
at async Client.uploadStream (file:///app/node_modules/minio/dist/esm/internal/client.mjs:1406:20)
at async S3StorageSync.uploadStreamingWACZ (file:///app/dist/util/storage.js:70:9)
at async S3StorageSync.uploadCollWACZ (file:///app/dist/util/storage.js:98:15)
I am using a remote S3 server.
When these errors happen, does it try to send the WARC again or are those pages then lost?