I have run into a situation where I have to repeatedly run a scrape on a site (pages are temp down or I get throttled or cloudflare temp blocks, etc).
A few I have had to restart it dozens of times. The problem is each time it runs as it goes through the save states it changes the yaml filename, so for each run I need to go back into the run command and put in the new yaml file name.
Is there any way to tell it to keep a consistent yaml file? Or a better way I should be handling these?
Thanks!