Should I be worried about JavaScript warnings on my crawl?
My log file is full of JavaScript warnings, here is one such warning
{"timestamp":"2026-07-16T22:12:45.103Z","logLevel":"warn","context":"general","message":"Invalid Page - URL must start with http:// or https://","details":{"url":"javascript:void(0);","page":"https://innercircle.drdavisinfinitehealth.com/course/Undoctored_Health_Omega_3_WNU","workerid":3}}
All of them have Invalid Page - URL must start with http:// or https://
No, we should probably remove this as a warning altogether.. This happens if a page has non-http URLs, like javascript: scripts as URLs or mailto:, they should really be debug messages.
They can indicate the a page had invalid links if the crawl is smaller than you’re expecting, but seem to be less than helpful in this case.
Hi thanks for your response, it was actually javascript on the page. It was a forum I was crawling and a lot of the buttons where in javascriot. The next button was important as I needed to write a script so the button would get pressed, otherwise the crawler would only scrape the 1st page on a particular thread.