Hi,
I’m trying to crawl a wordpress blog, I’ve created a user profile with my login and password, the website contains 6 lessons (courses), when the crawling job finishes, only 3 lessons are crawled (with my credentials) and the other 3 are requiring login to access.
does any one know why the cookies got rejected during the crawl ?
and is there any solution ?
and Thank you!