Facebook screenshots greyed out and small - pass options?

Help!
1

Using latest version of https://hub.docker.com/r/webrecorder/browsertrix-crawler/tags (1.2.8)

I can successfully run a Facebook page getting all the assets by passing a profile.

However the screenshot is

  • greyed out
  • with a small page

I know that if I pass a click to the screen it ‘ungreys’…

Is there a way to pass anything to the screenshotter browser before it takes?

2
21953×1192 88.5 KB 

docker run --rm -v /home/dave/foo/tmp:/crawls/ webrecorder/browsertrix-crawler crawl \
  --url 'https://www.facebook.com/permalink.php?story_fbid=pfbid023iiyYUGNHMHMbVkfsXHcjfGeVwQyGpGhJ9rszXDCZURGRSWhf3GppUEiB9gkb13bl&id=100014743650655' \
  --scopeType page \
  --generateWACZ \
  --text \
  --screenshot fullPage \
  --collection temp24 \
  --id 24 \
  --saveState never \
  --behaviors autoscroll,autoplay,autofetch,siteSpecific \
  --behaviorTimeout 200 \
  --timeout 200 \
  --profile /crawls/profile.tar.gz \
  --postLoadDelay 160
2

Dear All

Using 1.3.0 with an updated cookie profile is now working as expected.

Regards
Dave

1 Like
3

Hi David,

Glad that this worked with an updated profile! We could possibly add this to the facebook behavior as well, to click the page as part of the ‘waiting for page to be ready’ event. We haven’t yet implemented these new event for the Facebook behavior, something we’d like to add soon.

Best,
Ilya

4

Thanks for the message Ilya. On cookie refresh the grey issue has returned, so I’m digging into how best to approach. I’m looking at Behaviors

And how to run a custom version of browsertrix-crawler as it looks like this PR could be made to do a simple click on the page (which would get rid of my greyness):