Solved: Local Install: "No WARC Files, assuming crawl failed. Quitting"

kramski · August 4, 2026, 6:35am

Using this script we were able to capture crawler pod log files:

#!/bin/bash

# Try to get debug info from dynamic crawling pods

stdbuf -i0 -o0 -e0 kubectl get pods -n crawlers -w  |
while read pod numbers state dummy
do
    echo "$pod" "$numbers" "$state" "$dummy"
    if [[ "$state" == "Terminating" ]]
    then
        kubectl logs "$pod" -n crawlers > "$pod.log" 
    fi
done

Turns out it simply was

{“timestamp”:“2026-08-04T06:54:07.702Z”,“logLevel”:“info”,“context”:“general”,“message”:“Disk utilization threshold reached 92% > 90%, stopping”,“details”:{}}