For Admins

Health Checker (Admin)

Every submitted URL is periodically visited by the health checker; the result drives the active/inactive flags, the broken-link counts, and the salary domain bonus (only domains with an HTTP 200 URL count).

How it runs

  • Scheduled every 4 hours, in smart batches of up to 500 URLs.
  • Priority: never-checked URLs first, then oldest-checked; each URL has a 7-day cooldown before being re-checked.
  • Polite crawling: max 5 URLs per root domain per batch, with delays between requests, identifying itself as URLsNow-HealthChecker/1.0.
  • Sends HTTP HEAD (falls back to GET), 10-second timeout, one retry on failure.
  • 2xx β†’ active; anything else β†’ inactive, with the status code logged.

The admin page

Admin β†’ Health Check shows checker status and results. You can also trigger a manual batch from there, or from the shell:

php artisan urls:health-check --limit=500

Interpreting failures

Symptom Usual cause
404 / 410 The post was removed β€” the engineer should know
403 The site blocks bots; the link may be fine in a browser
Timeouts Slow/flaky host; the checker will retry on later cycles
Sudden mass failures on one domain That site changed or went down β€” not the engineers' fault

A fresh URL may show "never checked" for a few hours β€” give the scheduler a cycle or two, especially before month-end salary locking (dead links don't earn the domain bonus).