Skip to content

Troubleshooting Webhooks

Common Issues

1. Signature Verification Failed

  • Cause: The whsec_ secret used to sign the request doesn't match the one you are using.
  • Fix: Check the Dashboard to ensure you are using the correct secret for the specific endpoint. Secrets are unique per endpoint.
  • Check: Ensure you are using the raw, unmodified request body for verification. Frameworks like Express often parse JSON automatically; you need the raw buffer.

2. Timeouts (Delivery Failures)

  • Cause: Your server is taking too long (> 10s) to respond.
  • Fix: Move heavy processing (database writes, complex logic) to a background queue. Acknowledge the webhook with 200 OK or 202 Accepted immediately after verifying the signature.

3. Duplicate Events

  • Cause: Network retries.
  • Fix: Ensure your handler is idempotent. Store the event_id in a database (Redis/Postgres) and ignore requests with IDs you have already processed.

4. Endpoints Disabled

  • Cause: If an endpoint fails continuously (returns 4xx/5xx) for an extended period, ScrapeNest may automatically disable it to save resources.
  • Fix: Fix the underlying issue on your server, then re-enable the endpoint in the Dashboard.