Settings

Configure proxy, crawl behavior, and domain checker settings

Proxy Configuration

Proxy settings are configured via environment variables in your .env file for security. The values shown below are read-only indicators.

Proxy Host

${PROXY_HOST}

Proxy Port

${PROXY_PORT}

Proxy Username

${PROXY_USER}

Proxy Password

${PROXY_PASS}

Crawl Settings

Delay Between Requests (ms)

Max Pages Per Crawl

Respect robots.txt

Honor crawl restrictions specified in robots.txt files

Domain Checker Settings

Batch Size

Number of domains to check in each batch

Check Interval (hours)

How often to re-check domains for status changes

Crawl and checker settings are stored as environment variables. Changes made here will update the runtime configuration but will not persist across restarts. For permanent changes, update your .env file directly.