CurlyQ β€” rate limiting?

Love the idea. Curious if the automatic fallback for changing user agents is configurable with a delay. Some sites I use get unhappy with more than a few requests a second, which I could see happening inadvertently

1 Like

Definitely something that should be configurable. It does no rate limiting up front, it’s intended to be part of a pipeline where you can limit your own requests in a script as needed, but it also accepts multiple urls, so having a --delay parameter would be useful.

I still need to make it accept a whole slew of urls on STDIN. Given multiple URLs it outputs an array of results, one per URL, containing whatever hashes the command returns. Just need to work on the STDIN reading.