Rate limits at Cloudflare
when downloading via a script, I'm rate-limited after a few (40?) requests. Instead of HTTP 200, I receive 429 and the document content is `error code: 1015` which is documented here: https://support.cloudflare.com/hc/en-us/articles/360029779472-Troubleshooting-Cloudflare-1XXX-errors#error1015, so it looks like this is something you configured.
I'm downloading one file at a time, i.e. nothing in parallel. Mostly smaller boundaries but also a few big ones . I expect to do ~6000 in total per run, one with water and one without, in total around 12000. I'm planning to refresh my data roughly once a year.
Do you have any recommendations how long I should wait between requests? Or should I just add wait and retry again and again when I get limited?
I'd rather use your recommendations than pushing your great service to the limits (and thus triggering you to possibly impose stricter limits).