#1423 No longer able to scrape git.centos.org
Closed: Insufficient Data by jcpunk. Opened by jcpunk.

My build node sl7.fnal.gov is getting timeouts when attempting to scrape git.centos.org for new EL7 sources.

In the past it went over the rate limiter. I suspect it did so again.


can you define "scape git.centos.org" ?
Ideally people would not massively hammer git.centos.org but rather just subscribe to mqtt bus to receive notifications.
Also worth knowing that pagure was updated to 5.14.1 , due to security/CVE fixes in that release.

Metadata Update from @arrfab:
- Issue tagged with: need-more-info

Once a week I've got a script that checks out all the repos hosted there for if a package was published but the mqtt listener on my host was offline.

If is a fairly massive hammer, but has a number of sleeps to try and be a good citizen.

Do you still see the issue ? I had no time to investigate , due to c8s EOL plan and c10 launch.

It seems to have cleaned up over the weekend.

Metadata Update from @jcpunk:
- Issue close_status updated to: Insufficient Data
- Issue status updated to: Closed (was: Open)

Log in to comment on this ticket.

Metadata