#9 Add support for comparing ODCS composes
Merged by jkaluza. Opened by merlinm.
fedora-ci/ merlinm/cccc fetch-and-compare-composes  into  master

Adds functionality to download json metadata files from the ODCS composes to local fake compose directories, then run compose-diff-rpms to compare the composes and show the output.

The metadata/rpms.json files I included for testing purpose are from actual ELN composes. They're awfully big. Any thoughts for safely trimming them down in size?

Hmmm... How does one get the compose-utils package installed so the compose-diff-rpms command exists? When I try adding it to requirements.txt, I get "ERROR: No matching distribution found for compose-utils"

I will ask @lsedlar if compose-utils could be included in pypi. But if not, we will have to ask jenkins admins to install compose-utils on F29 Jenkins slave.

1 new commit added

  • Update unit tests to use a "real" HTTP server

2 new commits added

  • Fixup: update compose tests to use reduced test data
  • Fixup: use reduced ODCS compose test data

@jkaluza In my last two commits, I manually stripped down the metadata from earlier snapshots of actual ELN composes, adjusted them to make for slightly more interesting output, and adjusted the compose compare test accordingly. If you like what you see here so far, I'll squash my commits so the full-sized compose metadata doesn't get carried in the git history when merged into the master branch.

rebased onto d510d8fd15163c3618ad42d4539119f13cf8239c

1 new commit added

  • Optimization to generate ODCS composes in parallel

pretty please pagure-ci rebuild

pretty please pagure-ci rebuild

rebased onto 5f155ef7868b01c0937d6bdc460bbc865529df03

@jkaluza This PR now includes the improvement to generate composes in parallel, and it has been rebased onto PR #9. Let me know what you think! Thanks.

rebased onto 08976580fc07124c781f7955cbb6c1a5a09c423f

I added another commit to fix a problem I keep running into while testing interactively using Kerberos authentication. It avoids having to run kdestroy -A (and maybe kinit) when switching between running cccc and anything else that authenticates using Kerberos.

Pull-Request has been merged by jkaluza