On 5/19/21 9:40 AM, Nalin Dahyabhai wrote:
On Tue, May 18, 2021 at 04:03:18PM -0400, Chris Evich wrote:
> Would it be okay if we do as Tom suggests below, but also disable the
> 'conformance' task on the release branches?
Knowing that the behavior of docker build changes subtly between
versions, is it not possible to keep testing against the same version of
dockerd on a given branch? Otherwise, we can miss breakage that comes
in via backports.
This is possible, but it adds complexity to our setup. However, based
on your concerns, it sounds the added complexity may be necessary.
What I would propose is, instead of installing these packages from the
network at runtime, we download and cache them at VM image build time.
At runtime, for this specific test, we install the packages from cacche.
Since we never update VM images on release-branches, it should satisfy
both the testing requirements, while adding stability.
I'll add a Jira card so I don't forget to work on this.
Chris Evich (he/him), RHCA III
Senior Quality Assurance Engineer
If it ain't broke, yain't tryin' hard 'nough.