Skip to content

Install CSI driver on openshift-test start. #23560

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Nov 13, 2019

Conversation

jsafrane
Copy link
Contributor

@jsafrane jsafrane commented Aug 6, 2019

Goal: create a prow job that tests CSI sidecars shipped as part of OCP / OKD. In the future, use the same approach to test CSI drivers too.

There are 6 CSI sidecars in total (and the number is growing), so to simplify job definition in each repostory, I embedded AWS EBS driver yaml files into openshift-tests.

Prow configs for each sidecar repo would then contain something like this:

- as: e2e-aws-csi
  commands: TEST_INSTALL_CSI_DRIVERS=aws-ebs TEST_SUITE=openshift/csi run-tests
  openshift_installer:
    cluster_profile: aws
    upgrade: false

Env. variables are the easiest to pass between parent openshift-test and child openshift-test processes. It's a bit hacky though. I tried command line arguments, you can find the unsuccessful attempt in the commits in this PR.

The architecture is open for multiple CSI drivers, we will ship drivers for all clouds that we support eventually. In addition, we can easily replace yaml files with CSI drivers with CRs for an operator that installs CSI drivers, when we have them.

Future direction:

  • Add such prow job to all CSI sidecar repos + origin (to catch openshift-test changes & rebases).
  • When we add operators for CSI drivers (4.4?), use OLM manifests / CRDs for driver installation instead current yaml files.

/assign @smarterclayton

@openshift-ci-robot openshift-ci-robot added do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. size/XL Denotes a PR that changes 500-999 lines, ignoring generated files. labels Aug 6, 2019
@jsafrane jsafrane force-pushed the install-csi branch 2 times, most recently from 0a81093 to b309828 Compare August 7, 2019 08:05
)

// Initialize openshift/csi suite, i.e. define CSI tests from TEST_CSI_DRIVER_FILES.
func initCSITests() error {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Who calls this?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's called from initProvider:

func initProvider(provider string, dryRun bool) error {
// record the exit error to the output file
if err := decodeProviderTo(provider, exutil.TestContext); err != nil {
return err
}
exutil.TestContext.AllowedNotReadyNodes = 100
exutil.TestContext.MaxNodesToGather = 0
reale2e.SetViperConfig(os.Getenv("VIPERCONFIG"))
if err := initCSITests(); err != nil {

@jsafrane jsafrane changed the title WIP: Install CSI driver on openshift-test start Install CSI driver on openshift-test start Nov 11, 2019
@smarterclayton
Copy link
Contributor

/hold cancel
/lgtm

@jsafrane
Copy link
Contributor Author

/retest

@jsafrane jsafrane changed the title Install CSI driver on openshift-test start Install CSI driver on openshift-test start. Nov 12, 2019
@openshift-ci-robot openshift-ci-robot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Nov 12, 2019
@tsmetana
Copy link
Member

/lgtm

@openshift-ci-robot openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Nov 12, 2019
@openshift-ci-robot
Copy link

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jsafrane, smarterclayton, tsmetana

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci-robot openshift-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Nov 12, 2019
@openshift-bot
Copy link
Contributor

/retest

Please review the full test history for this PR and help us cut down flakes.

@jsafrane
Copy link
Contributor Author

/retest

@openshift-ci-robot
Copy link

openshift-ci-robot commented Nov 13, 2019

@jsafrane: The following test failed, say /retest to rerun them all:

Test name Commit Details Rerun command
ci/prow/e2e-aws-upgrade b309828 link /test e2e-aws-upgrade

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@jsafrane
Copy link
Contributor Author

/retest

@openshift-merge-robot openshift-merge-robot merged commit c517dee into openshift:master Nov 13, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged. size/XL Denotes a PR that changes 500-999 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants