Automatically registers nightly test runs in CAE TestRail

[nutjob4life]

🗒️ Summary

Merge this to resolve devops#35 which'll do the following:

• Update the Jenkins pipeline so that TestRail credentials are available
• Instantiate a service in the Docker Composition that runs Newman tests with the TestRail Reporter, using the credentials from above
  • In addition, it uses TestRail project ID 168 (which is PDS)
  • And TestRail suite ID 12824 (which is "PDS Registry API, automated tests")
• Adds the test case ID C1274687 to a single test (with three assertions) in the Postman collection (which is "As an API user, I want to search by a temporal range as an ISO-8601 time interval")

⚙️ Test Data and/or Report

• Jenkins: https://pds-jenkins.jpl.nasa.gov/job/Registry/454/
• TestRail: https://cae-testrail.jpl.nasa.gov/testrail/index.php?/runs/view/33672&group_by=cases:section_id&group_order=asc

♻️ Related Issues

• devops#35

🔮 Future Work

• The test case ID C1274687 is recorded in the postman_collection.json file only, not in Postman. Suppose someone were to fire up Postman and add a new test. Exporting a fresh postman_collection.json file would overwrite all test case IDs. The test case IDs should be in Postman itself (i.e., each pm.test("Summary of assertion being made", …) → pm.test("C1234567 Summary of assertion being made", …)
• PDS Jenkins has secrets in order to pass along to the TestRail reporter so it can use the TestRail API to register the results of Newman tests. These credentials currently consist of a username and an API key. The username is Sean.C.Kelly@jpl.nasa.gov. We should have a "service" account instead, since despite my rare use of public transportation, I could still get hit by a bus.

[ramesh-maddegoda]

Looks good

[tloubrieu-jpl]

That sounds good Sean, thanks. I think it is a very good candidate for a demo this Thursday.

[nutjob4life]

@tloubrieu-jpl I agree! However, I'm out this Thursday taking all day training ("Understanding Space").

If you want to run the demo, go for it. It's easy. I can tell you the steps.