Rijksmuseum Newman API Test

Testframework in Postman/Newman to test the Rijksmuseum Data Services.

How to run the tests

Variables

key	value
baseurl	"https://www.rijksmuseum.nl/api"
key

LOCAL

Postman

To run the test locally import into postman:

• collections/regression_testing.postman_collection.json
• environments/rijks.postman_environment.json

Make sure your apikey is filled in and run a specified test from the scenario based folder. If you want to run the data_driven tests, please use a runner tab and upload the json testdata document.

Newman

To run the test locally with newman install node.js and use the following command:

npx newman run collections/regression_testing.postman_collection.json \
	    -e environments/rijks.postman_environment.json \
	    -r cli \
	    --folder "scenario_based"

CI/CD

To run the pipeline checkout 'main' branch and do an empty commit.

git commit --allow-empty -m "Trigger pipeline"
git push

To see the report, navigate to Github Pages

Findings

• When using Collection Details without an object-number there is no error message, or functional feedback
• Malformed format leads to http 404 message
• Empty format leads to http 500 error
• Internal server error does not give functional error message (no output)
• When format is jsonp is generates a contenttype of text/javascript while application/javascript is considered best practice.
• ps > 10.000 is allowed in collection api