GSoC'20 - Automation of the Kubernetes Multi-tenancy Benchmarks

Project tracker for my GSoC project for CNCF & Kubernetes - Automation of Kubernetes Multi-Tenancy Benchmarks

Abstract

The Kubernetes Multi-Tenancy Working Group is chartered with exploring and defining multi-tenancy models for Kubernetes. The Multi Tenancy Benchmarks effort focuses on measuring and validating the desired behaviors for multi-tenancy. Part of this effort is to automate behavioral and configuration checks on existing clusters, which will be the focus of this project. This automated test suite will help all Kubernetes users validate whether their clusters are set up correctly for multi-tenancy.

General Information-

Name: Anuj E-mail: anujjangra25119@gmail.com
Website and Blog: https://phoenixking25.github.io
GitHub: phoenixking25
Slack (Kubernetes): phoenix Time zone: UTC+05:30 (Indian Standard Time)
Mentors: Jim Bugwadia, Ryan Bezdicek, Tasha Drew

Links

• Project on GSoC Webite
• Proposal Submitted for GSoC
• Proposal Draft (Google Doc)
• Original Feature Issue
• All commits to kubernetes-sigs/multi-tenancy

## Pull Requests and Issues

Repository: multi-tenancy

Total Pull Requests Created: 44

1. kubernetes-sigs/multi-tenancy#980 - Config correction
2. kubernetes-sigs/multi-tenancy#977 - added pl2 benchmark
3. kubernetes-sigs/multi-tenancy#966 - changed unittest template
4. kubernetes-sigs/multi-tenancy#963 - Resource quota Benchmark Bug
5. kubernetes-sigs/multi-tenancy#962 - Minor bugs
6. kubernetes-sigs/multi-tenancy#961 - Minor bugs
7. kubernetes-sigs/multi-tenancy#949 - [MTB] changed validation check for tenantnamespaces
8. kubernetes-sigs/multi-tenancy#944 - [MTB] Bugs removal and ux enhancement
9. kubernetes-sigs/multi-tenancy#939 - Test optimization
10. kubernetes-sigs/multi-tenancy#938 - [MTB] changed flag name -t to --as
11. kubernetes-sigs/multi-tenancy#933 - [MTB] Added minor tweaks and skip flag
12. kubernetes-sigs/multi-tenancy#925 - [MTB] added network policy test
13. kubernetes-sigs/multi-tenancy#919 - [MTB] added unit tests
14. kubernetes-sigs/multi-tenancy#896 - [MTB] added chain reporter
15. kubernetes-sigs/multi-tenancy#865 - Running all unit tests
16. kubernetes-sigs/multi-tenancy#862 - [MTB] added policy reporter
17. kubernetes-sigs/multi-tenancy#859 - [MTB] Migrated 10 benchmarks
18. kubernetes-sigs/multi-tenancy#821 - [MTB] Added Default Reporter
19. kubernetes-sigs/multi-tenancy#815 - [MTB] auto register benchmark
20. kubernetes-sigs/multi-tenancy#813 - [WIP] Benchmark Unit Testing
21. kubernetes-sigs/multi-tenancy#812 - [MTB] added readme
22. kubernetes-sigs/multi-tenancy#805 - [MTB] added error handler
23. kubernetes-sigs/multi-tenancy#794 - [Kubectl-MTB] Added packages, cli structure and one benchmark
24. kubernetes-sigs/multi-tenancy#706 - added test for block_nodeports
25. kubernetes-sigs/multi-tenancy#705 - added Profile level selectors
26. kubernetes-sigs/multi-tenancy#700 - classified tests in PLs
27. kubernetes-sigs/multi-tenancy#683 - Added test for Configure namespace object limits
28. kubernetes-sigs/multi-tenancy#676 - #401 [MTB] Added test for privilege escalation
29. kubernetes-sigs/multi-tenancy#670 - [MTB] defined merging strategy for e2e.go
30. kubernetes-sigs/multi-tenancy#659 - Added test definition for [MTB-PL3-BC-CPV-1]
31. kubernetes-sigs/multi-tenancy#621 - #405 Added test for block nodeports
32. kubernetes-sigs/multi-tenancy#620 - #404 added test for block use of bind mounts
33. kubernetes-sigs/multi-tenancy#614 - Added test for [MTB-PL2-BC-OPS-4]
34. kubernetes-sigs/multi-tenancy#612 - #403 added test for default deny network conn
35. kubernetes-sigs/multi-tenancy#587 - #406 added test for block_host_net_ports
36. kubernetes-sigs/multi-tenancy#583 - #401 added test for block privilege escalation
37. kubernetes-sigs/multi-tenancy#567 - added /vendor in gitignore
38. kubernetes-sigs/multi-tenancy#559 - #259 added test for (MTB-PL1-BC-CPI-2)
39. kubernetes-sigs/multi-tenancy#554 - corrected typo in README
40. kubernetes-sigs/multi-tenancy#553 - added test for [MTB-PL2-BC-OPS-3]
41. kubernetes-sigs/multi-tenancy#547 - added test definition of configure ns object limits
42. kubernetes-sigs/multi-tenancy#515 - #397 added block other tenant resources test
43. kubernetes-sigs/multi-tenancy#506 - #258 MTB: Test for Block modification of resource quotas (MTB-PL1-CC-TI-1)
44. kubernetes-sigs/multi-tenancy#499 - [MTB] corrected relative path of config.yaml

Total Issues Opened: 22

1. kubernetes-sigs/multi-tenancy#984 - [MTB]: Releases and publish mtb with Krew
2. kubernetes-sigs/multi-tenancy#983 - [MTB]: Add CI / CD to run unit tests on each PR
3. kubernetes-sigs/multi-tenancy#969 - [MTB] Add rationale field in config yamls
4. kubernetes-sigs/multi-tenancy#930 - [MTB] Sort the scorecard in default reporter acc to profile level
5. kubernetes-sigs/multi-tenancy#929 - [MTB] Get or test single benchmark
6. kubernetes-sigs/multi-tenancy#923 - [MTB] Change readme template format
7. kubernetes-sigs/multi-tenancy#874 - [MTB] Migrate benchmarks
8. kubernetes-sigs/multi-tenancy#873 - [MTB] Rearrange the benchmarks.
9. kubernetes-sigs/multi-tenancy#872 - [MTB] Add validation in the the Prerun to check that user has passed valid tenant and tenantadminnamespace.
10. kubernetes-sigs/multi-tenancy#810 - [MTB] Create a Reporter For Benchmarks.
11. kubernetes-sigs/multi-tenancy#802 - [MTB] Implement Benchmark Lifecycle.
12. kubernetes-sigs/multi-tenancy#793 - [MTB] Generating README.md from yaml
13. kubernetes-sigs/multi-tenancy#792 - [MTB] implement benchmark lifecycle
14. kubernetes-sigs/multi-tenancy#791 - [MTB] Use config files as static asset
15. kubernetes-sigs/multi-tenancy#695 - [MTB]: Method to run diff number of validation tests
16. kubernetes-sigs/multi-tenancy#694 - [MTB] Selection of packaging and execution tool for e2e tests
17. kubernetes-sigs/multi-tenancy#693 - [MTB]: custom controllers for namespace management for PL2 tests
18. kubernetes-sigs/multi-tenancy#692 - [MTB] Add validation for listing allowed cluster roles: PL2
19. kubernetes-sigs/multi-tenancy#691 - [MTB] Add Unit Tests for Benchmarks
20. kubernetes-sigs/multi-tenancy#535 - MTB: panic: runtime error: invalid memory address or nil pointer dereference
21. kubernetes-sigs/multi-tenancy#492 - MTB: Test Script to create tenant CRs
22. kubernetes-sigs/multi-tenancy#445 - Failed to run tests.

Total Pull Requests Reviewed: 3

1. kubernetes-sigs/multi-tenancy#993 - [MTB] Sort benchmarks in scorecard
2. kubernetes-sigs/multi-tenancy#981 - [MTB] Added leveled logging
3. kubernetes-sigs/multi-tenancy#880 - [MTB]Added Remaining benchmarks