Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lower heap and disk space used by compiling kafka tests #10915

Merged
merged 1 commit into from
Apr 23, 2020
Merged

Lower heap and disk space used by compiling kafka tests #10915

merged 1 commit into from
Apr 23, 2020

Conversation

sunjayBhatia
Copy link
Member

@sunjayBhatia sunjayBhatia commented Apr 23, 2020

Commit Message:
This patch either removes mocks.h related headers altogether from tests
which never required this very heavyweight dependency, or simplifies the
most heavyweight server/mocks.h and elects only more specific mocks. It
especially useful for reducing resource consumption on Windows with
cl.exe though compilation on Linux with clang is sped up and leaner
as well.

Additional Description:
Original/Revised Peak Working Set Memory for cl.exe (kb) used compiling (before/after simplifying mocks.h inclusions) on Windows
3619976 283508 //test/extensions/filters/network/kafka:request_codec_integration_test
3621112 177212 //test/extensions/filters/network/kafka:response_codec_integration_test
3631680 308996 //test/extensions/filters/network/kafka:kafka_response_parser_test
3637000 309368 //test/extensions/filters/network/kafka:kafka_request_parser_test
3734736 93464 //test/extensions/filters/network/kafka:request_codec_unit_test
3735984 342468 //test/extensions/filters/network/kafka:response_codec_unit_test
4295272 2323440 //test/extensions/filters/network/kafka/broker:filter_unit_test
4339972 932984 //test/extensions/filters/network/kafka:requests_test
4366380 945936 //test/extensions/filters/network/kafka:request_codec_request_test
4410788 1020112 //test/extensions/filters/network/kafka:responses_test
4437292 1033328 //test/extensions/filters/network/kafka:response_codec_response_test

Risk Level: Low
Testing: N/A
Docs Changes: N/A
Release Notes: N/A

This patch either removes mocks.h related headers altogether from tests
which never required this very heavyweight dependency, or simplifies the
most heavyweight server/mocks.h and elects only more specific mocks.

Original Revised Heap space used compiling (before/after simplifying mocks.h inclusions)
 3619976  283508 //test/extensions/filters/network/kafka:request_codec_integration_test
 3621112  177212 //test/extensions/filters/network/kafka:response_codec_integration_test
 3631680  308996 //test/extensions/filters/network/kafka:kafka_response_parser_test
 3637000  309368 //test/extensions/filters/network/kafka:kafka_request_parser_test
 3734736   93464 //test/extensions/filters/network/kafka:request_codec_unit_test
 3735984  342468 //test/extensions/filters/network/kafka:response_codec_unit_test
 4295272 2323440 //test/extensions/filters/network/kafka/broker:filter_unit_test
 4339972  932984 //test/extensions/filters/network/kafka:requests_test
 4366380  945936 //test/extensions/filters/network/kafka:request_codec_request_test
 4410788 1020112 //test/extensions/filters/network/kafka:responses_test
 4437292 1033328 //test/extensions/filters/network/kafka:response_codec_response_test

Co-authored-by: William A Rowe Jr <wrowe@pivotal.io>
Signed-off-by: William A Rowe Jr <wrowe@pivotal.io>
Co-authored-by: Sunjay Bhatia <sbhatia@pivotal.io>
Signed-off-by: Sunjay Bhatia <sbhatia@pivotal.io>
@sunjayBhatia sunjayBhatia changed the title Lower heap and disk space used by kafka tests Lower heap and disk space used by compiling kafka tests Apr 23, 2020
Copy link
Member

@mattklein123 mattklein123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@mattklein123 mattklein123 merged commit 61d23c4 into envoyproxy:master Apr 23, 2020
spenceral added a commit to spenceral/envoy that referenced this pull request Apr 23, 2020
Signed-off-by: Spencer Lewis <slewis@squareup.com>
* master: (46 commits)
  allow specifying the API version of bootstrap from the command line (envoyproxy#10803)
  config: adding connect matcher (unused) (envoyproxy#10894)
  Add missing dependency on `assert.h` (envoyproxy#10918)
  Lower heap and disk space used by kafka tests (envoyproxy#10915)
  [tools] handle commits merged without PR in deprecated script (envoyproxy#10723)
  tools: including working tree in modified_since_last_github_commit.sh diff. (envoyproxy#10911)
  rocketmq_proxy: implement rocketmq proxy
  [docs] PR template to include commit message (envoyproxy#10900)
  docs: breaking long word to stop content overflow. (envoyproxy#10880)
  Delete legacy connection pool code. (envoyproxy#10881)
  wasm: clarify how configuration is passed (envoyproxy#10782)
  issue template: clarify security/crash reporting (envoyproxy#10885)
  api/faq: add entry on incremental xDS. (envoyproxy#10876)
  router: retry overloaded requests (envoyproxy#10847)
  Remove inclusion of pthread.h, not needed for linux compilation (envoyproxy#10895)
  request_id: Add option to always set request id in response (envoyproxy#10808)
  xray: Use correct types for segment document output (envoyproxy#10834)
  router: fixing a watermark bug for streaming retries (envoyproxy#10866)
  http: auditing Path() calls for safety with Pathless CONNECT (envoyproxy#10851)
  Remove hardcoded type urls Part.2 (envoyproxy#10848)
  ...
@wrowe wrowe deleted the simplify-mock-dependencies branch June 16, 2020 18:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants