Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

nix: stop ndk-bundle from being cached #10889

Closed
wants to merge 1 commit into from
Closed

nix: stop ndk-bundle from being cached #10889

wants to merge 1 commit into from

Conversation

jakubgs
Copy link
Member

@jakubgs jakubgs commented Jun 29, 2020 •
edited by StatusWrike
Loading

This should in theory fix the issue with downloading the nkd-bundle from our own Nix cache:

copying path '/nix/store/64g5wharwjj040rg1v8jnc5qhv1hkgds-ndk-bundle-21.0.6113669' from 'https://nix-cache.status.im'...
warning: unable to download 'https://nix-cache.status.im/nar/64g5wharwjj040rg1v8jnc5qhv1hkgds.nar': HTTP error 200 (curl error: Stream error in the HTTP/2 framing layer); retrying in 314 ms
non-zero padding

The idea is to stop uploading Android NDK to our Nix cache and then purge it from the cache so that every time people have to download it they will get it directly from Google servers.

For more details see: https://github.com/status-im/infra-ci/issues/17

@jakubgs jakubgs self-assigned this Jun 29, 2020
@status-im-auto
Copy link
Member

status-im-auto commented Jun 29, 2020 •
edited
Loading

Jenkins Builds

Click to see older builds (6)
❔ Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ acb268e #1 2020-06-29 18:28:34 ~12 min android-e2e 📦apk 📲
✔️ acb268e #1 2020-06-29 18:30:13 ~13 min ios 📦ipa 📲
✔️ acb268e #1 2020-06-29 18:30:47 ~14 min android 📦apk 📲
✔️ 8f1b249 #2 2020-06-29 18:51:36 ~11 min android-e2e 📦apk 📲
✔️ 8f1b249 #2 2020-06-29 18:52:22 ~12 min android 📦apk 📲
✔️ 8f1b249 #2 2020-06-29 18:53:23 ~13 min ios 📦ipa 📲
❔ Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ ec383b3 #3 2020-06-29 20:43:08 ~13 min ios 📦ipa 📲
✔️ ec383b3 #3 2020-06-29 20:45:54 ~16 min android-e2e 📦apk 📲
✔️ ec383b3 #3 2020-06-29 20:45:54 ~15 min android 📦apk 📲
✔️ c70d589 #4 2020-06-29 21:00:05 ~13 min ios 📦ipa 📲
✔️ c70d589 #4 2020-06-29 21:01:35 ~14 min android-e2e 📦apk 📲
✔️ c70d589 #4 2020-06-29 21:01:43 ~15 min android 📦apk 📲

@status-im-auto
Copy link
Member

100% of end-end tests have passed

Total executed tests: 94
Failed tests: 0
Passed tests: 94

Passed tests (94)

Click to expand
1. test_decline_transactions_in_1_1_chat
Device sessions

2. test_delete_chats_via_delete_button
Device sessions

3. test_can_see_all_transactions_in_history
Device sessions

4. test_install_pack_and_send_sticker
Device sessions

5. test_login_with_new_account
Device sessions

6. test_timestamp_in_chats
Device sessions

7. test_password_in_logcat_sign_in
Device sessions

8. test_logcat_recovering_account
Device sessions

9. test_public_chat_clear_history
Device sessions

10. test_need_help_section
Device sessions

11. test_send_and_open_links
Device sessions

12. test_mobile_data_usage_popup_stop_syncing
Device sessions

13. test_mobile_data_usage_settings
Device sessions

14. test_create_new_group_chat
Device sessions

15. test_sign_typed_message (TestRail link is not found)
Device sessions

16. test_user_can_switch_network
Device sessions

17. test_mobile_data_usage_popup_continue_syncing
Device sessions

18. test_home_view
Device sessions

19. test_open_google_com_via_open_dapp
Device sessions

20. test_share_contact_code_and_wallet_address
Device sessions

21. test_connection_is_secure
Device sessions

22. test_add_to_contacts
Device sessions

23. test_add_account_to_multiaccount_instance_private_key
Device sessions

24. test_refresh_button_browsing_app_webview
Device sessions

25. test_keycard_send_two_transactions_one_after_another_in_dapp
Device sessions

26. test_can_add_existing_ens
Device sessions

27. test_transaction_wrong_password_wallet
Device sessions

28. test_public_chat_messaging
Device sessions

29. test_unread_messages_counter_public_chat
Device sessions

30. test_keycard_send_eth_from_wallet_to_address
Device sessions

31. test_keycard_fetching_balance_after_offline
Device sessions

32. test_keycard_send_transaction_from_daap
Device sessions

33. test_text_message_1_1_chat
Device sessions

34. test_can_use_purchased_stickers_on_recovered_account
Device sessions

35. test_open_transaction_on_etherscan
Device sessions

36. test_onboarding_screen_when_requesting_tokens_for_recovered_account
Device sessions

37. test_contact_profile_view
Device sessions

38. test_offline_add_new_group_chat_member
Device sessions

39. test_logcat_backup_recovery_phrase
Device sessions

40. test_start_chat_with_ens
Device sessions

41. test_add_and_remove_contact_from_public_chat
Device sessions

42. test_add_account_to_multiaccount_instance_seed_phrase
Device sessions

43. test_open_blocked_site
Device sessions

44. test_open_chat_by_pasting_public_key
Device sessions

45. test_pair_devices_sync_one_to_one_contacts_public_chat
Device sessions

46. test_keycard_sign_message_from_daap
Device sessions

47. test_send_non_english_message_to_newly_added_contact
Device sessions

48. test_ens_username_recipient
Device sessions

49. test_fetch_more_history_in_empty_chat
Device sessions

50. test_open_public_chat_using_deep_link
Device sessions

51. test_switch_users_and_add_new_account
Device sessions

52. test_add_account_to_multiaccount_instance_generate_new
Device sessions

53. test_copy_contact_code_and_wallet_address
Device sessions

54. test_send_transaction_from_daap
Device sessions

55. test_send_two_transactions_one_after_another_in_dapp
Device sessions

56. test_image_in_one_to_one_send_save_reply
Device sessions

57. test_add_new_keycard_account_and_login
Device sessions

58. test_long_press_delete_clear_all_dapps
Device sessions

59. test_copy_and_paste_messages
Device sessions

60. test_back_forward_buttons_browsing_website
Device sessions

61. test_password_in_logcat_creating_account
Device sessions

62. test_sign_message_from_daap
Device sessions

63. test_dapps_permissions
Device sessions

64. test_request_public_key_status_test_daap
Device sessions

65. test_long_press_to_delete_chat
Device sessions

66. test_log_level_and_fleet
Device sessions

67. test_add_and_delete_watch_only_account_to_multiaccount_instance
Device sessions

68. test_recover_account_from_new_user_seedphrase
Device sessions

69. test_send_transaction_with_custom_token
Device sessions

70. test_send_eth_in_1_1_chat
Device sessions

71. test_send_two_transactions_in_batch_in_dapp
Device sessions

72. test_ens_in_public_and_1_1_chats
Device sessions

73. test_block_user_from_public_chat
Device sessions

74. test_fetching_balance_after_offline
Device sessions

75. test_offline_status
Device sessions

76. test_wallet_set_up
Device sessions

77. test_manage_assets
Device sessions

78. test_offline_messaging_1_1_chat
Device sessions

79. test_account_recovery_with_uppercase_recovery_phrase
Device sessions

80. test_send_token_with_7_decimals
Device sessions

81. test_user_can_see_all_own_assets_after_account_recovering
Device sessions

82. test_pass_phrase_validation
Device sessions

83. test_keycard_can_see_all_transactions_in_history
Device sessions

84. test_keycard_send_two_transactions_in_batch_in_dapp
Device sessions

85. test_send_emoji
Device sessions

86. test_filters_from_daap
Device sessions

87. test_redirect_to_public_chat_tapping_tag_message
Device sessions

88. test_restore_account_from_mnemonic_to_keycard
Device sessions

89. test_send_eth_to_ens_in_chat
Device sessions

90. test_send_eth_from_wallet_to_address
Device sessions

91. test_request_and_receive_stt_in_1_1_chat_offline
Device sessions

92. test_messaging_in_different_networks
Device sessions

93. test_collectible_from_wallet_opens_in_browser_view
Device sessions

94. test_insufficient_funds_wallet_positive_balance
Device sessions

@jakubgs
nix: stop ndk-bundle from being cached
c70d589 
This should in theory fix the issue with downloading the
nkd-bundle from our own Nix cache.

For details see: status-im/infra-ci#17

Signed-off-by: Jakub Sokołowski <jakub@status.im>
@jakubgs
Copy link
Member Author

jakubgs commented Jun 29, 2020

Turns out that despite the change the NDK is still copied:

22:49:14  + nix-shell --show-trace --run 
22:49:14                find /nix/store/ -mindepth 1 -maxdepth 1 -type d                 -not -name *.links -and                 -not -name *-ndk-bundle-* -and                 -not -name *-status-react-*                 | tee find.log                 | xargs nix-copy-closure -v --to nix-cache@master-01.do-ams3.ci.misc.statusim.net
22:49:14               --no-out-link --keep LOCALE_ARCHIVE_2_27 --option sandbox true --attr shells.default /home/jenkins/workspace/status-react/nix-cache/linux/default.nix
22:49:17  copying 5 paths...
22:49:17  copying path '/nix/store/5mzkq45flafvzdvwp530z489yi28hcr7-ndk-bundle-21.0.6113669' to 'ssh://nix-cache@master-01.do-ams3.ci.misc.statusim.net'...
22:50:04  copying path '/nix/store/8i034qd00sqzvqnmcy4bbnfsmns81shh-androidsdk' to 'ssh://nix-cache@master-01.do-ams3.ci.misc.statusim.net'...
22:50:04  copying path '/nix/store/agjwnx35bvraps2a38pfjawxby77wv7y-licensed-android-sdk' to 'ssh://nix-cache@master-01.do-ams3.ci.misc.statusim.net'...
22:50:04  copying path '/nix/store/9nmxlbb73vlnzbfvb3z9i91f45zc0mrw-gomobile-20200329-4c31acb-bin' to 'ssh://nix-cache@master-01.do-ams3.ci.misc.statusim.net'...
22:50:04  copying path '/nix/store/gw4w9x0anxgl84c1hd380aah7ml4mpb9-gomobile-20200329-4c31acb-dev' to 'ssh://nix-cache@master-01.do-ams3.ci.misc.statusim.net'...

And when I checked the found results I verified that the -not clause I added works. Which means that it's nix-copy-closure that's causing it to be included.

@jakubgs
Copy link
Member Author

jakubgs commented Jun 29, 2020

Ooooooh, I see what this is. Here's part from manual of nix-copy-closure:

nix-copy-closure gives you an easy and efficient way to exchange software between machines. Given one or more Nix store paths on the local machine, nix-copy-closure computes the closure of those paths (i.e. all their dependencies in the Nix store), and copies all paths in the closure to the remote machine via the ssh command.

Which means that I can't stop it from copying Android NDK. The alternative would be to have a timer on the Nix cache host and periodically remove the NDK as a temporary fix for these issues.

Closing this since it doesn't work.

@jakubgs jakubgs closed this Jun 29, 2020
@weekly-digest weekly-digest bot mentioned this pull request Jul 5, 2020
Closed
@jakubgs jakubgs deleted the dont-cache-ndk-bundle branch February 2, 2021 18:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@flexsurfer flexsurfer flexsurfer approved these changes

@cammellos cammellos Awaiting requested review from cammellos

@yenda yenda Awaiting requested review from yenda

@Ferossgp Ferossgp Awaiting requested review from Ferossgp

Assignees

@jakubgs jakubgs

Labels
android
Projects
No open projects
Legacy QA Automation Project
Archived in project
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@jakubgs @status-im-auto @flexsurfer