Skip to content
This repository has been archived by the owner on Dec 11, 2019. It is now read-only.

Manual test run on Windows ia-32 for 0.19.x (Beta Channel) #11391

Closed
srirambv opened this issue Oct 9, 2017 · 1 comment
Closed

Manual test run on Windows ia-32 for 0.19.x (Beta Channel) #11391

srirambv opened this issue Oct 9, 2017 · 1 comment
Assignees
@kjozwiak
Labels
OS/Windows release-notes/exclude tests
Milestone
0.19.x (Beta Chan...

Comments

@srirambv
Copy link
Collaborator

srirambv commented Oct 9, 2017

Per release specialty tests

  • We should display unconfirmed funds to let users know balance is not 0. (#11334)
  • Ad blocking detection + ad replacement on tomshardware.com. (#11312)
  • Remove old CSV ledger export code. (#11295)
  • Recovery keys fail both manual/import. (#11293)
  • Copied text overlaps on the info message. (#11289)
  • Missing text in BAT add funds modal. (#11285)
  • URL Icon doesn't toggle include/exclude for non-verified publishers. (#11263)
  • 'Allow contributions to non-verified sites' toggle doesn't do anything. (#11261)
  • Min page time and min visit selections are not being saved in Advanced Settings. (#11260)
  • Default value for 'Minimum page time before logging a visit'. (#11258)
  • Anti-adblocker on Womenshealthmag.com. (#11257)
  • Error in undefined: "getWalletProperties" on master. (#11251)
  • Hide lower button hides all entries in ledger table. (#11246)
  • Edit Brave Payments Welcome Screen to reflect BAT integration. (#11242)
  • Speedtest fails with adblock message. (#11232)
  • Unable to drag/drop the un/lock icon onto a folder on Bookmarks Toolbar. (#11180)
  • Dragging from urlbar to create bookmark on toolbar doesn't respect position. (#11177)
  • Ledger transfer PDF opens another window. (#11173)
  • Npm run check-security fails (Large gzip Denial of Service). (#11168)
  • Netflix fails to login after import cookies from other browsers. (#11089)
  • Phantom Tab appears when middle clicking on a link with Switch to new tabs immediately. (#11070)
  • Typed in half URL is retained momentarily before loading the auto completed URL. (#11060)
  • URL suggestions for simple domain names sometimes don't appear up top. (#11057)
  • Netflix/Widevine notification banner does not go away. (#11054)
  • Errors joining a session on https://www.scrumpoker.online/. (#11053)
  • Upgrade to Chromium 61.0.3163.100. (#11052)
  • Top Site Tiles disappear after clicking on them. (#11043)
  • Check default browser dialog has the invalid background style property. (#11041)
  • Bookmark and Bookmark folder cannot be dragged and dropped into another folder on the bookmark toolbar. (#11040)
  • Brave not asking for permissions when loading geolocations . (#11036)
  • Drag padlock to add bookmark doesn't show bookmarked icon. (#11033)
  • Closing tab page makes browser unresponsive. (#11028)
  • Add notification after Brave app update for BAT Mercury. (#11021)
  • Fix button alignment for error page for small window. (#11007)
  • [hackerone] homepage homograph attack. (#11001)
  • Block coin miners by default with Brave shields up. (#10994)
  • Moving tabs sometimes doesn't respect the correct position. (#10961)
  • Site added instantly to the ledger. (#10955)
  • Bookmark manager dnd is not working. (#10936)
  • SiteInfo dialog cannot get large. (#10930)
  • Clicking on "magnifying glass" in URL bar under about:newtab displays certificate modal when loading website. (#10922)
  • Brave freezes when opening tabs while a window is loading. (#10866)
  • Upgrade to muon 4.4.25. (#10847)
  • Publisher entry jumps position when enabled/disabled. (#10716)
  • Browser crashes when trying to close other tabs. (#10696)
  • The first button on error pages is out of alignment. (#10679)
  • Buttons on certError lack margin. (#10677)
  • [hackerone] https://hackerone.com/reports/258578. (#10573)
  • Clipboard copy (cmd+c / ctrl+c) doesn't always work. (#10563)
  • Shared memory error on Windows. (#10366)
  • Add support for legacy ledger settings. (#10322)
  • Add Swedish (Sweden) language. (#10297)
  • Devtool via context menu cannot be displayed. (#10249)
  • Use better name mappings for channels on about:brave. (#10239)
  • Hide enpass & metamask for 0.19. (#10232)
  • AppStore calls diff on the state without first checking to see if there are changes. (#10195)
  • Move frame hrefPreview to a separate component . (#10194)
  • 0.19.x: Private tabs are broken by the new tab page. (#10182)
  • Replace 'Hide lower' button's label with something else. (#10158)
  • Sites shows up with 0 views in payments . (#10036)
  • Sites visited before payment enabling is shown as 0 views. (#9980)
  • ActivateIfOpen doesn't activate if open. (#9964)
  • Buttons has no margin in about:error page. (#9916)
  • Command+L when in url bar with URL bar suggestion should select full URL. (#9914)
  • Unable to fire devTools via shortcut. (#9889)
  • Downloading from Google Drive appears to become stuck. (#9810)
  • Only primitives in TabPage. (#9793)
  • Close tabs to the left/right (tab page). (#9789)
  • Theme color for find bar is not correct. (#9758)
  • Only primitives in UrlBar. (#9756)
  • Only primitives in UrlBarIcon. (#9753)
  • Only primitives in Navigator. (#9751)
  • Clicking on any entry in the kebab menu results in TypeError. (#9744)
  • Imported bookmarks don't show up in about:bookmark. (#9716)
  • Only primitives in BookmarksToolbar and BookmarkToolbarButton. (#9712)
  • Editing a bookmark (or folder) locks up the browser. (#9674)
  • Update to HTTPS Everywhere 5.2.19. (#9649)
  • Ledger pin publishers 0 for unpinned sites. (#9641)
  • Convert reload context menu to native context menu. (#9571)
  • Remove duping secondaryColor button on about:styles. (#9559)
  • Prevent Tab Close Button from allowing tab-tearoff. (#9511)
  • Redux component - ContextMenu. (#9482)
  • Redux component - BraveryPanel. (#9454)
  • Redux component - NotificationBar. (#9451)
  • Redux component - UpdateBar. (#9450)
  • Redux component - CheckDefaultBrowserDialog. (#9449)
  • Redux component - ReleaseNotes. (#9448)
  • Redux component - NoScriptInfo. (#9447)
  • Cleanup of LoginRequired component. (#9446)
  • Redux component - AutofillCreditCardPanel. (#9445)
  • Redux component - AutofillAddressPanel. (#9444)
  • Redux component - WidevinePanel. (#9443)
  • Redux component - ImportBrowserDataPanel. (#9442)
  • Redux component - ClearBrowsingDataPanel. (#9440)
  • Bitwarden extension header buttons are not clickable. (#9436)
  • Import passwords from Chrome. (#9434)
  • 'Sync could not create siteKey' error. (#9430)
  • Redux component - BookmarksToolbar and BookmarkToolbarButton. (#9421)
  • Close tab page is not working. (#9420)
  • XE.com not rendered properly . (#9419)
  • Redux component - Popup window. (#9416)
  • Redux component - Site info. (#9412)
  • Visited links are not reset when history is cleared. (#9351)
  • Redux component - Url bar icon. (#9340)
  • Redux component - Tab page. (#9339)
  • Redux component - Find bar. (#9338)
  • Redux component - PublisherToggle. (#9323)
  • Beef up the kabab. (#9305)
  • Import passwords from Firefox. (#9292)
  • Polish groupedItem button. (#9252)
  • Buttons for commonForm on about:styles need updating. (#9251)
  • Able to view certificate even after the URL is removed. (#9172)
  • Fa un/lock icon is not displayed for PDF file. (#9162)
  • Release note modal text should be scrollable . (#9121)
  • Autoplay block shouldn't weigh in once users start playing media. (#8897)
  • Find bar lose focus if tab is opened in a background. (#8877)
  • History entries often cannot be deleted. (#8761)
  • Mixed Content on http://us.coopertire.com. (#5634)
  • Add bookmark from toolbar/right click context menu brings up "edit bookmark" modal. (#5508)
  • Changing bookmark folder in the add bookmark modal changes it to bookmark added. (#5314)
  • Bookmark cannot be deleted from the panel if location is changed. (#4978)
  • Double click in addressbar maximizes/restores the window instead of selecting the address. (#4922)
  • Add Bitwarden Password Manager. (#4776)
  • Mailto: notifications display "null" rather than the domain when opening in new tabs. (#4198)

Installer

  1. Check that installer is close to the size of last release.
  2. Check signature: If OS Run spctl --assess --verbose /Applications/Brave.app/ and make sure it returns accepted. If Windows right click on the installer exe and go to Properties, go to the Digital Signatures tab and double click on the signature. Make sure it says "The digital signature is OK" in the popup window.
  3. Check Brave, muon, and libchromiumcontent version in About and make sure it is EXACTLY as expected.

Last changeset test

  1. Test what is covered by the last changeset (you can find this by clicking on the SHA in about:brave).

Widevine/Netflix test

  1. Test that you can log into Netflix and start a show.

Ledger

  1. Create a wallet with a value other than $5 selected in the monthly budget dropdown. Click on the 'Add Funds' button and check that Coinbase transactions are blocked.
  2. Remove all ledger-*.json files from ~/Library/Application\ Support/Brave/. Go to the Payments tab in about:preferences, enable payments, click on create wallet. Check that the add funds button appears after a wallet is created.
  3. Click on add funds and verify that adding funds through Coinbase increases the account balance.
  4. Repeat the step above but add funds by scanning the QR code in a mobile bitcoin app instead of through Coinbase.
  5. Visit nytimes.com for a few seconds and make sure it shows up in the Payments table.
  6. Go to https://jsfiddle.net/LnwtLckc/5/ and click the register button. In the Payments tab, click add funds. Verify that the transfer funds button is visible and that clicking on transfer funds opens a jsfiddle URL in a new tab.
  7. Go to https://jsfiddle.net/LnwtLckc/5/ and click unregister. Verify that the transfer funds button no longer appears in the add funds modal.
  8. Check that disabling payments and enabling them again does not lose state.

Sync

  1. Verify you are able to sync two devices using the secret code
  2. Visit a site on device 1 and change shield setting, ensure that the saved site preference is synced to device 2
  3. Enable Browsing history sync on device 1, ensure the history is shown on device 2
  4. Import/Add bookmarks on device 1, ensure it is synced on device 2
  5. Ensure imported bookmark folder structure is maintained on device 2
  6. Ensure bookmark favicons are shown after sync

Data

  1. Make sure that data from the last version appears in the new version OK.
  2. Test that the previous version's cookies are preserved in the next version.

About pages

  1. Test that about:adblock loads
  2. Test that about:autofill loads
  3. Test that about:bookmarks loads bookmarks
  4. Test that about:downloads loads downloads
  5. Test that about:extensions loads
  6. Test that about:history loads history
  7. Test that about:passwords loads
  8. Test that about:styles loads
  9. Test that about:welcome loads
  10. Test that about:preferences changing a preference takes effect right away
  11. Test that about:preferences language change takes effect on re-start

Bookmarks

  1. Test that creating a bookmark on the bookmarks toolbar with the star button works
  2. Test that creating a bookmark on the bookmarks toolbar by dragging the un/lock icon works
  3. Test that creating a bookmark folder on the bookmarks toolbar works
  4. Test that moving a bookmark into a folder by drag and drop on the bookmarks folder works
  5. Test that clicking a bookmark in the toolbar loads the bookmark.
  6. Test that clicking a bookmark in a bookmark toolbar folder loads the bookmark.

Context menus

  1. Make sure context menu items in the URL bar work
  2. Make sure context menu items on content work with no selected text.
  3. Make sure context menu items on content work with selected text.
  4. Make sure context menu items on content work inside an editable control on about:styles (input, textarea, or contenteditable).

Find on page

  1. Ensure search box is shown with shortcut
  2. Test successful find
  3. Test forward and backward find navigation
  4. Test failed find shows 0 results
  5. Test match case find

Geolocation

  1. Check that https://developer.mozilla.org/en-US/docs/Web/API/Geolocation/Using_geolocation works

Site hacks

  1. Test https://www.twitch.tv/adobe sub-page loads a video and you can play it

Downloads

  1. Test downloading a file works and that all actions on the download item works.

Fullscreen

  1. Test that entering full screen window works View -> Toggle Full Screen. And exit back (Not Esc).
  2. Test that entering HTML5 full screen works. And Esc to go back. (youtube.com)

Tabs, Pinning and Tear off tabs

  1. Test that tabs are pinnable
  2. Test that tabs are unpinnable
  3. Test that tabs are draggable to same tabset
  4. Test that tabs are draggable to alternate tabset
  5. Test that tabs can be teared off into a new window
  6. Test that you are able to reattach a tab that is teared off into a new window
  7. Test that tab pages can be closed
  8. Test that tab pages can be muted

Zoom

  1. Test zoom in / out shortcut works
  2. Test hamburger menu zooms.
  3. Test zoom saved when you close the browser and restore on a single site.
  4. Test zoom saved when you navigate within a single origin site.
  5. Test that navigating to a different origin resets the zoom

Bravery settings

  1. Check that HTTPS Everywhere works by loading https://https-everywhere.badssl.com/
  2. Turning HTTPS Everywhere off and shields off both disable the redirect to https://https-everywhere.badssl.com/
  3. Check that ad replacement works on http://slashdot.org
  4. Check that toggling to blocking and allow ads works as expected.
  5. Test that clicking through a cert error in https://badssl.com/ works.
  6. Test that Safe Browsing works (http://downloadme.org/)
  7. Turning Safe Browsing off and shields off both disable safe browsing for http://downloadme.org/.
  8. Visit https://brianbondy.com/ and then turn on script blocking, nothing should load. Allow it from the script blocking UI in the URL bar and it should work.
  9. Test that about:preferences default Bravery settings take effect on pages with no site settings.
  10. Test that turning on fingerprinting protection in about:preferences shows 3 fingerprints blocked at https://jsfiddle.net/bkf50r8v/13/. Test that turning it off in the Bravery menu shows 0 fingerprints blocked.
  11. Test that 3rd party storage results are blank at https://jsfiddle.net/7ke9r14a/9/ when 3rd party cookies are blocked and not blank when 3rd party cookies are unblocked.
  12. Test that audio fingerprint is blocked at https://audiofingerprint.openwpm.com/ when fingerprinting protection is on.
  13. Test that browser is not detected on https://extensions.inrialpes.fr/brave/

Content tests

  1. Go to https://brianbondy.com/ and click on the twitter icon on the top right. Test that context menus work in the new twitter tab.
  2. Load twitter and click on a tweet so the popup div shows. Click to dismiss and repeat with another div. Make sure it shows.
  3. Go to http://www.bennish.net/web-notifications.html and test that clicking on 'Show' pops up a notification asking for permission. Make sure that clicking 'Deny' leads to no notifications being shown.
  4. Go to https://trac.torproject.org/projects/tor/login and make sure that the password can be saved. Make sure the saved password shows up in about:passwords. Then reload https://trac.torproject.org/projects/tor/login and make sure the password is autofilled.
  5. Open about:styles and type some misspellings on a textbox, make sure they are underlined.
  6. Make sure that right clicking on a word with suggestions gives a suggestion and that clicking on the suggestion replaces the text.
  7. Make sure that Command + Click (Control + Click on Windows, Control + Click on Ubuntu) on a link opens a new tab but does NOT switch to it. Click on it and make sure it is already loaded.
  8. Open an email on http://mail.google.com/ or inbox.google.com and click on a link. Make sure it works.
  9. Test that PDF is loaded at http://www.orimi.com/pdf-test.pdf
  10. Test that https://mixed-script.badssl.com/ shows up as grey not red (no mixed content scripts are run).

Flash tests

  1. Turn on Flash in about:preferences#security. Test that clicking on 'Install Flash' banner on myspace.com shows a notification to allow Flash and that the banner disappears when 'Allow' is clicked.
  2. Test that flash placeholder appears on http://www.homestarrunner.com

Autofill tests

  1. Test that autofill works on http://www.roboform.com/filling-test-all-fields

Session storage

Do not forget to make a backup of your entire ~/Library/Application\ Support/Brave folder.

  1. Temporarily move away your ~/Library/Application\ Support/Brave/session-store-1 and test that clean session storage works. (%appdata%\Brave in Windows, ./config/brave in Ubuntu)
  2. Test that windows and tabs restore when closed, including active tab.
  3. Move away your entire ~/Library/Application\ Support/Brave folder (%appdata%\Brave in Windows, ./config/brave in Ubuntu)

Cookie and Cache

  1. Make a backup of your profile, turn on all clearing in preferences and shut down. Make sure when you bring the browser back up everything is gone that is specified.
  2. Go to http://samy.pl/evercookie/ and set an evercookie. Check that going to prefs, clearing site data and cache, and going back to the Evercookie site does not remember the old evercookie value.

Update tests

  1. Test that updating using BRAVE_UPDATE_VERSION=0.8.3 env variable works correctly.
@srirambv srirambv added this to the 0.19.x (Beta Channel) milestone Oct 9, 2017
@kjozwiak
Copy link
Member

Closing (won't have time to go through Win32)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@kjozwiak kjozwiak

Labels
OS/Windows release-notes/exclude tests
Projects
None yet
Milestone
0.19.x (Beta Channel)
Development

No branches or pull requests
2 participants
@kjozwiak @srirambv