Expand Outlook folder click has just stopped working.

[brianannett]

As part of my test I need to

• Verify that the product has sent an email
• Confirm the link within that email works

I've written some code to open browser based outlook, login, navigate to a top folder, then a sub folder. Then verify the top email contains the correct information. It's a little flaky as Outlook updates fairly regularly but has been reasonably stable for over a year, subject to tweaks by MS.

My problem is that just over a week ago the click which would normally expand a folder so that the sub folders are visible has stopped working and I can't see why!

Outlooks doesn't seem to have changed and my selector hasn’t changed. If I use my selector within developer tools it finds the element as expected.

In Outlook a folders name is the title and the dropdown is a button beneath it, giving:

myFolder: {
    selector: 'div[title="myFolder"]'
  },

And the button to access sub folders is

myFoldersDropdown: {
   selector: 'div[title="myFolder"] > button'
 },

This is called via

browser
    .waitForElementPresent(myFolder, this.timeoutLong, "Team folder present")         
    .waitForElementPresent(myFoldersDropdown, this.timeout, "Team folder dropdown present")

The above call results in

✔ Team folder present
✖ Team folder dropdown present - expected "found" but got: "not found" (10114ms)  
~
npm ERR! code ELIFECYCLE
npm ERR! errno 5
~
npm ERR! Exit status 5

Outlooks code for a folder with sub folders

<div class="_2f5JzhIau1fYVnCdnF6jed _3kaE-lp56xiPtiBK5bJWgr _2e45YSYkafAibqL8u3c2wj" data-is-focusable="true" title="myFolder" role="treeitem" aria-expanded="false" aria-selected="true" aria-level="2" tabindex="0" style="padding-left: 0px; padding-right: 28px;">
    <button type="button" data-is-focusable="false" tabindex="-1" class="ms-Button ms-Button--icon _3Tc12ptS8HtxbTLAGzivrO _13eMs9pGc0Ag2XqdlzNGl1 root-59" role="button" aria-hidden="true">
        <span class="ms-Button-flexContainer flexContainer-47" data-automationid="splitbuttonprimary">
            <i data-icon-name="ChevronRightMed" aria-hidden="true" class="ms-Button-icon _3xjtFZiBm1DrWK64r3hZWK _3kaE-lp56xiPtiBK5bJWgr aYuaXfV0-gcLcMNagk_0t _2D6wm1spPIPn1G8mum7M8h flipForRtl icon-61">
            </i>
        </span>
    </button>

I'm running
"nightwatch": "^1.7.8",
node -v
v12.20.0

For the life of me I can't see why it's stopped working and no amount of selector editing makes it miraculously work.
Anyone have any pointers?

P.S. Failing both locally, on a Mac against Chrome 92 and on Jenkins, using a Ubuntu 18.04 against Chrome 91 image.

[beatfactor]

Was this after a Nightwatch upgrade or a Chromedriver/Chrome upgrade? Can you share some more info about your config and preferably also a nightwatch verbose log?

[brianannett]

I don't think it was after a Nightwatch update but I took the hat off of "nightwatch": "^1.7.3", to pin it to that version, before migrating to 1.7.8, to see if that cured it.

Chrome did move from 91 to 92 on my system but the docker image for the Jenkins runs is pinned to 91.

Package.json

  "author": "Matthew Cooper",
  "license": "MIT",
  "dependencies": {
    "eslint": "^7.28.0",
    "eslint-config-prettier": "8.3.0",
    "eslint-plugin-prettier": "^3.4.0"
  },
  "devDependencies": {
    "chromedriver": "^92.0.0",
    "commitizen": "^4.2.2",
    "commitlint": "^12.1.4",
    "cz-conventional-changelog": "^3.3.0",
    "geckodriver": "^2.0.2",
    "handlebars": "^4.7.6",
    "nightwatch": "^1.7.3",
    "nightwatch-vrt": "^0.2.10",
    "platform-common-nightwatch": "git+ssh://git@github.com/ukxxxx/platform-common-nightwatch.git",
    "request": "^2.88.2",
    "selenium-server": "^3.141.59",
    "speakeasy": "^2.0.0"
  },
  "config": {
    "commitizen": {
      "path": "./node_modules/cz-conventional-changelog"
    }
  }

nightwatch.conf.js

const seleniumServer = require("selenium-server")
const chromedriver = require("chromedriver")
const geckodriver = require("geckodriver")

module.exports = {
  src_folders: ["tests"],
  output_folder: "reports",
  custom_commands_path: ["node_modules/platform-common-nightwatch/commands",
    "node_modules/nightwatch-vrt/commands"],
  custom_assertions_path: ["node_modules/platform-common-nightwatch/assertions",
    "node_modules/nightwatch-vrt/assertions"],
  page_objects_path: [
    "page_objects",
    "node_modules/platform-common-nightwatch/pages/auth",
    "node_modules/platform-common-nightwatch/pages/common"
  ],
  globals_path: "node_modules/platform-common-nightwatch/globals.js",
  selenium: {
    start_process: true,
    server_path: seleniumServer.path,
    log_path: "",
    port: 4444,
    cli_args: {
      "webdriver.chrome.driver": chromedriver.path,
      "webdriver.gecko.driver": geckodriver.path,
      "webdriver.edge.driver": "./MicrosoftWebDriver.exe"
    },
    check_process_delay: 10000,
  }, 
  disable_colors: false,
  // test_workers: {
  //   enabled: true,
  //   workers: 2,
  // },

  test_settings: {
    default: {
      launch_url: "http://localhost:8087",
      selenium_port: 4444,
      selenium_host: "localhost",
      webdriver: {
        timeout_options: {
          timeout: parseInt(process.env.TIMEOUT, 10) * 2,
          retry_attempts: 5
        }
      },
      desiredCapabilities: {
        browserName: "chrome",
        javascriptEnabled: true,
        acceptSslCerts: true
        //        chromeOptions: {
        //          args: ['headless', 'disable-gpu']
        //        }
      },
      screenshots: {
        enabled: true,
        path: "screenshots",
        on_failure: true,
        on_error: true
      }
    },
    chromeHeadless: {
      desiredCapabilities: {
        browserName: "chrome",
        javascriptEnabled: true,
        acceptSslCerts: true,
        chromeOptions: {
          args: [
            "headless",
            "disable-gpu",
            "no-sandbox",
            "disable-dev-shm-usage",
            "--start-maximized",
            "window-size=1920,1080"
          ],
          w3c: false
        }
      }
    },
    chromeIncog: {
      desiredCapabilities: {
          browserName: "chrome",
          javascriptEnabled: true,
          acceptSslCerts: true,
          chromeOptions: {
              args: ["incognito"],
              args: ["disable-gpu"],
              w3c: false
          }
        }
    },
    firefoxHeadless: {
      selenium_port: 4444,
      desiredCapabilities: {
        browserName: "firefox",
        javascriptEnabled: true,
        marionette: true,
        "moz:firefoxOptions": {
          args: ["-headless", "--window-size=1920,1080"]
        }
      }
    },
    chrome: {
      desiredCapabilities: {
        browserName: "chrome",
        javascriptEnabled: true,
        acceptSslCerts: true,
        chromeOptions: {
          args: ["disable-gpu"],
          w3c: false
        }
      }
    },
    firefox: {
      selenium_port: 4444,
      desiredCapabilities: {
        browserName: "firefox",
        javascriptEnabled: true,
        marionette: true
      }
    },
    edge: {
      selenium_port: 4444,
      desiredCapabilities: {
        platform: "Windows 10",
        browserName: "MicrosoftEdge",
        acceptSslCerts: true
      }
    },
    ie: {
      selenium_port: 4444,
      desiredCapabilities: {
        browserName: "internet explorer",
        acceptSslCerts: true
      },
      selenium: {
        cli_args: {
          "webdriver.edge.driver": "/git/nightwatchjs/bin/IEDriverServer.exe"
        }
      }
    },
    safari: {
      selenium_port: 4444,
      desiredCapabilities : {
        browserName: "safari",
        javascriptEnabled : true,
        acceptSslCerts : true,
        nativeEvents: true,
        real_mobile: false,
        //browserstack.debug: true,
        //browserstack.selenium_version : "3.14.0",
        os: "OS X",
        browser: "Safari",
      }
    }
  }
}

I'm not sure if there's a more detailed log option? But here's the output:

Running Then I can go to Outlook and click the Verify email button:
User email = anEmail@nightwatch.co.uk email folder = signinRegistration
outlookURL = https://outlook.office.com/mail/someones/inbox
Expected banner text =  Verify your email address
Starting Outlook
⠼ Running Then I can go to Outlook and click the Verify email button:
✔ Running Then I can go to Outlook and click the Verify email button:

✔ Passed [equal]: There should be 2 tabs open
✔ Element <body> was present after 9 milliseconds.
✔ Element <body> was present after 386 milliseconds.
✔ Outlook logo present

------Normal fresh login
✔ "Sign in" present
✔ Testing if element <body> contains text 'Sign in' (47ms)
✔ Outlook user input field present
✔ Passed [ok]: @[object Object] was clickable after 36 ms.
✔ Next button found
✔ Next button visible
✔ Passed [ok]: @[object Object] was clickable after 30 ms.
✔ Passed [strictEqual]: 0 === 0
✔ Password entry field found
✔ Password entry field visible
✔ Passed [ok]: @[object Object] was clickable after 30 ms.
✔ Sign in button found
✔ Sign in button visible
✔ Passed [ok]: @[object Object] was clickable after 32 ms.
✔ Passed [strictEqual]: 0 === 0
✔ Email present
✔ Next button is present
✔ Passed [ok]: @[object Object] was clickable after 583 ms.
✔ Passed [strictEqual]: 0 === 0
✔ Cancel button is present
✔ Passed [ok]: @[object Object] was clickable after 33 ms.
✔ Passed [strictEqual]: 0 === 0
✔ 'No' button present
✔ Passed [ok]: @[object Object] was clickable after 611 ms.
✔ Passed [strictEqual]: 0 === 0
Current URL  https://outlook.office.com/mail/someones/inbox/
✔ Testing if the URL contains 'someones' (5ms)
✔ Testing if the URL contains 'somethingElse' (6ms)

Select  myFolder  folder
Selecting myFolder folder
✔ Team folder present
✔ Passed [strictEqual]: 0 === 0
✖ Team folder dropdown present - expected "found" but got: "not found" (10114ms)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:97:5) 


FAILED: 1 assertions failed and  33 passed (29.542s)
_________________________________________________

TEST FAILURE:  1 assertions failed, 111 passed (57.311s)

 ✖ signin/registration/newAccountRegistration
 – Then I can go to Outlook and click the Verify email button (29.542s)
   Team folder dropdown present - expected "found" but got: "not found" (10114ms)
       at runMicrotasks (<anonymous>)
       at processTicksAndRejections (internal/process/task_queues.js:97:5)
   SKIPPED:
   - Some other steps....

Report generated: /Users/me/projects/nightwatch-signin/reports/results.html
npm ERR! code ELIFECYCLE
npm ERR! errno 5
npm ERR! nightwatch-signin@0.1.0 nw: `nightwatch "--group" "signin" "--tag" "fix" "--skiptags" "defacement,skip" "--env" "chrome" "--reporter" "./html-reporter.js"`
npm ERR! Exit status 5
npm ERR! 
npm ERR! Failed at the nightwatch-signin@0.1.0 nw script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR!     /Users/brianannett/.npm/_logs/2021-08-10T12_58_34_081Z-debug.log
npm ERR! code ELIFECYCLE
npm ERR! errno 5
npm ERR! nightwatch-signin@0.1.0 signin:chromeFix: `npm run nw -- --group signin --tag fix --skiptags defacement,skip --env chrome --reporter ./html-reporter.js`
npm ERR! Exit status 5
npm ERR! 
npm ERR! Failed at the nightwatch-signin@0.1.0 signin:chromeFix script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR!     /Users/me/.npm/_logs/2021-08-10T12_58_34_143Z-debug.log