Fetch and display web page data

[tolga-balci]

Hi,

One important addition to the dashboard would be to fetch data from a webpage.
It would help us to see portions of the pages we are interested in - no of tickets, available agents etc. and help us embed the utility further into our daily workflows.

Thanks!

[Seanstoppable]

It's hard to do something generically, given how variable websites can be to parse. However, this is possible via cmdrunner where anyone can write a script to display custom content in a window.

[tolga-balci]

I was thinking more of a module that accepts XPATH as inputs and displays the value(s) it receives.
Apologies, I did not put this thought into my post.

[senorprogrammer]

That sounds like a pretty reasonable addition and would be a cool module to have. Pull requests always welcome!

[tolga-balci]

I wish I were that talented.

[dzmitry-kankalovich]

I started to work on seemingly unrelated widget (#1578), but with this one I brought https://github.com/gocolly/colly dependency, which is essentially a web scraping solution.

I can see that a generic-purpose widget could be implemented to use website url and element selector to fetch and display it's text content.

The execution will depend on myriad factors (like is it static page or SPA, is there auth, is there bot detection), but it should work at least in some cases.