How it Works

Step 1 | Spider the Website by running 'main.py'

Spider the Website of your choice.
- This algorithm won't wander away from the inputted website. For ex if the domain is 'www.wikipedia.org' then it will stay on 'www.wikipedia.org'.
Grab all the links from the page, then randomly select a link, open the link and get all the links from that newly opened page.
The above process goes on until the specified number of pages are retrieved.

Step 2 | Calculate Pageranks by running 'pagerank.py'

After spidering has finished, calculate the page ranks of the retrieved pages.

Step 3 | Create JSON file using the links and ranks by running 'createJson.py'

Generate a JSON file to help with D3JS visualization.

Step 4 | Create a visualization using 'view.js' and view by opening 'view.html'

All you have to do after the first three steps is to open 'view.html' to view the results.

Step 1

Steps 2 and 3

Visual