generated from adobe/aem-boilerplate
-
Notifications
You must be signed in to change notification settings - Fork 8
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- parse one or several url or sitemap files (can be added in manifest), - for each url from sitemap, parse page for personnalization fragment or fragment, - for each ost link found in html, keep usage, - for each osi, get wcs entry, - output everything as CSV
- Loading branch information
Showing
3 changed files
with
482 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,20 @@ | ||
| # Miscellaneous | ||
|
|
||
| ## Audit script | ||
|
|
||
| script that crawls through raw EDS html versions of page for OST links and spits out a CSV report | ||
|
|
||
| for one page or two or more | ||
| `node audit.mjs https://www.adobe.com/page1.html https://www.adobe.com/page2.html` | ||
|
|
||
| for a sitemap or more | ||
| `node audit.mjs https://www.adobe.com/cc-shared/assets/sitemap.xml` | ||
|
|
||
| either case output will be entered as csv in /tmp/audit.csv, you can set a different output file with -f parameter | ||
|
|
||
| for a full configured set of URLs and/or sitemap you can use -m parameter with a manifest composed of URLs/Sitemap separated by new lines character | ||
|
|
||
| for faster execution, buffer size (number of parallel page being audited) can be increased but will impact your connection with parameter -b (you can move it lower to the default that is 100). | ||
|
|
||
| so typical execution could be | ||
| `node audit.mjs -b 50 -f ~/Documents/audit.csv -m ./audit-manifest.txt` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,186 @@ | ||
| https://www.adobe.com/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/au/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/cn/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/hk_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/hk_zh/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/id_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/id_id/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/in/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/in_hi/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/kr/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/my_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/my_ms/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/nz/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ph_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ph_fil/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/sg/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/th_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/th_th/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/tw/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/vn_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/vn_vi/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ae_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ae_ar/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/africa/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/at/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/be_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/be_fr/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/be_nl/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/bg/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ch_de/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ch_fr/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ch_it/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/cis_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/cis_ru/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/cz/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/de/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/dk/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ee/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/eg_ar/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/eg_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/es/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/fi/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/fr/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/gr_el/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/gr_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/hu/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ie/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/il_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/il_he/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/iq/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/is/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/it/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/kw_ar/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/kw_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/lt/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/lu_de/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/lu_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/lu_fr/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/lv/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/mena_ar/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/mena_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ng/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/nl/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/no/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/pl/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/pt/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/qa_ar/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/qa_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ro/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ru/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/sa_en/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/sa_ar/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/se/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/si/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/sk/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/tr/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ua/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/uk/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/za/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ar/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/br/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ca/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ca_fr/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/cl/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/co/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/cr/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ec/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/gt/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/la/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/mx/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/pe/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/pr/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/jp/cc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/au/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/cn/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/hk_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/hk_zh/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/id_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/id_id/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/in/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/in_hi/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/kr/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/my_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/my_ms/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/nz/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ph_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ph_fil/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/sg/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/th_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/th_th/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/tw/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/vn_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/vn_vi/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ae_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ae_ar/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/africa/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/at/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/be_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/be_fr/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/be_nl/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/bg/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ch_de/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ch_fr/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ch_it/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/cis_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/cis_ru/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/cz/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/de/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/dk/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ee/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/eg_ar/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/eg_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/es/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/fi/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/fr/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/gr_el/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/gr_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/hu/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ie/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/il_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/il_he/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/iq/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/is/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/it/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/kw_ar/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/kw_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/lt/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/lu_de/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/lu_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/lu_fr/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/lv/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/mena_ar/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/mena_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ng/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/nl/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/no/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/pl/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/pt/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/qa_ar/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/qa_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ro/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ru/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/sa_en/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/sa_ar/dc-shared/assets/sitema.xml | ||
| https://www.adobe.com/se/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/si/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/sk/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/tr/dc-shared/assetssitemap.xml | ||
| https://www.adobe.com/ua/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/uk/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/za/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ar/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/br/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ca/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ca_fr/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/cl/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/co/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/cr/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/ec/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/gt/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/la/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/mx/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/pe/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/pr/dc-shared/assets/sitemap.xml | ||
| https://www.adobe.com/jp/dc-shared/assets/sitemap.xml |
Oops, something went wrong.