chore: -

.github/workflows/build.yml

@@ -4,6 +4,7 @@ on:
     push:
         branches:
             - main
+    workflow_dispatch:
 
 jobs:
     build:
@@ -14,7 +15,7 @@ jobs:
                 name: Set up Go
                 uses: actions/setup-go@v2
                 with:
-                        go-version: 1.14
+                        go-version: 1.17
 
             -
                 name: Check out code

.github/workflows/release.yml

@@ -4,6 +4,7 @@ on:
     create:
         tags:
             - v*
+    workflow_dispatch:
 
 jobs:
     release:
@@ -14,7 +15,7 @@ jobs:
                 name: Set up Go
                 uses: actions/setup-go@v2
                 with:
-                    go-version: 1.14
+                    go-version: 1.17
 
             -
                 name: "Check out code"

README.md

@@ -2,39 +2,25 @@
 
 [![release](https://img.shields.io/github/release/signedsecurity/sigrawl3r?style=flat&color=0040ff)](https://github.com/signedsecurity/sigrawl3r/releases) [![maintenance](https://img.shields.io/badge/maintained%3F-yes-0040ff.svg)](https://github.com/signedsecurity/sigrawl3r) [![open issues](https://img.shields.io/github/issues-raw/signedsecurity/sigrawl3r.svg?style=flat&color=0040ff)](https://github.com/signedsecurity/sigrawl3r/issues?q=is:issue+is:open) [![closed issues](https://img.shields.io/github/issues-closed-raw/signedsecurity/sigrawl3r.svg?style=flat&color=0040ff)](https://github.com/signedsecurity/sigrawl3r/issues?q=is:issue+is:closed) [![license](https://img.shields.io/badge/license-MIT-gray.svg?colorB=0040FF)](https://github.com/signedsecurity/sigrawl3r/blob/master/LICENSE) [![twitter](https://img.shields.io/badge/twitter-@signedsecurity-0040ff.svg)](https://twitter.com/signedsecurity)
 
+A fast web crawler.
+
 ## Resources
 
-* [Installation](#installation)
-    * [From Binary](#from-binary)
-    * [From source](#from-source)
-    * [From github](#from-github)
+* [Features](#features)
 * [Usage](#usage)
+* [Installation](#installation)
+	* [From Binary](#from-binary)
+	* [From source](#from-source)
+	* [From github](#from-github)
 * [Contribution](#contribution)
 
+## Features
 
-## Installation
-
-#### From Binary
-
-You can download the pre-built binary for your platform from this repository's [releases](https://github.com/signedsecurity/sigrawl3r/releases/) page, extract, then move it to your `$PATH`and you're ready to go.
-
-#### From Source
-
-sigrawl3r requires **go1.14+** to install successfully. Run the following command to get the repo
-
-```bash
-GO111MODULE=on go get -u -v github.com/signedsecurity/sigrawl3r/cmd/sigrawl3r
-```
-
-#### From Github
-
-```bash
-git clone https://github.com/signedsecurity/sigrawl3r.git && \
-cd sigrawl3r/cmd/sigrawl3r/ && \
-go build . && \
-mv sigrawl3r /usr/local/bin/ && \
-sigrawl3r -h
-```
+* Parses sitemap for URLs.
+* Parses robots.txt for URLs.
+* Extracts URLs from documents *(including js, json, xml, csv, txt e.t.c)*.
+* Supports javaScript rendering *(including Single Page Applications such as Angular, React, e.t.c)*.
+* Supports customizable parallelism.
 
 ## Usage
 
@@ -66,6 +52,30 @@ OPTIONS:
   -x              comma separated list of proxies
 ```
 
+## Installation
+
+#### From Binary
+
+You can download the pre-built binary for your platform from this repository's [releases](https://github.com/signedsecurity/sigrawl3r/releases/) page, extract, then move it to your `$PATH`and you're ready to go.
+
+#### From Source
+
+sigrawl3r requires **go1.14+** to install successfully. Run the following command to get the repo
+
+```bash
+GO111MODULE=on go get -u -v github.com/signedsecurity/sigrawl3r/cmd/sigrawl3r
+```
+
+#### From Github
+
+```bash
+git clone https://github.com/signedsecurity/sigrawl3r.git && \
+cd sigrawl3r/cmd/sigrawl3r/ && \
+go build . && \
+mv sigrawl3r /usr/local/bin/ && \
+sigrawl3r -h
+```
+
 ## Contribution
 
 [Issues](https://github.com/signedsecurity/sigrawl3r/issues) and [Pull Requests](https://github.com/signedsecurity/sigrawl3r/pulls) are welcome!