Skip to content

qiniu/reviewbot

Repository files navigation

Reviewbot - Empower Your Code Quality with Self-Hosted Automated Analysis and Review

Build Status Go Report Card GitHub release

中文

Reviewbot assists you in rapidly establishing a self-hosted code analysis and review service, supporting multiple languages and coding standards. Its main features include:

  • Universal Compatibility - Provides a universal way to integrate and execute Linters without coding
  • Multi-Platform Support - Currently supports both GitHub and GitLab
  • AI-Powered - Detected issues are analyzed by AI to provide detailed explanations and improvement suggestions
  • Precise Feedback - All issues are reported during the Pull/Merge Request stage as comments, precisely pinpointing the relevant code lines
  • Self-Hosted Deployment - Recommended self-hosting for better data security and control

See practical examples:

Issue Comment CI Status

Table of Contents

Why Reviewbot

Reviewbot is a self-hosted code analysis and review service with the following features:

  • Universal Compatibility - Provides a universal way to integrate new code checking tools without modifying source code
  • Multi-Platform Support - Currently supports both GitHub and GitLab platforms
  • AI-Powered - Issues detected are analyzed by AI to provide detailed context and fix suggestions
  • Security - Recommended self-hosting for data security and control
  • Improvement-Oriented - Detected issues are primarily reported as comments precise to code lines, facilitating efficient problem resolution
  • Flexibility - Supports multiple languages and coding standards with flexible configuration
  • Observability - Supports alert notifications for timely awareness of detected issues

Installation

Please refer to the getting started guide.

The following are internal usage practices at Qiniu, which may provide you with more inspiration:

Linter Integration Guide

Universal Linter Integration (No Coding Required)

Reviewbot provides a universal way to integrate new code checking tools without modifying the source code.

For example:

customLinters:
  pylint:
    languages: [".py"] # Specify supported languages
    command: ["/bin/sh", "-c", "--"] # Specify execution command
    args: # Specify execution arguments
      - |
        pylint --disable=line-too-long --output-format=text --msg-template='{path}:{line}:{column}: {msg} ({symbol})' --reports=n --score=n --recursive=y ./

After this configuration, when there are changes to Python code in PR/MR, pylint will be used to perform checks, and the results will be reported to the corresponding code lines.

Note that the above configuration uses pylint from the default execution environment. If you need to use a specific version of pylint or want to use other execution environments, you can specify them through dockerAsRunner or kubernetesAsRunner, or even choose to check and install pylint in the above command before execution.

See the full configuration:

customLinters:
  <linter-name>:
    languages: <language-list> # optional, specify supported languages
    enable: <true|false> # optional, enable/disable this linter
    workDir: <work-dir> # optional, specify working directory
    command: <command-list> # optional, specify execution command
    args: <args-list> # optional, specify execution arguments
    env: <env-list> # optional, specify environment variables
    dockerAsRunner: # optional, use Docker image to execute linter
      image: <docker-image>
    kubernetesAsRunner: # optional, use Kubernetes to execute linter
      namespace: <kubernetes-namespace>
      image: <kubernetes-image>
    reportType: <report-type> # optional, specify report type
    configPath: <config-path> # optional, specify linter config file path

Custom Integration

For more complex scenarios, you can also consider code integration:

Supported Linters

The following are the linters currently supported by Reviewbot:

Go

Python

  • pylint

C/C++

Lua

Java

Shell

Git Workflow Standards

Documentation Standards

Configuration

Reviewbot adheres to a zero-configuration principle whenever possible, but also provides flexible configuration capabilities for special requirements. All configurable items are defined in the config/config.go file.

The following are some common configuration scenarios:

Adjusting Execution Commands

Linters are generally executed using default commands, but we can adjust these commands. For example:

qbox/kodo:
  linters:
    staticcheck:
      workDir: "src/qiniu.com/kodo"

This configuration means that for the staticcheck inspection of the qbox/kodo repository code, execution should occur in the src/qiniu.com/kodo directory.

We can even configure more complex commands, such as:

qbox/kodo:
  linters:
    golangci-lint:
      command:
        - "/bin/sh"
        - "-c"
        - "--"
      args:
        - |
          source env.sh
          cp .golangci.yml src/qiniu.com/kodo/.golangci.yml
          cd src/qiniu.com/kodo
          export GO111MODULE=auto
          go mod tidy
          golangci-lint run --timeout=10m0s --allow-parallel-runners=true --print-issued-lines=false --out-format=line-number >> $ARTIFACT/lint.log 2>&1

This configuration indicates that for the golangci-lint inspection of the qbox/kodo repository code, execution occurs through custom commands and arguments.

The usage of command and args here is similar to that of Kubernetes Pod command and args. You can refer to Kubernetes Pod for more information.

The $ARTIFACT environment variable is noteworthy. This is a built-in variable in Reviewbot used to specify the output directory, facilitating the exclusion of irrelevant interference. Since Reviewbot ultimately only cares about the linters' output, and in this complex scenario, the shell script will output a lot of irrelevant information, we can use this environment variable to specify the output directory. This allows Reviewbot to parse only the files in this directory, resulting in more precise detection results.

Disabling a Linter

We can also disable a specific linter check for a particular repository through configuration. For example:

qbox/net-gslb:
  linters:
    golangci-lint:
      enable: false

This configuration means that the golangci-lint check is disabled for the qbox/net-gslb repository.

We can also globally disable a linter, like this:

customLinters:
  golangci-lint:
    enable: false

Cloning multiple repositories

By default, Reviewbot clones the repository where the event occurs. However, in some scenarios, we might want to clone multiple repositories, and customizing the cloning path.

For example:

qbox/net-gslb:
  refs:
    - org: "qbox"
      repo: "net-gslb"
      pathAlias: "src/qiniu.com/net-gslb"
    - org: "qbox"
      repo: "kodo"

Executing Linters via Docker

By default, Reviewbot uses locally installed linters for checks. However, in some scenarios, we might want to use Docker images to execute linters, such as:

  • When the relevant linter is not installed locally
  • When the target repository requires different versions of linters or dependencies
  • When the target repository depends on many third-party libraries, which would be cumbersome to install locally

In these scenarios, we can configure Docker images to execute the linters. For example:

qbox/net-gslb:
  linters:
    golangci-lint:
      dockerAsRunner:
        image: "golangci/golangci-lint:v1.54.2" # specify the Docker image to use

This configuration means that for the golangci-lint check of the qbox/net-gslb repository code, the golangci/golangci-lint:v1.54.2 Docker image is used for execution.

Executing Linters in Kubernetes Cluster

Reviewbot also supports executing linters in a Kubernetes cluster. This is particularly useful in scenarios where multiple tasks are running concurrently, and local resources are insufficient.

Example configuration:

qiniu/reviewbot:
  linters:
    golangci-lint:
      enable: true
      kubernetesAsRunner:
        image: "golangci/golangci-lint:v1.61.0" # specify the Docker image to use
        namespace: "reviewbot" # specify the Kubernetes namespace to use

AI Enhancement

Reviewbot integrates AI analysis capabilities to provide more detailed explanations and improvement suggestions for detected issues:

AI Enhancement

Reviewbot Operational Flow

Reviewbot primarily operates as a Webhook service, accepting GitHub or GitLab Events, executing various checks, and providing precise feedback on the corresponding code if issues are detected.

Webhook Event -> Reviewbot -> Execute Linter -> Provide Feedback

Monitoring Detection Results

Reviewbot supports notification of detection results through WeWork (企业微信) alerts. For specific implementation details, refer to here.

To enable this feature, simply set the environment variable WEWORK_WEBHOOK when starting Reviewbot. This environment variable should point to the WeWork chat group's bot URL. When valid issues are detected, notifications will be sent automatically. For example:

Found valid issue

If unexpected output is encountered, notifications will also be sent, like this:

Found unexpected issue

For unexpected outputs, it usually means that the default execution configuration of the relevant linter does not support the current repository. In such cases, you need to explicitly specify the configuration through a configuration file based on the actual situation.

Talks

Give it a Star! ⭐

If you like this project or are using it to learn or start your own solution, please give it a star to receive updates about new versions. Your support matters!

Contributing

Your contributions to Reviewbot are essential for its long-term maintenance and improvement. Thanks for supporting Reviewbot!

If you find a bug while working with the Reviewbot, please open an issue on GitHub and let us know what went wrong. We will try to fix it as quickly as we can.

License

Reviewbot is released under the Apache 2.0 license. See the LICENSE file for details.