Skip to content

ngreve/web_scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

36 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

What is this?

This is a simple web scraper, written as a Node.js application. It checks if there is a new Linux kernel version available. If it detects a new kernel version it sends an email to the in the config.js defined address.
For further information visit my corresponding blog article

How to use it

Change the parameter in the config.js file to your needs:

module.exports = {
  uri: 'https://www.kernel.org',
  email: {
    user: 'your_login_user',
    pass: 'your_password'
  },
  interval: 5 * 1000 * 60 // in milliseconds
}

For further configuration of the notification service, configure the Nodemailer transporter:

// src/services/NotificationService.js

'use strict'

const config = require('../config')
const nodemailer = require('nodemailer')
const transporter = nodemailer.createTransport({
  host: 'smtp.mail.org',
  port: 587,
  secure: false,
  auth: {
    user: config.email.user,
    pass: config.email.pass
  }
})

. . .

Start the application with:

$ npm run start