Skip to content

Knot-Archive/splitsite

Repository files navigation

summary

split website, count word, asynchronous, save result into database.

requirement

python requirements

pip install -r requirements.txt

database with docker: Postgres

docker run --name some-postgres -e POSTGRES_PASSWORD=mysecretpassword -d postgres
docker run --name EngCalc-local-postgres -e POSTGRES_PASSWORD=FeintVeela-Vagrant -d postgress

MQ worker with docker: Redis

docker run --name some-redis -v /docker/host/dir:/data -d redis redis-server --appendonly yes

need Download nltk recource

python install_nltk_resource

migrations

database init

python manage.py db init

database migrate

python manage.py db migrate

database upgrade

python manage.py db upgrade

start

start up MQ worker

python worker.py

start web server

python manage.py runserver

About

获取网页页面使用nltk进行分词统计 flask demo

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published