Skip to content

graysurf/crawler_master

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

crawler_master GCP
Usage: crawler_master [options] task-id

task-id tasks for monitor
--vm-amount default 2
--vm-image default server-base
--vm-region default us-west1
--vm-zone default a
--vm-core default 1
--vm-memory default container-memory * container-amount-in-vm + 256
--container-image default gcr.io/crawler-1383/fb-crawler
--container-image-version default latest
--container-amount-in-vm default 4
--container-core WARN: not implement yet, default 0.25
--container-memory default 1024
-c, --cron default '0 0/3 * * * ?'
--first-sleep-time default 60 (seconds)
-u, --user default empty
-b, --branch default master
-t, --tag defaultgit push -u origin master ''
-k, --secret-key key for decrypting PII
-e, --environment must be 'product' or 'develop' default product
--ssh-user default onlinecrm
--ssh-key-path default /etc/ssh/onlinecrm/onlinecrm.pem
--help prints this usage text

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published