Code

0.9.x#169

Code

Merged

FlorianPerucki merged 158 commits intomasterpricingassistant/mrq:masterfrom 0.9.xpricingassistant/mrq:0.9.xCopy head branch name to clipboardAug 30, 2018

+4,788-2,214

Commits

Commits on Feb 19, 2017

• Refactor queue implementation, add docs on queue performance & fix some tests

  sylvinus

  committed
  ab757f8

Commits on Feb 20, 2017

• Fix some more tests

  sylvinus

  committed
  3fbdd2e

• travis debug

  sylvinus

  committed
  5af3eec

• more debug in travis

  sylvinus

  committed
  eef164f

• Fix psutil API change

  sylvinus

  committed
  3adf4d0

• more psutil fixes

  sylvinus

  committed
  484d7ee

• Fix tests

  sylvinus

  committed
  451d15b

• another fix for psutil api change

  sylvinus

  committed
  4744e2b

Commits on Feb 21, 2017

• More test fixes

  sylvinus

  committed
  9c1550e

Commits on Feb 22, 2017

• Fix tests & restore queued order

  sylvinus

  committed
  df43ea5

Commits on Feb 26, 2017

• maxconcurrency refactor

  sylvinus

  committed
  cd0b3a9

Commits on Feb 27, 2017

• Add Agent, ProcessPool, and our own Supervisor

  sylvinus

  committed
  5d6cc22

Commits on Feb 28, 2017

• Agent fixes

  sylvinus

  committed
  57800f8

• Worker group dashboard + misc fixes

  sylvinus

  committed
  639f950

Commits on Mar 1, 2017

• 0.9.0

  sylvinus

  committed
  5f51521

Commits on Mar 6, 2017

• Fix agent shutdown

  sylvinus

  committed
  7c1e229

• Refactor queue implementation (#150)

  Show description for d34c316
  sylvinus

  authored
  d34c316

Commits on Mar 7, 2017

• Merge branch 'agent' into 0.9.x

  Show description for 426dc4a
  sylvinus

  committed
  426dc4a

• stabilize more tests

  sylvinus

  committed
  7b8bd67

Commits on Mar 8, 2017

• fix network latency test

  sylvinus

  committed
  9689dc0

• add test timeout

  sylvinus

  committed
  77afe3f

• fix timeout

  sylvinus

  committed
  57a0113

Commits on Mar 11, 2017

• Deprecate no_mongodb_ensure_indexes & subqueues_delimiter options. Better wait_for_idle with worker refactor.

  sylvinus

  committed
  1daf54d

Commits on Mar 13, 2017

• Refactor of the scheduler & test fixes

  sylvinus

  committed
  8af36b7

• add missing dep

  sylvinus

  committed
  e91eee6

• Make sure the python3 tests actually use python3 !

  sylvinus

  committed
  a879a6b

Commits on Mar 17, 2017

• Faster wait_for_idle

  sylvinus

  committed
  233821b

Commits on Mar 18, 2017

• Better wait_for_idle

  sylvinus

  committed
  98d85d0

Commits on Mar 19, 2017

• Agent improvements + Dashboard page

  sylvinus

  committed
  09d0c43

Commits on Mar 22, 2017

• Safer wait_for_idle

  sylvinus

  committed
  a5f3d42

Commits on Mar 27, 2017

• Autoscaling!

  sylvinus

  committed
  9fe0579

• Fix agent tests + coverage for subprocesses

  sylvinus

  committed
  0fd9f29

• Merge branch 'master' into 0.9.x

  Show description for 311c492
  sylvinus

  committed
  311c492

• Requirements update

  sylvinus

  committed
  4895e66

Commits on Mar 29, 2017

• Add missing index + better worker.stop in tests

  sylvinus

  committed
  55e8310

Commits on May 1, 2017

• Add a test for scheduler restart

  sylvinus

  committed
  a490347

Commits on May 6, 2017

• Disable cache busting for dashboard

  sylvinus

  committed
  2e5d48c

Commits on May 24, 2017

• patch

  mehdigmira

  committed
  51ed2a3

Commits on May 26, 2017

• Merge pull request #168 from pricingassistant/scheduler-patch

  Show description for 6555dc4
  FlorianPerucki

  authored
  6555dc4

Commits on Jun 18, 2017

• Agent has user-provided callback and tries to enforce worker profile diversity

  sylvinus

  committed
  31a6a7c

• Merge branch '0.9.x' of github.com:pricingassistant/mrq into 0.9.x

  Show description for a26762f
  sylvinus

  committed
  a26762f

• protect from orchestration crashes

  sylvinus

  committed
  7b7cd1f

Commits on Jun 19, 2017

• Don't decode redis responses (revert to default)

  sylvinus

  committed
  3c32e30

• implement process_termination_timeout

  sylvinus

  committed
  367861b

• Python 3 fixes

  sylvinus

  committed
  759f7a0

• Upgrade pylint

  sylvinus

  committed
  e2b3122

• More Python 3 fixes

  sylvinus

  committed
  eb1d4ed

Commits on Jun 20, 2017

• Task whitelisting + SIGKILL in agent

  sylvinus

  committed
  8b03f4c

Commits on Jun 21, 2017

• Save traceback history by default

  sylvinus

  committed
  e8cd61a

Commits on Jun 28, 2017

• temporarily disable sorting in the jobs dashboard

  sylvinus

  committed
  aa530da

• Performance optims + prototype PyPy support

  sylvinus

  committed
  865f46f

Commits on Jun 30, 2017

• Make sure env variables are passed correctly from agent to processes

  sylvinus

  committed
  97fe009

Commits on Jul 8, 2017

• Fix traceback API

  sylvinus

  committed
  9861f62

• prefer displaying traceback_history

  sylvinus

  committed
  003e437

Commits on Aug 1, 2017

• only take started agents into account

  sylvinus

  committed
  0c537db

Commits on Sep 28, 2017

• move to webpack

  mehdigmira

  committed
  e016ec4

• rm old config

  mehdigmira

  committed
  3318e40

• dockerfile fixes

  mehdigmira

  committed
  a837187

Commits on Sep 29, 2017

• Merge pull request #185 from pricingassistant/to-webpack

  Show description for 4c773ad
  mehdigmira

  authored
  4c773ad

• do not send multiple queries to backend

  mehdigmira

  committed
  3fb7d0b

• rm from .gitignore

  mehdigmira

  committed
  aac2ef0

• Merge pull request #186 from pricingassistant/performance

  Show description for b838d97
  mehdigmira

  authored
  b838d97

• webpack generated files

  mehdigmira

  committed
  bcc94a9

• Merge branch '0.9.x' of https://github.com/pricingassistant/mrq into 0.9.x

  Show description for 3eb6720
  mehdigmira

  committed
  3eb6720

• moment

  mehdigmira

  committed
  6e1a900

Commits on Oct 19, 2017

• Some cleaning tasks are not needed anymore

  sylvinus

  committed
  1980826

Commits on Nov 14, 2017

• add task to repopulate known queues

  

  Florian Perucki

  committed
  e281a84

Commits on Dec 7, 2017

• Correctly patch HTTPConnection.request for Python 3.6 (#184)

  

  kewngen

  authored and

  sylvinus

  committed
  6fd40e8

Commits on Dec 20, 2017

• fix runtime error in get_worker_report

  mehdigmira

  committed
  5856134

Commits on Jan 10, 2018

• don't search entire queue

  

  ismael

  committed
  9b45a8b

• add external ip in config

  

  ismael

  committed
  cb58ac4

• add external ip on dashboard

  

  ismael

  committed
  40f867d

Commits on Jan 11, 2018

• add dateexpires on other statuses

  

  ismael

  committed
  2d224cb

Commits on Jan 15, 2018

• default job ttl

  

  ismael

  committed
  8ab4942

• add default value in config for job ttl

  

  ismael

  committed
  92bd2ea

• add minified js

  

  ismael

  committed
  c970335

Commits on Jan 16, 2018

• fix makefile

  

  Florian Perucki

  committed
  b212787

• update known queues when requeuing jobs

  

  Florian Perucki

  committed
  b8d7112

Commits on Jan 17, 2018

• Merge branch '0.9.x' into task_expiry

  Show description for 5ee1335
  

  ismael

  committed
  5ee1335

• Merge branch 'master' of github.com:pricingassistant/mrq into 0.9.x

  Show description for 2b8f364
  sylvinus

  committed
  2b8f364

• Store subpool tracebacks + test fixes

  sylvinus

  committed
  0503a0f

• Merge branch '0.9.x' of github.com:pricingassistant/mrq into 0.9.x

  Show description for 7a7a598
  sylvinus

  committed
  7a7a598

Commits on Jan 19, 2018

• make sure there's no job before cleaning a known queue

  

  Florian Perucki

  committed
  f5e3cf0

• fix cleaning logic

  

  Florian Perucki

  committed
  04e2e8a

• more readable condition

  

  Florian Perucki

  committed
  bfcc5bc

Commits on Feb 8, 2018

• Merge branch '0.9.x' into task_expiry

  Show description for 3b78c0e
  

  ismael

  committed
  3b78c0e

Commits on Feb 12, 2018

• fix task expiry ttl

  

  ismael

  committed
  f607354

Commits on Mar 6, 2018

• Add warning when context.get_current_config is called before context.setup_context()

  mongin

  committed
  68f5240

• remove supervisord from doc

  Romarci

  committed
  78a54ac

• Merge branch 'workshop' of https://github.com/pricingassistant/mrq into workshop

  mongin

  committed
  b4a65b3

• Don't build subprocess32 by default on windows. Fixes #119

  sylvinus

  committed
  ffd31fd

• Merge branch 'workshop' of github.com:pricingassistant/mrq into workshop

  Show description for d22efd7
  sylvinus

  committed
  d22efd7

• filters in workers tab

  mehdigmira

  committed
  9df282f

• add exceptiontype in jobs tab

  mehdigmira

  committed
  09ad19a

• Rename docker container, remove useless subprocess32 usages

  sylvinus

  committed
  8cd35a9

• Merge branch 'workshop' of github.com:pricingassistant/mrq into workshop

  Show description for 13fb673
  sylvinus

  committed
  13fb673

• Don't use absolute paths in dashboard

  sylvinus

  committed
  7e732f6

• Merge tume@97e2a53

  sylvinus

  committed
  fc971ce

• Add scheduler exemple

  mongin

  committed
  c73d51b

• Merge branch 'workshop' of https://github.com/pricingassistant/mrq into workshop

  mongin

  committed
  62d7c3d

• fix cancel by worker + test

  mehdigmira

  committed
  cf213b6

• move worker orchestration code to a separate task

  

  Florian Perucki

  committed
  a4a9abe

• prints

  

  Florian Perucki

  committed
  1b82351

• prevent new scheduled task with dailytime to run if dailytime already passed

  

  benjamin

  committed
  76d40b9

• Update simple crawler exemple

  mongin

  committed
  5196614

• Merge branch 'workshop' of https://github.com/pricingassistant/mrq into workshop

  mongin

  committed
  88b75c3

• Add cleaning jobs don't over-reach and tests

  NicoZivy

  committed
  0320837

• Merge remote-tracking branch 'origin/workshop' into workshop

  Show description for 3198712
  NicoZivy

  committed
  3198712

Commits on Mar 7, 2018

• logger refactor

  

  ismael

  committed
  2815446

• consistency fixes

  

  ismael

  committed
  3f61fab

• change logger name

  

  ismael

  committed
  da8c2f2

Commits on Mar 8, 2018

• timed set example

  Romarci

  committed
  26e34e5

• Merge branch 'workshop' of github.com:pricingassistant/mrq into workshop

  Romarci

  committed
  fce95dc

• fix mrq_logs creation

  Romarci

  committed
  9b199d3

• add config + update readme

  Romarci

  committed
  24f64f1

Commits on Mar 9, 2018

• Update doc for exemples

  mongin

  committed
  2bc80e6

• Merge branch 'workshop' of https://github.com/pricingassistant/mrq into workshop

  mongin

  committed
  445890a

Commits on Mar 20, 2018

• fix iterating keys for python3

  

  Florian Perucki

  committed
  be6f3c6

Commits on Apr 22, 2018

• Refactor subqueue implementation

  sylvinus

  committed
  23ec9e8

Commits on Apr 26, 2018

• docker build

  

  ismael

  committed
  14e30a7

• one clean too many

  

  ismael

  committed
  cffcf7d

• update image name

  

  ismael

  committed
  a0344c4

• fix mongo logger

  

  ismael

  committed
  51684f2

• fix testjobaction

  

  ismael

  committed
  a784bf5

• fix test_general

  

  ismael

  committed
  414f89e

• test iohooks

  

  ismael

  committed
  dd478af

• fix test concurrency

  

  ismael

  committed
  a1a5894

• restore quiet logger option

  

  ismael

  committed
  7cb565e

• test cancel

  

  ismael

  committed
  1804923

• non existing type

  

  ismael

  committed
  25f5305

Commits on Apr 27, 2018

• test raw

  

  ismael

  committed
  9658241

Commits on May 24, 2018

• fix test_routes

  

  ismael

  committed
  b56b097

Commits on May 27, 2018

• Test fixes

  sylvinus

  committed
  acbb6cd

• Merge branch 'workshop' of github.com:pricingassistant/mrq into workshop

  Show description for 77c9042
  sylvinus

  committed
  77c9042

• Refactor redis_key methods

  sylvinus

  committed
  20162a4

Commits on May 28, 2018

• skip agent test for now

  

  ismael

  committed
  322b95c

• Merge branch 'workshop' into 0.9.x

  Show description for 24abc67
  

  ismael

  committed
  24abc67

• fix ttl attribute error

  

  ismael

  committed
  6d03846

• fix attribute error

  

  ismael

  committed
  262b45f

Commits on Jun 14, 2018

• Make command-line flags explicitly passed with default values able to overwrite custom config

  sylvinus

  committed
  34dae37

• no need to ensure known queues

  

  ismael

  committed
  9fe3b3a

Commits on Jun 28, 2018

• Relax requirement on gevent 1.3

  sylvinus

  authored
  916a8e8

Commits on Jun 30, 2018

• Don't check for queue size at each remove_raw_jobs

  sylvinus

  committed
  dcb7c95

Commits on Jul 13, 2018

• Allow filtering by parent queues

  sylvinus

  committed
  5737a6e

Commits on Jul 23, 2018

• fix task cancelation

  

  maelorn

  committed
  7180bb6

Commits on Jul 24, 2018

• cancel edgecases

  

  maelorn

  committed
  f1c4acd

Commits on Jul 31, 2018

• flatten worker groups

  

  maelorn

  committed
  21dd22c

Commits on Aug 1, 2018

• fix tests

  

  maelorn

  committed
  5f49482

• Add full paths in traces by default

  sylvinus

  committed
  728c2bd

• Merge branch '0.9.x' of github.com:pricingassistant/mrq into 0.9.x

  Show description for 9c4f913
  sylvinus

  committed
  9c4f913

Commits on Aug 9, 2018

• New method of checking timeouted jobs, add maxconcurrency status in dashboard + test fixes

  sylvinus

  committed
  ea9c9a2

Commits on Aug 21, 2018

• add metrics class

  

  maelorn

  committed
  6b3d61b

• fix tests

  

  maelorn

  committed
  dc1991b

Commits on Aug 22, 2018

• correctly use metrics

  

  maelorn

  committed
  41e6225

Commits on Aug 23, 2018

• multiply worker group commands by number of processes

  

  maelorn

  committed
  086e463

• typo

  

  maelorn

  committed
  0e7c655

Commits on Aug 27, 2018

• extra space

  

  maelorn

  committed
  e073a09

• Merge pull request #204 from pricingassistant/refactorworkergroup

  Show description for a6d89c4
  maelorn

  authored
  a6d89c4