Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable inventory collector worker by default #160

Merged

Conversation

agrare
Copy link
Member

@agrare agrare commented Nov 6, 2017

Due to the large payload size generated by the watch notices disable the collector worker by default until payloads can be moved to BinaryBlobs table

@miq-bot
Copy link
Member

miq-bot commented Nov 6, 2017

Checked commit agrare@7790b41 with ruby 2.3.3, rubocop 0.47.1, and haml-lint 0.20.0
0 files checked, 0 offenses detected
Everything looks fine. 🏆

@agrare
Copy link
Member Author

agrare commented Nov 6, 2017

cc @cben @Ladas @kbrock @simon3z

@kbrock
Copy link
Member

kbrock commented Nov 6, 2017

Error message:

PG::OutOfMemory: ERROR:  out of memory
DETAIL:  Failed on request of size 536,870,912.
UPDATE "miq_queue"
SET "msg_data" = '\x0...',
"updated_on" = '2017-11-06 07:27:56.217163',
"lock_version" = 42
WHERE "miq_queue"."id" = $1
AND "miq_queue"."lock_version" = $2" attempting merge next message]

It is a EmsRefresh#refresh message for a ManageIQ::Providers::Openshift::ContainerManager

my exact case has bit_length(msg_data) = 1,583,198,704 and id = 7460835 (not sure if that is helpful)

protip: tail -c 250 log/automation.log lets you see VERY long lines
protip: select id from miq_queue where lock_version > 20;

@cben
Copy link
Contributor

cben commented Nov 6, 2017

🙀 💥
gitter discussion: https://gitter.im/ManageIQ/manageiq?at=5a00960551915d962afb91ad

LGTM

@agrare
Copy link
Member Author

agrare commented Nov 6, 2017

@miq-bot assign @Fryguy

@miq-bot miq-bot assigned Fryguy and unassigned moolitayer Nov 6, 2017
Copy link
Member

@kbrock kbrock left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@kbrock
Copy link
Member

kbrock commented Nov 6, 2017

@Fryguy Fryguy merged commit 3789cfd into ManageIQ:master Nov 6, 2017
@Fryguy Fryguy added this to the Sprint 73 Ending Nov 13, 2017 milestone Nov 6, 2017
@kbrock
Copy link
Member

kbrock commented Nov 6, 2017

Adding cross reference: ManageIQ/manageiq-providers-openshift#63

@agrare agrare deleted the disable_inventory_collector_worker_by_default branch November 6, 2017 20:59
simaishi pushed a commit that referenced this pull request Nov 6, 2017
…r_by_default

Disable inventory collector worker by default
(cherry picked from commit 3789cfd)
@simaishi
Copy link

simaishi commented Nov 6, 2017

Gaprindashvili backport details:

$ git log -1
commit ae37ec1f69a7b99256116f46ba953c1536cdae65
Author: Jason Frey <fryguy9@gmail.com>
Date:   Mon Nov 6 14:19:08 2017 -0500

    Merge pull request #160 from agrare/disable_inventory_collector_worker_by_default
    
    Disable inventory collector worker by default
    (cherry picked from commit 3789cfdc7dc785b7122865996a9005ac5bfc3f5f)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants