Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add support for debug mode #122

Merged
merged 5 commits into from
Sep 10, 2024
Merged

add support for debug mode #122

merged 5 commits into from
Sep 10, 2024

Conversation

kacurez
Copy link
Member

@kacurez kacurez commented Sep 6, 2024

https://keboola.atlassian.net/browse/ST-2209
Tato uprava zavadza moznost zapnut debug-mode (pod parameters).
image

Ak je zapnuty debug-mode tak to loguje request url, status a response s tym ze access token sa z logu odstrani (nahradi slovom TOKEN).

Test ex fb with debug-mode on

Vyskusal som to tym ze som pustil extractor a vidim v logoch ze sa to loguje spravne: https://connection.eu-central-1.keboola.com/admin/projects/63/jobs/775200829

Test ex fb ads async insights extraction with debug-mode on

Tu som pustil test ktory stahuje insights cez async query/job a vypada to cajk

Test without debug-mode

Spravne to neloguje nic (resp po starom) https://connection.eu-central-1.keboola.com/admin/projects/63/jobs/775202688

@kacurez kacurez requested a review from eddycek September 6, 2024 16:04
(def MAX_WAIT_TIME (* 1000 60 60 10))
(def time-slot-ms 1000)
(def truncate 6) ; sleep for 64 seconds at most (2^6)
(def MAX_WAIT_TIME (* 1000 60 60 24)) ; poll for 24 hours at most
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

este som upravil ex backoff pre pollovanie async jobov, po novom iteruje maximalne po 60 sekundach (doteraz to bolo 0.5 sekundy) a polluje async job maximalne 24 hodin (doteraz to bolo 10 hodin). Slubujem si od toho mensiu zataz na fb api v pripade ze sa dlho polluje job (x hodin). Fb api ma moze uplatnit throtling, tak sa tomu chcem vyhnut.

Copy link
Member

@eddycek eddycek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Prošel jsem to a vypadá to oka

@kacurez kacurez merged commit 4a302bc into master Sep 10, 2024
8 checks passed
@kacurez kacurez deleted the kacurez-debug-mode-ST-2209 branch September 10, 2024 07:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants