Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Turn suppression list CSV into a set of SQL files to be ran on the server #892

Merged
merged 10 commits into from
Apr 9, 2024

Conversation

leplatrem
Copy link
Contributor

@leplatrem leplatrem commented Mar 12, 2024

  • polish expectations on input CSV format (eg. header names, double quotes)
  • estimate time of execution of join query on primary_email in prod turn joins into batches

@leplatrem leplatrem requested a review from a team as a code owner March 12, 2024 17:00
@leplatrem leplatrem marked this pull request as draft March 12, 2024 17:00
@leplatrem leplatrem force-pushed the apply-suppression-list branch 3 times, most recently from aeb8db9 to a79e69e Compare March 13, 2024 16:00
@leplatrem leplatrem force-pushed the apply-suppression-list branch from a79e69e to 4b6fdb5 Compare March 13, 2024 19:13
@leplatrem leplatrem added the enhancement New feature or request label Mar 14, 2024
END;
$$;

CREATE TEMPORARY TABLE IF NOT EXISTS imported_{tmp_suffix} (
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we need a table suffix for a temp table? The table would be dropped at the end of the session by default (or at the end of a transaction if we specify on commit drop)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, you're right, this is not necessary

@leplatrem leplatrem changed the title [draft] Suppression list Turn suppression list CSV into a set of SQL files to be ran on the server Mar 18, 2024
@leplatrem leplatrem marked this pull request as ready for review March 18, 2024 14:42
Copy link
Contributor

@alexcottner alexcottner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

seems reasonable for a one-off import

@leplatrem
Copy link
Contributor Author

I'll merge this because it was done. If the location in the repo is not adecuate, I'm happy to move it.

@leplatrem leplatrem merged commit ec3b35d into main Apr 9, 2024
5 checks passed
@leplatrem leplatrem deleted the apply-suppression-list branch April 9, 2024 06:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants