Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add more helper methods and utilities to Parsons (and create standardized process for it) #554

Closed
schuyler1d opened this issue Jul 30, 2021 · 2 comments
Labels
enhancement Impact - something should be added to or changed about Parsons that isn't causing a current breakage good first issue These issues are great ones to start working on for Parsons newcomers! medium priority Priority - this doesn't need to be addressed immediately, but will broadly impact Parsons users needs discussion needs community input and/or maintainer discussion parsons core Work type - changes to core Parsons infrastructure pieces (like the Parsons table or API connector) sample script Work type - writing or changing Parsons sample scripts

Comments

@schuyler1d
Copy link
Contributor

schuyler1d commented Jul 30, 2021

Note: Sky's original title was "Easy 'glue' connector script/format".

There are a lot of "copy from X over to Y" uses in Parsons, and at MoveOn we found it useful to write a little 'generic' script that can take basically some JSON data and a link to credentials and shovel bits from one place to another place(s).

Here is our internal script:
https://gist.github.com/schuyler1d/6a5200214d43196e1d48cc9db136e720

It covers only the things that we, ourselves, needed as sources/destinations, but it would be great if we started building something like this in Parsons. It could also pave the way for things like common From-A-to-B recipes, where A and B have specific schema mappings that we could save the same "created_at" => "date_created" kind of boring-work

@neverett neverett added the sample script Work type - writing or changing Parsons sample scripts label Nov 3, 2021
@SorenSpicknall SorenSpicknall added enhancement Impact - something should be added to or changed about Parsons that isn't causing a current breakage good first issue These issues are great ones to start working on for Parsons newcomers! labels Mar 17, 2022
@shaunagm
Copy link
Collaborator

Semi-addressed by #724 - changed the title of this issue to be a bit more expansive

@shaunagm shaunagm added parsons core Work type - changes to core Parsons infrastructure pieces (like the Parsons table or API connector) medium priority Priority - this doesn't need to be addressed immediately, but will broadly impact Parsons users needs discussion needs community input and/or maintainer discussion labels Feb 21, 2023
@shaunagm shaunagm changed the title Easy 'glue' connector script/format Add more helper methods and utilities to Parsons (and create standardized process for it) Feb 21, 2023
@SorenSpicknall
Copy link
Collaborator

Old issue - community approach to utilities has evolved and spawned several new related issues

@SorenSpicknall SorenSpicknall closed this as not planned Won't fix, can't repro, duplicate, stale Jul 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Impact - something should be added to or changed about Parsons that isn't causing a current breakage good first issue These issues are great ones to start working on for Parsons newcomers! medium priority Priority - this doesn't need to be addressed immediately, but will broadly impact Parsons users needs discussion needs community input and/or maintainer discussion parsons core Work type - changes to core Parsons infrastructure pieces (like the Parsons table or API connector) sample script Work type - writing or changing Parsons sample scripts
Projects
None yet
Development

No branches or pull requests

4 participants