Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Source-plaid: minimum last updated datetime support added for Capital One items #15228

Closed
wants to merge 55 commits into from

Commits on Aug 1, 2022

  1. Configuration menu
    Copy the full SHA
    af49a10 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2022

  1. Configuration menu
    Copy the full SHA
    546ed3e View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2022

  1. Configuration menu
    Copy the full SHA
    58589fb View commit details
    Browse the repository at this point in the history
  2. Correct formatting

    UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    88f64d2 View commit details
    Browse the repository at this point in the history
  3. Update docs

    UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    791f502 View commit details
    Browse the repository at this point in the history
  4. Correct formatting

    UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    46b8a40 View commit details
    Browse the repository at this point in the history
  5. Use default formatting

    UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    cff06a6 View commit details
    Browse the repository at this point in the history
  6. 🎉 Source Okta: return deprovisioned users (airbytehq#15001)

    * add statuses to user filtering
    
    * bump version
    
    * upd
    
    * add comment
    
    * auto-bump connector version [ci skip]
    
    * format
    
    Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
    2 people authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    b328672 View commit details
    Browse the repository at this point in the history
  7. 🪟 🎨 Trial end banner (airbytehq#14913)

    * alert banner
    
    * cleanup
    
    * cleanup
    
    * review cleanup
    
    * Minor cleanup
    
    Co-authored-by: Tim Roes <tim@airbyte.io>
    2 people authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    47ece16 View commit details
    Browse the repository at this point in the history
  8. 🪟 🎨 Update layout of create connection and replication settings pages…

    … to mach design (airbytehq#14946)
    
    * Update ConnectionForm to match design
    * Split sections into cards
    * Update connection name label to heading
    * Move create/edit buttons outside of card
    * Fix spacing to match design
    * Remove noTitles prop from CreateConnectionContent component
    
    * Update OperationsSection title to match the rest of the sections
    
    * Update connection name text to show that it's required
    
    * Divide streams into sections, center dont worry teext
    
    * Wrap SyncCatalogField in a div to prevent style impact from parent
    
    * Remove don't worry message from create connection page
    
    * Update resizing of left fields and right fields to match design. Now fields should stop at certain width of page
    
    * Move replication and tarnsformation section in connection form to its own card
    
    * Move OperationSection within same render condition as CreateControls
    
    * Apply design changes to main page with scroll, connection page title, and status main info
    
    * Update main page with scroll to only scroll x on the content, not the whole page
    * Update connection page title to all SCSS, add xl horizontal padding to match content
    * Update status main info to be more flexible on window resize
    * Remove extra div from status view that was adding extra horizontal margin to the card
    
    * Fix minor issues
    
    Co-authored-by: Tim Roes <tim@airbyte.io>
    2 people authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    0bf971e View commit details
    Browse the repository at this point in the history
  9. 🐛 Source Google Ads: Fix wrong schema for `ad_group_criterion.topic.p…

    …ath` and shifted `Campaigns` stream to non-managers stream list (airbytehq#15084)
    
    * Fix wrong schema for ad_group_criterion.topic.path
    
    * Shifted campaingns stream to non-manager streams
    
    * auto-bump connector version [ci skip]
    
    Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
    2 people authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    53a270b View commit details
    Browse the repository at this point in the history
  10. 🎉Source PayPal Transactions: Updated docs (airbytehq#15105)

    * Updated docs
    
    * Updated docs
    lazebnyi authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    314a6e4 View commit details
    Browse the repository at this point in the history
  11. Snowflake destination: support key pair authentication (airbytehq#14388)

    * Snowflake destination: support key pair authentication.
    
    * Snowflake destination: update docs
    
    * Snowflake destination: support key pair authentication for normalization, added tests
    
    * Snowflake destination: update normalization
    
    * Snowflake destination: update way of read secrets for test
    
    * Snowflake destination: moved test to another class for test purpose
    
    * Snowflake destination: update secrets for test purpose
    
    * Snowflake destination: revert changes added for test purpose
    
    * Snowflake destination: changes added for test purpose
    
    * Snowflake destination: updated required fields in specs
    
    * Snowflake destination: clean up
    
    * Snowflake destination: support encrypted key pair authentication (airbytehq#14589)
    
    * Snowflake destination: add support for ecrypted private key
    
    * Snowflake destination: temp reverting for test purpose
    
    * Revert "Snowflake destination: temp reverting for test purpose"
    
    This reverts commit 260ecce.
    
    * Snowflake destination: add passphrase and remove auth_type from required fields
    
    * Snowflake destination: format code
    
    * Snowflake destination: clean up
    
    * Snowflake destination: update docs
    
    * Normalization for Snowflake destination: added unit tests and change file creating process
    
    * Normalization for Snowflake destination: renamed property passphrase to password
    
    * Snowflake destination: apply changes from normalization
    
    * Snowflake destination: clean code
    
    * Snowflake destination: clean up
    
    * auto-bump connector version [ci skip]
    
    Co-authored-by: Edward Gao <edward.gao@airbyte.io>
    Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
    3 people authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    27f39c7 View commit details
    Browse the repository at this point in the history
  12. [low-code-connectors] Disable parse-time interpolation in favor of ru…

    …ntime-only (airbytehq#14923)
    
    * abstract auth token
    
    * basichttp
    
    * remove prints
    
    * docstrings
    
    * get rid of parse-time interpolation
    
    * always pass options through
    
    * delete print
    
    * delete misleading comment
    
    * delete note
    
    * reset
    
    * pass down options
    
    * delete duplicate file
    
    * missing test
    
    * refactor test
    
    * rename to '$options'
    
    * rename to ''
    
    * interpolatedauth
    
    * fix tests
    
    * fix
    
    * docstrings
    
    * update docstring
    
    * docstring
    
    * update docstring
    
    * remove extra field
    
    * undo
    
    * rename to runtime_parameters
    
    * docstring
    
    * update
    
    * / -> *
    
    * update template
    
    * rename to options
    
    * Add examples
    
    * update docstring
    
    * Update test
    
    * newlines
    
    * rename kwargs to options
    
    * options init param
    
    * delete duplicate line
    
    * type hints
    
    * update docstring
    
    * Revert "delete duplicate line"
    
    This reverts commit 4255d5b.
    
    * delete duplicate code from bad merge
    
    * rename file
    
    * bump cdk version
    girarda authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    bf251f1 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    2cd8f10 View commit details
    Browse the repository at this point in the history
  14. Source Hubspot: implement new stream to read associations in incremen…

    …tal mode (airbytehq#15099)
    
    * airbytehq#359 oncall - source hubspot: implement new stream to read associations in incremental mode
    
    * airbytehq#359 source hubspot: upd changelog
    
    * airbytehq#359 source hubspot: do not pass identifiers
    
    * auto-bump connector version [ci skip]
    
    Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
    2 people authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    9fd0344 View commit details
    Browse the repository at this point in the history
  15. Source PayPal Transactions: increase unit tests (airbytehq#15098)

    * add unit tests
    
    * add unit tests
    
    * up
    
    * bump version
    
    * upd
    
    * upd
    
    * revert bump version
    annalvova05 authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    e23e7e8 View commit details
    Browse the repository at this point in the history
  16. Source Hubspot: revert v0.1.78 (airbytehq#15144)

    * Revert "Source Hubspot: implement new stream to read associations in incremental mode (airbytehq#15099)"
    
    This reverts commit dd109de.
    
    * airbytehq#359 rollback
    
    * hubspot: upd changelog
    
    * auto-bump connector version [ci skip]
    
    Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
    2 people authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    c9b2c0e View commit details
    Browse the repository at this point in the history
  17. 🎉 Source Github: bugfix schemas for streams deployments, `workflow_…

    …runs`, `teams` (airbytehq#15049)
    
    Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
    grubberr authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    37e3b02 View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    78dbeb2 View commit details
    Browse the repository at this point in the history
  19. pin flake8==4.0.1 (airbytehq#15155)

    Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
    grubberr authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    1b2e622 View commit details
    Browse the repository at this point in the history
  20. Docs: Fix link to roadmap (airbytehq#15103)

    Replace the broken markdown link and add an external link to the roadmap.
    nialloriordan authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    80a1814 View commit details
    Browse the repository at this point in the history
  21. fix: Fix extraEnv, Update OSS charts (airbytehq#15159)

    * fix: Add new labels to all charts + fix indent issue for extraEnv
    
    * fix: Update docs, add extraContainers parameter into dependent charts
    xpuska513 authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    14919f2 View commit details
    Browse the repository at this point in the history
  22. GitHub Actions - workflow Connector Integration Tests - add retry (a…

    …irbytehq#14452)
    
    Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
    grubberr authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    920e4f5 View commit details
    Browse the repository at this point in the history
  23. source-S3: Support JSON format (airbytehq#14213)

    * json format support added
    
    * json format support added
    
    * code formatted
    
    * format convertion changed
    
    * format naming convertion changed
    
    * test cased issue fixed
    
    * test case issued resolved
    
    * sample file and config added for integration tests
    
    * Json doc added
    
    Json doc added
    
    * update
    
    * sample file and config added for integration tests
    
    * sample file and config added for integration tests
    
    * update jsonl files
    
    * review 1
    
    * review 1
    
    * review 1
    
    * pyarrow version upgrade
    
    * clean integration test folder architecture
    
    * add timestamp record to simple_test.jsonl
    
    * fixed integration test and parser review change
    
    * simplify table read
    
    * doc update
    
    * fix specs
    
    * user sample files
    
    * fix sample files
    
    * add newlines at end of files
    
    * rename json parser
    
    * rename jsonfile to jsonlfile
    
    * schema inference added
    
    * patch review fix
    
    * Update docs/integrations/sources/s3.md
    
    doc update
    
    Co-authored-by: George Claireaux <george@airbyte.io>
    
    * changing the version
    
    * changing the title to sync with other type
    
    * fix expected csv records
    
    * fix expected records for avro and parquet
    
    * review fix
    
    * fixed master schema handling
    
    * remove sample configs
    
    * fix expected records
    
    * json doc update
    
    added more details on json parser
    
    * fixed api name
    
    * bump version
    
    * auto-bump connector version [ci skip]
    
    Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
    Co-authored-by: George Claireaux <george@airbyte.io>
    Co-authored-by: George Claireaux <george@claireaux.co.uk>
    Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
    5 people authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    f848f08 View commit details
    Browse the repository at this point in the history
  24. Fix terminate workflow by using JQ Args. (airbytehq#15160)

    This is failing today since we aren't injecting the bash variables correctly into JQ. This PR makes it so.
    
    We also increase the time limit to 4 hours to accommodate long running test jobs.
    davinchia authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    2efdb88 View commit details
    Browse the repository at this point in the history
  25. AnalyticsService event cleanup (airbytehq#15142)

    * AnalyticsService event cleanup
    
    * Remove dead generics
    
    * Fix broken parameters
    timroes authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    d011970 View commit details
    Browse the repository at this point in the history
  26. fix tests (airbytehq#15133)

    * fix tests
    
    * fix redshift test
    mkhokh-33 authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    52d4067 View commit details
    Browse the repository at this point in the history
  27. fix HikariPool error on postgres destination integration tests (airby…

    …tehq#15165)
    
    * add ed's hikari fix
    
    * fix maybe?
    
    * remove debug lines
    
    * revert bandaid
    Phlair authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    6e914e5 View commit details
    Browse the repository at this point in the history
  28. Configuration menu
    Copy the full SHA
    61e4bdd View commit details
    Browse the repository at this point in the history
  29. Add metrics for temporal workflow resets (airbytehq#15016)

    * Add metrics for temporal workflow resets
    
    * Properly record metric attributes
    
    * PR feedback
    
    * Formatting
    
    * Record general workflow attempts/failures
    
    * Refactor metric methods
    
    * PR feedback
    
    * Formatting
    jdpgrailsdev authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    cb69aec View commit details
    Browse the repository at this point in the history
  30. Configuration menu
    Copy the full SHA
    fb03519 View commit details
    Browse the repository at this point in the history
  31. Fix callout formatting (airbytehq#15162)

    * Fix callout formatting
    
    * Updating copy
    
    * Fixed typo
    
    Co-authored-by: Yowan Ramchoreeter <26179814+YowanR@users.noreply.github.com>
    2 people authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    fe72b35 View commit details
    Browse the repository at this point in the history
  32. Configuration menu
    Copy the full SHA
    3773395 View commit details
    Browse the repository at this point in the history
  33. Docs cleanup (airbytehq#15174)

    * Deleted extra pages + removed changelogs from the navigation bar
    
    * fixed broken link
    Amruta-Ranade authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    0945988 View commit details
    Browse the repository at this point in the history
  34. Configuration menu
    Copy the full SHA
    e70b3aa View commit details
    Browse the repository at this point in the history
  35. 🐛 Source shortio: Changing links primary key (airbytehq#15066)

    * Changing primary key in links stream and some small cleanups throughout the source
    
    * Adding unit tests and applied gradle formatting
    
    * update doc
    
    * auto-bump connector version [ci skip]
    
    Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
    Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
    3 people authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    462c342 View commit details
    Browse the repository at this point in the history
  36. Configuration menu
    Copy the full SHA
    64b2f54 View commit details
    Browse the repository at this point in the history
  37. Configuration menu
    Copy the full SHA
    bc3aa38 View commit details
    Browse the repository at this point in the history
  38. Export temporal metrics to datadog (airbytehq#14842)

    * add error code to ManualOperationResult
    
    * fix a bug
    
    * support temporal metrics
    
    * metrics in temporal
    
    * use statsd
    
    * wrap otel config to temporal metric export
    
    * use http port 4318 for otlp exporter
    
    * simpilfy to support dd only
    
    * use /v1/metrics for endpoint
    
    * use statsd
    
    * fix
    
    * remove unused func
    
    * wrap up implementation to export temporal metrics to datadog
    
    * use deps.toml to wrap up the dependency
    
    * move to metric client factory
    
    * fix pmd error
    
    * pmd, comment fix
    
    * pr comment fix
    xiaohansong authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    8124cd8 View commit details
    Browse the repository at this point in the history
  39. Configuration menu
    Copy the full SHA
    59050b9 View commit details
    Browse the repository at this point in the history
  40. Configuration menu
    Copy the full SHA
    8dea9f2 View commit details
    Browse the repository at this point in the history
  41. Source Hubspot: fix 401 for associations (airbytehq#15156)

    * Revert "Source Hubspot: revert v0.1.78 (airbytehq#15144)"
    
    This reverts commit cbdb897.
    
    * airbytehq#379 source hubspot: fix 401 when reading associations
    
    * airbytehq#379 source hubspot: fix 401 when reading associations
    
    * airbytehq#379 source hubspot: upd changelog
    
    * auto-bump connector version [ci skip]
    
    Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
    2 people authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    f969baf View commit details
    Browse the repository at this point in the history
  42. 🎉 Source Github: PullRequestCommentReactions - re-implemented using G…

    …raphQL (airbytehq#14795)
    
    Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
    grubberr authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    cce2d3e View commit details
    Browse the repository at this point in the history
  43. Configuration menu
    Copy the full SHA
    b798e38 View commit details
    Browse the repository at this point in the history
  44. report synchronous check/spec/discover failures to JobErrorReporter (a…

    …irbytehq#14818)
    
    * report failures for synchronous check/discover, refactor common logic
    
    * allow null workspace, send spec errors
    
    * add failure origin, format
    
    * rm connector_type, fix failing tests
    
    * add tests for other job types
    
    * log instead of throw
    
    * move swallow to common spot
    
    * connector jobs use context instead of passing full config
    
    * sync jobs use context instead of passing raw config
    
    * fix failing test
    
    * fix failing scheduler client test
    pedroslopez authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    9793d84 View commit details
    Browse the repository at this point in the history
  45. Add and persist job failures for Normalization (airbytehq#14790)

    * added TracedException and uncaught exception handler
    
    * added trace message capturing
    
    * added tests for TRACE messages
    
    * pre-json logging
    
    * propagating normalization failures
    
    * log format json & fix hang
    
    * parsing dbt json logs
    
    * bump normalization version
    
    * tests
    
    * Benoit comments
    
    * update trace exception user message
    
    * review comments
    
    * bump version
    
    * bump version
    
    * review comments
    
    * nit comments
    
    * add normalization trace failure test
    
    * version bump
    
    * pmd
    
    * formatto
    
    * bump version
    Phlair authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    f706a0a View commit details
    Browse the repository at this point in the history
  46. Configuration menu
    Copy the full SHA
    674f1b7 View commit details
    Browse the repository at this point in the history
  47. Configuration menu
    Copy the full SHA
    a72f1fb View commit details
    Browse the repository at this point in the history
  48. Fix bq standard mode (airbytehq#15180)

    * Fix
    
    * Add version and changelog
    
    * auto-bump connector version [ci skip]
    
    * auto-bump connector version [ci skip]
    
    Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
    2 people authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    d895891 View commit details
    Browse the repository at this point in the history
  49. Configuration menu
    Copy the full SHA
    7888a01 View commit details
    Browse the repository at this point in the history
  50. Source Stripe: external account streams (airbytehq#14357)

    * added external account streams
    
    * fix metadata type and formatting
    
    * consolidate types to one line
    
    * fix api docs link
    
    * auto-bump connector version [ci skip]
    
    * format files
    
    Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
    Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
    3 people authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    21e83a6 View commit details
    Browse the repository at this point in the history
  51. 🪟 🐛 Fix out of credits banner (airbytehq#15216)

    * fix out of credits banner
    
    * change intl string id
    
    * show trial expiration over credit issues
    teallarson authored and UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    5fb0e08 View commit details
    Browse the repository at this point in the history
  52. Configuration menu
    Copy the full SHA
    0f357ed View commit details
    Browse the repository at this point in the history
  53. Use default formatting

    UsmanAli99 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    3c346a9 View commit details
    Browse the repository at this point in the history