Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update Structured File Ingestor #180

Merged
merged 22 commits into from
Jul 19, 2017
Merged

Update Structured File Ingestor #180

merged 22 commits into from
Jul 19, 2017

Commits on Jun 19, 2017

  1. Add support for iterating over a StructuredFile data endpoint

    @smgallo
    smgallo committed Jun 19, 2017
    Configuration menu
    Copy the full SHA
    7764fc0 View commit details
    Browse the repository at this point in the history

  2. Improve comments, logging, and phpcs style fixes

    @smgallo
    smgallo committed Jun 19, 2017
    Configuration menu
    Copy the full SHA
    93ee7f9 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'xdmod7.0' of github.com:ubccr/xdmod into etl/structured… 

    …-file-ingestor
    @smgallo
    smgallo committed Jun 19, 2017
    Configuration menu
    Copy the full SHA
    765f18c View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2017

  1. Move handling of destination_record_map config directive from pdoInge… 

    …stor to aRdbmsDestinationAction
    @smgallo
    smgallo committed Jun 21, 2017
    Configuration menu
    Copy the full SHA
    d7e2402 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2017

  1. Consolidate common functionality. Move pre- and post-execute tasks in… 

    …to aAction and aRdbmsDestinationAction
    @smgallo
    smgallo committed Jun 22, 2017
    Configuration menu
    Copy the full SHA
    536ee64 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2017

  1. Merge branch 'xdmod7.0' of github.com:ubccr/xdmod into etl/structured… 

    …-file-ingestor
    @smgallo
    smgallo committed Jun 28, 2017
    Configuration menu
    Copy the full SHA
    59f5049 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2017

  1. Add handling of requested and expected record fields to StructuredFil… 

    …e endpoint plus associated tests
    @smgallo
    smgallo committed Jun 29, 2017
    Configuration menu
    Copy the full SHA
    c0af908 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2017

  1. Merge branch 'xdmod7.0' of github.com:ubccr/xdmod into etl/structured… 

    …-file-ingestor
    @smgallo
    smgallo committed Jun 30, 2017
    Configuration menu
    Copy the full SHA
    a967a25 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2017

  1. Apply command-line where clause to table row count calculation

    @smgallo
    smgallo committed Jul 5, 2017
    Configuration menu
    Copy the full SHA
    8381b8e View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2017

  1. Fix support for passing overrides on the ETL command line

    @smgallo
    smgallo committed Jul 6, 2017
    Configuration menu
    Copy the full SHA
    efe7468 View commit details
    Browse the repository at this point in the history

  2. Improve debugging output

    @smgallo
    smgallo committed Jul 6, 2017
    Configuration menu
    Copy the full SHA
    6f7a502 View commit details
    Browse the repository at this point in the history

  3. Allow public properties of any object type to be verified

    @smgallo
    smgallo committed Jul 6, 2017
    Configuration menu
    Copy the full SHA
    5a5f352 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2017

  1. Fix bugs in experimental aggregation from update to DbModel

    @smgallo
    smgallo committed Jul 7, 2017
    Configuration menu
    Copy the full SHA
    79a8f27 View commit details
    Browse the repository at this point in the history

  2. Improve debugging

    @smgallo
    smgallo committed Jul 7, 2017
    Configuration menu
    Copy the full SHA
    7c84f41 View commit details
    Browse the repository at this point in the history

  3. PHPCS fixes

    @smgallo
    smgallo committed Jul 7, 2017
    Configuration menu
    Copy the full SHA
    9d148d4 View commit details
    Browse the repository at this point in the history

  4. PHPCS fixes

    @smgallo
    smgallo committed Jul 7, 2017
    Configuration menu
    Copy the full SHA
    0cbbe57 View commit details
    Browse the repository at this point in the history

  5. Add handling of record fields to StructuredFile endpoint

    @smgallo
    smgallo committed Jul 7, 2017
    Configuration menu
    Copy the full SHA
    4c0c698 View commit details
    Browse the repository at this point in the history

  6. Update ingestors to use updated StructuredFile endpoint

    @smgallo
    smgallo committed Jul 7, 2017
    Configuration menu
    Copy the full SHA
    635d774 View commit details
    Browse the repository at this point in the history

  7. Update sample ETL files

    @smgallo
    smgallo committed Jul 7, 2017
    Configuration menu
    Copy the full SHA
    d6863bd View commit details
    Browse the repository at this point in the history

  8. Move source data out of ETL table definitions into data directory. Up… 

    …date ETL config to use new endpoint
    @smgallo
    smgallo committed Jul 7, 2017
    Configuration menu
    Copy the full SHA
    ab66e93 View commit details
    Browse the repository at this point in the history

  9. Fix PHPCS style error

    @smgallo
    smgallo committed Jul 7, 2017
    Configuration menu
    Copy the full SHA
    786fc57 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2017

  1. Remove commented out code

    @smgallo
    smgallo committed Jul 17, 2017
    Configuration menu
    Copy the full SHA
    33d7bce View commit details
    Browse the repository at this point in the history