Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make ingest executing non blocking #43361

Merged
merged 19 commits into from
Jul 1, 2019
Merged

Make ingest executing non blocking #43361

merged 19 commits into from
Jul 1, 2019

Commits on Jun 14, 2019

  1. Non blocking ingest processor execution. 

    Added an additional method to the Processor interface to allow a
processor implementation to make a non blocking call.
    @martijnvg
    martijnvg committed Jun 14, 2019
    Configuration menu
    Copy the full SHA
    7222f1e View commit details
    Browse the repository at this point in the history

  2. make iterator thread safe

    @martijnvg
    martijnvg committed Jun 14, 2019
    Configuration menu
    Copy the full SHA
    7df6779 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2019

  1. fixed simulate execution service to be async

    @martijnvg
    martijnvg committed Jun 17, 2019
    Configuration menu
    Copy the full SHA
    72a4690 View commit details
    Browse the repository at this point in the history

  2. changed IngestService#executeBulkRequest(...) to be like a loop ins… 

    …tead of recursively invoking a method in order to avoid SO
    @martijnvg
    martijnvg committed Jun 17, 2019
    Configuration menu
    Copy the full SHA
    09bdbd1 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2019

  1. Change BulkRequestModifier, so that it can accept items that have 

    failed or dropped out of order.
    @martijnvg
    martijnvg committed Jun 19, 2019
    Configuration menu
    Copy the full SHA
    58658be View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2019

  1. Merge remote-tracking branch 'es/enrich' into enrich_non_block_ingest… 

    …_execution
    @martijnvg
    martijnvg committed Jun 26, 2019
    Configuration menu
    Copy the full SHA
    0cc9e5f View commit details
    Browse the repository at this point in the history

  2. make ExactMatchProcessor execute search in a non blocking manner

    @martijnvg
    martijnvg committed Jun 26, 2019
    Configuration menu
    Copy the full SHA
    d000f85 View commit details
    Browse the repository at this point in the history

  3. iter

    @martijnvg
    martijnvg committed Jun 26, 2019
    Configuration menu
    Copy the full SHA
    a77f9ee View commit details
    Browse the repository at this point in the history

  4. fork back to write thread if needed

    @martijnvg
    martijnvg committed Jun 26, 2019
    Configuration menu
    Copy the full SHA
    cc718a4 View commit details
    Browse the repository at this point in the history

  5. jdoc tweak

    @martijnvg
    martijnvg committed Jun 26, 2019
    Configuration menu
    Copy the full SHA
    2dce37a View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2019

  1. Merge remote-tracking branch 'es/enrich' into enrich_non_block_ingest… 

    …_execution
    @martijnvg
    martijnvg committed Jun 27, 2019
    Configuration menu
    Copy the full SHA
    5f66516 View commit details
    Browse the repository at this point in the history

  2. small changes

    @martijnvg
    martijnvg committed Jun 27, 2019
    Configuration menu
    Copy the full SHA
    acd3671 View commit details
    Browse the repository at this point in the history

  3. keep track of the original thread and 

    only if the current thread is not the same as original thread then
fork into write thread
    @martijnvg
    martijnvg committed Jun 27, 2019
    Configuration menu
    Copy the full SHA
    720ee01 View commit details
    Browse the repository at this point in the history

  4. fixed test

    @martijnvg
    martijnvg committed Jun 27, 2019
    Configuration menu
    Copy the full SHA
    5d105a1 View commit details
    Browse the repository at this point in the history

  5. iter

    @martijnvg
    martijnvg committed Jun 27, 2019
    Configuration menu
    Copy the full SHA
    494cdbe View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2019

  1. Added semaphore in order to avoid search thread pools from rejecting 

    search requests originating from the match processor.

This is a temporary workaround.
    @martijnvg
    martijnvg committed Jun 28, 2019
    2 Configuration menu
    Copy the full SHA
    9256652 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2019

  1. made originalSlots field look less tricky

    @martijnvg
    martijnvg committed Jun 30, 2019
    Configuration menu
    Copy the full SHA
    f404843 View commit details
    Browse the repository at this point in the history

  2. for each iter

    @martijnvg
    martijnvg committed Jun 30, 2019
    Configuration menu
    Copy the full SHA
    0103761 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'es/enrich' into enrich_non_block_ingest… 

    …_execution
    @martijnvg
    martijnvg committed Jun 30, 2019
    Configuration menu
    Copy the full SHA
    17f9a66 View commit details
    Browse the repository at this point in the history