ingest API

[sckott]

https://www.elastic.co/guide/en/elasticsearch/reference/current/ingest-apis.html

[dbuijs]

Temporary workaround to use pipelines (that you've already defined):

docs_bulk(my_data_frame, index = "my_index", type = "my_row", query = "pipeline=my_pipeline")

[sckott]

thanks @dbuijs will have a look

[sckott]

SO question related https://stackoverflow.com/questions/51365187/index-files-using-r-and-elastic

[Jensxy]

How to use the workaround for arrays?

[sckott]

done in 6be1f45

[sckott]

@dbuijs @Jensxy just added ingest/pipeline fxns, reinstall remotes::install_github("ropensci/elastic") and see ?ingest

[Jensxy]

Thank you very much @sckott . But how do I load data to an index using the pipeline?

For example, the normal ES statement looks like this

curl -XPUT 'ES_HOST:ES_PORT/test_index/test_type/test_id?pipeline=attachment&pretty' -H 'Content-Type: application/json' -d '{
 "data": "UWJveCBlbmFibGVzIGxhdW5jaGluZyBzdXBwb3J0ZWQsIGZ1bGx5LW1hbmFnZWQsIFJFU1RmdWwgRWxhc3RpY3NlYXJjaCBTZXJ2aWNlIGluc3RhbnRseS4g"
}'

In other words, how do I use the created pipelines? And is it possible to use the attachment processor or the pipeline with arrays?

[sckott]

sorry, not sure how to do that