Unexpected loss of digits in docs_bulk

[cphaarmeyer]

Not sure if this is a bug or intended. It caused me some problems.

When using docs_bulk_index on a data frame, only 4 digits actually appeared in the Elasticsearch. This was due to a call of jsonlite::toJSON in make_bulk_ which only keeps 4 digits by default. Maybe set digits = NA?

In my case I resolved this by writing my own custum function to create a bulk upload textfile. But maybe someone else has a similar problem and I didnt find an issue on this here.

[sckott]

Share your R session info and ideally a reproducible example

[cphaarmeyer]

Edited out the connection Info.

library(elastic)

conn <- connect(...)

conn$es_ver()
#> [1] 561

index_create(conn, index = "tmp")
#> $acknowledged
#> [1] TRUE
#> 
#> $shards_acknowledged
#> [1] TRUE
#> 
#> $index
#> [1] "tmp"

df <- data.frame(x = 1.23456789)

docs_bulk_index(conn, df,
  index = "tmp", type = "tmp", es_ids = FALSE, doc_ids = 1
)
#>   |                                                                              |                                                                      |   0%  |                                                                              |======================================================================| 100%
#> [[1]]
#> [[1]]$took
#> [1] 26
#> 
#> [[1]]$errors
#> [1] FALSE
#> 
#> [[1]]$items
#> [[1]]$items[[1]]
#> [[1]]$items[[1]]$index
#> [[1]]$items[[1]]$index$`_index`
#> [1] "tmp"
#> 
#> [[1]]$items[[1]]$index$`_type`
#> [1] "tmp"
#> 
#> [[1]]$items[[1]]$index$`_id`
#> [1] "1"
#> 
#> [[1]]$items[[1]]$index$`_version`
#> [1] 1
#> 
#> [[1]]$items[[1]]$index$result
#> [1] "created"
#> 
#> [[1]]$items[[1]]$index$`_shards`
#> [[1]]$items[[1]]$index$`_shards`$total
#> [1] 2
#> 
#> [[1]]$items[[1]]$index$`_shards`$successful
#> [1] 1
#> 
#> [[1]]$items[[1]]$index$`_shards`$failed
#> [1] 0
#> 
#> 
#> [[1]]$items[[1]]$index$created
#> [1] TRUE
#> 
#> [[1]]$items[[1]]$index$status
#> [1] 201

docs_get(conn, index = "tmp", type = "tmp", id = 1)
#> $`_index`
#> [1] "tmp"
#> 
#> $`_type`
#> [1] "tmp"
#> 
#> $`_id`
#> [1] "1"
#> 
#> $`_version`
#> [1] 1
#> 
#> $found
#> [1] TRUE
#> 
#> $`_source`
#> $`_source`$x
#> [1] 1.2346

index_delete(conn, index = "tmp")
#> $acknowledged
#> [1] TRUE

^{Created on 2021-02-15 by the reprex package (v1.0.0)}

Session info

sessioninfo::session_info()
#> - Session info ---------------------------------------------------------------
#>  setting  value                       
#>  version  R version 4.0.3 (2020-10-10)
#>  os       Windows 10 x64              
#>  system   x86_64, mingw32             
#>  ui       RTerm                       
#>  language (EN)                        
#>  collate  German_Germany.1252         
#>  ctype    German_Germany.1252         
#>  tz       Europe/Berlin               
#>  date     2021-02-15                  
#> 
#> - Packages -------------------------------------------------------------------
#>  package     * version date       lib source        
#>  assertthat    0.2.1   2019-03-21 [1] CRAN (R 4.0.0)
#>  backports     1.2.1   2020-12-09 [1] CRAN (R 4.0.3)
#>  cli           2.3.0   2021-01-31 [1] CRAN (R 4.0.3)
#>  crayon        1.4.0   2021-01-30 [1] CRAN (R 4.0.3)
#>  crul          1.0.0   2020-07-30 [1] CRAN (R 4.0.2)
#>  curl          4.3     2019-12-02 [1] CRAN (R 4.0.0)
#>  digest        0.6.27  2020-10-24 [1] CRAN (R 4.0.3)
#>  elastic     * 1.1.0   2020-01-11 [1] CRAN (R 4.0.3)
#>  ellipsis      0.3.1   2020-05-15 [1] CRAN (R 4.0.0)
#>  evaluate      0.14    2019-05-28 [1] CRAN (R 4.0.0)
#>  fs            1.5.0   2020-07-31 [1] CRAN (R 4.0.2)
#>  glue          1.4.2   2020-08-27 [1] CRAN (R 4.0.2)
#>  highr         0.8     2019-03-20 [1] CRAN (R 4.0.0)
#>  htmltools     0.5.1.1 2021-01-22 [1] CRAN (R 4.0.3)
#>  httpcode      0.3.0   2020-04-10 [1] CRAN (R 4.0.0)
#>  jsonlite      1.7.2   2020-12-09 [1] CRAN (R 4.0.3)
#>  knitr         1.31    2021-01-27 [1] CRAN (R 4.0.3)
#>  lifecycle     0.2.0   2020-03-06 [1] CRAN (R 4.0.0)
#>  magrittr      2.0.1   2020-11-17 [1] CRAN (R 4.0.3)
#>  pillar        1.4.7   2020-11-20 [1] CRAN (R 4.0.3)
#>  pkgconfig     2.0.3   2019-09-22 [1] CRAN (R 4.0.0)
#>  purrr         0.3.4   2020-04-17 [1] CRAN (R 4.0.0)
#>  R6            2.5.0   2020-10-28 [1] CRAN (R 4.0.3)
#>  Rcpp          1.0.6   2021-01-15 [1] CRAN (R 4.0.3)
#>  reprex        1.0.0   2021-01-27 [1] CRAN (R 4.0.3)
#>  rlang         0.4.10  2020-12-30 [1] CRAN (R 4.0.3)
#>  rmarkdown     2.6     2020-12-14 [1] CRAN (R 4.0.3)
#>  sessioninfo   1.1.1   2018-11-05 [1] CRAN (R 4.0.0)
#>  stringi       1.5.3   2020-09-09 [1] CRAN (R 4.0.2)
#>  stringr       1.4.0   2019-02-10 [1] CRAN (R 4.0.0)
#>  styler        1.3.2   2020-02-23 [1] CRAN (R 4.0.0)
#>  tibble        3.0.6   2021-01-29 [1] CRAN (R 4.0.3)
#>  triebeard     0.3.0   2016-08-04 [1] CRAN (R 4.0.0)
#>  urltools      1.7.3   2019-04-14 [1] CRAN (R 4.0.0)
#>  vctrs         0.3.6   2020-12-17 [1] CRAN (R 4.0.3)
#>  withr         2.4.1   2021-01-26 [1] CRAN (R 4.0.3)
#>  xfun          0.20    2021-01-06 [1] CRAN (R 4.0.3)
#>  yaml          2.2.1   2020-02-01 [1] CRAN (R 4.0.0)
#> 
#> [1] C:/Users/philipp/Documents/R/win-library/4.0
#> [2] C:/Program Files/R/R-4.0.3/library

[sckott]

@cphaarmeyer should work now. reinstall remotes::install_github("ropensci/elastic"), and see digits param https://docs.ropensci.org/elastic/reference/docs_bulk_index.html