Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Catch error when step_dummy() tries to create too many columns #828

Closed
EmilHvitfeldt opened this issue Oct 6, 2021 · 1 comment · Fixed by #1327
Closed

Catch error when step_dummy() tries to create too many columns #828

EmilHvitfeldt opened this issue Oct 6, 2021 · 1 comment · Fixed by #1327
Assignees
Labels
feature a feature request or enhancement

Comments

@EmilHvitfeldt
Copy link
Member

Should there be a catch for this particular error that gets produced in step_dummy() when it tries to calculate too big of a matrix? I realise this will eventually get fixed by #420, but is vector memory exhausted (limit reached?) enough of a hint that x has too many levels/too many rows

library(recipes)

dat <- data.frame(x = as.character(1:100000))

recipe(~ ., data = dat) %>%
  step_dummy(x) %>%
  prep()
#> Error: vector memory exhausted (limit reached?)
@EmilHvitfeldt EmilHvitfeldt changed the title Catch error when step_dummy() Catch error when step_dummy() tries to create too many columns Oct 6, 2021
@EmilHvitfeldt EmilHvitfeldt added the feature a feature request or enhancement label Mar 30, 2023
@EmilHvitfeldt EmilHvitfeldt self-assigned this May 26, 2024
Copy link

This issue has been automatically locked. If you believe you have found a related problem, please file a new issue (with a reprex https://reprex.tidyverse.org) and link to this issue.

@github-actions github-actions bot locked and limited conversation to collaborators Jun 16, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
feature a feature request or enhancement
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant