Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hyperparameter Optimization #12

Open
xown3197 opened this issue May 30, 2019 · 0 comments
Open

Hyperparameter Optimization #12

xown3197 opened this issue May 30, 2019 · 0 comments
Labels
deep learning about neural network plan will be executing

Comments

@xown3197
Copy link
Collaborator

xown3197 commented May 30, 2019 •
edited
Loading

  • Hyperparameter Optimization 는 learning rate, batch, epoch, 층의 갯수, 정규화 정도, 필터 크기 등 학습이 아닌 사람이 정하는 변수를 칭합니다.
  • Hyperparameter Tuning은 일정 수준의 모델에서는 성능의 우세를 결정하는 중요한 요소입니다.
  • 최적화를 하는 방법으로는 bayesian optimization, genetic algorithms 등 사용이 되고 각광 받는 방법으로는 random search가 있습니다.
  • 단, 너무 과한 Hyperparameter Optimization는 Over fitting을 발생시킬 수 있습니다.

Ps. 기회가 된다면 Hyperparameter Optimization도 적용해볼 생각입니다.
@xown3197 xown3197 mentioned this issue May 30, 2019
Open
@xown3197 xown3197 changed the title 하이퍼파라미터 최적화 Hyperparameter Optimization May 30, 2019
@sorachin sorachin added deep learning about neural network plan will be executing labels May 30, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
deep learning about neural network plan will be executing
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sorachin @xown3197