Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for RMSProp #21

Closed
beniz opened this issue Jul 28, 2015 · 3 comments
Closed

Add support for RMSProp #21

beniz opened this issue Jul 28, 2015 · 3 comments
Assignees
@beniz
Labels
kind:neural net mllib:caffe type:enhancement

Comments

@beniz
Copy link
Collaborator

beniz commented Jul 28, 2015

There's a PR to Caffe here: BVLC/caffe#1890
Requires some empirical testing after merging.
@beniz beniz self-assigned this Jul 30, 2015
@beniz
Copy link
Collaborator Author

beniz commented Jul 30, 2015

Merged and fixed RMSProp support to the underlying custom caffe version at https://github.com/beniz/caffe/tree/master_dd_integ_rmsprop

Early testing shows RMSProp working on standard problems, though the gradient unit tests are not passing for now, which precludes immediate inclusion.

Support for RMSPROP in solver_type for Caffe in deepdetect API + rms_decay parameter are in branch https://github.com/beniz/deepdetect/tree/rmsprop_21 (requires master_dd_integ_rmsprop).

@beniz
Copy link
Collaborator Author

beniz commented Aug 6, 2015

New PR for Caffe is here: BVLC/caffe#2867

@beniz
Copy link
Collaborator Author

beniz commented Aug 7, 2015

Merged into master.

@beniz beniz closed this as completed Aug 7, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@beniz beniz

Labels
kind:neural net mllib:caffe type:enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@beniz