Added Clipping constraint and KLD loss with CD

[Aakanksha-Rana]

Types of changes

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)

Summary

This code improves the concrete dropout code by adding the KL loss approximation and also adds a clipping constraint for the value of p, so that it doesn't fall to 0.

Checklist

• I have added tests to cover my changes
• I have updated documentation (if necessary)

Acknowledgment

• I acknowledge that this contribution will be available under the Apache 2 license.

[Aakanksha-Rana]

@satra this looks like unusual to me. is this a problem with the hook? Error doesn't seem to appear from the code.

[satra]

it looks like black is modifying some file: https://results.pre-commit.ci/run/github/94588639/1634850114.qOu0gxTiQIyeYIEiVOoi6g - you can run pre-commit locally on the exact branch after fetching from github to see what is changing.