Minor Refactoring of clip_sampler

[rsomani95]

No description provided.

[codecov-io]

Codecov Report

Merging #1562 into master will not change coverage.
The diff coverage is 60%.

@@           Coverage Diff           @@
##           master    #1562   +/-   ##
=======================================
  Coverage   65.93%   65.93%           
=======================================
  Files          90       90           
  Lines        7074     7074           
  Branches     1076     1076           
=======================================
  Hits         4664     4664           
  Misses       2102     2102           
  Partials      308      308

Impacted Files	Coverage Δ
torchvision/datasets/samplers/clip_sampler.py	79.54% <60%> (ø)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 95131de...fb516ba. Read the comment docs.

[fmassa]

Thanks!