Code

127 adjust threshold#136

Code

Merged

yiwen-h merged 21 commits intodevelopmentThe-Strategy-Unit/pxtextmining:developmentfrom 127_adjust_thresholdThe-Strategy-Unit/pxtextmining:127_adjust_thresholdCopy head branch name to clipboardSep 8, 2023

+879-709

Commits

Commits on Sep 1, 2023

• wrote get_thresholds function

  yiwen-h

  committed
  42b2a3e

  Copy full SHA for 42b2a3e

Commits on Sep 4, 2023

• added test and docstring for get_thresholds

  yiwen-h

  committed
  b0c9788

  Copy full SHA for b0c9788

• moved np divide-by-zero error suppression to specific codeblock

  yiwen-h

  committed
  8b57aee

  Copy full SHA for 8b57aee

• Merge branch 'development' of github.com:CDU-data-science-team/pxtextmining into 127_adjust_threshold

  yiwen-h

  committed
  4874366

  Copy full SHA for 4874366

• took out already_encoded as positional argument

  Show description for 1949238
  yiwen-h

  committed
  1949238

  Copy full SHA for 1949238

Commits on Sep 5, 2023

• added test and function for turn_probs_into_binary taking custom thresholds

  yiwen-h

  committed
  dc57f0f

  Copy full SHA for dc57f0f

• refactored code, taking out model_type

  Show description for 09ec65a
  yiwen-h

  committed
  09ec65a

  Copy full SHA for 09ec65a

• added custom_threshold_dict to predict_multilabel_bert and get_multilabel_metrics

  yiwen-h

  committed
  2d8a0f4

  Copy full SHA for 2d8a0f4

• added threshold_dict to sklearn_pipeline

  Show description for 14325c4
  yiwen-h

  committed
  14325c4

  Copy full SHA for 14325c4

• added custom_threshold to the svc pipeline. removed two_layer pipeline and test

  yiwen-h

  committed
  b36f1b2

  Copy full SHA for b36f1b2

Commits on Sep 6, 2023

• added test and threshold dict to additional_analysis function

  yiwen-h

  committed
  b8dad02

  Copy full SHA for b8dad02

• added custom_threshold_dict to write_model_analysis

  yiwen-h

  committed
  39e5b2a

  Copy full SHA for 39e5b2a

• write_results now takes preds_df rather than making predictions itself

  yiwen-h

  committed
  e88eaef

  Copy full SHA for e88eaef

• added check for length to write_model_preds

  yiwen-h

  committed
  daa21b3

  Copy full SHA for daa21b3

• moved prediction step out of get_multilabel_metrics function

  yiwen-h

  committed
  1520ec7

  Copy full SHA for 1520ec7

• fixed bug with creating threshold_dict

  yiwen-h

  committed
  2dca18c

  Copy full SHA for 2dca18c

Commits on Sep 7, 2023

• fixed bug with too many arguments for get_multilabel_metrics

  yiwen-h

  committed
  c775c03

  Copy full SHA for c775c03

• trying different values in gridsearch

  yiwen-h

  committed
  632ae12

  Copy full SHA for 632ae12

• moved label_fix to before custom threshold in bert_predict

  yiwen-h

  committed
  0c9bb7f

  Copy full SHA for 0c9bb7f

• more resilient turn_probs_into_binary by using dict.get

  yiwen-h

  committed
  4cd664a

  Copy full SHA for 4cd664a

• fixed bug with threshold_dict and added new coverage

  yiwen-h

  committed
  5c1c217

  Copy full SHA for 5c1c217