add RL4LMs summarization #1078

dwyzzy · 2023-03-13T08:40:39Z

No description provided.

CLAassistant · 2023-03-13T08:40:44Z

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
0 out of 2 committers have signed the CLA.

❌ dwyzzy
❌ TomorrowIsAnOtherDay
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

…n' into sentence_review_summarization

benchmark/torch/RL4LMs/t5_ppo.yml

benchmark/torch/RL4LMs/train.py

benchmark/torch/RL4LMs/seq2seq_model.py

benchmark/torch/RL4LMs/rl4lms_agent.py

benchmark/torch/RL4LMs/rl4lms_ppo.py

benchmark/torch/RL4LMs/README.md

benchmark/torch/RL4LMs/instructor.py

benchmark/torch/RL4LMs/rl4lms_agent.py

benchmark/torch/RL4LMs/seq2seq_model.py

benchmark/torch/RL4LMs/rl4lms_utils/rollout_util.py

benchmark/torch/RL4LMs/rl4lms_ppo.py

rical730 · 2023-03-31T09:06:20Z

benchmark/torch/RL4LMs/rl4lms_utils/buffer.py

-        self.pos += 1
-        if self.pos == self.buffer_size:
-            self.full = True
+    def add_transitions(self, episode_wise_transitions, rollout_info):


you don't have to remove add method, it abstracts the process of adding a single transitions

…n' into sentence_review_summarization

dwyzzy added 15 commits March 1, 2023 19:22

init file using files from RL4LMS

a1a4c4b

benchmark of RL4LMs v0.0

e706ed4

benchmark of RL4LMs v0.1

f816028

fix pg reward bug, remove no use warmstartup

0293734

merge models and buffers, add README.md

02efdd9

simplified code v0.0

89c4efb

remove distribution_wrapper.py and sample_util.py

0b69359

remove EvaluateActionsOutput, ValueOutput and PolicyOutput

23735cb

use Reviewer and ReviewerGroup instead of Env

bbdd102

use Reviewer and ReviewerGroup instead of Env (parl parallel)

a9aef6b

use Reviewer and ReviewerGroup instead of Env (parl parallel version)

bf3c625

review using sentence (parl parallel version)

d452685

remove some '**config' and change rollout util

b943f1c

use instructor instead of reviewer, add examiner

086ce6f

add requirements.txt

3acf2c3

dwyzzy and others added 12 commits March 13, 2023 16:55

change code style

090b190

Merge branch 'develop' into sentence_review_summarization

78f44b8

change train.py style

b66f07e

Merge remote-tracking branch 'rl4lm_parl/sentence_review_summarizatio…

0d8af33

…n' into sentence_review_summarization

change style

337ac75

change style

d0ced44

change code style(add copyright)

151fcea

bring for-batch-rollout loop out of rl4lms_ppo

f91d2c9

change name of policy/value , obs-preprocess and add-to-buffer

dc1d835

change config structure

a23e8fe

change ppo code style according to parl ppo

c2be52f

yapf code style

b34ea18

TomorrowIsAnOtherDay reviewed Mar 16, 2023

View reviewed changes

change code for PARL-RL4LMs summarization version 0.1

02c8956

dwyzzy added 2 commits March 16, 2023 21:45

change code style of PARL-RL4LMs summarization version 0.1

760cc9d

change unreasonable name to n_steps_per_instructor in config

1770e45

rical730 reviewed Mar 17, 2023

View reviewed changes

dwyzzy and others added 4 commits March 20, 2023 10:08

add object for all classes, adjust add-to-buffer structure

b9c3e5c

change t5_ppo_config and README

59e02fa

yapf code style

4cd67e2

Merge branch 'develop' into sentence_review_summarization

6af0e40

rical730 reviewed Mar 31, 2023

View reviewed changes

dwyzzy and others added 5 commits April 3, 2023 10:52

change buffer add(), add save/load

da94226

yapf code style

68ec090

Merge remote-tracking branch 'rl4lm_parl/sentence_review_summarizatio…

2b82da6

…n' into sentence_review_summarization

evaluate at beginning

21e99e8

Merge branch 'develop' into sentence_review_summarization

1704e4f

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add RL4LMs summarization #1078

add RL4LMs summarization #1078

dwyzzy commented Mar 13, 2023

CLAassistant commented Mar 13, 2023 •

edited

Loading

rical730 Mar 31, 2023

add RL4LMs summarization #1078

Are you sure you want to change the base?

add RL4LMs summarization #1078

Conversation

dwyzzy commented Mar 13, 2023

CLAassistant commented Mar 13, 2023 • edited Loading

rical730 Mar 31, 2023

Choose a reason for hiding this comment

CLAassistant commented Mar 13, 2023 •

edited

Loading