Code

Visual DPO#1647

Code

Merged

kashif merged 44 commits intohuggingface:mainhuggingface/trl:mainfrom qgallouedec:fix-vsft-exampleqgallouedec/trl:fix-vsft-exampleCopy head branch name to clipboardJun 26, 2024

+536-46

Commits

Commits on May 17, 2024

• Remove extra whitespaces

  qgallouedec

  committed
  8768fe6

  Copy full SHA for 8768fe6

• idefics

  qgallouedec

  committed
  5d43f2b

  Copy full SHA for 5d43f2b

Commits on May 27, 2024

• vdpo

  qgallouedec

  committed
  f5a3237

  Copy full SHA for f5a3237

• sft idefics

  qgallouedec

  committed
  682c034

  Copy full SHA for 682c034

Commits on May 30, 2024

• pad with test

  qgallouedec

  committed
  bf01bf3

  Copy full SHA for bf01bf3

• use prompt instead of tokenizer

  qgallouedec

  committed
  aed1aeb

  Copy full SHA for aed1aeb

• rm name main

  qgallouedec

  committed
  e814f88

  Copy full SHA for e814f88

• support vlm in tokenize row

  qgallouedec

  committed
  fd5d71b

  Copy full SHA for fd5d71b

• temp fix for regex in lora_target_module

  qgallouedec

  committed
  e1b8755

  Copy full SHA for e1b8755

Commits on May 31, 2024

• format

  qgallouedec

  committed
  8075419

  Copy full SHA for 8075419

• vdpo

  qgallouedec

  committed
  1b815c2

  Copy full SHA for 1b815c2

Commits on Jun 3, 2024

• tmp float16 hard code

  qgallouedec

  committed
  6d6a194

  Copy full SHA for 6d6a194

• concatenated_forward support for vision

  qgallouedec

  committed
  1935d3d

  Copy full SHA for 1935d3d

Commits on Jun 17, 2024

• style and new command line

  qgallouedec

  committed
  bdc2b95

  Copy full SHA for bdc2b95

• all-linear

  qgallouedec

  committed
  24b08f5

  Copy full SHA for 24b08f5

Commits on Jun 18, 2024

• format

  qgallouedec

  committed
  c5ff8d7

  Copy full SHA for c5ff8d7

• delete old examples

  qgallouedec

  committed
  a7d1732

  Copy full SHA for a7d1732

• get image

  qgallouedec

  committed
  2303c40

  Copy full SHA for 2303c40

• upcast

  qgallouedec

  committed
  b606190

  Copy full SHA for b606190

• new test

  qgallouedec

  committed
  4f78ee5

  Copy full SHA for 4f78ee5

• modified test

  qgallouedec

  committed
  c4433c0

  Copy full SHA for c4433c0

• new strat for tokenizer

  qgallouedec

  committed
  7a8a94f

  Copy full SHA for 7a8a94f

Commits on Jun 25, 2024

• Merge branch 'main' into fix-vsft-example

  qgallouedec

  authored
  a9a4607

  Copy full SHA for a9a4607

• rm token transfer

  qgallouedec

  committed
  9955710

  Copy full SHA for 9955710

• integrate vision in dpo example

  qgallouedec

  committed
  f6ee370

  Copy full SHA for f6ee370

• format

  qgallouedec

  committed
  56fb036

  Copy full SHA for 56fb036

• add FDivergenceType back

  qgallouedec

  committed
  c3249e5

  Copy full SHA for c3249e5

• precommit

  qgallouedec

  committed
  f69bb1c

  Copy full SHA for f69bb1c

• pillow test dep

  qgallouedec

  committed
  6d859cf

  Copy full SHA for 6d859cf

• optional prompt

  qgallouedec

  committed
  48db3e1

  Copy full SHA for 48db3e1

• evaluation_strategy to eval_strategy

  qgallouedec

  committed
  dea765b

  Copy full SHA for dea765b

• revert vsft change (oos)

  qgallouedec

  committed
  d6dc3ba

  Copy full SHA for d6dc3ba

• update test

  qgallouedec

  committed
  3a1f5b8

  Copy full SHA for 3a1f5b8

• test

  qgallouedec

  committed
  5545825

  Copy full SHA for 5545825

Commits on Jun 26, 2024

• comment and support more in process

  qgallouedec

  committed
  5197d6d

  Copy full SHA for 5197d6d

• update process

  qgallouedec

  committed
  45fda7e

  Copy full SHA for 45fda7e

• update doc for vdpo

  qgallouedec

  committed
  5a1dfa7

  Copy full SHA for 5a1dfa7

• caution about limited support

  qgallouedec

  committed
  2c10ca8

  Copy full SHA for 2c10ca8

• Update docs/source/dpo_trainer.mdx

  Show description for 2e47633
  

  qgallouedec

  and

  kashif

  authored
  2e47633

  Copy full SHA for 2e47633

• revert DPO example changes

  qgallouedec

  committed
  f960a2a

  Copy full SHA for f960a2a

• cleaner way to check if a model is vision

  qgallouedec

  committed
  e4c7436

  Copy full SHA for e4c7436

• comment

  qgallouedec

  committed
  bfb35d3

  Copy full SHA for bfb35d3

• update vdpo example

  qgallouedec

  committed
  7b22153

  Copy full SHA for 7b22153

• rename

  qgallouedec

  committed
  5155194

  Copy full SHA for 5155194