Code

Activation Ordering Strategies#121

Code

Merged

kylesayrs merged 80 commits intomainvllm-project/llm-compressor:mainfrom kylesayrs/actorder_static_groupvllm-project/llm-compressor:kylesayrs/actorder_static_groupCopy head branch name to clipboardSep 3, 2024

+271-121

Commits

Commits on Aug 16, 2024

• actorder

  

  horheynm

  authored and

  kylesayrs

  committed
  012138a

• g_idx fix

  

  horheynm

  authored and

  kylesayrs

  committed
  f88c84e

• fix

  

  horheynm

  authored and

  kylesayrs

  committed
  3211fe1

• lint

  

  horheynm

  authored and

  kylesayrs

  committed
  bbbf564

• propagagte g_idx with perm

  

  horheynm

  authored and

  kylesayrs

  committed
  8d29f0d

• scratch

  

  horheynm

  authored and

  kylesayrs

  committed
  89224e9

• GPTQ - move calibration of quantiztion params to after hessian calibration

  

  Benjamin

  authored and

  kylesayrs

  committed
  cb8446d

• no recompute

  

  horheynm

  authored and

  kylesayrs

  committed
  d7029a0

• clean up

  

  horheynm

  authored and

  kylesayrs

  committed
  eeff533

• remvoe unwanted code

  

  horheynm

  authored and

  kylesayrs

  committed
  842b150

• draft

  

  horheynm

  authored and

  kylesayrs

  committed
  240c39d

• draft

  

  horheynm

  authored and

  kylesayrs

  committed
  820d08a

• draft

  

  horheynm

  authored and

  kylesayrs

  committed
  564845e

• mimic gptq

  

  horheynm

  authored and

  kylesayrs

  committed
  6f54737

• permutation seems to be working

  kylesayrs

  committed
  2cc99bb

• WIP: fails on non-square weights

  kylesayrs

  committed
  6fe537d

• pass perm into quant params calculation

  kylesayrs

  committed
  6611073

• works on vllm and loading with identity permutation

  kylesayrs

  committed
  9077969

• WIP: working pytorch with actorder

  kylesayrs

  committed
  6a1565e

• able to inference with script and reload, needed to set

  kylesayrs

  committed
  1940df4

• remove testing comments

  kylesayrs

  committed
  11beac1

• remove scripts

  kylesayrs

  committed
  9456698

• remove dregs

  kylesayrs

  committed
  0c773e6

• merge actorder and group cases

  kylesayrs

  committed
  b6bebc2

• code structuring and cleanup

  kylesayrs

  committed
  3bde194

• use refresh_layer_weight_quant_params

  kylesayrs

  committed
  758c495

• update_layer_weight_quant_params reuse

  kylesayrs

  committed
  85fb1ff

• deep copy H to allow for future reuse

  kylesayrs

  committed
  5b52e9d

• hoist group_size

  kylesayrs

  committed
  9e2cef9

• remove footer note

  kylesayrs

  committed
  e725cc7

• apply style

  kylesayrs

  committed
  2392b83

• fix rebase dreggs

  kylesayrs

  committed
  a5a30e1

• remove extra line

  kylesayrs

  committed
  ca6fc6e

• move lines for better grouping

  kylesayrs

  committed
  6f99634

• move for better diff

  kylesayrs

  committed
  b726bd6

• remove extra lines

  kylesayrs

  committed
  2002761

Commits on Aug 17, 2024

• use getattr to avoid pr dep

  kylesayrs

  committed
  0ef0c5b

• Revert "use getattr to avoid pr dep"

  Show description for 476aed0
  kylesayrs

  committed
  476aed0

Commits on Aug 21, 2024

• add actorder to docstring

  kylesayrs

  committed
  ffb809c

Commits on Aug 22, 2024

• Merge remote-tracking branch 'origin' into kylesayrs/activation-ordering

  kylesayrs

  committed
  edc02d4

• do not clone hessian

  kylesayrs

  committed
  bc49946

• apply style

  kylesayrs

  committed
  99f2286

• avoid unset g_idx parameter by observing directly

  kylesayrs

  committed
  48b36c2

• use update_layer_weight_quant_params

  kylesayrs

  committed
  9550f14

Commits on Aug 23, 2024

• Merge remote-tracking branch 'origin/main' into kylesayrs/activation-ordering

  kylesayrs

  committed
  d22ff2e

Commits on Aug 25, 2024

• Merge branch 'main' into kylesayrs/activation-ordering

  kylesayrs

  committed
  72d919f

• indent for when quantization_scheme is missing

  kylesayrs

  committed
  e4d37a6

• add actorder e2e test

  kylesayrs

  committed
  cdc8bcd

Commits on Aug 27, 2024

• do not freeze if initialized from gptq

  kylesayrs

  committed
  1fe188b

• add get_attr_chain helper function

  kylesayrs

  committed
  b06a103

• cleanup and clarify logic

  kylesayrs

  committed
  f293efd

• apply style

  kylesayrs

  committed
  a99e0da

• rename to getattr_chain, handle no default case

  kylesayrs

  committed
  bf915d4

• out of place type conversion

  kylesayrs

  committed
  66ef96b

• Merge remote-tracking branch 'origin/gptq-cleanup' into kylesayrs/activation-ordering

  kylesayrs

  committed
  98aaf88

• account for extra case

  kylesayrs

  committed
  91c877a

Commits on Aug 28, 2024

• remove freeze_quantization argument

  kylesayrs

  committed
  b711e14

• remove fake_quantization case, update debug message

  kylesayrs

  committed
  974dbc7

• remove todo

  kylesayrs

  committed
  094e429

• Merge remote-tracking branch 'origin/gptq-cleanup' into kylesayrs/activation-ordering

  kylesayrs

  committed
  582c179

• correct name

  kylesayrs

  committed
  febb741

• wip

  kylesayrs

  committed
  c74bbbd

• unpermute in both cases

  kylesayrs

  committed
  1af4a04

Commits on Aug 30, 2024

• integrate with ct

  kylesayrs

  committed
  1fdfdd7

• Merge remote-tracking branch 'origin/main' into kylesayrs/actorder_static_group

  kylesayrs

  committed
  8a22e82

• resolve merge

  kylesayrs

  committed
  2d3cc54

• fix import

  kylesayrs

  committed
  9bfeb9f

• pass args

  kylesayrs

  committed
  2976c7e

• write g_idx only for group activation ordering

  kylesayrs

  committed
  e8053dd

• unpermute for weight option as well

  kylesayrs

  committed
  143ec4b

• rename and add tests

  kylesayrs

  committed
  bfa3ff6

• comments

  kylesayrs

  committed
  3de429c

Commits on Sep 1, 2024

• Merge remote-tracking branch 'origin/main' into kylesayrs/actorder_static_group

  kylesayrs

  committed
  acd44cf

Commits on Sep 3, 2024

• Activation Ordering Tests (#135)

  kylesayrs

  authored
  2696f45

• update enum name, apply style

  kylesayrs

  committed
  c6710f8

• break out actordering

  kylesayrs

  committed
  c39d945

• Merge remote-tracking branch 'origin/main' into kylesayrs/actorder_static_group

  kylesayrs

  committed
  d03ba61

• compute sparsity mask after permutation

  kylesayrs

  committed
  00f2fa0

• use get_observer

  kylesayrs

  committed
  14559a9

• Merge branch 'main' into kylesayrs/actorder_static_group

  kylesayrs

  authored
  f903305