NotImplementedError: Not implemented attn grouped_query_attention

[zhao-lun]

i have this model config that uses grouped_query_attention. does tgi support attention_type: gqa ?

text-generation-launcher  --trust-remote-code --model-id <path_to_my_model>