POS tagging

[dandiep]

Hi, one of the things we're using spacy-transformers currently is POS tagging. Having to have a different model for each language is a huge problem in terms of memory consumption and architecture. Is it possible to use spacy-llm to do POS tagging, e.g. with OpenAI? Or could it be extended to do so?

[svlandeg]

Yes - you can write a custom task to do this with spacy-llm, it would probably look a bit like the lemmatizer, you can see its prompt template here.

In general, it should be relatively straightforward to implement a custom task, see the docs here and here: you need a generate_prompts function and a parse_responses function.

Let us know if you run into issues implementing this!