The goal of rmorphodita is to enable morphological analysis, tagging and
generation using MorphoDiTa’s
Python bindings (contained in the ufal.morphodita Python
package).
And the development version from GitHub with:
# install.packages("devtools")
devtools::install_github("skvrnami/rmorphodita")First you need to install morphodita by running install_morphodita().
library(rmorphodita)install_morphodita()Then you need to download a language model to use for tagging etc. There
are three languages available: Czech (CZ), Slovak (SK), and English
(EN). The download_models function downloads a .zip file with models
from LINDAT/CLARIAH-CZ repository to a
specified directory, unzips them and returns list of files with
morphological taggers and dictionaries.
cz_models <- download_models(lang = "CZ", dest_folder = "tmp")
cz_models
#> [1] "/Users/skvrnami/github/rmorphodita/tmp/czech-morfflex-pdt-161115/czech-morfflex-161115-no_dia-pos_only.dict"
#> [2] "/Users/skvrnami/github/rmorphodita/tmp/czech-morfflex-pdt-161115/czech-morfflex-161115-no_dia.dict"
#> [3] "/Users/skvrnami/github/rmorphodita/tmp/czech-morfflex-pdt-161115/czech-morfflex-161115-pos_only.dict"
#> [4] "/Users/skvrnami/github/rmorphodita/tmp/czech-morfflex-pdt-161115/czech-morfflex-161115.dict"
#> [5] "/Users/skvrnami/github/rmorphodita/tmp/czech-morfflex-pdt-161115/czech-morfflex-pdt-161115-no_dia-pos_only.tagger"
#> [6] "/Users/skvrnami/github/rmorphodita/tmp/czech-morfflex-pdt-161115/czech-morfflex-pdt-161115-no_dia.tagger"
#> [7] "/Users/skvrnami/github/rmorphodita/tmp/czech-morfflex-pdt-161115/czech-morfflex-pdt-161115-pos_only.tagger"
#> [8] "/Users/skvrnami/github/rmorphodita/tmp/czech-morfflex-pdt-161115/czech-morfflex-pdt-161115.tagger"Then it is necessary to load tagger:
cz_tagger <- load_tagger(cz_models[8])tagged_text <- morpho_tag(cz_tagger, "Já bych všechny ty počítače zakázala.", NULL)
tagged_text
#> # A tibble: 7 × 6
#> lemma tag start length word sentence
#> <chr> <chr> <int> <int> <chr> <dbl>
#> 1 já PP-S1--1------- 0 2 Já 1
#> 2 být Vc-S---1------- 3 4 bych 1
#> 3 všechen PLYP4---------- 8 7 všechny 1
#> 4 ten PDIP4---------- 16 2 ty 1
#> 5 počítač NNIP4-----A---- 19 8 počítače 1
#> 6 zakázat VpQW---XR-AA--- 28 8 zakázala 1
#> 7 . Z:------------- 36 1 . 1Function morpho_analyze returns all possible forms of a word.
morpho_analyze(cz_tagger, "kout")
#> # A tibble: 3 × 2
#> lemma tag
#> <chr> <chr>
#> 1 kout_^(např._železo) Vf--------A----
#> 2 kout_^(př._dát_něco_do_kouta) NNIS1-----A----
#> 3 kout_^(př._dát_něco_do_kouta) NNIS4-----A----And function morpho_generate returns all possible forms of a given
lemma that complies with the specified wildcard. In the case below, it
returns all nouns in second case.
morpho_generate(cz_tagger, "kout", tag_wildcard = "N???2?")
#> # A tibble: 3 × 3
#> form tag lemma
#> <chr> <chr> <chr>
#> 1 koutu NNIS2-----A---1 kout
#> 2 kouta NNIS2-----A---- kout_^(př._dát_něco_do_kouta)
#> 3 koutů NNIP2-----A---- kout_^(př._dát_něco_do_kouta)As the tags are quite unintelligible, it is possible to extract and
recode them like this. The extract_hm_tags function splits the tag
into columns indicating particular grammatical categories such as part
of speech (pos), gender, number, case etc. The recode_tags function
then recode the tag marks into factor with a full description of the tag
meaning (using the TAGS list which stores the meaning of the tag
values).
tagged_text %>%
extract_hm_tags() %>%
recode_tags(., tags_df = TAGS)
#> # A tibble: 7 × 18
#> lemma pos pos_detail gender number case poss_gender poss_number person
#> <chr> <fct> <fct> <fct> <fct> <fct> <fct> <fct> <fct>
#> 1 já "Prono… "Personal … <NA> Singu… Nomi… <NA> <NA> 1
#> 2 být "Verb" "Condition… <NA> Singu… <NA> <NA> <NA> 1
#> 3 všechen "Prono… "Pronoun i… Mascu… Plural Accu… <NA> <NA> <NA>
#> 4 ten "Prono… "Pronoun, … Mascu… Plural Accu… <NA> <NA> <NA>
#> 5 počítač "Noun" "Noun, gen… Mascu… Plural Accu… <NA> <NA> <NA>
#> 6 zakázat "Verb" "Verb, pas… Femin… Singu… <NA> <NA> <NA> Any
#> 7 . "Punct… "Punctuati… <NA> <NA> <NA> <NA> <NA> <NA>
#> # … with 9 more variables: tense <fct>, grade <fct>, negation <fct>,
#> # voice <fct>, variant <fct>, start <int>, length <int>, word <chr>,
#> # sentence <dbl>