Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

KeyError during POS tagging using the French model #1052

Closed
raphael0202 opened this issue May 12, 2017 · 13 comments
Closed

KeyError during POS tagging using the French model #1052

raphael0202 opened this issue May 12, 2017 · 13 comments
Labels
bug Bugs and behaviour differing from documentation lang / fr French language data and models models Issues related to the statistical models

Comments

@raphael0202
Copy link
Contributor

raphael0202 commented May 12, 2017 •
edited
Loading

Related to #683

Minimal example to reproduce the bug:

In [1]: import spacy
In [2]: nlp = spacy.load('fr')
In [3]: nlp(" ")
---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
<ipython-input-39-170215c766db> in <module>()
----> 1 nlp(" ")

/home/raphael/git_core/spaCy/spacy/language.py in __call__(self, text, tag, parse, entity)
    327         for proc in self.pipeline:
    328             if proc and not skip.get(proc):
--> 329                 proc(doc)
    330         return doc
    331 

/home/raphael/git_core/spaCy/spacy/tagger.pyx in spacy.tagger.Tagger.__call__ (spacy/tagger.cpp:6245)()

/home/raphael/git_core/spaCy/spacy/morphology.pyx in spacy.morphology.Morphology.assign_tag_id (spacy/morphology.cpp:4681)()

KeyError: 139255`

The error comes from morphology.pyx (line 76):

    cdef int assign_tag_id(self, TokenC* token, int tag_id) except -1:
        if tag_id >= self.n_tags:
            raise ValueError("Unknown tag ID: %s" % tag_id)
        # TODO: It's pretty arbitrary to put this logic here. I guess the justification
        # is that this is where the specific word and the tag interact. Still,
        # we should have a better way to enforce this rule, or figure out why
        # the statistical model fails.
        # Related to Issue #220
        if Lexeme.c_check_flag(token.lex, IS_SPACE):
            tag_id = self.reverse_index[self.strings['SP']]  # <<<<<<<<<<<<

'SP' is not defined in the French tag map, so its ID is not in self.reverse_index, leading to the KeyError. Here is the associated morphology tag_map:

In [43]: nlp.vocab.morphology.tag_map
Out[43]: 
{'ADJ': {74: 82},
 'ADP': {74: 83},
 'ADV': {74: 84},
 'AUX': {74: 85},
 'CCONJ': {74: 87},
 'CONJ': {74: 86},
 'DET': {74: 88},
 'INTJ': {74: 89},
 'NOUN': {74: 90},
 'NUM': {74: 91},
 'PART': {74: 92},
 'PRON': {74: 93},
 'PROPN': {74: 94},
 'PUNCT': {74: 95},
 'SCONJ': {74: 96},
 'SYM': {74: 97},
 'VERB': {74: 98},
 'X': {74: 99}}

I added the following tag map to FrenchDefaults:

TAG_MAP = {
    "SP": {POS: SPACE},
}

and got a core dumped with nlp('\n'):

*** Error in `/home/raphael/.virtualenvs/spacy_dev/bin/python3': free(): invalid next size (fast): 0x00000000036b1aa0 ***
======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(+0x777e5)[0x7f20e50097e5]
/lib/x86_64-linux-gnu/libc.so.6(+0x7fe0a)[0x7f20e5011e0a]
/lib/x86_64-linux-gnu/libc.so.6(cfree+0x4c)[0x7f20e501598c]
/home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/cymem/cymem.cpython-35m-x86_64-linux-gnu.so(+0x382c)[0x7f20d991882c]
/home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/eg.cpython-35m-x86_64-linux-gnu.so(+0x4ebf)[0x7f20bd0f7ebf]
/home/raphael/git_core/spaCy/spacy/tagger.cpython-35m-x86_64-linux-gnu.so(+0xd5f6)[0x7f20bd9435f6]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyObject_Call+0x47)[0x5b7167]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x4f06)[0x528d06]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalCodeEx+0x13b)[0x52e12b]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x4ebd38]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyObject_Call+0x47)[0x5b7167]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x4f413e]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyObject_Call+0x47)[0x5b7167]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x54d4f6]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyObject_Call+0x47)[0x5b7167]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x4f06)[0x528d06]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalCode+0x1f)[0x52dfdf]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x5c7b85]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyCFunction_Call+0x4f)[0x4e9b9f]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x614)[0x524414]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x50ee)[0x528eee]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x50ee)[0x528eee]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d82f]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x50ee)[0x528eee]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x50ee)[0x528eee]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x50ee)[0x528eee]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x4a14)[0x528814]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalCodeEx+0x13b)[0x52e12b]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x4ebdd7]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyObject_Call+0x47)[0x5b7167]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x24af)[0x5262af]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x50ee)[0x528eee]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalCode+0x1f)[0x52dfdf]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x5fd2c2]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyRun_FileExFlags+0x9a)[0x5ff76a]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyRun_SimpleFileExFlags+0x1bc)[0x5ff95c]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(Py_Main+0x456)[0x63e7d6]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(main+0xe1)[0x4cfe41]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7f20e4fb2830]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(_start+0x29)[0x5d5f29]
======= Memory map: ========
00400000-007a8000 r-xp 00000000 00:2b 17700507                           /home/raphael/.virtualenvs/spacy_dev/bin/python3
009a8000-009aa000 r--p 003a8000 00:2b 17700507                           /home/raphael/.virtualenvs/spacy_dev/bin/python3
009aa000-00a41000 rw-p 003aa000 00:2b 17700507                           /home/raphael/.virtualenvs/spacy_dev/bin/python3
00a41000-00a72000 rw-p 00000000 00:00 0 
01f18000-75ddd000 rw-p 00000000 00:00 0                                  [heap]
7f209403b000-7f20a203d000 rw-p 00000000 00:00 0 
7f20a303e000-7f20ae441000 rw-p 00000000 00:00 0 
7f20ae44d000-7f20aee0d000 rw-p 00000000 00:00 0 
7f20aff8e000-7f20b670f000 rw-p 00000000 00:00 0 
7f20b6710000-7f20b7f50000 rw-p 00000000 00:00 0 
7f20b7f51000-7f20bc893000 rw-p 00000000 00:00 0 
7f20bc893000-7f20bc8c2000 r-xp 00000000 00:2b 15205820                   /home/raphael/git_core/spaCy/spacy/matcher.cpython-35m-x86_64-linux-gnu.so
7f20bc8c2000-7f20bcac2000 ---p 0002f000 00:2b 15205820                   /home/raphael/git_core/spaCy/spacy/matcher.cpython-35m-x86_64-linux-gnu.so
7f20bcac2000-7f20bcac3000 r--p 0002f000 00:2b 15205820                   /home/raphael/git_core/spaCy/spacy/matcher.cpython-35m-x86_64-linux-gnu.so
7f20bcac3000-7f20bcac8000 rw-p 00030000 00:2b 15205820                   /home/raphael/git_core/spaCy/spacy/matcher.cpython-35m-x86_64-linux-gnu.so
7f20bcac8000-7f20bcad3000 r-xp 00000000 00:2b 17834655                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/serialize.cpython-35m-x86_64-linux-gnu.so
7f20bcad3000-7f20bccd2000 ---p 0000b000 00:2b 17834655                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/serialize.cpython-35m-x86_64-linux-gnu.so
7f20bccd2000-7f20bccd3000 r--p 0000a000 00:2b 17834655                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/serialize.cpython-35m-x86_64-linux-gnu.so
7f20bccd3000-7f20bccd4000 rw-p 0000b000 00:2b 17834655                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/serialize.cpython-35m-x86_64-linux-gnu.so
7f20bccd4000-7f20bcce3000 r-xp 00000000 00:2b 17834549                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/mb.cpython-35m-x86_64-linux-gnu.so
7f20bcce3000-7f20bcee2000 ---p 0000f000 00:2b 17834549                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/mb.cpython-35m-x86_64-linux-gnu.so
7f20bcee2000-7f20bcee3000 r--p 0000e000 00:2b 17834549                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/mb.cpython-35m-x86_64-linux-gnu.so
7f20bcee3000-7f20bcee4000 rw-p 0000f000 00:2b 17834549                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/mb.cpython-35m-x86_64-linux-gnu.so
7f20bcee4000-7f20bcee5000 rw-p 00000000 00:00 0 
7f20bcee5000-7f20bcef1000 r-xp 00000000 00:2b 17834649                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/sparse.cpython-35m-x86_64-linux-gnu.so
7f20bcef1000-7f20bd0f0000 ---p 0000c000 00:2b 17834649                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/sparse.cpython-35m-x86_64-linux-gnu.so
7f20bd0f0000-7f20bd0f1000 r--p 0000b000 00:2b 17834649                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/sparse.cpython-35m-x86_64-linux-gnu.so
7f20bd0f1000-7f20bd0f2000 rw-p 0000c000 00:2b 17834649                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/sparse.cpython-35m-x86_64-linux-gnu.so
7f20bd0f2000-7f20bd0f3000 rw-p 00000000 00:00 0 
7f20bd0f3000-7f20bd108000 r-xp 00000000 00:2b 17834555                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/eg.cpython-35m-x86_64-linux-gnu.so
7f20bd108000-7f20bd307000 ---p 00015000 00:2b 17834555                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/eg.cpython-35m-x86_64-linux-gnu.so
7f20bd307000-7f20bd308000 r--p 00014000 00:2b 17834555                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/eg.cpython-35m-x86_64-linux-gnu.so
7f20bd308000-7f20bd30a000 rw-p 00015000 00:2b 17834555                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/eg.cpython-35m-x86_64-linux-gnu.so
7f20bd30a000-7f20bd314000 r-xp 00000000 00:2b 17834645                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/features.cpython-35m-x86_64-linux-gnu.so
7f20bd314000-7f20bd513000 ---p 0000a000 00:2b 17834645                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/features.cpython-35m-x86_64-linux-gnu.so
7f20bd513000-7f20bd514000 r--p 00009000 00:2b 17834645                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/features.cpython-35m-x86_64-linux-gnu.so
7f20bd514000-7f20bd515000 rw-p 0000a000 00:2b 17834645                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/features.cpython-35m-x86_64-linux-gnu.so
7f20bd515000-7f20bd51b000 r-xp 00000000 00:2b 17834476                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linalg.cpython-35m-x86_64-linux-gnu.so
7f20bd51b000-7f20bd71b000 ---p 00006000 00:2b 17834476                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linalg.cpython-35m-x86_64-linux-gnu.so
7f20bd71b000-7f20bd71c000 r--p 00006000 00:2b 17834476                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linalg.cpython-35m-x86_64-linux-gnu.so
7f20bd71c000-7f20bd71d000 rw-p 00007000 00:2b 17834476                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linalg.cpython-35m-x86_64-linux-gnu.so
7f20bd71d000-7f20bd734000 r-xp 00000000 00:2b 17834657                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/avgtron.cpython-35m-x86_64-linux-gnu.so
7f20bd734000-7f20bd933000 ---p 00017000 00:2b 17834657                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/avgtron.cpython-35m-x86_64-linux-gnu.so
7f20bd933000-7f20bd934000 r--p 00016000 00:2b 17834657                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/avgtron.cpython-35m-x86_64-linux-gnu.so
7f20bd934000-7f20bd936000 rw-p 00017000 00:2b 17834657                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/avgtron.cpython-35m-x86_64-linux-gnu.so
7f20bd936000-7f20bd95d000 r-xp 00000000 00:2b 15205779                   /home/raphael/git_core/spaCy/spacy/tagger.cpython-35m-x86_64-linux-gnu.so
7f20bd95d000-7f20bdb5c000 ---p 00027000 00:2b 15205779                   /home/raphael/git_core/spaCy/spacy/tagger.cpython-35m-x86_64-linux-gnu.so
7f20bdb5c000-7f20bdb5d000 r--p 00026000 00:2b 15205779                   /home/raphael/git_core/spaCy/spacy/tagger.cpython-35m-x86_64-linux-gnu.so
7f20bdb5d000-7f20bdb60000 rw-p 00027000 00:2b 15205779                   /home/raphael/git_core/spaCy/spacy/tagger.cpython-35m-x86_64-linux-gnu.so
7f20bdb60000-7f20bdb7c000 r-xp 00000000 00:2b 15205788                   /home/raphael/git_core/spaCy/spacy/tokenizer.cpython-35m-x86_64-linux-gnu.so
7f20bdb7c000-7f20bdd7b000 ---p 0001c000 00:2b 15205788                   /home/raphael/git_core/spaCy/spacy/tokenizer.cpython-35m-x86_64-linux-gnu.so
7f20bdd7b000-7f20bdd7c000 r--p 0001b000 00:2b 15205788                   /home/raphael/git_core/spaCy/spacy/tokenizer.cpython-35m-x86_64-linux-gnu.so
7f20bdd7c000-7f20bdd7f000 rw-p 0001c000 00:2b 15205788                   /home/raphael/git_core/spaCy/spacy/tokenizer.cpython-35m-x86_64-linux-gnu.so
7f20bdd7f000-7f20bdd80000 rw-p 00000000 00:00 0 
7f20bdd80000-7f20bdda2000 r-xp 00000000 00:2b 15205792                   /home/raphael/git_core/spaCy/spacy/syntax/nonproj.cpython-35m-x86_64-linux-gnu.so
7f20bdda2000-7f20bdfa1000 ---p 00022000 00:2b 15205792                   /home/raphael/git_core/spaCy/spacy/syntax/nonproj.cpython-35m-x86_64-linux-gnu.so
7f20bdfa1000-7f20bdfa2000 r--p 00021000 00:2b 15205792                   /home/raphael/git_core/spaCy/spacy/syntax/nonproj.cpython-35m-x86_64-linux-gnu.so
7f20bdfa2000-7f20bdfa5000 rw-p 00022000 00:2b 15205792                   /home/raphael/git_core/spaCy/spacy/syntax/nonproj.cpython-35m-x86_64-linux-gnu.so
7f20bdfa5000-7f20bdfa6000 rw-p 00000000 00:00 0 
7f20bdfa6000-7f20bdfb7000 r-xp 00000000 00:2b 15205794                   /home/raphael/git_core/spaCy/spacy/syntax/transition_system.cpython-35m-x86_64-linux-gnu.so
7f20bdfb7000-7f20be1b7000 ---p 00011000 00:2b 15205794                   /home/raphael/git_core/spaCy/spacy/syntax/transition_system.cpython-35m-x86_64-linux-gnu.so
7f20be1b7000-7f20be1b8000 r--p 00011000 00:2b 15205794                   /home/raphael/git_core/spaCy/spacy/syntax/transition_system.cpython-35m-x86_64-linux-gnu.so
7f20be1b8000-7f20be1b9000 rw-p 00012000 00:2b 15205794                   /home/raphael/git_core/spaCy/spacy/syntax/transition_system.cpython-35m-x86_64-linux-gnu.so
7f20be1b9000-7f20be1ba000 rw-p 00000000 00:00 0 
7f20be1ba000-7f20be1c8000 r-xp 00000000 00:2b 15205784                   /home/raphael/git_core/spaCy/spacy/syntax/stateclass.cpython-35m-x86_64-linux-gnu.so
7f20be1c8000-7f20be3c7000 ---p 0000e000 00:2b 15205784                   /home/raphael/git_core/spaCy/spacy/syntax/stateclass.cpython-35m-x86_64-linux-gnu.so
7f20be3c7000-7f20be3c8000 r--p 0000d000 00:2b 15205784                   /home/raphael/git_core/spaCy/spacy/syntax/stateclass.cpython-35m-x86_64-linux-gnu.so
7f20be3c8000-7f20be3c9000 rw-p 0000e000 00:2b 15205784                   /home/raphael/git_core/spaCy/spacy/syntax/stateclass.cpython-35m-x86_64-linux-gnu.so
7f20be3c9000-7f20be3db000 r-xp 00000000 00:2b 15205774                   /home/raphael/git_core/spaCy/spacy/attrs.cpython-35m-x86_64-linux-gnu.so
7f20be3db000-7f20be5da000 ---p 00012000 00:2b 15205774                   /home/raphael/git_core/spaCy/spacy/attrs.cpython-35m-x86_64-linux-gnu.so
7f20be5da000-7f20be5db000 r--p 00011000 00:2b 15205774                   /home/raphael/git_core/spaCy/spacy/attrs.cpython-35m-x86_64-linux-gnu.so
7f20be5db000-7f20be5de000 rw-p 00012000 00:2b 15205774                   /home/raphael/git_core/spaCy/spacy/attrs.cpython-35m-x86_64-linux-gnu.so
7f20be5de000-7f20be61e000 rw-p 00000000 00:00 0 
7f20be61e000-7f20be640000 r-xp 00000000 00:2b 15205824                   /home/raphael/git_core/spaCy/spacy/symbols.cpython-35m-x86_64-linux-gnu.so
7f20be640000-7f20be83f000 ---p 00022000 00:2b 15205824                   /home/raphael/git_core/spaCy/spacy/symbols.cpython-35m-x86_64-linux-gnu.so
7f20be83f000-7f20be840000 r--p 00021000 00:2b 15205824                   /home/raphael/git_core/spaCy/spacy/symbols.cpython-35m-x86_64-linux-gnu.so
7f20be840000-7f20be847000 rw-p 00022000 00:2b 15205824                   /home/raphael/git_core/spaCy/spacy/symbols.cpython-35m-x86_64-linux-gnu.so
7f20be847000-7f20be848000 rw-p 00000000 00:00 0 
7f20be848000-7f20be872000 r-xp 00000000 00:2b 15205814                   /home/raphael/git_core/spaCy/spacy/serialize/huffman.cpython-35m-x86_64-linux-gnu.so
7f20be872000-7f20bea71000 ---p 0002a000 00:2b 15205814                   /home/raphael/git_core/spaCy/spacy/serialize/huffman.cpython-35m-x86_64-linux-gnu.so
7f20bea71000-7f20bea72000 r--p 00029000 00:2b 15205814                   /home/raphael/git_core/spaCy/spacy/serialize/huffman.cpython-35m-x86_64-linux-gnu.so
7f20bea72000-7f20bea75000 rw-p 0002a000 00:2b 15205814                   /home/raphael/git_core/spaCy/spacy/serialize/huffman.cpython-35m-x86_64-linux-gnu.so
7f20bea75000-7f20beaaa000 r-xp 00000000 00:2b 15205812                   /home/raphael/git_core/spaCy/spacy/serialize/packer.cpython-35m-x86_64-linux-gnu.so
7f20beaaa000-7f20beca9000 ---p 00035000 00:2b 15205812                   /home/raphael/git_core/spaCy/spacy/serialize/packer.cpython-35m-x86_64-linux-gnu.so
7f20beca9000-7f20becaa000 r--p 00034000 00:2b 15205812                   /home/raphael/git_core/spaCy/spacy/serialize/packer.cpython-35m-x86_64-linux-gnu.so
7f20becaa000-7f20becae000 rw-p 00035000 00:2b 15205812                   /home/raphael/git_core/spaCy/spacy/serialize/packer.cpython-35m-x86_64-linux-gnu.so
7f20becae000-7f20becaf000 rw-p 00000000 00:00 0 
7f20becaf000-7f20becbf000 r-xp 00000000 00:2b 15205826                   /home/raphael/git_core/spaCy/spacy/syntax/iterators.cpython-35m-x86_64-linux-gnu.so
7f20becbf000-7f20beebe000 ---p 00010000 00:2b 15205826                   /home/raphael/git_core/spaCy/spacy/syntax/iterators.cpython-35m-x86_64-linux-gnu.so
7f20beebe000-7f20beebf000 r--p 0000f000 00:2b 15205826                   /home/raphael/git_core/spaCy/spacy/syntax/iterators.cpython-35m-x86_64-linux-gnu.so
7f20beebf000-7f20beec1000 rw-p 00010000 00:2b 15205826                   /home/raphael/git_core/spaCy/spacy/syntax/iterators.cpython-35m-x86_64-linux-gnu.so
7f20beec1000-7f20beec2000 rw-p 00000000 00:00 0 
7f20beec2000-7f20beece000 r-xp 00000000 00:2b 15205816                   /home/raphael/git_core/spaCy/spacy/serialize/bits.cpython-35m-x86_64-linux-gnu.so
7f20beece000-7f20bf0ce000 ---p 0000c000 00:2b 15205816                   /home/raphael/git_core/spaCy/spacy/serialize/bits.cpython-35m-x86_64-linux-gnu.so
7f20bf0ce000-7f20bf0cf000 r--p 0000c000 00:2b 15205816                   /home/raphael/git_core/spaCy/spacy/serialize/bits.cpython-35m-x86_64-linux-gnu.so
7f20bf0cf000-7f20bf0d0000 rw-p 0000d000 00:2b 15205816                   /home/raphael/git_core/spaCy/spacy/serialize/bits.cpython-35m-x86_64-linux-gnu.so
7f20bf0d0000-7f20bf0d1000 rw-p 00000000 00:00 0 
7f20bf0d1000-7f20bf0d6000 r-xp 00000000 00:2b 15205635                   /home/raphael/git_core/spaCy/spacy/parts_of_speech.cpython-35m-x86_64-linux-gnu.so
7f20bf0d6000-7f20bf2d5000 ---p 00005000 00:2b 15205635                   /home/raphael/git_core/spaCy/spacy/parts_of_speech.cpython-35m-x86_64-linux-gnu.so
7f20bf2d5000-7f20bf2d6000 r--p 00004000 00:2b 15205635                   /home/raphael/git_core/spaCy/spacy/parts_of_speech.cpython-35m-x86_64-linux-gnu.so
7f20bf2d6000-7f20bf2d7000 rw-p 00005000 00:2b 15205635                   /home/raphael/git_core/spaCy/spacy/parts_of_speech.cpython-35m-x86_64-linux-gnu.so
7f20bf2d7000-7f20bf30a000 r-xp 00000000 00:2b 15205809                   /home/raphael/git_core/spaCy/spacy/tokens/token.cpython-35m-x86_64-linux-gnu.so
7f20bf30a000-7f20bf509000 ---p 00033000 00:2b 15205809                   /home/raphael/git_core/spaCy/spacy/tokens/token.cpython-35m-x86_64-linux-gnu.so
7f20bf509000-7f20bf50a000 r--p 00032000 00:2b 15205809                   /home/raphael/git_core/spaCy/spacy/tokens/token.cpython-35m-x86_64-linux-gnu.so
7f20bf50a000-7f20bf510000 rw-p 00033000 00:2b 15205809                   /home/raphael/git_core/spaCy/spacy/tokens/token.cpython-35m-x86_64-linux-gnu.so
7f20bf510000-7f20bf511000 rw-p 00000000 00:00 0 
7f20bf511000-7f20bf52e000 r-xp 00000000 00:2b 15205807                   /home/raphael/git_core/spaCy/spacy/tokens/span.cpython-35m-x86_64-linux-gnu.so
7f20bf52e000-7f20bf72e000 ---p 0001d000 00:2b 15205807                   /home/raphael/git_core/spaCy/spacy/tokens/span.cpython-35m-x86_64-linux-gnu.so
7f20bf72e000-7f20bf72f000 r--p 0001d000 00:2b 15205807                   /home/raphael/git_core/spaCy/spacy/tokens/span.cpython-35m-x86_64-linux-gnu.so
7f20bf72f000-7f20bf733000 rw-p 0001e000 00:2b 15205807                   /home/raphael/git_core/spaCy/spacy/tokens/span.cpython-35m-x86_64-linux-gnu.so
7f20bf733000-7f20bf734000 rw-p 00000000 00:00 0 
7f20bf734000-7f20bf777000 r-xp 00000000 00:2b 15205805                   /home/raphael/git_core/spaCy/spacy/tokens/doc.cpython-35m-x86_64-linux-gnu.so
7f20bf777000-7f20bf976000 ---p 00043000 00:2b 15205805                   /home/raphael/git_core/spaCy/spacy/tokens/doc.cpython-35m-x86_64-linux-gnu.so
7f20bf976000-7f20bf977000 r--p 00042000 00:2b 15205805                   /home/raphael/git_core/spaCy/spacy/tokens/doc.cpython-35m-x86_64-linux-gnu.so
7f20bf977000-7f20bf97f000 rw-p 00043000 00:2b 15205805                   /home/raphael/git_core/spaCy/spacy/tokens/doc.cpython-35m-x86_64-linux-gnu.so
7f20bf97f000-7f20bf980000 rw-p 00000000 00:00 0 
7f20bf980000-7f20bf992000 r-xp 00000000 00:2b 17834161                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/preshed/counter.cpython-35m-x86_64-linux-gnu.so
7f20bf992000-7f20bfb91000 ---p 00012000 00:2b 17834161                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/preshed/counter.cpython-35m-x86_64-linux-gnu.so
7f20bfb91000-7f20bfb92000 r--p 00011000 00:2b 17834161                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/preshed/counter.cpython-35m-x86_64-linux-gnu.so
7f20bfb92000-7f20bfb94000 rw-p 00012000 00:2b 17834161                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/preshed/counter.cpython-35m-x86_64-linux-gnu.so
7f20bfb94000-7f20bfb9d000 r-xp 00000000 00:2b 15205818                   /home/raphael/git_core/spaCy/spacy/cfile.cpython-35m-x86_64-linux-gnu.so
7f20bfb9d000-7f20bfd9c000 ---p 00009000 00:2b 15205818                   /home/raphael/git_core/spaCy/spacy/cfile.cpython-35m-x86_64-linux-gnu.so
7f20bfd9c000-7f20bfd9d000 r--p 00008000 00:2b 15205818                   /home/raphael/git_core/spaCy/spacy/cfile.cpython-35m-x86_64-linux-gnu.so
7f20bfd9d000-7f20bfd9e000 rw-p 00009000 00:2b 15205818                   /home/raphael/git_core/spaCy/spacy/cfile.cpython-35m-x86_64-linux-gnu.so
7f20bfd9e000-7f20bfdaa000 r-xp 00000000 00:2b 15205802                   /home/raphael/git_core/spaCy/spacy/orth.cpython-35m-x86_64-linux-gnu.so
7f20bfdaa000-7f20bffa9000 ---p 0000c000 00:2b 15205802                   /home/raphael/git_core/spaCy/spacy/orth.cpython-35m-x86_64-linux-gnu.so
7f20bffa9000-7f20bffaa000 r--p 0000b000 00:2b 15205802                   /home/raphael/git_core/spaCy/spacy/orth.cpython-35m-x86_64-linux-gnu.so
7f20bffaa000-7f20bffac000 rw-p 0000c000 00:2b 15205802                   /home/raphael/git_core/spaCy/spacy/orth.cpython-35m-x86_64-linux-gnu.so
7f20bffac000-7f20bffd1000 r-xp 00000000 00:2b 15205770                   /home/raphael/git_core/spaCy/spacy/lexeme.cpython-35m-x86_64-linux-gnu.so
7f20bffd1000-7f20c01d1000 ---p 00025000 00:2b 15205770                   /home/raphael/git_core/spaCy/spacy/lexeme.cpython-35m-x86_64-linux-gnu.so
7f20c01d1000-7f20c01d2000 r--p 00025000 00:2b 15205770                   /home/raphael/git_core/spaCy/spacy/lexeme.cpython-35m-x86_64-linux-gnu.so
7f20c01d2000-7f20c01d6000 rw-p 00026000 00:2b 15205770                   /home/raphael/git_core/spaCy/spacy/lexeme.cpython-35m-x86_64-linux-gnu.so
7f20c01d6000-7f20c0256000 rw-p 00000000 00:00 0 
7f20c0256000-7f20c030e000 r-xp 00000000 00:2b 17834113                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/random/mtrand.cpython-35m-x86_64-linux-gnu.so
7f20c030e000-7f20c050d000 ---p 000b8000 00:2b 17834113                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/random/mtrand.cpython-35m-x86_64-linux-gnu.so
7f20c050d000-7f20c0532000 rw-p 000b7000 00:2b 17834113                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/random/mtrand.cpython-35m-x86_64-linux-gnu.so
7f20c0532000-7f20c0574000 rw-p 00000000 00:00 0 
7f20c0574000-7f20c057d000 r-xp 00000000 00:2b 17834094                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/fft/fftpack_lite.cpython-35m-x86_64-linux-gnu.so
7f20c057d000-7f20c077c000 ---p 00009000 00:2b 17834094                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/fft/fftpack_lite.cpython-35m-x86_64-linux-gnu.so
7f20c077c000-7f20c077d000 rw-p 00008000 00:2b 17834094                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/fft/fftpack_lite.cpython-35m-x86_64-linux-gnu.so
7f20c077d000-7f20c07bd000 rw-p 00000000 00:00 0 
7f20c07bd000-7f20c07e6000 r-xp 00000000 00:2b 17833516                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/linalg/_umath_linalg.cpython-35m-x86_64-linux-gnu.so
7f20c07e6000-7f20c09e5000 ---p 00029000 00:2b 17833516                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/linalg/_umath_linalg.cpython-35m-x86_64-linux-gnu.so
7f20c09e5000-7f20c09e7000 rw-p 00028000 00:2b 17833516                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/linalg/_umath_linalg.cpython-35m-x86_64-linux-gnu.so
7f20c09e7000-7f20c09e9000 rw-p 000c3000 00:2b 17833516                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/linalg/_umath_linalg.cpython-35m-x86_64-linux-gnu.so
7f20c09e9000-7f20c49e9000 rw-p 00000000 00:00 0 
7f20c49e9000-7f20c89e9000 rw-p 00000000 00:00 0 
7f20c89e9000-7f20ca9e9000 rw-p 00000000 00:00 0 
7f20ca9e9000-7f20ca9ea000 ---p 00000000 00:00 0 
7f20ca9ea000-7f20cb1ea000 rw-p 00000000 00:00 0 
7f20cb1ea000-7f20cb1eb000 ---p 00000000 00:00 0 
7f20cb1eb000-7f20cb9eb000 rw-p 00000000 00:00 0 
7f20cb9eb000-7f20cb9ec000 ---p 00000000 00:00 0 
7f20cb9ec000-7f20cc1ec000 rw-p 00000000 00:00 0 
7f20cc1ec000-7f20cc1ed000 ---p 00000000 00:00 0 
7f20cc1ed000-7f20cc9ed000 rw-p 00000000 00:00 0 
7f20cc9ed000-7f20ce9ed000 rw-p 00000000 00:00 0 
7f20ce9fa000-7f20cedba000 rw-p 00000000 00:00 0 
7f20cedba000-7f20cedd4000 r-xp 00000000 00:2b 15205822                   /home/raphael/git_core/spaCy/spacy/syntax/ner.cpython-35m-x86_64-linux-gnu.so
7f20cedd4000-7f20cefd3000 ---p 0001a000 00:2b 15205822                   /home/raphael/git_core/spaCy/spacy/syntax/ner.cpython-35m-x86_64-linux-gnu.so
7f20cefd3000-7f20cefd4000 r--p 00019000 00:2b 15205822                   /home/raphael/git_core/spaCy/spacy/syntax/ner.cpython-35m-x86_64-linux-gnu.so
7f20cefd4000-7f20cefd6000 rw-p 0001a000 00:2b 15205822                   /home/raphael/git_core/spaCy/spacy/syntax/ner.cpython-35m-x86_64-linux-gnu.so
7f20cefd6000-7f20cefec000 r-xp 00000000 00:2b 17834558                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/search.cpython-35m-x86_64-linux-gnu.so
7f20cefec000-7f20cf1eb000 ---p 00016000 00:2b 17834558                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/search.cpython-35m-x86_64-linux-gnu.so
7f20cf1eb000-7f20cf1ec000 r--p 00015000 00:2b 17834558                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/search.cpython-35m-x86_64-linux-gnu.so
7f20cf1ec000-7f20cf1ee000 rw-p 00016000 00:2b 17834558                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/search.cpython-35m-x86_64-linux-gnu.so
7f20cf1ee000-7f20d11ee000 rw-p 00000000 00:00 0 
7f20d11f0000-7f20d12f0000 rw-p 00000000 00:00 0 
7f20d12f0000-7f20d130a000 r-xp 00000000 00:2b 15207187                   /home/raphael/git_core/spaCy/spacy/syntax/beam_parser.cpython-35m-x86_64-linux-gnu.so
7f20d130a000-7f20d150a000 ---p 0001a000 00:2b 15207187                   /home/raphael/git_core/spaCy/spacy/syntax/beam_parser.cpython-35m-x86_64-linux-gnu.so
7f20d150a000-7f20d150b000 r--p 0001a000 00:2b 15207187                   /home/raphael/git_core/spaCy/spacy/syntax/beam_parser.cpython-35m-x86_64-linux-gnu.so
7f20d150b000-7f20d150d000 rw-p 0001b000 00:2b 15207187                   /home/raphael/git_core/spaCy/spacy/syntax/beam_parser.cpython-35m-x86_64-linux-gnu.so
7f20d150d000-7f20d151f000 r-xp 00000000 00:2b 15205781                   /home/raphael/git_core/spaCy/spacy/pipeline.cpython-35m-x86_64-linux-gnu.so
7f20d151f000-7f20d171e000 ---p 00012000 00:2b 15205781                   /home/raphael/git_core/spaCy/spacy/pipeline.cpython-35m-x86_64-linux-gnu.so
7f20d171e000-7f20d171f000 r--p 00011000 00:2b 15205781                   /home/raphael/git_core/spaCy/spacy/pipeline.cpython-35m-x86_64-linux-gnu.so
7f20d171f000-7f20d1721000 rw-p 00012000 00:2b 15205781                   /home/raphael/git_core/spaCy/spacy/pipeline.cpython-35m-x86_64-linux-gnu.so
7f20d1721000-7f20d17ee000 r-xp 00000000 00:2b 15205797                   /home/raphael/git_core/spaCy/spacy/syntax/_parse_features.cpython-35m-x86_64-linux-gnu.so
7f20d17ee000-7f20d19ed000 ---p 000cd000 00:2b 15205797                   /home/raphael/git_core/spaCy/spacy/syntax/_parse_features.cpython-35m-x86_64-linux-gnu.so
7f20d19ed000-7f20d19ee000 r--p 000cc000 00:2b 15205797                   /home/raphael/git_core/spaCy/spacy/syntax/_parse_features.cpython-35m-x86_64-linux-gnu.so
7f20d19ee000-7f20d19ef000 rw-p 000cd000 00:2b 15205797                   /home/raphael/git_core/spaCy/spacy/syntax/_parse_features.cpython-35m-x86_64-linux-gnu.so
7f20d19ef000-7f20d3d03000 r-xp 00000000 00:2b 17833878                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/.libs/libopenblasp-r0-39a31c03.2.18.so
7f20d3d03000-7f20d3f02000 ---p 02314000 00:2b 17833878                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/.libs/libopenblasp-r0-39a31c03.2.18.so
7f20d3f02000-7f20d3f21000 rw-p 02313000 00:2b 17833878                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/.libs/libopenblasp-r0-39a31c03.2.18.so
7f20d3f21000-7f20d3f84000 rw-p 00000000 00:00 0 
7f20d3f84000-7f20d4000000 rw-p 02425000 00:2b 17833878                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/.libs/libopenblasp-r0-39a31c03.2.18.soAbandon (core dumped)
(spacy_dev) raphael@raphael-likeabird:~/git_core/spaCy$ nlp
La commande « nlp » est introuvable, vouliez-vous dire :
 La commande « nap » du paquet « nap » (universe)
 La commande « nop » du paquet « graphviz » (main)
 La commande « nqp » du paquet « nqp » (universe)
 La commande « lp » du paquet « cups-client » (main)
 La commande « lp » du paquet « lprng » (universe)
 La commande « nl » du paquet « coreutils » (main)
 La commande « np » du paquet « mosquitto-auth-plugin » (universe)
 La commande « nup » du paquet « dvi2ps » (universe)
 La commande « tlp » du paquet « tlp » (universe)
 La commande « clp » du paquet « coinor-clp » (universe)
nlp : commande introuvable
(spacy_dev) raphael@raphael-likeabird:~/git_core/spaCy$ pip3 install -e .
Obtaining file:///home/raphael/git_core/spaCy
Requirement already satisfied: numpy>=1.7 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from spacy==1.8.1)
Requirement already satisfied: murmurhash<0.27,>=0.26 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from spacy==1.8.1)
Requirement already satisfied: cymem<1.32,>=1.30 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from spacy==1.8.1)
Requirement already satisfied: preshed<2.0.0,>=1.0.0 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from spacy==1.8.1)
Requirement already satisfied: thinc<6.6.0,>=6.5.0 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from spacy==1.8.1)
Requirement already satisfied: plac<1.0.0,>=0.9.6 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from spacy==1.8.1)
Requirement already satisfied: six in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from spacy==1.8.1)
Requirement already satisfied: pathlib in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from spacy==1.8.1)
Requirement already satisfied: ujson>=1.35 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from spacy==1.8.1)
Requirement already satisfied: dill<0.3,>=0.2 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from spacy==1.8.1)
Requirement already satisfied: requests<3.0.0,>=2.13.0 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from spacy==1.8.1)
Requirement already satisfied: regex==2017.4.5 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from spacy==1.8.1)
Requirement already satisfied: ftfy<5.0.0,>=4.4.2 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from spacy==1.8.1)
Requirement already satisfied: cytoolz<0.9,>=0.8 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from thinc<6.6.0,>=6.5.0->spacy==1.8.1)
Requirement already satisfied: wrapt in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from thinc<6.6.0,>=6.5.0->spacy==1.8.1)
Requirement already satisfied: tqdm<5.0.0,>=4.10.0 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from thinc<6.6.0,>=6.5.0->spacy==1.8.1)
Requirement already satisfied: termcolor in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from thinc<6.6.0,>=6.5.0->spacy==1.8.1)
Requirement already satisfied: wcwidth in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from ftfy<5.0.0,>=4.4.2->spacy==1.8.1)
Requirement already satisfied: html5lib in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from ftfy<5.0.0,>=4.4.2->spacy==1.8.1)
Requirement already satisfied: toolz>=0.8.0 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from cytoolz<0.9,>=0.8->thinc<6.6.0,>=6.5.0->spacy==1.8.1)
Requirement already satisfied: setuptools>=18.5 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from html5lib->ftfy<5.0.0,>=4.4.2->spacy==1.8.1)
Requirement already satisfied: webencodings in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from html5lib->ftfy<5.0.0,>=4.4.2->spacy==1.8.1)
Requirement already satisfied: appdirs>=1.4.0 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from setuptools>=18.5->html5lib->ftfy<5.0.0,>=4.4.2->spacy==1.8.1)
Requirement already satisfied: packaging>=16.8 in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from setuptools>=18.5->html5lib->ftfy<5.0.0,>=4.4.2->spacy==1.8.1)
Requirement already satisfied: pyparsing in /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages (from packaging>=16.8->setuptools>=18.5->html5lib->ftfy<5.0.0,>=4.4.2->spacy==1.8.1)
Installing collected packages: spacy
  Found existing installation: spacy 1.8.1
    Uninstalling spacy-1.8.1:
      Successfully uninstalled spacy-1.8.1
  Running setup.py develop for spacy
Successfully installed spacy
(spacy_dev) raphael@raphael-likeabird:~/git_core/spaCy$ ipython3
Python 3.5.2 (default, Nov 17 2016, 17:05:23) 
Type "copyright", "credits" or "license" for more information.

IPython 5.3.0 -- An enhanced Interactive Python.
?         -> Introduction and overview of IPython's features.
%quickref -> Quick reference.
help      -> Python's own help system.
object?   -> Details about 'object', use 'object??' for extra details.

In [1]: import spacy

In [2]: nlp = spacy.load('fr')

In [3]: doc = nlp('\n')
*** Error in `/home/raphael/.virtualenvs/spacy_dev/bin/python3': free(): invalid next size (fast): 0x0000000002d74640 ***
======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(+0x777e5)[0x7f01d3a4f7e5]
/lib/x86_64-linux-gnu/libc.so.6(+0x7fe0a)[0x7f01d3a57e0a]
/lib/x86_64-linux-gnu/libc.so.6(cfree+0x4c)[0x7f01d3a5b98c]
/home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/cymem/cymem.cpython-35m-x86_64-linux-gnu.so(+0x382c)[0x7f01cc36382c]
/home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/eg.cpython-35m-x86_64-linux-gnu.so(+0x4ebf)[0x7f01abaadebf]
/home/raphael/git_core/spaCy/spacy/tagger.cpython-35m-x86_64-linux-gnu.so(+0xd5f6)[0x7f01ac2f95f6]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyObject_Call+0x47)[0x5b7167]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x4f06)[0x528d06]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalCodeEx+0x13b)[0x52e12b]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x4ebd38]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyObject_Call+0x47)[0x5b7167]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x4f413e]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyObject_Call+0x47)[0x5b7167]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x54d4f6]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyObject_Call+0x47)[0x5b7167]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x4f06)[0x528d06]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalCode+0x1f)[0x52dfdf]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x5c7b85]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyCFunction_Call+0x4f)[0x4e9b9f]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x614)[0x524414]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x50ee)[0x528eee]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x50ee)[0x528eee]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d82f]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x50ee)[0x528eee]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x50ee)[0x528eee]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x50ee)[0x528eee]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x4a14)[0x528814]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalCodeEx+0x13b)[0x52e12b]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x4ebdd7]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyObject_Call+0x47)[0x5b7167]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x24af)[0x5262af]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalFrameEx+0x50ee)[0x528eee]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x52d2e3]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyEval_EvalCode+0x1f)[0x52dfdf]
/home/raphael/.virtualenvs/spacy_dev/bin/python3[0x5fd2c2]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyRun_FileExFlags+0x9a)[0x5ff76a]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(PyRun_SimpleFileExFlags+0x1bc)[0x5ff95c]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(Py_Main+0x456)[0x63e7d6]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(main+0xe1)[0x4cfe41]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7f01d39f8830]
/home/raphael/.virtualenvs/spacy_dev/bin/python3(_start+0x29)[0x5d5f29]
======= Memory map: ========
00400000-007a8000 r-xp 00000000 00:2b 17700507                           /home/raphael/.virtualenvs/spacy_dev/bin/python3
009a8000-009aa000 r--p 003a8000 00:2b 17700507                           /home/raphael/.virtualenvs/spacy_dev/bin/python3
009aa000-00a41000 rw-p 003aa000 00:2b 17700507                           /home/raphael/.virtualenvs/spacy_dev/bin/python3
00a41000-00a72000 rw-p 00000000 00:00 0 
0173b000-75601000 rw-p 00000000 00:00 0                                  [heap]
7f017c000000-7f017c021000 rw-p 00000000 00:00 0 
7f017c021000-7f0180000000 ---p 00000000 00:00 0 
7f0182a71000-7f0190a73000 rw-p 00000000 00:00 0 
7f0192bb4000-7f019f1b7000 rw-p 00000000 00:00 0 
7f019f1c4000-7f01a5145000 rw-p 00000000 00:00 0 
7f01a5146000-7f01a6986000 rw-p 00000000 00:00 0 
7f01a6987000-7f01ab249000 rw-p 00000000 00:00 0 
7f01ab249000-7f01ab278000 r-xp 00000000 00:2b 15205820                   /home/raphael/git_core/spaCy/spacy/matcher.cpython-35m-x86_64-linux-gnu.so
7f01ab278000-7f01ab478000 ---p 0002f000 00:2b 15205820                   /home/raphael/git_core/spaCy/spacy/matcher.cpython-35m-x86_64-linux-gnu.so
7f01ab478000-7f01ab479000 r--p 0002f000 00:2b 15205820                   /home/raphael/git_core/spaCy/spacy/matcher.cpython-35m-x86_64-linux-gnu.so
7f01ab479000-7f01ab47e000 rw-p 00030000 00:2b 15205820                   /home/raphael/git_core/spaCy/spacy/matcher.cpython-35m-x86_64-linux-gnu.so
7f01ab47e000-7f01ab489000 r-xp 00000000 00:2b 17834655                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/serialize.cpython-35m-x86_64-linux-gnu.so
7f01ab489000-7f01ab688000 ---p 0000b000 00:2b 17834655                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/serialize.cpython-35m-x86_64-linux-gnu.so
7f01ab688000-7f01ab689000 r--p 0000a000 00:2b 17834655                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/serialize.cpython-35m-x86_64-linux-gnu.so
7f01ab689000-7f01ab68a000 rw-p 0000b000 00:2b 17834655                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/serialize.cpython-35m-x86_64-linux-gnu.so
7f01ab68a000-7f01ab699000 r-xp 00000000 00:2b 17834549                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/mb.cpython-35m-x86_64-linux-gnu.so
7f01ab699000-7f01ab898000 ---p 0000f000 00:2b 17834549                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/mb.cpython-35m-x86_64-linux-gnu.so
7f01ab898000-7f01ab899000 r--p 0000e000 00:2b 17834549                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/mb.cpython-35m-x86_64-linux-gnu.so
7f01ab899000-7f01ab89a000 rw-p 0000f000 00:2b 17834549                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/mb.cpython-35m-x86_64-linux-gnu.so
7f01ab89a000-7f01ab89b000 rw-p 00000000 00:00 0 
7f01ab89b000-7f01ab8a7000 r-xp 00000000 00:2b 17834649                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/sparse.cpython-35m-x86_64-linux-gnu.so
7f01ab8a7000-7f01abaa6000 ---p 0000c000 00:2b 17834649                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/sparse.cpython-35m-x86_64-linux-gnu.so
7f01abaa6000-7f01abaa7000 r--p 0000b000 00:2b 17834649                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/sparse.cpython-35m-x86_64-linux-gnu.so
7f01abaa7000-7f01abaa8000 rw-p 0000c000 00:2b 17834649                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/sparse.cpython-35m-x86_64-linux-gnu.so
7f01abaa8000-7f01abaa9000 rw-p 00000000 00:00 0 
7f01abaa9000-7f01ababe000 r-xp 00000000 00:2b 17834555                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/eg.cpython-35m-x86_64-linux-gnu.so
7f01ababe000-7f01abcbd000 ---p 00015000 00:2b 17834555                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/eg.cpython-35m-x86_64-linux-gnu.so
7f01abcbd000-7f01abcbe000 r--p 00014000 00:2b 17834555                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/eg.cpython-35m-x86_64-linux-gnu.so
7f01abcbe000-7f01abcc0000 rw-p 00015000 00:2b 17834555                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/eg.cpython-35m-x86_64-linux-gnu.so
7f01abcc0000-7f01abcca000 r-xp 00000000 00:2b 17834645                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/features.cpython-35m-x86_64-linux-gnu.so
7f01abcca000-7f01abec9000 ---p 0000a000 00:2b 17834645                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/features.cpython-35m-x86_64-linux-gnu.so
7f01abec9000-7f01abeca000 r--p 00009000 00:2b 17834645                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/features.cpython-35m-x86_64-linux-gnu.so
7f01abeca000-7f01abecb000 rw-p 0000a000 00:2b 17834645                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/features.cpython-35m-x86_64-linux-gnu.so
7f01abecb000-7f01abed1000 r-xp 00000000 00:2b 17834476                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linalg.cpython-35m-x86_64-linux-gnu.so
7f01abed1000-7f01ac0d1000 ---p 00006000 00:2b 17834476                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linalg.cpython-35m-x86_64-linux-gnu.so
7f01ac0d1000-7f01ac0d2000 r--p 00006000 00:2b 17834476                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linalg.cpython-35m-x86_64-linux-gnu.so
7f01ac0d2000-7f01ac0d3000 rw-p 00007000 00:2b 17834476                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linalg.cpython-35m-x86_64-linux-gnu.so
7f01ac0d3000-7f01ac0ea000 r-xp 00000000 00:2b 17834657                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/avgtron.cpython-35m-x86_64-linux-gnu.so
7f01ac0ea000-7f01ac2e9000 ---p 00017000 00:2b 17834657                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/avgtron.cpython-35m-x86_64-linux-gnu.so
7f01ac2e9000-7f01ac2ea000 r--p 00016000 00:2b 17834657                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/avgtron.cpython-35m-x86_64-linux-gnu.so
7f01ac2ea000-7f01ac2ec000 rw-p 00017000 00:2b 17834657                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/linear/avgtron.cpython-35m-x86_64-linux-gnu.so
7f01ac2ec000-7f01ac313000 r-xp 00000000 00:2b 15205779                   /home/raphael/git_core/spaCy/spacy/tagger.cpython-35m-x86_64-linux-gnu.so
7f01ac313000-7f01ac512000 ---p 00027000 00:2b 15205779                   /home/raphael/git_core/spaCy/spacy/tagger.cpython-35m-x86_64-linux-gnu.so
7f01ac512000-7f01ac513000 r--p 00026000 00:2b 15205779                   /home/raphael/git_core/spaCy/spacy/tagger.cpython-35m-x86_64-linux-gnu.so
7f01ac513000-7f01ac516000 rw-p 00027000 00:2b 15205779                   /home/raphael/git_core/spaCy/spacy/tagger.cpython-35m-x86_64-linux-gnu.so
7f01ac516000-7f01ac532000 r-xp 00000000 00:2b 15205788                   /home/raphael/git_core/spaCy/spacy/tokenizer.cpython-35m-x86_64-linux-gnu.so
7f01ac532000-7f01ac731000 ---p 0001c000 00:2b 15205788                   /home/raphael/git_core/spaCy/spacy/tokenizer.cpython-35m-x86_64-linux-gnu.so
7f01ac731000-7f01ac732000 r--p 0001b000 00:2b 15205788                   /home/raphael/git_core/spaCy/spacy/tokenizer.cpython-35m-x86_64-linux-gnu.so
7f01ac732000-7f01ac735000 rw-p 0001c000 00:2b 15205788                   /home/raphael/git_core/spaCy/spacy/tokenizer.cpython-35m-x86_64-linux-gnu.so
7f01ac735000-7f01ac736000 rw-p 00000000 00:00 0 
7f01ac736000-7f01ac758000 r-xp 00000000 00:2b 15205792                   /home/raphael/git_core/spaCy/spacy/syntax/nonproj.cpython-35m-x86_64-linux-gnu.so
7f01ac758000-7f01ac957000 ---p 00022000 00:2b 15205792                   /home/raphael/git_core/spaCy/spacy/syntax/nonproj.cpython-35m-x86_64-linux-gnu.so
7f01ac957000-7f01ac958000 r--p 00021000 00:2b 15205792                   /home/raphael/git_core/spaCy/spacy/syntax/nonproj.cpython-35m-x86_64-linux-gnu.so
7f01ac958000-7f01ac95b000 rw-p 00022000 00:2b 15205792                   /home/raphael/git_core/spaCy/spacy/syntax/nonproj.cpython-35m-x86_64-linux-gnu.so
7f01ac95b000-7f01ac95c000 rw-p 00000000 00:00 0 
7f01ac95c000-7f01ac96d000 r-xp 00000000 00:2b 15205794                   /home/raphael/git_core/spaCy/spacy/syntax/transition_system.cpython-35m-x86_64-linux-gnu.so
7f01ac96d000-7f01acb6d000 ---p 00011000 00:2b 15205794                   /home/raphael/git_core/spaCy/spacy/syntax/transition_system.cpython-35m-x86_64-linux-gnu.so
7f01acb6d000-7f01acb6e000 r--p 00011000 00:2b 15205794                   /home/raphael/git_core/spaCy/spacy/syntax/transition_system.cpython-35m-x86_64-linux-gnu.so
7f01acb6e000-7f01acb6f000 rw-p 00012000 00:2b 15205794                   /home/raphael/git_core/spaCy/spacy/syntax/transition_system.cpython-35m-x86_64-linux-gnu.so
7f01acb6f000-7f01acb70000 rw-p 00000000 00:00 0 
7f01acb70000-7f01acb7e000 r-xp 00000000 00:2b 15205784                   /home/raphael/git_core/spaCy/spacy/syntax/stateclass.cpython-35m-x86_64-linux-gnu.so
7f01acb7e000-7f01acd7d000 ---p 0000e000 00:2b 15205784                   /home/raphael/git_core/spaCy/spacy/syntax/stateclass.cpython-35m-x86_64-linux-gnu.so
7f01acd7d000-7f01acd7e000 r--p 0000d000 00:2b 15205784                   /home/raphael/git_core/spaCy/spacy/syntax/stateclass.cpython-35m-x86_64-linux-gnu.so
7f01acd7e000-7f01acd7f000 rw-p 0000e000 00:2b 15205784                   /home/raphael/git_core/spaCy/spacy/syntax/stateclass.cpython-35m-x86_64-linux-gnu.so
7f01acd7f000-7f01acd91000 r-xp 00000000 00:2b 15205774                   /home/raphael/git_core/spaCy/spacy/attrs.cpython-35m-x86_64-linux-gnu.so
7f01acd91000-7f01acf90000 ---p 00012000 00:2b 15205774                   /home/raphael/git_core/spaCy/spacy/attrs.cpython-35m-x86_64-linux-gnu.so
7f01acf90000-7f01acf91000 r--p 00011000 00:2b 15205774                   /home/raphael/git_core/spaCy/spacy/attrs.cpython-35m-x86_64-linux-gnu.so
7f01acf91000-7f01acf94000 rw-p 00012000 00:2b 15205774                   /home/raphael/git_core/spaCy/spacy/attrs.cpython-35m-x86_64-linux-gnu.so
7f01acf94000-7f01acfb6000 r-xp 00000000 00:2b 15205824                   /home/raphael/git_core/spaCy/spacy/symbols.cpython-35m-x86_64-linux-gnu.so
7f01acfb6000-7f01ad1b5000 ---p 00022000 00:2b 15205824                   /home/raphael/git_core/spaCy/spacy/symbols.cpython-35m-x86_64-linux-gnu.so
7f01ad1b5000-7f01ad1b6000 r--p 00021000 00:2b 15205824                   /home/raphael/git_core/spaCy/spacy/symbols.cpython-35m-x86_64-linux-gnu.so
7f01ad1b6000-7f01ad1bd000 rw-p 00022000 00:2b 15205824                   /home/raphael/git_core/spaCy/spacy/symbols.cpython-35m-x86_64-linux-gnu.so
7f01ad1bd000-7f01ad1be000 rw-p 00000000 00:00 0 
7f01ad1be000-7f01ad1e8000 r-xp 00000000 00:2b 15205814                   /home/raphael/git_core/spaCy/spacy/serialize/huffman.cpython-35m-x86_64-linux-gnu.so
7f01ad1e8000-7f01ad3e7000 ---p 0002a000 00:2b 15205814                   /home/raphael/git_core/spaCy/spacy/serialize/huffman.cpython-35m-x86_64-linux-gnu.so
7f01ad3e7000-7f01ad3e8000 r--p 00029000 00:2b 15205814                   /home/raphael/git_core/spaCy/spacy/serialize/huffman.cpython-35m-x86_64-linux-gnu.so
7f01ad3e8000-7f01ad3eb000 rw-p 0002a000 00:2b 15205814                   /home/raphael/git_core/spaCy/spacy/serialize/huffman.cpython-35m-x86_64-linux-gnu.so
7f01ad3eb000-7f01ad420000 r-xp 00000000 00:2b 15205812                   /home/raphael/git_core/spaCy/spacy/serialize/packer.cpython-35m-x86_64-linux-gnu.so
7f01ad420000-7f01ad61f000 ---p 00035000 00:2b 15205812                   /home/raphael/git_core/spaCy/spacy/serialize/packer.cpython-35m-x86_64-linux-gnu.so
7f01ad61f000-7f01ad620000 r--p 00034000 00:2b 15205812                   /home/raphael/git_core/spaCy/spacy/serialize/packer.cpython-35m-x86_64-linux-gnu.so
7f01ad620000-7f01ad624000 rw-p 00035000 00:2b 15205812                   /home/raphael/git_core/spaCy/spacy/serialize/packer.cpython-35m-x86_64-linux-gnu.so
7f01ad624000-7f01ad625000 rw-p 00000000 00:00 0 
7f01ad625000-7f01ad635000 r-xp 00000000 00:2b 15205826                   /home/raphael/git_core/spaCy/spacy/syntax/iterators.cpython-35m-x86_64-linux-gnu.so
7f01ad635000-7f01ad834000 ---p 00010000 00:2b 15205826                   /home/raphael/git_core/spaCy/spacy/syntax/iterators.cpython-35m-x86_64-linux-gnu.so
7f01ad834000-7f01ad835000 r--p 0000f000 00:2b 15205826                   /home/raphael/git_core/spaCy/spacy/syntax/iterators.cpython-35m-x86_64-linux-gnu.so
7f01ad835000-7f01ad837000 rw-p 00010000 00:2b 15205826                   /home/raphael/git_core/spaCy/spacy/syntax/iterators.cpython-35m-x86_64-linux-gnu.so
7f01ad837000-7f01ad838000 rw-p 00000000 00:00 0 
7f01ad838000-7f01ad844000 r-xp 00000000 00:2b 15205816                   /home/raphael/git_core/spaCy/spacy/serialize/bits.cpython-35m-x86_64-linux-gnu.so
7f01ad844000-7f01ada44000 ---p 0000c000 00:2b 15205816                   /home/raphael/git_core/spaCy/spacy/serialize/bits.cpython-35m-x86_64-linux-gnu.so
7f01ada44000-7f01ada45000 r--p 0000c000 00:2b 15205816                   /home/raphael/git_core/spaCy/spacy/serialize/bits.cpython-35m-x86_64-linux-gnu.so
7f01ada45000-7f01ada46000 rw-p 0000d000 00:2b 15205816                   /home/raphael/git_core/spaCy/spacy/serialize/bits.cpython-35m-x86_64-linux-gnu.so
7f01ada46000-7f01ada47000 rw-p 00000000 00:00 0 
7f01ada47000-7f01ada4c000 r-xp 00000000 00:2b 15205635                   /home/raphael/git_core/spaCy/spacy/parts_of_speech.cpython-35m-x86_64-linux-gnu.so
7f01ada4c000-7f01adc4b000 ---p 00005000 00:2b 15205635                   /home/raphael/git_core/spaCy/spacy/parts_of_speech.cpython-35m-x86_64-linux-gnu.so
7f01adc4b000-7f01adc4c000 r--p 00004000 00:2b 15205635                   /home/raphael/git_core/spaCy/spacy/parts_of_speech.cpython-35m-x86_64-linux-gnu.so
7f01adc4c000-7f01adc4d000 rw-p 00005000 00:2b 15205635                   /home/raphael/git_core/spaCy/spacy/parts_of_speech.cpython-35m-x86_64-linux-gnu.so
7f01adc4d000-7f01adc80000 r-xp 00000000 00:2b 15205809                   /home/raphael/git_core/spaCy/spacy/tokens/token.cpython-35m-x86_64-linux-gnu.so
7f01adc80000-7f01ade7f000 ---p 00033000 00:2b 15205809                   /home/raphael/git_core/spaCy/spacy/tokens/token.cpython-35m-x86_64-linux-gnu.so
7f01ade7f000-7f01ade80000 r--p 00032000 00:2b 15205809                   /home/raphael/git_core/spaCy/spacy/tokens/token.cpython-35m-x86_64-linux-gnu.so
7f01ade80000-7f01ade86000 rw-p 00033000 00:2b 15205809                   /home/raphael/git_core/spaCy/spacy/tokens/token.cpython-35m-x86_64-linux-gnu.so
7f01ade86000-7f01ade87000 rw-p 00000000 00:00 0 
7f01ade87000-7f01adea4000 r-xp 00000000 00:2b 15205807                   /home/raphael/git_core/spaCy/spacy/tokens/span.cpython-35m-x86_64-linux-gnu.so
7f01adea4000-7f01ae0a4000 ---p 0001d000 00:2b 15205807                   /home/raphael/git_core/spaCy/spacy/tokens/span.cpython-35m-x86_64-linux-gnu.so
7f01ae0a4000-7f01ae0a5000 r--p 0001d000 00:2b 15205807                   /home/raphael/git_core/spaCy/spacy/tokens/span.cpython-35m-x86_64-linux-gnu.so
7f01ae0a5000-7f01ae0a9000 rw-p 0001e000 00:2b 15205807                   /home/raphael/git_core/spaCy/spacy/tokens/span.cpython-35m-x86_64-linux-gnu.so
7f01ae0a9000-7f01ae0aa000 rw-p 00000000 00:00 0 
7f01ae0aa000-7f01ae0ed000 r-xp 00000000 00:2b 15205805                   /home/raphael/git_core/spaCy/spacy/tokens/doc.cpython-35m-x86_64-linux-gnu.so
7f01ae0ed000-7f01ae2ec000 ---p 00043000 00:2b 15205805                   /home/raphael/git_core/spaCy/spacy/tokens/doc.cpython-35m-x86_64-linux-gnu.so
7f01ae2ec000-7f01ae2ed000 r--p 00042000 00:2b 15205805                   /home/raphael/git_core/spaCy/spacy/tokens/doc.cpython-35m-x86_64-linux-gnu.so
7f01ae2ed000-7f01ae2f5000 rw-p 00043000 00:2b 15205805                   /home/raphael/git_core/spaCy/spacy/tokens/doc.cpython-35m-x86_64-linux-gnu.so
7f01ae2f5000-7f01ae2f6000 rw-p 00000000 00:00 0 
7f01ae2f6000-7f01ae308000 r-xp 00000000 00:2b 17834161                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/preshed/counter.cpython-35m-x86_64-linux-gnu.so
7f01ae308000-7f01ae507000 ---p 00012000 00:2b 17834161                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/preshed/counter.cpython-35m-x86_64-linux-gnu.so
7f01ae507000-7f01ae508000 r--p 00011000 00:2b 17834161                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/preshed/counter.cpython-35m-x86_64-linux-gnu.so
7f01ae508000-7f01ae50a000 rw-p 00012000 00:2b 17834161                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/preshed/counter.cpython-35m-x86_64-linux-gnu.so
7f01ae50a000-7f01ae513000 r-xp 00000000 00:2b 15205818                   /home/raphael/git_core/spaCy/spacy/cfile.cpython-35m-x86_64-linux-gnu.so
7f01ae513000-7f01ae712000 ---p 00009000 00:2b 15205818                   /home/raphael/git_core/spaCy/spacy/cfile.cpython-35m-x86_64-linux-gnu.so
7f01ae712000-7f01ae713000 r--p 00008000 00:2b 15205818                   /home/raphael/git_core/spaCy/spacy/cfile.cpython-35m-x86_64-linux-gnu.so
7f01ae713000-7f01ae714000 rw-p 00009000 00:2b 15205818                   /home/raphael/git_core/spaCy/spacy/cfile.cpython-35m-x86_64-linux-gnu.so
7f01ae714000-7f01ae720000 r-xp 00000000 00:2b 15205802                   /home/raphael/git_core/spaCy/spacy/orth.cpython-35m-x86_64-linux-gnu.so
7f01ae720000-7f01ae91f000 ---p 0000c000 00:2b 15205802                   /home/raphael/git_core/spaCy/spacy/orth.cpython-35m-x86_64-linux-gnu.so
7f01ae91f000-7f01ae920000 r--p 0000b000 00:2b 15205802                   /home/raphael/git_core/spaCy/spacy/orth.cpython-35m-x86_64-linux-gnu.so
7f01ae920000-7f01ae922000 rw-p 0000c000 00:2b 15205802                   /home/raphael/git_core/spaCy/spacy/orth.cpython-35m-x86_64-linux-gnu.so
7f01ae922000-7f01ae947000 r-xp 00000000 00:2b 15205770                   /home/raphael/git_core/spaCy/spacy/lexeme.cpython-35m-x86_64-linux-gnu.so
7f01ae947000-7f01aeb47000 ---p 00025000 00:2b 15205770                   /home/raphael/git_core/spaCy/spacy/lexeme.cpython-35m-x86_64-linux-gnu.so
7f01aeb47000-7f01aeb48000 r--p 00025000 00:2b 15205770                   /home/raphael/git_core/spaCy/spacy/lexeme.cpython-35m-x86_64-linux-gnu.so
7f01aeb48000-7f01aeb4c000 rw-p 00026000 00:2b 15205770                   /home/raphael/git_core/spaCy/spacy/lexeme.cpython-35m-x86_64-linux-gnu.so
7f01aeb4c000-7f01aec04000 r-xp 00000000 00:2b 17834113                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/random/mtrand.cpython-35m-x86_64-linux-gnu.so
7f01aec04000-7f01aee03000 ---p 000b8000 00:2b 17834113                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/random/mtrand.cpython-35m-x86_64-linux-gnu.so
7f01aee03000-7f01aee28000 rw-p 000b7000 00:2b 17834113                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/random/mtrand.cpython-35m-x86_64-linux-gnu.so
7f01aee28000-7f01aee2a000 rw-p 00000000 00:00 0 
7f01aee2a000-7f01aee33000 r-xp 00000000 00:2b 17834094                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/fft/fftpack_lite.cpython-35m-x86_64-linux-gnu.so
7f01aee33000-7f01af032000 ---p 00009000 00:2b 17834094                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/fft/fftpack_lite.cpython-35m-x86_64-linux-gnu.so
7f01af032000-7f01af033000 rw-p 00008000 00:2b 17834094                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/fft/fftpack_lite.cpython-35m-x86_64-linux-gnu.so
7f01af033000-7f01af05c000 r-xp 00000000 00:2b 17833516                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/linalg/_umath_linalg.cpython-35m-x86_64-linux-gnu.so
7f01af05c000-7f01af25b000 ---p 00029000 00:2b 17833516                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/linalg/_umath_linalg.cpython-35m-x86_64-linux-gnu.so
7f01af25b000-7f01af25d000 rw-p 00028000 00:2b 17833516                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/linalg/_umath_linalg.cpython-35m-x86_64-linux-gnu.so
7f01af25d000-7f01af25f000 rw-p 000c3000 00:2b 17833516                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/linalg/_umath_linalg.cpython-35m-x86_64-linux-gnu.so
7f01af25f000-7f01af263000 r-xp 00000000 00:2b 17833513                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/linalg/lapack_lite.cpython-35m-x86_64-linux-gnu.so
7f01af263000-7f01af463000 ---p 00004000 00:2b 17833513                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/linalg/lapack_lite.cpython-35m-x86_64-linux-gnu.so
7f01af463000-7f01af464000 rw-p 00004000 00:2b 17833513                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/linalg/lapack_lite.cpython-35m-x86_64-linux-gnu.so
7f01af464000-7f01af466000 rw-p 00019000 00:2b 17833513                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/linalg/lapack_lite.cpython-35m-x86_64-linux-gnu.so
7f01af466000-7f01b1466000 rw-p 00000000 00:00 0 
7f01b1466000-7f01b5466000 rw-p 00000000 00:00 0 
7f01b5466000-7f01b9466000 rw-p 00000000 00:00 0 
7f01b9466000-7f01b95f4000 r-xp 00000000 00:2b 17833694                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/core/umath.cpython-35m-x86_64-linux-gnu.so
7f01b95f4000-7f01b97f3000 ---p 0018e000 00:2b 17833694                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/core/umath.cpython-35m-x86_64-linux-gnu.so
7f01b97f3000-7f01b97f9000 rw-p 0018d000 00:2b 17833694                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/core/umath.cpython-35m-x86_64-linux-gnu.so
7f01b97f9000-7f01b97fb000 rw-p 00000000 00:00 0 
7f01b97fb000-7f01b97fc000 ---p 00000000 00:00 0 
7f01b97fc000-7f01b9ffc000 rw-p 00000000 00:00 0 
7f01b9ffc000-7f01b9ffd000 ---p 00000000 00:00 0 
7f01b9ffd000-7f01ba7fd000 rw-p 00000000 00:00 0 
7f01ba7fd000-7f01ba7fe000 ---p 00000000 00:00 0 
7f01ba7fe000-7f01baffe000 rw-p 00000000 00:00 0 
7f01baffe000-7f01beffe000 rw-p 00000000 00:00 0 
7f01beffe000-7f01befff000 ---p 00000000 00:00 0 
7f01befff000-7f01bf7ff000 rw-p 00000000 00:00 0 
7f01bf80c000-7f01bfbcc000 rw-p 00000000 00:00 0 
7f01bfbcc000-7f01bfbe6000 r-xp 00000000 00:2b 15205822                   /home/raphael/git_core/spaCy/spacy/syntax/ner.cpython-35m-x86_64-linux-gnu.so
7f01bfbe6000-7f01bfde5000 ---p 0001a000 00:2b 15205822                   /home/raphael/git_core/spaCy/spacy/syntax/ner.cpython-35m-x86_64-linux-gnu.so
7f01bfde5000-7f01bfde6000 r--p 00019000 00:2b 15205822                   /home/raphael/git_core/spaCy/spacy/syntax/ner.cpython-35m-x86_64-linux-gnu.so
7f01bfde6000-7f01bfde8000 rw-p 0001a000 00:2b 15205822                   /home/raphael/git_core/spaCy/spacy/syntax/ner.cpython-35m-x86_64-linux-gnu.so
7f01bfde8000-7f01bfdfe000 r-xp 00000000 00:2b 17834558                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/search.cpython-35m-x86_64-linux-gnu.so
7f01bfdfe000-7f01bfffd000 ---p 00016000 00:2b 17834558                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/search.cpython-35m-x86_64-linux-gnu.so
7f01bfffd000-7f01bfffe000 r--p 00015000 00:2b 17834558                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/search.cpython-35m-x86_64-linux-gnu.so
7f01bfffe000-7f01c0000000 rw-p 00016000 00:2b 17834558                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/thinc/extra/search.cpython-35m-x86_64-linux-gnu.so
7f01c0000000-7f01c0021000 rw-p 00000000 00:00 0 
7f01c0021000-7f01c4000000 ---p 00000000 00:00 0 
7f01c4020000-7f01c4220000 rw-p 00000000 00:00 0 
7f01c4222000-7f01c4322000 rw-p 00000000 00:00 0 
7f01c4322000-7f01c433c000 r-xp 00000000 00:2b 15207187                   /home/raphael/git_core/spaCy/spacy/syntax/beam_parser.cpython-35m-x86_64-linux-gnu.so
7f01c433c000-7f01c453c000 ---p 0001a000 00:2b 15207187                   /home/raphael/git_core/spaCy/spacy/syntax/beam_parser.cpython-35m-x86_64-linux-gnu.so
7f01c453c000-7f01c453d000 r--p 0001a000 00:2b 15207187                   /home/raphael/git_core/spaCy/spacy/syntax/beam_parser.cpython-35m-x86_64-linux-gnu.so
7f01c453d000-7f01c453f000 rw-p 0001b000 00:2b 15207187                   /home/raphael/git_core/spaCy/spacy/syntax/beam_parser.cpython-35m-x86_64-linux-gnu.so
7f01c453f000-7f01c4551000 r-xp 00000000 00:2b 15205781                   /home/raphael/git_core/spaCy/spacy/pipeline.cpython-35m-x86_64-linux-gnu.so
7f01c4551000-7f01c4750000 ---p 00012000 00:2b 15205781                   /home/raphael/git_core/spaCy/spacy/pipeline.cpython-35m-x86_64-linux-gnu.so
7f01c4750000-7f01c4751000 r--p 00011000 00:2b 15205781                   /home/raphael/git_core/spaCy/spacy/pipeline.cpython-35m-x86_64-linux-gnu.so
7f01c4751000-7f01c4753000 rw-p 00012000 00:2b 15205781                   /home/raphael/git_core/spaCy/spacy/pipeline.cpython-35m-x86_64-linux-gnu.so
7f01c4753000-7f01c4820000 r-xp 00000000 00:2b 15205797                   /home/raphael/git_core/spaCy/spacy/syntax/_parse_features.cpython-35m-x86_64-linux-gnu.so
7f01c4820000-7f01c4a1f000 ---p 000cd000 00:2b 15205797                   /home/raphael/git_core/spaCy/spacy/syntax/_parse_features.cpython-35m-x86_64-linux-gnu.so
7f01c4a1f000-7f01c4a20000 r--p 000cc000 00:2b 15205797                   /home/raphael/git_core/spaCy/spacy/syntax/_parse_features.cpython-35m-x86_64-linux-gnu.so
7f01c4a20000-7f01c4a21000 rw-p 000cd000 00:2b 15205797                   /home/raphael/git_core/spaCy/spacy/syntax/_parse_features.cpython-35m-x86_64-linux-gnu.so
7f01c4a21000-7f01c4b11000 r-xp 00000000 00:2b 17833879                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/.libs/libgfortran-ed201abd.so.3.0.0
7f01c4b11000-7f01c4d10000 ---p 000f0000 00:2b 17833879                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/.libs/libgfortran-ed201abd.so.3.0.0
7f01c4d10000-7f01c4d12000 rw-p 000ef000 00:2b 17833879                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/.libs/libgfortran-ed201abd.so.3.0.0
7f01c4d12000-7f01c4d13000 rw-p 00000000 00:00 0 
7f01c4d13000-7f01c4d1a000 rw-p 000f2000 00:2b 17833879                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/.libs/libgfortran-ed201abd.so.3.0.0
7f01c4d1a000-7f01c702e000 r-xp 00000000 00:2b 17833878                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/.libs/libopenblasp-r0-39a31c03.2.18.so
7f01c702e000-7f01c722d000 ---p 02314000 00:2b 17833878                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/.libs/libopenblasp-r0-39a31c03.2.18.so
7f01c722d000-7f01c724c000 rw-p 02313000 00:2b 17833878                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/.libs/libopenblasp-r0-39a31c03.2.18.so
7f01c724c000-7f01c72af000 rw-p 00000000 00:00 0 
7f01c72af000-7f01c732b000 rw-p 02425000 00:2b 17833878                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/.libs/libopenblasp-r0-39a31c03.2.18.so
7f01c732b000-7f01c74f9000 r-xp 00000000 00:2b 17833681                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/core/multiarray.cpython-35m-x86_64-linux-gnu.so
7f01c74f9000-7f01c76f9000 ---p 001ce000 00:2b 17833681                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/core/multiarray.cpython-35m-x86_64-linux-gnu.so
7f01c76f9000-7f01c7708000 rw-p 001ce000 00:2b 17833681                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/core/multiarray.cpython-35m-x86_64-linux-gnu.so
7f01c7708000-7f01c771a000 rw-p 00000000 00:00 0 
7f01c771a000-7f01c7720000 rw-p 0097f000 00:2b 17833681                   /home/raphael/.virtualenvs/spacy_dev/lib/python3.5/site-packages/numpy/core/multiarray.cpython-35m-x86_64-linux-gnu.soAbandon (core dumped)

Your Environment

  • Operating System: linux
  • Python Version Used: 3.5
  • spaCy Version Used: HEAD
  • Environment Information:
@ines ines added bug Bugs and behaviour differing from documentation lang / fr French language data and models models Issues related to the statistical models labels May 12, 2017
@v3t3a
Copy link

v3t3a commented May 17, 2017

Thanks @raphael0202 for debug.
Just to confirm that adding :

TAG_MAP = {
    "SP": {POS: SPACE},
}

in following file :

/spacy/language_data/tag_map.py

solve the problem.

Again, thanks for spacy's contributors 👍

@tmbo tmbo mentioned this issue May 24, 2017
Closed
@oroszgy
Copy link
Contributor

oroszgy commented Jun 11, 2017

Trained a Hungarian PoS model and run into the same problem.

@twielfaert twielfaert mentioned this issue Jun 15, 2017
Closed
@oliverdain
Copy link

Having the same issue with the Spanish model:

def test_spacy():
    nlp = spacy.load('es_core_web_md')
    doc = nlp("""Hay alguno cosas que me hacemos una persona la única. La
              primera característica es que soy muy talentoso en los idiomas
              extraños.  Para mí, aprender un idioma extranjera no es un tarea
              muy difícil. La otra característica que me único hace es que sea
              muy resuelto. Cuando yo era niño, y jugaba deportes, detestaba
              perder un juego. Al final, soy un hombre que tiene talentas en
              los idiomas extrajeros, y es muy resuelto.""")
    assert doc.is_parsed

results in:

build/virtualenv/lib/python3.5/site-packages/spacy/language.py:320: in __call__
    proc(doc)
spacy/tagger.pyx:212: in spacy.tagger.Tagger.__call__ (spacy/tagger.cpp:6245)
    ???
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

>   ???
E   KeyError: 690

spacy/morphology.pyx:76: KeyError

@oliverdain oliverdain mentioned this issue Jun 26, 2017
Closed
@FelixLC FelixLC mentioned this issue Jul 6, 2017
Closed
@christofs
Copy link

christofs commented Jul 15, 2017 •
edited
Loading

I can confirm the KeyError originally reported in this issue. Looks like it is still around.

In my experience, the error seems to appear whenever the model encounters a linebreak ("\n"). If I feed a simple string, all works fine. If my string includes a linebreak ("\n"), the KeyErrror appears. Similarly, if I load some text from a file and that file has linebreaks in it, the KeyError appears. If I split the text loaded from the file in lines on the linebreak ("\n") and parse each line separatedly, there is no error.

I assume I'm using version 1.8.2 of spacy (there doesn't seem to be a __version__ attribute so I'm not sure) on Ubuntu 17.04 and using files in UTF-8 with Linux-style linebreaks.

Traceback (most recent call last):
  File "myspacy.py", line 96, in <module>
    run_spacy(textfolder, language, outfolder)
  File "myspacy.py", line 91, in run_spacy
    annotated = annotate_text(text, annotator)
  File "myspacy.py", line 48, in annotate_text
    annotated = annotator(text)
  File "/usr/local/lib/python3.5/dist-packages/spacy/language.py", line 329, in __call__
    proc(doc)
  File "spacy/tagger.pyx", line 212, in spacy.tagger.Tagger.__call__ (spacy/tagger.cpp:6245)
  File "spacy/morphology.pyx", line 76, in spacy.morphology.Morphology.assign_tag_id (spacy/morphology.cpp:4681)
KeyError: 139255

honnibal added a commit that referenced this issue Jul 22, 2017
@honnibal
Add missing SP symbol to tag map, re #1052
8b9c4c5
@anna-hope anna-hope mentioned this issue Aug 16, 2017
Closed
@pocman
Copy link

pocman commented Sep 11, 2017

I ran into this issue using Rasa NLU, parsing the following string t +3 with French model.

Unhandled Error
	Traceback (most recent call last):
	  File "/usr/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 500, in errback
	    self._startRunCallbacks(fail)
	  File "/usr/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 567, in _startRunCallbacks
	    self._runCallbacks()
	  File "/usr/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 653, in _runCallbacks
	    current.result = callback(current.result, *args, **kw)
	  File "/usr/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1442, in gotResult
	    _inlineCallbacks(r, g, deferred)
	--- <exception caught here> ---
	  File "/usr/local/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks
	    result = result.throwExceptionIntoGenerator(g)
	  File "/usr/local/lib/python2.7/site-packages/twisted/python/failure.py", line 393, in throwExceptionIntoGenerator
	    return g.throw(self.type, self.value, self.tb)
	  File "/app/rasa_nlu/server.py", line 127, in parse_get
	    else threads.deferToThread(self.data_router.parse, data))
	  File "/usr/local/lib/python2.7/site-packages/twisted/python/threadpool.py", line 250, in inContext
	    result = inContext.theWork()
	  File "/usr/local/lib/python2.7/site-packages/twisted/python/threadpool.py", line 266, in <lambda>
	    inContext.theWork = lambda: context.call(ctx, func, *args, **kw)
	  File "/usr/local/lib/python2.7/site-packages/twisted/python/context.py", line 122, in callWithContext
	    return self.currentContext().callWithContext(ctx, func, *args, **kw)
	  File "/usr/local/lib/python2.7/site-packages/twisted/python/context.py", line 85, in callWithContext
	    return func(*args,**kw)
	  File "rasa_nlu/data_router.py", line 200, in parse
	    response = model.parse(data['text'], data.get('time', None))
	  File "rasa_nlu/model.py", line 263, in parse
	    component.process(message, **self.context)
	  File "rasa_nlu/utils/spacy_utils.py", line 80, in process
	    message.set("spacy_doc", self.nlp(message.text))
	  File "/usr/local/lib/python2.7/site-packages/spacy/language.py", line 329, in __call__
	    proc(doc)
	  File "spacy/tagger.pyx", line 212, in spacy.tagger.Tagger.__call__ (spacy/tagger.cpp:6245)
	    self.vocab.morphology.assign_tag_id(&tokens.c[i], guess)
	  File "spacy/morphology.pyx", line 76, in spacy.morphology.Morphology.assign_tag_id (spacy/morphology.cpp:4681)
	    tag_id = self.reverse_index[self.strings['SP']]
	exceptions.KeyError: 139255

@pocman pocman mentioned this issue Sep 11, 2017
Closed
@Gullfaxi171 Gullfaxi171 mentioned this issue Sep 20, 2017
Closed
@KaterinaDK
Copy link

I also have a key error when trying to use the Dutch parser for text from text files. I checked the tag_map.py file and it already includes 'SP': {POS: SPACE}. Any other ideas what I can try?

@KaterinaDK
Copy link

Also, my text is cleaned of \n, so i'm not sure why this error comes up.

@KaterinaDK
Copy link

This is the error I get:
`/home/akandyla/spaCy/spacy/morphology.pyx in spacy.morphology.Morphology.assign_tag_id (spacy/morphology.cpp:4082)()
51 # Related to Issue #220
52 if Lexeme.c_check_flag(token.lex, IS_SPACE):
---> 53 tag_id = self.reverse_index[self.strings['SP']]
54 analysis = <MorphAnalysisC*>self._cache.get(tag_id, token.lex.orth)
55 if analysis is NULL:

KeyError: 119560`

@KaterinaDK
Copy link

Solved it. I was looking into the wrong tag_map.py
I had to add "SP": {POS: SPACE} in the folder of the language Dutch.

I hope this is helpful for other people.

@bsatts
Copy link

bsatts commented Oct 19, 2017

The same problem occurs with the English model too (web-core-sm). Spacy 1.9 returns SP as the tag but in the alpha it's returned as an empty string

@honnibal
Copy link
Member

Working on this in the v2 branch. Thanks for your patience with this frustrating problem.

@honnibal honnibal mentioned this issue Oct 20, 2017
Merged
8 tasks
@honnibal
Copy link
Member

Fixed 🎉

@znat znat mentioned this issue Jan 16, 2018
Merged
4 tasks
@mollerhoj mollerhoj mentioned this issue Apr 27, 2018
Closed
@lock
Copy link

lock bot commented May 8, 2018

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked as resolved and limited conversation to collaborators May 8, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
bug Bugs and behaviour differing from documentation lang / fr French language data and models models Issues related to the statistical models
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
10 participants
@oroszgy @pocman @christofs @bsatts @oliverdain @v3t3a @honnibal @raphael0202 @ines @KaterinaDK