Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix for issue #1009 #1018

Merged
merged 9 commits into from
Nov 16, 2016
Merged

Fix for issue #1009 #1018

Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
4d61547
has_pattern removed from utils, pattern check moved to utils.lemmatize
shashankg7 Nov 14, 2016
b621f10
default value for lemmatize in corpora/wikicorpus.__init__ changed to…
shashankg7 Nov 14, 2016
0af3fd0
duplicate check for pattern removed from corpora/wikicorpus
shashankg7 Nov 14, 2016
56deea3
exception handling added in lematize if pattern not found
shashankg7 Nov 14, 2016
8b17640
wikicorpus lemmatize call giving error issue fixed
shashankg7 Nov 14, 2016
8d6774b
syntax error fix in lematize
shashankg7 Nov 14, 2016
2257343
multiple import checks for pattern in utils removed, single import added
shashankg7 Nov 14, 2016
8fb22df
pattern check statement changed in has_pattern method
shashankg7 Nov 15, 2016
edc7ea8
Merge branch 'develop' of https://github.com/shashankg7/gensim into d…
shashankg7 Nov 15, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 4 additions & 8 deletions gensim/utils.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -80,7 +80,6 @@ def smart_open(fname, mode='rb'):
RE_HTML_ENTITY = re.compile(r'&(#?)([xX]?)(\w{1,8});', re.UNICODE)



def synchronous(tlockname):
"""
A decorator to place an instance-based lock around a method.
Expand Down Expand Up @@ -1005,15 +1004,13 @@ def pyro_daemon(name, obj, random_suffix=False, ip=None, port=None, ns_conf={}):

def has_pattern():
"""
Function to check if there is installed pattern library
Function which returns a flag indicating whether pattern is installed or not
"""
pattern = False
try:
from pattern.en import parse
pattern = True
return True
except ImportError:
warnings.warn("Pattern library is not installed, lemmatization won't be available.")
return pattern
return False


def lemmatize(content, allowed_tags=re.compile('(NN|VB|JJ|RB)'), light=False,
Expand All @@ -1038,8 +1035,7 @@ def lemmatize(content, allowed_tags=re.compile('(NN|VB|JJ|RB)'), light=False,

"""
if not has_pattern():
raise ImportError("Pattern library is not installed. Pattern library is needed in order \
to use lemmatize function")
raise ImportError("Pattern library is not installed. Pattern library is needed in order to use lemmatize function")
from pattern.en import parse

if light:
Expand Down