filter_tokens

Module Contents

Functions

filter_for_token(tokens,search_token,match_type=”exact”,ignore_case=False,glob_method=”match”,remove_found_token=False,remove_empty_docs=True)
filter_for_tokenpattern(tokens,tokpattern,ignore_case=False,remove_found_token=False,remove_empty_docs=True)
filter_for_pos(tokens,required_pos,simplify_pos=True,simplify_pos_tagset=None)
token_match(pattern,tokens,match_type=”exact”,ignore_case=False,glob_method=”match”) Return a NumPy array signaling matches between pattern and tokens. pattern is a string that will be
filter_for_token(tokens, search_token, match_type="exact", ignore_case=False, glob_method="match", remove_found_token=False, remove_empty_docs=True)
filter_for_tokenpattern(tokens, tokpattern, ignore_case=False, remove_found_token=False, remove_empty_docs=True)
filter_for_pos(tokens, required_pos, simplify_pos=True, simplify_pos_tagset=None)
token_match(pattern, tokens, match_type="exact", ignore_case=False, glob_method="match")

Return a NumPy array signaling matches between pattern and tokens. pattern is a string that will be compared with each element in sequence tokens either as exact string equality (match_type is ‘exact’) or regular expression (match_type is ‘regex’) or glob pattern (match_type is ‘glob’).