An R wrapper for Jagger's tokenizer (a tibble input)

An R wrapper for Jagger's tokenizer (a tibble input)

tokenize_tbl(tbl, column, model_path = NULL, keep = NULL)

Arguments

tbl

a tibble.

column

a column name of the tibble to tokenize.

model_path

a path to the model.

keep

a vector of POS(s) to keep. Default is NULL.

Value

a tibble.

Examples

 data(sentence_example)
 res_tokenize <- tokenize_tbl(tibble::as_tibble(sentence_example), "text")