Jiuqiang TangandCopybara-Service f329e38dc1 Map the "com_github_glog_glog" dependency of "com_google_sentencepiece" to mediapipe's "com_github_glog_glog_no_gflags". ...

PiperOrigin-RevId: 487727239

2022-11-10 22:12:42 -08:00

..

bert_tokenizer_test.cc

Internal change

2022-09-28 21:32:36 +00:00

bert_tokenizer.cc

Internal change

2022-09-28 21:32:36 +00:00

bert_tokenizer.h

Internal change

2022-09-28 21:32:36 +00:00

BUILD

Map the "com_github_glog_glog" dependency of "com_google_sentencepiece" to mediapipe's "com_github_glog_glog_no_gflags".

2022-11-10 22:12:42 -08:00

regex_tokenizer_test.cc

Internal change

2022-09-28 21:32:36 +00:00

regex_tokenizer.cc

Internal change

2022-09-28 21:32:36 +00:00

regex_tokenizer.h

Internal change

2022-09-28 21:32:36 +00:00

sentencepiece_tokenizer_test.cc

Internal change

2022-09-28 21:32:36 +00:00

sentencepiece_tokenizer.h

Internal change

2022-09-28 21:32:36 +00:00

tokenizer_utils_test.cc

Internal change

2022-09-28 21:32:36 +00:00

tokenizer_utils.cc

Internal change

2022-09-28 21:32:36 +00:00

tokenizer_utils.h

Internal change

2022-09-28 21:32:36 +00:00

tokenizer.h

Internal change

2022-09-28 21:32:36 +00:00