How to use google-bert/bert-large-cased-whole-word-masking with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="google-bert/bert-large-cased-whole-word-masking")
# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("google-bert/bert-large-cased-whole-word-masking") model = AutoModelForMaskedLM.from_pretrained("google-bert/bert-large-cased-whole-word-masking", device_map="auto")
What was the definition of a whole word? What about punctuation?
· Sign up or log in to comment
