How to use ckiplab/bert-base-han-chinese-ws-jindai with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="ckiplab/bert-base-han-chinese-ws-jindai")
# Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("ckiplab/bert-base-han-chinese-ws-jindai") model = AutoModelForTokenClassification.from_pretrained("ckiplab/bert-base-han-chinese-ws-jindai", device_map="auto")
This model provides word segmentation for the ancient Chinese language. Our training dataset covers four eras of the Chinese language.
