DibaOne-X1 / tokenizer_config.json

Commit History

Tokenizer files as saved by the training tokenizer (id-for-id verified)
0415f34
verified

DibaAi commited on

Self-contained repo: tokenizer, stage-1 retriever, ONNX fp32/fp16/int8
9d7debd
verified

DibaAi commited on