# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("shareAI/bimoGPT-llama2-13b", device_map="auto")Quick Links
bimoGPT - 一个在llama2 13b基座模型上做中文精细SFT的版本，拥有接近ChatGPT的语气和对话问答能力，以及不错的代码编程能力。
底座：https://www.codewithgpu.com/m/file/llama2-13b-Chinese-chat (中的llama2-13B-sharegpt_cn-epoch2.zip)
# Use a pipeline as a high-level helper # Warning: Pipeline type "question-answering" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("question-answering", model="shareAI/bimoGPT-llama2-13b")