This is a Phi3 model uploaded using the KerasNLP library and can be used with JAX, TensorFlow, and PyTorch backends.
This model is related to a CausalLM task.
Model config:
- name: phi3_backbone_1
- trainable: True
- vocabulary_size: 32064
- num_layers: 32
- num_query_heads: 32
- hidden_dim: 3072
- intermediate_dim: 8192
- num_key_value_heads: 32
- layer_norm_epsilon: 1e-05
- dropout: 0.0
- max_sequence_length: 4096
- pretraining_sequence_length: 4096
- rope_max_wavelength: 10000.0
- rope_scaling_type: None
- rope_scaling_short_factor: None
- rope_scaling_long_factor: None
This model card has been generated automatically and should be completed by the model author. See Model Cards documentation for more information.
- Downloads last month
- 13
# !pip install -U keras tensorflow huggingface_hub # Keras needs TensorFlow installed to read "hf://" paths, so the tensorflow backend is selected here; # "jax" and "torch" also work for computation once TensorFlow is installed. import os os.environ["KERAS_BACKEND"] = "tensorflow" import keras model = keras.saving.load_model("hf://blackWizard/phi_3_game")