Text Generation
Transformers
Safetensors
GGUF
English
falcon_h1
palmer
text-editing
rewriting
paraphrasing
grammar-correction
edge
small-language-model
Instructions to use appvoid/palmer-006 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use appvoid/palmer-006 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="appvoid/palmer-006")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("appvoid/palmer-006") model = AutoModelForCausalLM.from_pretrained("appvoid/palmer-006", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use appvoid/palmer-006 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf appvoid/palmer-006 # Run inference directly in the terminal: llama cli -hf appvoid/palmer-006
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf appvoid/palmer-006 # Run inference directly in the terminal: llama cli -hf appvoid/palmer-006
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf appvoid/palmer-006 # Run inference directly in the terminal: ./llama-cli -hf appvoid/palmer-006
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf appvoid/palmer-006 # Run inference directly in the terminal: ./build/bin/llama-cli -hf appvoid/palmer-006
Use Docker
docker model run hf.co/appvoid/palmer-006
- LM Studio
- Jan
- vLLM
How to use appvoid/palmer-006 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "appvoid/palmer-006" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "appvoid/palmer-006", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/appvoid/palmer-006
- SGLang
How to use appvoid/palmer-006 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "appvoid/palmer-006" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "appvoid/palmer-006", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "appvoid/palmer-006" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "appvoid/palmer-006", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Ollama
How to use appvoid/palmer-006 with Ollama:
ollama run hf.co/appvoid/palmer-006
- Unsloth Desktop
- Docker Model Runner
How to use appvoid/palmer-006 with Docker Model Runner:
docker model run hf.co/appvoid/palmer-006
- Lemonade
How to use appvoid/palmer-006 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull appvoid/palmer-006
Run and chat with the model
lemonade run user.palmer-006-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
| TII FALCON LICENSE | |
| December 2024 | |
| Official source: | |
| https://falconllm.tii.ae/falcon-terms-and-conditions.html | |
| Introductory note | |
| This license is, in part, based on the Apache License Version 2.0 | |
| (available at http://www.apache.org/licenses/), with a series of modifications. | |
| The contribution of the Apache License 2.0 to the framing of this document is | |
| acknowledged. | |
| TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION | |
| 1. Definitions | |
| “License” shall mean the terms and conditions for use, reproduction, and | |
| distribution as defined by Sections 1 to 11 of this document. | |
| “Licensor” shall mean the copyright owner or entity authorized by the copyright | |
| owner that is granting the License. | |
| “Legal Entity” shall mean the union of the acting entity and all other entities | |
| that control, are controlled by, or are under common control with that entity. | |
| For the purposes of this definition, “control” means (i) the power, direct or | |
| indirect, to cause the direction or management of such entity, whether by | |
| contract or otherwise, or (ii) ownership of fifty percent (50%) or more of the | |
| outstanding shares, or (iii) beneficial ownership of such entity. | |
| “You” (or “Your”) shall mean an individual or Legal Entity exercising | |
| permissions granted by this License. | |
| “Source” form shall mean the preferred form for making modifications, including | |
| but not limited to software source code, training datasets used for training or | |
| fine tuning a machine learning model or artificial intelligence model, | |
| documentation source, and configuration files. | |
| “Object” form shall mean any form resulting from mechanical transformation or | |
| translation of a Source form, including but not limited to compiled object code, | |
| a trained and/or fine-tuned machine learning model or artificial intelligence | |
| model, generated documentation, and conversions to other media types. | |
| “Work” shall mean the work of authorship, which in relation to the initial | |
| release of each Relevant Model is in Object form only, but in the case of any | |
| and all Derivative Works means that Work whether in Source or Object form, made | |
| available under the License, as indicated by a copyright notice that is included | |
| in or attached to the work (an example is provided in the Appendix below). | |
| “Derivative Works” shall mean any work, whether in Source or Object form, that | |
| is based on (or derived from) the Work and for which the editorial revisions, | |
| annotations, elaborations, or other modifications represent, as a whole, an | |
| original work of authorship. For the purposes of this License, Derivative Works | |
| shall not include works that remain separable from, or merely link (or bind by | |
| name) to the interfaces of, the Work and Derivative Works thereof. | |
| “Contribution” shall mean any work of authorship, including the original version | |
| of the Work and any modifications or additions to that Work or Derivative Works | |
| thereof, that is intentionally submitted to Licensor for inclusion in the Work | |
| by the copyright owner or by an individual or Legal Entity authorized to submit | |
| on behalf of the copyright owner. | |
| For the purposes of this definition, “submitted” means any form of electronic, | |
| verbal, or written communication sent to the Licensor or its representatives, | |
| including but not limited to communication on electronic mailing lists, source | |
| code control systems, and issue tracking systems that are managed by, or on | |
| behalf of, the Licensor for the purpose of discussing and improving the Work, | |
| but excluding communication that is conspicuously marked or otherwise | |
| designated in writing by the copyright owner as “Not a Contribution.” | |
| “Contributor” shall mean Licensor and any individual or Legal Entity on behalf | |
| of whom a Contribution has been received by Licensor and subsequently | |
| incorporated within the Work. | |
| “Acceptable Use Policy” means the latest version from time to time of the policy | |
| designated as such hosted at FalconLLM.tii.ae. | |
| “Relevant Model” shall mean those artificial intelligence models to which this | |
| license has been applied (as indicated by a copyright notice in the form stated | |
| in the Appendix below), each initially made available in Object form only. | |
| “TII” shall mean the Technology Innovation Institute – Sole Proprietorship | |
| L.L.C., or any party nominated in writing by Technology Innovation Institute – | |
| Sole Proprietorship L.L.C. as its successor for the purposes of this License, or | |
| any party nominated in writing to be a successor to any successor for the | |
| purposes of this license. | |
| 2. Grant of Copyright License | |
| 2.1 Subject to the terms and conditions of this License, each Contributor hereby | |
| grants to You a perpetual, worldwide, non-exclusive, irrevocable copyright | |
| license to reproduce, prepare Derivative Works of, publicly display, publicly | |
| perform, sublicense, and distribute the Work and such Derivative Works in Source | |
| or Object form. | |
| 2.2 Your copyright license to use the Work shall be royalty free and without | |
| charge. | |
| 3. Grant of Patent License | |
| 3.1 Subject to the terms and conditions of this License, each Contributor hereby | |
| grants to You a perpetual, worldwide, non-exclusive, irrevocable (except as | |
| stated in this section) patent license to make, have made, use, offer to sell, | |
| sell, import, and otherwise transfer the Work, where such license applies only | |
| to those patent claims licensable by such Contributor that are necessarily | |
| infringed by their Contribution(s) alone or by combination of their | |
| Contribution(s) with the Work to which such Contribution(s) was submitted. | |
| If You institute patent litigation against any entity (including a cross-claim | |
| or counterclaim in a lawsuit) alleging that the Work or a Contribution | |
| incorporated within the Work constitutes direct or contributory patent | |
| infringement, then any patent licenses granted to You under this License for | |
| that Work shall terminate as of the date such litigation is filed. | |
| 3.2 Your patent license to use the Work shall be royalty free and without | |
| charge. | |
| 4. Redistribution | |
| 4.1 You may reproduce and distribute copies of the Work or Derivative Works | |
| thereof in any medium, with or without modifications, and in Source or Object | |
| form, provided that You meet the following conditions: | |
| 4.1.1 Use-based restrictions incorporating the Acceptable Use Policy in the | |
| manner set out in Section 5 of this license, and which do not otherwise conflict | |
| with the Acceptable Use Policy, must be included as enforceable provisions by | |
| You in any type of legal agreement (e.g. a license) governing the use and/or | |
| distribution of the Work or any Derivative Works that You distribute; | |
| 4.1.2 You must give any other recipients of the Work or Derivative Works a copy | |
| of this License; | |
| 4.1.3 You must cause any modified files to carry prominent notices stating that | |
| You changed the files; | |
| 4.1.4 You must retain, in the Source form of any Derivative Works that You | |
| distribute, all copyright, patent, trademark, and attribution notices from the | |
| Source form of the Work, excluding those notices that do not pertain to any part | |
| of the Derivative Works; and | |
| 4.1.5 If the Work includes a “NOTICE” text file as part of its distribution, | |
| then any Derivative Works that You distribute must include a readable copy of | |
| the attribution notices contained within such NOTICE file, excluding those | |
| notices that do not pertain to any part of the Derivative Works, in at least one | |
| of the following places: within a NOTICE text file distributed as part of the | |
| Derivative Works; within the Source form or documentation, if provided along | |
| with the Derivative Works; or, within a display generated by the Derivative | |
| Works, if and wherever such third-party notices normally appear. | |
| The contents of the NOTICE file are for informational purposes only and do not | |
| modify the License. You may add Your own attribution notices within Derivative | |
| Works that You distribute, alongside or as an addendum to the NOTICE text from | |
| the Work, provided that such additional attribution notices cannot be construed | |
| as modifying the License. | |
| 4.2 Subject to Section 6, You may add Your own copyright statement to Your | |
| modifications and may provide additional or different license terms and | |
| conditions for use, reproduction, or distribution of Your modifications, or for | |
| any such Derivative Works as a whole, provided Your use, reproduction, and | |
| distribution of the Work otherwise complies with the conditions stated in this | |
| License. | |
| 5. Acceptable Use | |
| 5.1 Subject to Section 5.3, your use of the Work or any Derivative Work must | |
| comply with the Acceptable Use Policy at all times. You shall procure that all | |
| persons using the Work or Derivative Work for you or on your behalf comply with | |
| the Acceptable Use Policy in their use. | |
| 5.2 You may not use the Work or any Derivative Work or any output from the Work | |
| or Derivative Work, whether directly or indirectly, to create other works for | |
| any purpose which conflicts with the Acceptable Use Policy. | |
| 5.3 The Acceptable Use Policy may be updated from time to time. You should | |
| monitor the web address at which the Acceptable Use Policy is hosted to ensure | |
| that your use of the Work or any Derivative Work complies with the updated | |
| Acceptable Use Policy. | |
| 6. Publication | |
| 6.1 You shall include prominently in any public statement regarding a | |
| Derivative Work the following statement: | |
| “[name of relevant Derivative Work] is built using artificial intelligence | |
| technology from the Technology Innovation Institute”. | |
| 6.2 You may request from TII a reasonably adjusted version of the above | |
| statement to suit the publication the relevant statement is being made in. TII | |
| will not unreasonably withhold or delay approval of such a request. | |
| 7. Submission of Contributions | |
| 7.1 Unless You explicitly state otherwise, any Contribution intentionally | |
| submitted for inclusion in the Work by You to the Licensor shall be under the | |
| terms and conditions of this License, without any additional terms or | |
| conditions. | |
| 7.2 Notwithstanding the above, nothing herein shall supersede or modify the | |
| terms of any separate license agreement you may have executed with Licensor | |
| regarding such Contributions. | |
| 8. Trademarks | |
| 8.1 Except as required for compliance with Section 6 of this License, this | |
| License does not grant permission to use the trade names, trademarks, service | |
| marks, or product names of the Licensor, except as required for reasonable and | |
| customary use in describing the origin of the Work and reproducing the content | |
| of the NOTICE file. | |
| 9. Disclaimer of Warranty | |
| 9.1 Unless required by applicable law or agreed to in writing, Licensor provides | |
| the Work (and each Contributor provides its Contributions) on an “AS IS” BASIS, | |
| WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied, | |
| including, without limitation, any warranties or conditions of TITLE, | |
| NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A PARTICULAR PURPOSE. | |
| You are solely responsible for determining the appropriateness of using or | |
| redistributing the Work and assume any risks associated with Your exercise of | |
| permissions under this License. | |
| 10. Limitation of Liability | |
| 10.1 In no event and under no legal theory, whether in tort (including | |
| negligence), contract, or otherwise, unless required by applicable law (such as | |
| deliberate and grossly negligent acts) or agreed to in writing, shall any | |
| Contributor be liable to You for damages, including any direct, indirect, | |
| special, incidental, or consequential damages of any character arising as a | |
| result of this License or out of the use or inability to use the Work (including | |
| but not limited to damages for loss of goodwill, work stoppage, computer failure | |
| or malfunction, or any and all other commercial damages or losses), even if | |
| such Contributor has been advised of the possibility of such damages. | |
| 11. Accepting Warranty or Additional Liability | |
| 11.1 While redistributing the Work or Derivative Works thereof, You may choose | |
| to offer, and charge a fee for, acceptance of support, warranty, indemnity, or | |
| other liability obligations and/or rights consistent with this License. | |
| However, in accepting such obligations, You may act only on Your own behalf and | |
| on Your sole responsibility, not on behalf of any other Contributor, and only | |
| if You agree to indemnify, defend, and hold each Contributor harmless for any | |
| liability incurred by, or claims asserted against, such Contributor by reason | |
| of your accepting any such warranty or additional liability. | |
| END OF TERMS AND CONDITIONS | |
| APPENDIX: How to apply the TII Falcon License to your work | |
| To apply the TII Falcon License to your work, attach the following boilerplate | |
| notice, with the fields enclosed by brackets “[]” replaced with your own | |
| identifying information. Do not include the brackets. The text should be | |
| enclosed in the appropriate comment syntax for the file format. | |
| Copyright [yyyy] [name of copyright owner] | |
| Licensed under the TII Falcon License (the “License”); you may not use this file | |
| except in compliance with the License. | |
| You may obtain a copy of the License at FalconLLM.tii.ae. Unless required by | |
| applicable law or agreed to in writing, software distributed under the License | |
| is distributed on an “AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY | |
| KIND, either express or implied. | |
| See the License for the specific language governing permissions and limitations | |
| under the License. | |