Instructions to use davidcondrey/llama-3.3-70B-i-ft-rev3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use davidcondrey/llama-3.3-70B-i-ft-rev3 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("davidcondrey/llama-3.3-70B-i-ft-rev3", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Llama-3.3-70B-Instruct-LoRA-Rev3
Usage
from peft import PeftModel
from transformers import AutoTokenizer, AutoModelForCausalLM
base = "meta-llama/Llama-3.3-70B-Instruct"
tok = AutoTokenizer.from_pretrained(base)
model = AutoModelForCausalLM.from_pretrained(base, torch_dtype="auto", device_map="auto")
model = PeftModel.from_pretrained(model, "davidcondrey/llama-3.3-70B-i-ft-rev3")
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support