Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
zzzzzhowie
/
llama-3.2-1b-dpo-judge
like
0
Text Generation
PEFT
TensorBoard
Safetensors
Transformers
dpo
lora
trl
arxiv:
2305.18290
Model card
Files
Files and versions
xet
Metrics
Training metrics
Community
Use this model
main
llama-3.2-1b-dpo-judge
215 MB
1 contributor
History:
2 commits
zzzzzhowie
Upload folder using huggingface_hub
9fa38ac
verified
3 months ago
checkpoint-33
Upload folder using huggingface_hub
3 months ago
runs
Upload folder using huggingface_hub
3 months ago
.gitattributes
1.64 kB
Upload folder using huggingface_hub
3 months ago
README.md
2.47 kB
Upload folder using huggingface_hub
3 months ago
adapter_config.json
935 Bytes
Upload folder using huggingface_hub
3 months ago
adapter_model.safetensors
45.1 MB
xet
Upload folder using huggingface_hub
3 months ago
special_tokens_map.json
335 Bytes
Upload folder using huggingface_hub
3 months ago
tokenizer.json
17.2 MB
xet
Upload folder using huggingface_hub
3 months ago
tokenizer_config.json
50.6 kB
Upload folder using huggingface_hub
3 months ago
training_args.bin
6.8 kB
xet
Upload folder using huggingface_hub
3 months ago