Niklas Wahlby's picture

7 34

Niklas Wahlby

dussinus

·

dussinus

AI & ML interests

None yet

Recent Activity

liked a Space about 6 hours ago

abidlabs/daggr

reacted to bartowski's post with 👍 about 2 months ago

Was going to post this on /r/LocalLLaMa, but apparently it's without moderation at this time :') https://huggingface.co/bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there) Outlined the details of the script and results in my llama.cpp PR to add the jinja template: https://github.com/ggml-org/llama.cpp/pull/14349 Start server with a command like this: ``` ./llama-server -m /models/mistralai_Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf --jinja --chat-template-file /models/Mistral-Small-3.2-24B-Instruct-2506.jinja ``` and it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)

liked a Space about 2 months ago

DontPlanToEnd/UGI-Leaderboard

View all activity

Organizations

Collections 1

spaces 1

First Agent Template

Retrieve current local time in a specified timezone

models 15

dussinus/rl_course_vizdoom_health_gathering_supreme

Reinforcement Learning • Updated Apr 25, 2023

dussinus/ppo-cleanrl-Lunar

Reinforcement Learning • Updated Apr 25, 2023

dussinus/poca-SoccerTwos

Reinforcement Learning • Updated Mar 22, 2023 • 25

dussinus/a2c-PandaReachDense-v2

Reinforcement Learning • Updated Mar 22, 2023 • 1

dussinus/a2c-AntBulletEnv-v0

Reinforcement Learning • Updated Mar 20, 2023 • 1

dussinus/ppo-resnet-Pyramids-adj-config

Reinforcement Learning • Updated Mar 20, 2023 • 6

dussinus/ppo-Snowball-adj-config

Reinforcement Learning • Updated Mar 20, 2023 • 18

dussinus/pixelcopter-unit4-lr98e-5

Reinforcement Learning • Updated Mar 18, 2023

dussinus/Reinforce-pytorch-unit4

Reinforcement Learning • Updated Mar 17, 2023

dussinus/qrdqn-SpaceInvadersNoFrameskip-v4

Reinforcement Learning • Updated Mar 17, 2023 • 2

datasets 0

None public yet