Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
cpburns2009
36 days ago
|
parent
|
context
|
favorite
| on:
Unsloth Dynamic 2.0 GGUFs
Does llama.cpp support Qwen3.5 yet? When I tried it before, it failed saying "qwen35moe" is an unsupported architecture.
hnfong
36 days ago
|
next
[–]
Yes, but make sure you grab the latest llama.cpp release
New model archs usually involve code changes.
sowbug
35 days ago
|
parent
|
next
[–]
If you're running Ollama, you'll have to wait a little longer for its embedded version of llama.cpp to catch up. It can be a couple days or weeks behind.
cpburns2009
36 days ago
|
parent
|
prev
|
next
[–]
Awesome! It looks like the llama.cpp-hip AUR was updated today to b8179, and it works.
reactordev
36 days ago
|
prev
[–]
You would need the Dynamic 2.0 GGUF as discussed in the article.
But mmmmmm, Q8_K_XL looks mighty nice.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: