Some people seem to be suggesting these are coverups for quantization...

Those who work on agent harnesses for a living realize how sensitive models can be to even minor changes in the prompt.

I would not suspect quantization before I would suspect harness changes.

really fun :) thanks!

it sounds like you described it pretty well!

~/.claude/projects is where the real fun is :)

What is your domain?

so we need to make some crazy llms...

there used to be https://default-filename-tv.neocities.org/ but it got taken down :/

The bitter lesson strikes again, I suppose!

Good questions! It's clear I need to gather more metrics from our next generated inference library.

Unfortunately it hasn't been open sourced. We're debating how / when to do this right now.

Confusing, since this is specific to an architecture that no one making money will use (8B is consumer space, not enterprise). The produced code shouldn't hold much interesting IP?