depends if post-correction it is worth anyone's money to keep training new frontier models. It could be that it isn't, so we are left with models that were trained in the bubble, but are now increasingly out of date, or (open?) models that are trained much more cheaply somehow with consequent lack of utility.
I like open note exams (and perhaps open book exams, as you need to know the book well to know which page to look at) - it forces you to condense the material to the salient points and operationalise it to solve what would be more challenging problems than a simple recall exam.
When I see 'cheat sheets' - designed to be hidden on the back of calculators or whatever - then I see true application of human ingenuity and intellect.
My understanding is that the major part of the cost of a given model is the training - so open models depend on the training that was done for frontier models? I'm finding hard to imagine (e.g.) RLHF being fundable through a free software type arrangement.
No, the training between proprietary and open models is completely different. The speculation that open models might be "distilled" from proprietary ones is just that, speculation, and a large portion of it is outright nonsense. It's physically possible to train on chat logs from another model but that's not "distilling" anything, and it's not even eliciting any real fraction of the other model's overall knowledge.
I don't know what to make of it, I am skeptical of OpenAI/Anthropic claims about distillation, but I did notice DeepSeek started sounding a lot like Claude recently.
Really not the same. Assembly / machine code is entirely deterministic - they are a notation for your thoughts. LLM produced content is more a smorgasbord of other people's thoughts, and cannot help you with clarity, conviction, etc etc.
They meant to say that swithing from assembly to high-level programming is not the same as switching from high-level programming to LLMs, because the latter loses you the guarantee that the computer will do what you told it to.
Sure, it's less common that people are writing full-fledged applications in nothing but assembly.
However, I would strongly disagree that people are no longer writing/using assembly. I was writing a bit of assembly the other day, for example.
Come on over to the game emulation, reverse engineering, exploitation writing, CTF, malware analysis, etc. hobby spaces. Knowledge of assembly is absolutely mandatory to do essentially anything useful.
My point is that the coding LLMs are another point on the reliability / ease of use spectrum. We already mostly moved to another point with HLL compilers from machine language. This is another leap where the transform is unreliable but it's very easy to use (and it could preserve output edits, to some indeterminate extent).
this is a very low bar for determining a decent quality of life for a human being.
> ideological places or jealousy
but presumably you are a "temporarily embarrassed billionaire"?
> billionaire is likely providing over 1,000,000 direct and indirect jobs
No, they don't 'provide jobs', they suck up [human] resources that could otherwise have gone to schools and hospitals.
> Undoubtedly Amazon has lowered the prices of goods.
but at what cost to the social fabric (Walmart is probably the greater transgressor there though).
Developed societies tolerate the ultra-wealthy because a) they are an artifact of a free market for capital allocation (vs state control), and b) sometimes having large wealth concentrations has proved a useful 'short-circuit' to normal capital allocation for otherwise unfundable but ultimately beneficial projects.
The key word here is 'tolerate'. If society feels the ultra-wealthy are no longer worth the problems they cause (e.g. hoarding certain finite resources), then society should get rid of them.
I would add that beyond a certain point (a place to live, personal possessions, retirement fund, etc), there is no moral case - in the sense of the natural right of ownership - for their wealth, and we can simply confiscate it. For example in the UK we used 'death duties' to break the aristocracy.
I really liked the number/name system in SF when I was living there. It was very legible, even if you didn't know the named street, you could quickly dial in to the location by scanning along the numbered street.
Where I live now the streets are 'wavy' and have very long names, usually a person or an auspicious date - and often multiple instances quite nearby. Almost useless for navigation.
I also miss the grid system - traffic naturally gets calmed down, and you are never too far from a cross walk.
3. You use the act of writing code to think about a given problem, and by so doing not only produce a better code, but also gain a deeper understanding of the problem itself - in combination a better product all around.
reply