This is an active area of research. Demis Hassabis proposed training a model with a strict knowledge cutoff before 1915, and seeing whether it can independently arrive at general relativity.
I think this is a good way to test a certain kind of capability, but as to whether LLMs would pass such a test, I'm guessing almost certainly not. If you've ever used one for research, it's very 'in' the current literature, whatever that may be. It's an incredible retrieval tool, and it will glibly evaluate any novel ideas that you feed in, but analyses are often incorrect when there's a paucity of directly relevant training data.
> I for one love the advances in technology in something as supposedly simple as a shoe. And maybe I'll get to use it on a hike in a few years.
These shoes are practically disposable. They trade longevity for noticeable gains in performance. Even the tier below don’t last very long. This is not tech that is going to filter down to your hiking boots.
There's a whole industry of hiking gear that has been steadily trading weight for durability. I only hike in running shoes (altras) which only last me 400 or so miles. It's way less durable than my old boots.
I doubt this sort of thing will translate, but I wouldn't put it past hikers to opt for something less durable to shave a few grams.
But the initial tech on an F1 car was not made for 200k miles either.
Even if the full tech stack to make it all work - material science, physical layout and construction - doesn't transfer, maybe some bit of it will.
My point being though, unlike some purists, I like the technology race. It is much better than having a brand war simply on the basis of brand loyalty.
Sometimes they have big running machines with a crash mat around them running at 2h marathon pace at running shows. I’ve o ly seen them on video - no one can keep up with it for more than 30 odd seconds. It’s INSANE they are running this fast.
Also bear in mind running a single mile under 4 mins was considered impossible for a long time.
Yesterday I put my AirPod in and squeezed it, expecting Spotify to play - but it must have quit, and instead my mac opened up Music - and that album was STILL there and started to play. How many years has it been?
Every now and then I feel like I got a handle on AI and it makes sense. Then something like this happens and either my whole concept of it is wrong, or this makes no sense and is insane.
At least then you know the answer yourself and know it’s something that can be reasonably worked out.
reply