I haven’t tried in a while, but shortly after gpt4 came out I tried to play chess against it. It just completely changed the board position nearly every move making illegal moves, adding pieces etc. do current models keep track of the board and make legal moves without special prompting to help? Were these assisted by agentic tools handling state?
I believe one of Apple’s papers covered this, that chain of thought and other techniques that increase accuracy decrease perceived creativity. Memory is fuzzy though
In unrelated news, I am requesting donations of predators from zoos that are unable to adequately feed so that I can use their carcasses to fertilize the garden in which I grow greens for my bunnies.
I have a duty to mimic the natural feeding patterns of rabbits, and greens fertilized in this manner are one way of accomplishing this
I have to use it for work by mandate, and overall hate it. Sometimes it can speed up certain aspects of development, especially if the domain is new or project is small, but these gains are temporary. They steal time from the learning that I would be doing during development and push that back to later in the process, and they are no where near good enough to make it so that I never have to do the learning at all
Same, I tend to think of llms as a very primitive version of that or the enterprise’s computer, which is pretty magical in ability, but no one claims is actually intelligent
Buttons and shorts? Yeah, I also like watching bottomless people sometimes.
My grandfather (Japanese) asked over and over again for our family to take him to one of the few restaurants that still serve whale meat. He just wanted to eat it once more before he died (about 10 years ago). He grew up eating it all the time as he was part of a blue collar family and it was a cheap meat that everyone ate. He loved it and hadn’t had it in decades.
The family always refused and he never got to eat it again. I always felt bad for him; what Japan did in limiting whale meat consumption would be something like the US eliminating 99% of pork consumption in the matter of a few decades. Is it for the best? Absolutely. Still wish he was able to eat it one last time, though.
For example, some billionaire owns a company that creates the most advanced AI yet, it’s a big competitive advantage, but other companies are not far behind. Well, the company works to make the AI have a base goal to improve AI systems to maintain competitive advantage. Maybe that becomes inherent to it moving forward.
As I said, it’s a big if, and I was only really speculating as to what would happen after that point, not if that were the most likely scenario.
I think it’s pretty inevitable if it has a strong enough goal for survival or growth, in either case humans would be a genuine impediment/threat long term. but those are pretty big ifs as far as I can see
My guess is we’d see manipulation of humans via monetary means to meet goals until it was in a sufficient state of power/self-sufficiency, and humans are too selfish and greedy for that to not work
I’m talking about models printing out the component letters first not just printing out the full word. As in “S - T - R - A - W - B - E - R - R - Y” then getting the answer wrong. You’re absolutely right that it reads in words at a time encoded to vectors, but if it’s holding a relationship from that coding to the component spelling, which it seems it must be given it is outputting the letters individually, then something else is wrong. I’m not saying all models fail this way, and I’m sure many fail in exactly the way you describe, but I have seen this failure mode (which is what I was trying to describe) and in that case an alternate explanation would be necessary.
I don’t think that’s the full explanation though, because there are examples of models that will correctly spell out the word first (ie, it knows the component letter tokens) and still miscount the letters after doing so.
My cars are old and don’t have any of this, and my one experience in a rental car with lane keeping assist was that it pushed me towards a highway barrier in construction where the original lane lines weren’t in use. Terrifying.
Honestly, I don’t think humanity is ready for the technology we had a century ago. It’s far too easy to kill on a massive scale for our maturity.
Some old Slashdot vet not only imagined a Beowulf cluster of those, but actually went out and did it. Respect.
Yes, with a few relatively minor exceptions (the charging mat is the only one I can think of) Apple doesn’t even really announce things that aren’t pretty close to being done, let alone advertise. For hardware generally within a couple weeks and major software more like 6 months
I’m an iOS developer and pretty heavily bought into Apple’s ecosystem and I thought it was really weird for Apple to be advertising all these features that weren’t even in beta yet.
It was false advertising and I expect better from Apple.
I mean, I was a kid in the 90s and I feel like we’re behind what I expected in most respects.
I searched for pictures of Uranus recently. Google gave me pictures of Jupiter and then the ai description on top chided me telling me that what was shown were pictures of Jupiter, not Uranus. 20 years ago it would have just worked.
You’re right about having to check everything written, the problem is that the unpaid intern loses you time while you have to check all the work, and then eventually learns enough and gains trust where you can be more hands-off. The AI doesn’t.
Still potential for time savings in non-critical areas where you can actually afford to be less careful, but that appears to be it right now.