It’s irresponsible because making it sound like it’s true AI when it’s not is going to make it difficult to pull the plug when things go wrong and you’ll have the debate of whether it’s sentient or not and if it’s humane to kill it like a pet or a criminal. It’s more akin to using rainbow tables to help crack passwords and claiming your software is super powerful when in reality it’s nothing without the tables. (Very very rudimentary example that’s not supposed to be taken at face value).
It’s dangerous because talking about AI like it’s a reasoning/thinking thing is just not true, and we’re already seeing the big AI overlords try to justify how they created it with copyrighted material, which means the arguments over copyrighted material are being made and we’ll soon see those companies claim that it’s no different than a child looking up something on Google. It’s irresponsible because it screws over creative people and copyright holders that genuinely made a product or piece of art or book or something in their own free time and now it’s been ripped away to be used to create something else that will eventually push those copyright holders out.
The AI market is moving faster than the world is capable of keeping up with it, and that is a dangerous precedent to set for the future of this market. And for the record I don’t think we’re dealing with early generations of skynet or anything like that, we’re dealing with tools that have the capability to create economical collapse on a scale we’ve never seen, and if we don’t lay the ground rules now, then we will be in trouble.
Edit: A great example of this is https://v0.dev/chat it has the potential to put front end developers out of work and jobless. It’s simple now but give it time and it has the potential to create a frontend that rivals the best UX designs if the prompt is right.
AI peaked a while ago IMO, the nail in the coffin for me was Microsoft making deals for nuclear power plants to power their data centers for ML and AI. It’s great they’re using nuclear power since it’s at least a clean source of energy, but it’s also extremely telling of the limitations and power requirements for these languages models. Without some kind of power reduction breakthrough, AI will continue to stall while these companies think of new ways to sell snake oil and gimmicks.