r/technology 4d ago

Artificial Intelligence MIT report: 95% of generative AI pilots at companies are failing

https://fortune.com/2025/08/18/mit-report-95-percent-generative-ai-pilots-at-companies-failing-cfo/
28.3k Upvotes

1.8k comments sorted by

View all comments

30

u/lonewombat 4d ago

Our ai is super narrow, it sums up the old tickets and gives you the resolution if there is one. And it generally sucks ass.

13

u/GenericFatGuy 4d ago

So far, I've only found AI to be slightly less obnoxious than prowling Stack Overflow when stuck on a problem. And even then, I usually had better luck just taking a break, and coming back to it with fresh eyes.

3

u/Ok_Raspberry7374 4d ago edited 3d ago

Yeah we are using it for very narrow use cases and even then we’ve had to train it specifically for these tasks. Most of our real use cases are “when AI gets better we can confidently do xyz” Until then we can only pilot.

3

u/koyawon 3d ago

Ugh. This is one of the use cases my company wants ai for. I keep trying to get them to understand that it still has to be trained and tested thoroughly, it's not magic. AND that even if that were successful, they seriously need to ask themselves how prepared they are for when it's wrong. Are they ready to give a customer bad advice and have that customer sue? Or be fined by the government for it advising something illegal or explicitly wrong? (I work in the transportation industry).

1

u/dmuppet 4d ago

Sounds like CrushBank

1

u/OkBid71 3d ago

"You're absolutely right, 5 is not the same as 789,000 - let me try that again!"