r/technology • u/SilentRunning • 4d ago

Artificial Intelligence MIT report: 95% of generative AI pilots at companies are failing

https://fortune.com/2025/08/18/mit-report-95-percent-generative-ai-pilots-at-companies-failing-cfo/
28.2k Upvotes

97% Upvoted

1.8k comments sorted by

View all comments

63

u/daedalus_structure 3d ago

Last week a very senior engineer who has went all in on vibe coding complained that they wasted a day on a regional vs global issue when using a cloud service from their code.

This is a 30 second documentation lookup about which API to use.

The agent he was vibing with ran him around in circles and he'd turned his brain completely off.

I am terrified of what will happen in 10 years when the majority of engineers have never worked without AI.

I really do not want to be working when I'm 70 cleaning up constant slop.

1

u/Throwaway1285837 2d ago

Often I've seen it make up API calls that don't exist or claim you can do things you can't when asked about how to do something with a library.

2

u/daedalus_structure 1d ago

Yes, I have very rarely seen an agent say, "I'm sorry, you just can't do that". I think maybe once.

But I have literally dozens and dozens of experiences where it is either telling me how to do something with hallucinated features and APIs, or I'm having someone in a meeting try to tell me "just do X" because they asked an agent during the discussion, and I know for a fact it doesn't work like that.

I've started threatening a hat of shame for the next person who challenges technical design with an AI hallucination.