The number of paying subscribers for Copilot has leaked, and it is a disaster. Now even reshaping Satya Nadella's CEO role into tech leadership rather than delivering commercial results.
Every time I’ve been desperate enough to use AI (ChatGPT, Gemini) for a semi-difficult question, it has failed me miserably.
It’s hallucinated libraries.
It’s hallucinated commands.
I tried to have it write me a complex formula to evaluate a date value. I noticed one of the conditions I needed to be covered was not, and brought up a date that would evaluate incorrectly. It basically “explained” step by step that the formula worked for my example date but used a different year for the one step where the flaw was. Like it gaslighting me.
Just last week I searched Google about a product owned by Google, Gemini interjected and gave me a detailed list of the product’s features, including the feature I was searching for so it caught my eye. The reference link was to a forum post where someone asked if it had that feature and then someone responded that it did not have that feature.
Every time I’ve been desperate enough to use AI (ChatGPT, Gemini) for a semi-difficult question, it has failed me miserably.
It’s hallucinated libraries.
It’s hallucinated commands.
I tried to have it write me a complex formula to evaluate a date value. I noticed one of the conditions I needed to be covered was not, and brought up a date that would evaluate incorrectly. It basically “explained” step by step that the formula worked for my example date but used a different year for the one step where the flaw was. Like it gaslighting me.
Just last week I searched Google about a product owned by Google, Gemini interjected and gave me a detailed list of the product’s features, including the feature I was searching for so it caught my eye. The reference link was to a forum post where someone asked if it had that feature and then someone responded that it did not have that feature.
It’s just… not reliable.