Now I understand why at each windows 11 update, they introduce more bugs than ever
Horseshit.
The current state of code generated by AI is sketchy at best. I often get plain wrong answers because the model tries to derive. It comes up with calls to functions and properties that just do not exist.
“You are right, I made a mistake. Here is a better answer.” Continues to give wrong answers.
Apart from that, apps that are glued together from AI generated code are not maintainable at all. What if there is a bug somewhere and you so not comprehend what is actually happening? Ask AI to fix it? Yeah good luck with that.
I do use AI for simple questions, and it works fairly well for that, but this claim by MS is just marketing bullshit.
This ^
“20%-30% of code inside the company’s repositories”
Now, if they had said “20%-30% of code written in the past 6 months…” I might buy that.
The repositories are going to have all the current codebase, likely going back years now. AI generated code is barely viable at this point and really only pretty recently.
No way 1/3rd of all current codebase is AI.
Even 20% of new code would be a stretch unless they count every first iteration of code written by AI that needs to be replaced by a human later because it was plain wrong.
Maybe they’re counting the six iterations of code it gives me as I tell it what’s wrong with each one.
20% of code = 20 lines of production code.
“Please move all comments from in-line to the line above, and add a separator line”
They mean new code, as per the article. And they mean code gen and IntelliSence
They say that because they are selling it.
And yeah, my experience is the same. The most frustrating is when writing in a typed python, and it gives answers that are clearly incorrect, making up attributes that don’t even exist etc.
My brother said his superior asked him to use more AI auto complete so that they can brag to investors that X percent of the company’s code is written by AI. This told me everything about the current state of this bullshit.
I didn’t RTA, but if they mean ALL code at MS, that just can’t be true. They have legacy stuff going back decades, beyond just their windows platform. There’s no way 30% of all their code is replaced or newly created by AI.
“You are right, I made a mistake. Here is a better answer.” Continues to give wrong answers
The exact same wrong answer. Co-Pilot is especially bad for that. I’m practically giving up using it outside of vs code because the actual copilot AI is dog shit stupid m
It would explain the constant barrage of system breaking bugs and RCE vulns
Turns out they have been using AI for decades.
“Auto complete generated 30% of characters”
Fixed it.
“You are right, I made a mistake. Here is a better answer.” Continues to give wrong answers.
To be fair, the AI’s not wrong. It’s probably better, but just a teeny tiny bit so.
Honestly, AI is like a genie - whatever you come up with he’ll just butcher and misinterpret so you start questioning both your own sanity and the semantics of language. Good thing these genies have no wish limit, but bad thing that they murder rainforests while generating their non-sequitur replies.
Ah but it was nice for a minute imagining microsoft vibe coding windows…
He used the words “written by software”. This is ambiguous and doesn’t mean AI, for example, using annotations for variables and generating the getters and setters would count. Right click and create function body for interface function definitions also.
They’re exaggerating to pretend their AI is more useful than it is.
Intellisense in visual studio has also been really good for over a decade. Which is technically also written by software and not me.
I mean, really good intellisense is a great improvement, but it’s not replacing devs any time soon.
People have been using annotations to generate code since I rode my dinosaur to work.
Don’t forget code generation for stuff like bindings or database schemes
That’s… not something to be proud of.
Power move by the zucc by first asking how much genai is used at Microsoft then refusing to answer his own question at Facebook 😂
So the CEO is trying to tell investors that they are saving money by not paying employees. But to me it sounds more like: we are letting our sub-par products continue to enshitify, and any other company using AI to program will be equal competition.
I think he’s trying to say that their AI writes code good enough for Microsoft. Which is a message to other business leaders that your company too can benefit from copilot, just hand over your credit card!
Microsoft has absolutely gotten worse in the consumer space, but that isn’t really their business these days.
They’re worse in the business space too. Teams is crashing on me daily.
Teams crashed on me today too! It’s great because it was a meeting with external people, so I had to sit in the waiting room in shame until one of them let me back in.
Good point
Well, that explains Windows 11.
I bet they’re counting code written while someone had an AI plugin installed as “written by AI” and I bet that accounts for almost all of that 30%. On top of that, I’m betting that they made it mandatory to have such a plug in, and the other 70% is just code written before they mandated this.
I would be very surprised if 30% of their code lines had even been touched at all by anyone since AI coding assistants became a thing.
I wish this shot from The Terminator had the camera showing Sarah Conner’s face instead of Reese’s, because it’d be such an appropriate meme image on multiple levels for when someone makes a misleading claim about some current AI system.
I could see stuff getting small changes and them claiming that the entirety of the new version is “written by AI”.
Also, having 1/3 lines with obvious code that can be auto suggested correctly would make sense, but that is hardly code “written by ai” in the way they suggest.
I’d guess a lot of the people writing the code don’t even have it turned on, it’s just installed because management said it had to be, because management wants to be able to tell investors they’re “innovating work flows”.
I am a small sample to confirm that’s exactly the reason in my brother’s company.
And in my company we’re pressured to make X prompts every week to the company’s own ChatGPT wrapper to show we’re being productive. Even our profit shares have a KPO attached to that now. So many people just type “Hello there” every morning to count as another interaction with the AI.
Every few months I turn it on for a few days just to see if it is better.
Then I go back to the old AST based autocomplete that actually knows something useful about my code.
Those are the easy time savings though, the safe easy stuff the developer doesn’t have to worry about anymore. (Giving them time do the gnarly stuff)
It is exactly the opposite, with simple, predictable auto-complete you didn’t have to worry about that anymore, with LLMs you always have to look at it in detail because every little thing could be just plain completely different and wrong.
I can read way faster than I can type though. You still check it, but it’s pretty good as that kind of stuff once you have an example for it to follow.
Reading code is usually orders of magnitude slower than writing code. Sure, typing might be slower than reading but to check if it is what you intended you have to understand it too.
Well, I’m generally very anti-LLM but as a library author in Java it has been very helpful to create lots of similar overloads/methods for different types and filling in the corresponding documentation comments. I’ve already done all the thinking and I just need to check that the overload makes the right call or does the same thing that the other ones do – in that particular case, it’s faster. But if I myself don’t know yet how I’m going to do something, I would never trust an AI to tell me.
Well, okay, I can see how it would be useful in languages like Java that are extremely verbose and have a low expressiveness. Writing Java pretty much was already IDEs with code generation 20 years or so ago because nobody wants to write so much boilerplate by hand.
This is my own experience but the past few years Windows has been extremely dependable for me and then in the last few months the updates they’ve have been terrible. I’ve seen more blue screens recently than I have in a lot of years.
All this to say that if it is 30% AI code being used then it’s very telling!
Windows was always garbage to be honest, windows 7 was the best release in my opinion. You are correct though it is way worse these past months. By the way does your mouse lag when the update notification comes up?
i had such a bad experience with 7, it was horribly unstable on a computer that had handled vista just fine. i switched to 8 as soon as i could and was better off for it.
Win98SE was my favorite. Maximum just working, minimum trying to “help.”
It’s great if you don’t need it to be on the network. I’d say they didn’t have networking figured out until almost the end of XPs lifespan.
Government spyware finally has a challenger for the title of “primary reason that most Microsoft software runs like hot garbage”.
So this explains why Microsoft Swiftkey is total dogshit now. Also why the Outlook app barely works.
Its unbelievable.
I used to be able to swipe freely on SwiftKey, and now I can’t really do it without being extra careful and mindful of not spelling the wrong thing. Idk what Microsoft did to the product but I wouldn’t call it an improvement.
Idk what Microsoft did to the product but I wouldn’t call it an improvement.
I think the article we’re looking at here isn’t really hyperbolic. They got AI to write all their code and broke the Keyboard.
Just FYI, if you can live without swipping, I recommend FUTO keyboard., it is basically Swiftkey but it actually works and doesn’t come with Microsoft’s spyware built in.
It’s what I use now, and I’m really happy. Don’t be fooled by it being in Alpha, because it works flawlessly (minus the swipe, which is hit and miss).
Thanks for the suggestion, I’ll check it out
“Up to” can also be 0%. Why is there even a need to say “up to” here.
So you are saying up to 100% of their code is written by AI?
Up to 100% of all Windows code was written by a Macaque monkey on meth.
So you are saying up to 100% of all Windows code is Mac code?
Well, that would explain a lot.
I’m also guessing that at “up to 30%” of the company’s leadership decisions are being made by AI too.
This only makes sense if they are counting intellisense auto complete as “AI written”
Has to be something like that. Nadella is somehow cheating with the number, trying to keep the AI hype going.
You could say ALL of my latest scripts were written with AI. Because I often use it to get a hint or gather some boilerplate code (which I still go over and modify).
Was the auto complete in visual studio not a “trained” set before the llm craze kicked off? Would not surprise me if they decided to include that.
It shows
Beat me to it.
That explains so much
That’s why their products are so crappy!
No way, they get their results through honest effort. Anyone can make crappy AI products now, but Microsoft have been doing crappy products the hard way for decades. Don’t downplay their hard work !