We’re about to learn a painful lesson about delayed gratification in software engineering.

New data from China, 26,811 students tracked January 2023 through June 2025. Students using AI for homework saw their scores jump 20 percent. Completion time dropped nearly half. They aced the assignments.

Then exam season came. Those same students scored 20 to 40 percent worse when they couldn’t use the tool.

The homework phase is over. The exam phase is coming.

We’re doing this in software right now. Vibe coding feels incredible. Features ship fast. Nobody’s asking what happens in Month 18 when the original dev has left and nobody understands the codebase.

Commercial pilots fly with autopilot for most of every flight. They’re required to maintain manual flying proficiency regardless. If the system fails mid-air and the pilot can’t take over, people die.

Most teams using AI right now have forgotten how to fly manually. They’ve become passengers in their own systems. The autopilot flies, nobody checks instruments, and the first sign of trouble will be a breach notice or outage.

Three rules:

  1. Command the mission. Define architecture before prompting. Ambiguity kills in code and in flight. Delegate selectively. Offload mechanical work. Keep design and security reviews human. Verify everything. Audit before production.
  1. Never trust the automation without checking instruments.
  1. Quick wins feel good. Sustainable engineering feels boring. Boring keeps systems standing.

Organisations surviving the next two years won’t ship the fastest. They’ll be the ones who remember how to fly without the aids.


people insisting that you actually be skilled, independently of your tools, doesn’t make them Luddites. Rather, being unable to do so makes you a phony.

  • FuglyDuck@lemmy.world
    link
    fedilink
    English
    arrow-up
    118
    ·
    25 days ago

    The luddites had a point.

    They weren’t opposed to technology, but the use of technology to remove skilled labor to produce inferior products.

    Also, the pilot/autopilot argument is, kinda not applicable. The pilots aren’t just fucking around- autopilot systems only manage some aspects of flying, the pilots are still fully engaged.

    • WolfLink@sh.itjust.works
      link
      fedilink
      arrow-up
      45
      ·
      edit-2
      25 days ago

      The pilots absolutely can just fuck around for most of the flight, and even during the critical moments of takeoff and landing, the plane can do a lot of it automatically these days.

      Pilots need to actively practice flying without autopilot to keep those skills up in case the autopilot fails.

      • fake@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        16
        ·
        25 days ago

        the plane can do a lot of it automatically these days.

        It can but nobody is out there flying CAT IIIc autoland approaches because its ‘easier’.

      • sem@piefed.blahaj.zone
        link
        fedilink
        English
        arrow-up
        3
        ·
        24 days ago

        I watch a lot of airplane youtube, and this just seems to be wrong. During critical phases of flight, i.e landing and descending, the pilots have a high workload even with the autopilot. They are directing the autopilot ( which isn’t obvious how to do), they’re communicating, navigating, etc.

        Flight crews of the 20th century sometimes had crews of 3 or 4 people to handle all the tasks that are more automated these days. We don’t have dedicated flight engineers or navigators any more – the pilots do these jobs now too.

        During the cruise phase of flight, yes the pilots have a lower workload because of the autopilot. But on lots of flights, there might not be much of a cruise at all – they climb, and then descend.

        I don’t know how much commercial pilots are required to hand fly the plane, but it is a high workload even with the automation – the automation just helps them do a better job.

    • Fandangalo@lemmy.world
      link
      fedilink
      arrow-up
      25
      ·
      edit-2
      25 days ago

      I feel like their point was that the gains of technology were not distributed fairly, which is largely the concern today. It’s not “technology is bad”, or “technology make bad thing”; rather, “the owners of the machine undercut our labor, and we lose our jobs”, which I think was true. In the modern world, there are likely less tailors, as a percentage of the working population, certainly in first world countries. Sweatshops still exist, and it’s people’s labor competing against a production line, in terms of ROI for a business.

      I get the sense we all know AI isn’t going to bring about a uptopia for all people, because the economic systems don’t incentivize that. There’s some hypothetical world where this sort of technological advance could benefit all people, but it’s not the one we live in. That’s a reality & major problem for the technology (among other issues).

      I certainly think the cost of labor for tech development is going to drop significantly due to the market pressures; look at all the tech layoffs. At the same time, the upside is these tools make certain projects accessible & possible, because prior, would have needed significant funding, amazing solo skills, etc. There’s new opportunities available, but it’ll come at the cost of cratering tech position compensation & job security.

      I don’t know anyone in my field right now who feels safe (game dev), and I have many talented friends out of work.

      • nightlily@leminal.space
        link
        fedilink
        English
        arrow-up
        14
        ·
        24 days ago

        Just look at any productivity vs wage growth chart from any country. Anyone who thinks that any efficiency gain will pay off for workers is either naive or part of the grift.

    • Pup Biru@aussie.zone
      link
      fedilink
      English
      arrow-up
      7
      ·
      25 days ago

      the luddites had a point… in the moment… kinda… but i think have largely been pretty conclusively proven wrong… clothing is now plentiful, and i doubt anyone would want to go back to paying taylors to make all their clothes for 10x more, even if the clothing would be much higher quality, which i even doubt: clothing quality doesn’t come down to artisan skill any more, it comes down to choices you make, and an artisan can still make cost cutting decisions on fabric, construction, etc

        • BlaestEgnen@feddit.dk
          link
          fedilink
          arrow-up
          2
          ·
          25 days ago

          Fast fashion is a different topic from the machine produced vs tailor point they’re making.

          Made to order is getting more and more traction, because we have machines able to fully automate it. Making higher quality clothing more available than ever

          • Leon@pawb.social
            link
            fedilink
            arrow-up
            3
            ·
            24 days ago

            Eeh. High quality fabric is decently hard to get still, and the ability to recognise the quality of fabric is a more or less lost art for laypeople, when in times past this was something most everyone could tell.

        • Pup Biru@aussie.zone
          link
          fedilink
          English
          arrow-up
          1
          ·
          24 days ago

          i definitely agree, but plenty leading to waste doesn’t mean that plenty is a bad thing

          having enough food to not worry about food waste is definitively a good problem to have. ideally we don’t have food waste because we don’t have enough food for everyone, but just because plenty leads to waste at least initially isn’t an argument against plenty

          • WhyJiffie@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            1
            ·
            24 days ago

            what are you agreeing with you dummy? you definetly agree to disagree or what? fast fashion clothes become waste because people don’t actually want to wear them after a few times, or even if they do the clothes are so bad they get damaged very soon.

            its also not just about the waste products, its about the pollution and the destruction of our environment

      • Annoyed_🦀 @lemmy.zip
        link
        fedilink
        English
        arrow-up
        17
        ·
        25 days ago

        So…have you not heard the damage fast fashion did to the planet? Sure, it make making cloth quicker and cheaper and widely available, but in the end it’s a huge source of chemical waste, landfill waste, and microplastic. Because clothing are so much cheaper to buy new than fixing it, we lost a lot of skilled labour to automation.

        The same thing happened everywhere, automation take away human agency, and that take away skill learning. In the end humanity will suffer because less and less people gonna learn how to fix the shit that they rely on. That didn’t happen on accident, that’s by design. We all thought AI gonna upskill a lot of people, but i feels like instead of making a nation of artisan it gonna make a nation of 7/11. Just look at Destin’s struggle to make a fucking bbq brush fully American, the nation of 300millions people can’t even provide parts that fully made within the nation.

        • captcha_incorrect@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          24 days ago

          Fast fashion would be the other end of an extreme. Another way is for stores to have one of each size, you try the one you want and place an order. The store delivers in batches and enough orders are placed.

          • kestrel7_7@lemmy.world
            link
            fedilink
            arrow-up
            2
            ·
            24 days ago

            That’s not how clothes work, these days you either get fast fashion or tailored. There’s basically nothing left in between because of the economics of the industry. If you’re doing readymade clothing, you gotta do it at scale (and it’s never going to fit a lot of people). This is exactly what the Luddites predicted; tailored clothes for very rich people, slop for everyone else.

      • creamfresh@lemmy.world
        link
        fedilink
        arrow-up
        16
        ·
        25 days ago

        No. They weren’t proven wrong, pauperism was the consequence and it was horrible. Luckily we shifted that back to regimes that don’t like to report much on terrible living and environmental conditions so we don’t have the filth at our doorstep.

        • Pup Biru@aussie.zone
          link
          fedilink
          English
          arrow-up
          1
          ·
          24 days ago

          yeah… as i said, they had a point in the moment

          in 2026 we have retraining programs and social security programs… these are the solutions to industrialisation; not ignorance… the longer you fight industrialisation the harder it hits because rather than happening gradually it happens all at once and society has a harder time absorbing it

          • creamfresh@lemmy.world
            link
            fedilink
            arrow-up
            7
            ·
            24 days ago

            Stupid Uyghurs, should just make use of their “retraining programs and social security programs” instead of being forced to produce our cheap shit.

            • Pup Biru@aussie.zone
              link
              fedilink
              English
              arrow-up
              2
              ·
              24 days ago

              china having human rights abuses is not an argument against retraining people when technology starts to make jobs redundant

              • kestrel7_7@lemmy.world
                link
                fedilink
                arrow-up
                5
                ·
                24 days ago

                Their point is that the people being abused in sweatshops aren’t the same people who are benefiting from retraining and social security. Because the Luddites were basically correct about everything

        • melfie@lemmy.zip
          link
          fedilink
          arrow-up
          2
          ·
          24 days ago

          The one glimmer of hope is open models and especially fully open source ones like K2 Horizon. Open models and tooling for running them locally are rapidly evolving such that the tech will be democratized instead of a couple capitalists having a stranglehold on the tech.

      • kestrel7_7@lemmy.world
        link
        fedilink
        arrow-up
        5
        ·
        edit-2
        24 days ago

        It’s the sweatshops, man. The sweatshops suck. I would absolutely rather have one set of tailored clothes, vs. endless variety from sweatshops where Bangladeshi children work for pennies an hour.

      • FuglyDuck@lemmy.world
        link
        fedilink
        English
        arrow-up
        23
        ·
        25 days ago

        Luddites weren’t concerned about the printing press. Their fight was over mechanized looms and knitting frames.

        Their concerns were mostly about losing their jobs, as well as the absolute dog shit quality the mechanical machines produced at the time.

        In 1814, printers in London did have similar conniptions over the steam press, though.

  • annoying_cyclist@programming.dev
    link
    fedilink
    arrow-up
    51
    ·
    25 days ago

    I have a hard time telling AI authored LinkedIn thought leadership apart from formulaic LinkedIn thought leadership sometimes, but this feels AI written, which makes it fairly amusing considering the point it’s making.

    (Does vibe coding feel incredible? Also, “Nobody’s asking what happens in Month 18 when the original dev has left and nobody understands the codebase” implies that the vibe coder original dev understood the codebase at any point, which isn’t an argument I’d feel comfortable making for any of the ones I’ve worked with)

    • T156@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      edit-2
      25 days ago

      Does vibe coding feel incredible?

      There’s definitely a magic in watching it print code with almost no input. Like watching git history with Gource.

      It’s not good code, but it is cool to see.

  • Wirlocke@lemmy.blahaj.zone
    link
    fedilink
    arrow-up
    44
    ·
    24 days ago

    I agree with everything except for vibe coding feeling great.

    Am I the only one who gets incredibly anxious relying on AI to code? I still ask it for code when I really just want to move on from a problem but it always feels like voluntarily putting mold in my floorboards.

    • RamRabbit@lemmy.world
      link
      fedilink
      arrow-up
      12
      ·
      edit-2
      24 days ago

      I only use it to solve specific problems when I can’t find the solution elsewhere. Then I spend the time to understand and rewrite the code myself.

      It’s the same workflow as using Stack Overflow, etc. You can’t just copy/paste solutions.

    • ThunderComplex@lemmy.today
      link
      fedilink
      arrow-up
      12
      ·
      24 days ago

      I try vibe coding from time to time and it’s a mixed bag. When it works it works but then there’s suddenly just code there. It’s like when a colleague implements a feature in a project with multiple devs but since it’s just your personal project you suddenly got put in the code reviewer chair.

      When I write code I reason about all the small decisions but when the agent takes over I have to figure out step by step why decisions were made.

      I’m still not sold on coding agents and vibecoding but it’s getting better and more usable.
      The only downside is that a agent doing its thing is now seen as downtime where you could just prompt another agent and work on several projects simultaneously. If anyone ever tells you vibecoding is good because you can work in parallel RUN

      • BrickEater@lemmy.world
        link
        fedilink
        arrow-up
        9
        ·
        edit-2
        24 days ago

        I try vibe coding from time to time and it’s a mixed bag. When it works it works but then there’s suddenly just code there. It’s like when a colleague implements a feature in a project with multiple devs but since it’s just your personal project you suddenly got put in the code reviewer chair.

        When I write code I reason about all the small decisions but when the agent takes over I have to figure out step by step why decisions were made.

        I’m still not sold on coding agents and vibecoding but it’s getting better and more usable. The only downside is that a agent doing its thing is now seen as downtime where you could just prompt another agent and work on several projects simultaneously. If anyone ever tells you vibecoding is good because you can work in parallel RUN

      • BrickEater@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        24 days ago

        ~~I try vibe coding from time to time and it’s a mixed bag. When it works it works but then there’s suddenly just code there. It’s like when a colleague implements a feature in a project with multiple devs but since it’s just your personal project you suddenly got put in the code reviewer chair.

        When I write code I reason about all the small decisions but when the agent takes over I have to figure out step by step why decisions were made.

        I’m still not sold on coding agents and vibecoding but it’s getting better and more usable.
        The only downside is that a agent doing its thing is now seen as downtime where you could just prompt another agent and work on several projects simultaneously.~~ If anyone ever tells you vibecoding is good because you can work in parallel RUN

    • MonkeMischief@lemmy.today
      link
      fedilink
      arrow-up
      7
      ·
      edit-2
      24 days ago

      I think it sounds really weird, too. I don’t like the sound of that at all. I’m not a pro though.

      I’ll admit I enjoy carrying on little tutoring sessions with my GPU though. “How might I approach something like that?” “Can you explain this concept a bit differently?”

      But I try to do all the solid brain work myself. Letting the machine write the code for me feels…kinda gross.

      I actually think it’s awesome that it understands coding convention and codebases and stuff well enough. Saves a lot of time digging through the wreckage of search engines…

      But I don’t appreciate that a lot of its “skill” is pulled from the efforts of uncompensated coders.

  • farmgineer@nord.pub
    link
    fedilink
    English
    arrow-up
    38
    ·
    25 days ago

    when the original dev leaves and nobody understands the code

    In my experience at work, no one cares about this. They assume the AI will be able to get there with enough tokens/time with the help of the human at the other end. They have done this and decided it was good enough.

    Meanwhile, people like me who don’t use AI coding agents and are PRing and modifying the code are having a hell of a time.

    • T156@lemmy.world
      link
      fedilink
      English
      arrow-up
      14
      ·
      25 days ago

      They assume the AI will be able to get there with enough tokens/time with the help of the human at the other end. They have done this and decided it was good enough.

      Or if it does break, just hit it with the AI stick until it works again.

  • reallykindasorta@slrpnk.net
    link
    fedilink
    arrow-up
    37
    ·
    25 days ago

    That’s what they’re doing for my SO’s big introductory class in the humanities. No homework, quizzes, or papers. Short answer exams done in a special testing center.

    Really sucks for people who were decent at essays and turning in assignments on time but not great at exams.

      • queerlilhayseed@piefed.blahaj.zone
        link
        fedilink
        English
        arrow-up
        9
        ·
        25 days ago

        I’m the “good at exams” type, I find paper writing (or novel writing… 😢) unpleasantly tedious. If we lose the “good at structuring complex thoughts in a way that can be coherently decoded by other humans” types, the “good at exams” types will suffer. We need people who can write good papers and people who can recall diverse facts and arrange them into simple shapes quickly.

          • MalReynolds@slrpnk.net
            link
            fedilink
            English
            arrow-up
            5
            ·
            edit-2
            25 days ago

            we were talking about the need for radical education reform over a decade ago

            Education, and especially critical thinking, has been systematically gutted by conservative governments for at least 4 decades in the Western world. The goal is the absolute minimum knowledge and thinking skills (preferably without learning skills) necessary to complete the wage slavery tasks.

              • MalReynolds@slrpnk.net
                link
                fedilink
                English
                arrow-up
                2
                ·
                24 days ago

                Hard agree on Prussian-style education (which had similar goals of wage slavery when it was introduced). Unfortunately the pessimist in me thinks reform will likely have to wait until after this round of fascism has run its course, but it absolutely need to be a high priority when the time comes. Best time to plant a seed is twenty years ago…

      • reallykindasorta@slrpnk.net
        link
        fedilink
        arrow-up
        4
        ·
        25 days ago

        Yeah I would have done much better in high school like this, though I don’t think AI will eliminate the poster projects unfortunately.

      • FaceDeer@fedia.io
        link
        fedilink
        arrow-up
        3
        ·
        25 days ago

        I wasn’t great at exams, but I think if I re-did university today I’d still do much better because my personal learning style is best when I talk through the material with someone. Sitting in a lecture listening to someone monologue at me, reading a static textbook, those weren’t great. But with LLMs every student now has full-time access to a “live tutor” with infinite patience and no sense of social risk from asking it dumb questions. It’s absolutely my perfect learning environment.

        • dubs@lemmy.dbzer0.com
          link
          fedilink
          arrow-up
          2
          ·
          24 days ago

          https://www.youtube.com/watch?v=VwZi58u1FjI - The Dragon Speech

          All the higher mammals learn by playing, by doing, by interacting. And indeed, the higher the mammal, the more of its life it spends in play to prepare itself for adulthood. So you can see, this active role of the mind is fundamental to the way we think. It’s wired into our brains.

          It’s a really great speech, and a lot of it is about the failures of our educational system.

  • FishFace@piefed.social
    link
    fedilink
    English
    arrow-up
    24
    ·
    24 days ago

    This is probably overly pessimistic/optimistic (depending on your outlook) in terms of timing. You won’t forget how to code after 18 months of using AI to do it instead; if you decide to go cold turkey, or OpenAI turns the screws on pricing, or whatever, you’ll be back in the swing of things in no time. The lesson from schools is that junior programmers who are learning now are not going to gain the same ability we did. (Besides that they’re finding it difficult to get hired because the AI can do junior programming fairly OK, that is). So the problem won’t be in 18 months; it’ll be in a few years at least, from that point of view.

    There’s the separate question of architecture and code quality; by this point we’ve probably all seen the impenetrable morass that vibe coding leads to. That, I’m guessing, will cause problems much sooner.

    • Kairos@lemmy.today
      link
      fedilink
      arrow-up
      4
      ·
      24 days ago

      That’s not what we’re talking about. Knowing how to program is just one thing. Students who use AI to cheat on theory classes won’t learn the theory. Additionally in programming classes they won’t learn how to program as well as they could

      • FishFace@piefed.social
        link
        fedilink
        English
        arrow-up
        3
        ·
        24 days ago

        I think it is what the original post is talking about - it literally says “We’re doing this in software now … Nobody’s asking what happens in month 18”!

        • Kairos@lemmy.today
          link
          fedilink
          arrow-up
          2
          ·
          24 days ago

          “Software” is not just knowing how to write code. I know from firsthand experience that experience with how a program runs, and the more technical bits help a shittton.

            • Kairos@lemmy.today
              link
              fedilink
              arrow-up
              1
              ·
              edit-2
              24 days ago

              And using “AI” to write code or assignments will hinder a student from learning that more technical in the first place.

                • Kairos@lemmy.today
                  link
                  fedilink
                  arrow-up
                  3
                  ·
                  24 days ago

                  This happens with students and professionals all the same. I did miss you specifying professionals in your comment but most of what I said is correct. I’m not a student and I’m still learning more just by forcing myself to do things on my own.

  • dandi8@fedia.io
    link
    fedilink
    arrow-up
    16
    ·
    24 days ago

    Nice message, but why use the slop machine to write it? Use your own words!

  • mojofrododojo@lemmy.world
    link
    fedilink
    English
    arrow-up
    15
    ·
    24 days ago

    “AI is the asbestos we are shovelling into the walls of our society, and our descendants will be digging it out for generations.” - Cory Doctorow,

  • dylanTheDeveloper@lemmy.world
    link
    fedilink
    arrow-up
    14
    ·
    24 days ago

    I know that when i started using AI i got over blocks much faster. A system from design to implementation that use to take a week now only takes a few hours with most of that is testing and reviewing the code.

    I don’t use agents to test and review code btw because i still want to know what’s going on but my colleagues are definitely using agents to build test large codebases. Im sorry but the truth is AI has changed how we build products in the same way intellisense and jet brains did but on a scale i haven’t seen in my lifetime.

    • UnfortunateShort@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      24 days ago

      Agreed. If you don’t use AI in coding you are not competitive with someone who does. It really is that simple. You won’t be able to keep up, your bosses will see, you will get fired and that’s that.

      Even if the quality you deliver without AI is better, quality is not everything. Time is always a factor and AI beates you ten times over. The rest is sane flows with lot’s of testing etc.

      • mindbleach@sh.itjust.works
        link
        fedilink
        arrow-up
        14
        ·
        24 days ago

        This isn’t One Hour Hot Dog. If you need a big huge fix right the hell yesterday, you fucked up last week. Possibly last year. And what’s gonna prevent that sort of company-liquidating blunder is a layer of crotchety obsessives who can spend a day reading and then commit one line. ‘Hit engine with hammer: $1. Knowing where to hit: $9,999.’

        A system that’s pretty good at guessing a hundred places to try hitting has obvious value. Especially when undo is a thing. But this attitude of ‘the future is now, old man!’ is almost as off-base as the folks insisting a magic coding robot won’t help anybody.

        • MonkeMischief@lemmy.today
          link
          fedilink
          arrow-up
          3
          ·
          24 days ago

          I agree with you. I’m not even 100% anti-AI even though a lot of how it is used absolutely reeks.

          Of course Big Business is gonna be all about shipping it fast and cheap to the detriment of all else as long as it “works right now.” The ridiculous farce of capitalism as we know it now is that their real goal is to sell off and bail at a profit just before all that vibe-debt comes due and things implode.

          It doesn’t mean it’s the best way to create software.

          It reminds me of how homes nowadays are thrown together and so ridiculously shoddy because it’s all about speed and holding together just long enough to sell.

      • porous_grey_matter@lemmy.ml
        link
        fedilink
        arrow-up
        5
        ·
        24 days ago

        Haha, nah. If you’re generally faster with AI assistance it just means you never actually knew how to do your job properly. Sure it can help you get over some hurdles, make docs searches a bit easier if some library has crap docs, but it’s a 5% speed improvement at best and it’s all worse the moment it sends you down some stupid hallucinated rabbithole.

        • UnfortunateShort@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          24 days ago

          I don’t know whether this is just ragebait, whether you have never tried any advanced AI agent or whether you genuinely think you can work as fast as an AI, but I can asure you that you can’t.

        • dylanTheDeveloper@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          edit-2
          24 days ago

          You should give it another go, it has evolved disturbingly since last year. It out performs a junior level software engineer in both design, implementation, testing and debugging.

          The hybrid model of a senior engineer using AI to produce code while the rest of the time allocation is spent on reviewing is the new normal.

          You get 4 weeks to build x feature, you spend maybe a day with the help of AI then use the rest of the allotted time testing and debugging. What’s happening now is your allotted time is shrinking because managers understand how much faster engineers are working so its a cycle of shorter deadlines which pushes everyone to use AI.

          I wouldn’t worry about software engineers going extinct. The role is changing but those core skills are really important to catch mistakes from both humans and AI.

          Right now theirs two types of people using AI, software engineers who learned computer science and built software products and Joe MBA who struggles to write a bat file with the latter struggling to build cohesive products

  • underscores@lemmy.zip
    link
    fedilink
    English
    arrow-up
    13
    ·
    24 days ago

    Goodluck arguing this with the AI bros

    “dude I have an agent of workflow that goes through the entire codebase. the agent is the expert and I am guiding it”

    alright man you have fun with that

    • Auth@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      24 days ago

      My co worker is beyond that. He says the AI is smarter than him and he just passes the captchas and interacts with the real world for it

      • veni_vedi_veni@lemmy.world
        link
        fedilink
        arrow-up
        7
        ·
        24 days ago

        Fucking scary people are so willing to turn off their brain. When shit goes wrong, they will hold you accountable, not the AI.

  • FaceDeer@fedia.io
    link
    fedilink
    arrow-up
    12
    ·
    25 days ago

    Nobody’s asking what happens in Month 18 when the original dev has left and nobody understands the codebase.

    Throughout my career, I’ve often had to sync a git repository for some random project that I’ve never worked with before and then had to muddle through whatever was in there hoping that the documentation was vaguely complete and accurate.

    Nowadays it’s actually much easier. If the documentation isn’t complete or accurate I just turn my coding agent loose on it and tell it to write the documentation.

    I get the impression that the guy writing this hasn’t actually used modern coding agents, this is not a problem.

    I see coding AI as being similar to a compiler. Before compilers came along programmers had to work in assembly language. Nowadays very few programmers ever do anything in assembly and that’s perfectly fine.

    • Pup Biru@aussie.zone
      link
      fedilink
      English
      arrow-up
      8
      ·
      25 days ago

      i’d say it’s not quite like a compiler because you still need to know what the code does… a compiler you largely don’t care, and it’s deterministic… an LLM hallucinates, so you can’t just trust it, which means you have to be able to assess when it’s doing the wrong thing

      i agree that setting an agent going helping you learn a codebase is reasonable, largely because it can quickly point out connections in the code quicker than you can understand the architecture, and its guesses are usually just as good as your guesses until you get knowledgeable with the codebase

      however, and that’s a very load-bearing however, i don’t think you should just jump into a codebase and just go ahead and tell the LLM to write new code without understanding what it’s done… the understanding is exactly what this graph is trying to show: actually learning is critical, so your review of the code becomes doubly important: you’re gaining institutional knowledge, and you’re making sure the output isn’t slop

      • locuester@lemmy.zip
        link
        fedilink
        English
        arrow-up
        2
        ·
        25 days ago

        an LLM hallucinates, so you can’t just trust it, which means you have to be able to assess when it’s doing the wrong thing

        Unless you can define what the right thing is. Then you just have it write proper tests, and it’s able to verify itself.

        • trebach@sh.itjust.works
          link
          fedilink
          arrow-up
          3
          ·
          24 days ago
          Assert.IsTrue(true);
          

          There! That’s a passing test but doesn’t test anything. That’s why you write your own tests instead of having a machine do it for you.

        • Pup Biru@aussie.zone
          link
          fedilink
          English
          arrow-up
          2
          ·
          24 days ago

          an LLM frequently writes shit tests… you’re just moving the architecture problem: either you properly understand and review the initial code, which means you catch not just binary “correct input/output” but also performance, layout, DRY, style, heaps of things

          OR

          you properly review the tests because “passing” doesn’t mean tested

        • Honytawk@discuss.tchncs.de
          link
          fedilink
          English
          arrow-up
          1
          ·
          24 days ago

          Don’t let an AI verify itself, it will just make the exact same mistakes.

          Verification should still be done by a human. You can use a different AI in addition to human verification, but a human should still be in the chain somewhere.

    • BlueÆther@no.lastname.nz
      link
      fedilink
      English
      arrow-up
      7
      ·
      25 days ago

      I’m no dev, but did do my HND in computing some 25 years ago. I have also tinkered with scripts to solve an itch and have has plenty of VBA and of late DAX and power query.

      I did a project for myself around a year ago that was much larger than I normally would these days and I used Gemini. It was a constant battle with the LLM (man it’s hard not to gender and personify these LLMs) to keep it on track and not keep breaking shit all the time. It struggled to writ valid rules for it’s own firebase/firestore. It generally felt like a bad time.

      This past week end I got codex to migrate the PWA from google’s services and database into a selfhostable docker stack. It was a pleasure, it documented the whole process map, built a full test environment, followed through and imported my data. It the suggested a few improvements. It even rewrote a a complex equation that Gemini could nust not get correct and added manufacture safe/max bounds.

      all this to say ‘yes, modern agents do seem to do a good job of a codebase that they have never seen’

      • FaceDeer@fedia.io
        link
        fedilink
        arrow-up
        7
        ·
        25 days ago

        Yeah, I’ve been tinkering with coding agents for a while now and it feels like some sort of “phase transition” happened earlier this year - the models and their harnesses went from being the sort of clumsy barely-passable student coders that people make fun of to being actually highly competent. Lately even the small local models have reached that level - I’ve been using Qwen3.8 27B on my own machine and it’s been doing just fine. I suspect a lot of the folks making fun of them tried them early on and wrote them off, not giving the latest versions a second chance.

        The compiler comparison works there too, IMO. I remember back when I was learning the tricks of the trade there were all sorts of ways you were supposed to write code to trick compilers into generating more efficient results. Coding standards would say to use ++i instead of i++ for incrementing loop indices, use x*0.1 instead of x/10 because division was way more expensive than multiplication, using memcpy instead of copying values with =, using int instead of bool, and so forth. Lots of stuff. Some of it was never useful, it was just folklore and superstition. Other stuff did make a difference with early compilers but modern ones know these tricks themselves and can often apply them better than the human programmer can. So the old-school greybeards who still insist on doing that stuff can actually make things worse these days (disclaimer: my beard is pretty grey these days too).

        I expect so too will this “hah, vibe slop” attitude eventually pass away. AI is getting quite good quite quickly.

          • FaceDeer@fedia.io
            link
            fedilink
            arrow-up
            3
            ·
            25 days ago

            To be serious for a moment here on programmer_humor, yeah, it’s a real puzzler. For now there’s still a role for programmers like us in all this because we’re still good at knowing how to translate the requirements of non-technical people into the things we actually ask the coding agents to build for us. But AI’s getting good at that too. As might be expected, they’re language models so interpreting what people tell them using language is kind of their jam.

            If I were advising someone who’s looking at whether to get into programming as a profession right now, I’d tell them to only go that route if they had the resources to take a mulligan on their education and try something else if a couple of years from now it turns out that the robots have completely taken the job over. I think it’s a real possibility, and will lead to some interesting times indeed.

            Until then, I guess we keep making jokes about it? Just make sure not to take them too seriously. AIs can count how many Rs are in “strawberry” now. They can whip up a bit of Javascript to do it for them in their harness’ sandbox.

    • idriss@lemmy.ml
      link
      fedilink
      arrow-up
      5
      ·
      25 days ago

      (talking about non-trivial code bases here)

      Not being able to understand a code base and needing an agent to do that is one thing (skill issue I guess), but not knowing the intention behind a piece of program is a complete different thing (the agent can’t read the mind of the original author on why certain business compromise was made, how the design evolved to this point, …).

      I get the feeling all these people defending vibe coding never worked on a non-trivial project and something that has to live and serve large volume of requests for 5+ years.

      • FaceDeer@fedia.io
        link
        fedilink
        arrow-up
        2
        ·
        24 days ago

        Heck, I’ve been using them to untangle years worth of me working on codebases. I’ve got a lot of random little scripts and “applications” and whatnot that I threw together to perform various tasks on my home computer over the years and most of them were extremely sloppy because “who cares, this is just for me and just for this one weird thing I need to do.” I’ve been pointing my AI agent at these things and telling it to clean them up. I’m hoping this isn’t putting me a lot higher on Skynet’s naughty list when the time comes for the robots to punish all those who have been mean to them.

  • mystic-macaroni@lemmy.ml
    link
    fedilink
    arrow-up
    10
    ·
    25 days ago

    This is largely an oversimplification because it depends on how you use AI in the first place. Are you building modularly and incrementally? Or are you letting it ride on black?

    • yamper@piefed.social
      link
      fedilink
      English
      arrow-up
      10
      ·
      25 days ago

      ive personally found LLM coding to be pretty effective if i adhere to very strict “engineering best practices” like TDD, good documentation, thorough API design, systems design, etc.

      im very afraid that the next generation of software engineers will never develop the skills needed to make the most out of it because they skipped the rudiments of good software engineering.

      to me it feels like playing jazz without learning scales. it’s possible to be an incredible jazz musician without formal training if you’re a savant… but you’re probably not.

      • mystic-macaroni@lemmy.ml
        link
        fedilink
        arrow-up
        1
        ·
        24 days ago

        I have a little more hope for future generations. Regardless of if you are primarily using ai to speed up a traditional work flow or vibe coding, there still are more and less effective ways to get things done. I’ve found if I write sonething I’m familiar with like bash or Python, I “know enough” to write functions and refactor incrementally. It’s a methodical process which produces code better than I can write by myself in less time.

        Compare that to when I write Lisp. There it’s more or less throw shit at the wall until I somewhat get what I want. It takes longer and can be next to impossible to extend or effectively refactor.

        Based on that observation of myself, I think we’ll find two (and probably more) kinds of programmers in the future. Ones who use it as an assistant to speed up a traditional workflow, and those who produce the slop that we are afraid of.

        Perhaps to give us any amount of additional hope/comparison to now. There still have been people who have programmed now who create slop. And that comes to the way we use references like stack exchange or the Arch Wiki. Are you copy and pasting while learning what things mean and learning in the process? Or are you just stringing things together to get results at all? I don’t think we would argue those references made all of us worse.

        So I think it’s an apt concern, but we’ll have to wait to see what it’s like whole sale. I was a doubter for a long time, but I’ve come to understand where Torvalds et al are coming from.

    • MonkeMischief@lemmy.today
      link
      fedilink
      arrow-up
      3
      ·
      edit-2
      24 days ago

      I kinda agree. Although, I think the logic is nuanced. There is value in being able to know your stuff when your advanced tools and reference materials aren’t readily available or have failed.

      … But then again I’m sure most of these kids aren’t going to be needing to emergency land a spacecraft by doing complex math from their head, Apollo 13 style… so… :p

      But the cynic in me agrees “exams are horseshit.” It feels like they’re often used as a filter to keep the degree/cert/whatever “valuable.”

    • AliOski@feddit.nl
      link
      fedilink
      arrow-up
      1
      ·
      24 days ago

      It is a metaphor, not a representation.

      What it is saying is that structural qualitative improvement holds out longer and will give better results compared to trying to improve as fast as possible regardless of quality.

      Kind of.