• model_tar_gz@lemmy.world
    link
    fedilink
    English
    arrow-up
    61
    arrow-down
    3
    ·
    3 months ago

    I’m an AI Engineer, been doing this for a long time. I’ve seen plenty of projects that stagnate, wither and get abandoned. I agree with the top 5 in this article, but I might change the priority sequence.

    Five leading root causes of the failure of AI projects were identified

    • First, industry stakeholders often misunderstand — or miscommunicate — what problem needs to be solved using AI.
    • Second, many AI projects fail because the organization lacks the necessary data to adequately train an effective AI model.
    • Third, in some cases, AI projects fail because the organization focuses more on using the latest and greatest technology than on solving real problems for their intended users.
    • Fourth, organizations might not have adequate infrastructure to manage their data and deploy completed AI models, which increases the likelihood of project failure.
    • Finally, in some cases, AI projects fail because the technology is applied to problems that are too difficult for AI to solve.

    4 & 2 —>1. IF they even have enough data to train an effective model, most organizations have no clue how to handle the sheer variety, volume, velocity, and veracity of the big data that AI needs. It’s a specialized engineering discipline to handle that (data engineer). Let alone how to deploy and manage the infra that models need—also a specialized discipline has emerged to handle that aspect (ML engineer). Often they sit at the same desk.

    1 & 5 —> 2: stakeholders seem to want AI to be a boil-the-ocean solution. They want it to do everything and be awesome at it. What they often don’t realize is that AI can be a really awesome specialist tool, that really sucks on testing scenarios that it hasn’t been trained on. Transfer learning is a thing but that requires fine tuning and additional training. Huge models like LLMs are starting to bridge this somewhat, but at the expense of the really sharp specialization. So without a really clear understanding of what can be done with AI really well, and perhaps more importantly, what problems are a poor fit for AI solutions, of course they’ll be destined to fail.

    3 —> 3: This isn’t a problem with just AI. It’s all shiny new tech. Standard Gardner hype cycle stuff. Remember how they were saying we’d have crypto-refrigerators back in 2016?

    • Hackerman_uwu@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 months ago

      Also in the industry and I gotta say it’s not often I agree with every damn point. You nailed it. Thanks for posting!

  • FlashMobOfOne@lemmy.world
    link
    fedilink
    English
    arrow-up
    20
    arrow-down
    2
    ·
    3 months ago

    I’ve been reading a book about Elizabeth Holmes and the Theranos scam, and the parallels with Gen AI seem pretty astounding. Gen AI is known to be so buggy the industry even created a euphemistic term so they wouldn’t have to call it buggy: Hallucinations.

  • RememberTheApollo_@lemmy.world
    link
    fedilink
    English
    arrow-up
    18
    arrow-down
    2
    ·
    3 months ago

    Wasting?

    A bunch of rich guy’s money going to other people, enriching some of the recipients, in hopes of making the rich guy even richer? And the point of AI is to eliminate jobs that cost rich people money?

    I’m all for more foolish AI failed investments.

    • Jax@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      7
      ·
      edit-2
      3 months ago

      It’s a circle jerk, don’t get fooled into thinking this is some new version of trickle down economics

      • RememberTheApollo_@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        3 months ago

        It’s not trickle down at all. Definitely not what I was trying to say. Just rich people trading money among themselves in hopes of getting richer.

    • Cryophilia@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      3 months ago

      Imo it’s wasted in the sense that the money could have gone towards much better uses.

      Which is not unique to AI, it’s just about the level of money involved.

        • Cryophilia@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          3 months ago

          New renewable energy installations.

          Research into vaccines.

          Malaria distribution.

          Higher education endowments.

          Heck, just paying the salaries of people working in those fields. Sure, spending money stimulates the economy so I wouldn’t go so far as to say it’s totally wasted, it’s definitely being put to a much better use than just sitting in someone’s bank account. But it could be put to a lot better uses. The software engineers could be developing a new program for balancing energy loads, or managing the maintenance of wind turbine fields. The hardware engineers could be optimizing a better autoclave or building a machine that automatically dispenses medicine when fed a script. The PMs could be managing a team distributing aid in Ukraine or designing a new blood drive initiative. Jobs that have positive societal impact, instead of - at best - neutral societal impact.

    • DrQuickbeam@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      3 months ago

      This was my first thought. VC’s always expect 4 out of 5 projects they invest in to fail and always have. But it still makes them money because the successes pay off big. Is the money and resources wasted? Welcome to modern capitalism.

  • Thebeardedsinglemalt@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    1
    ·
    3 months ago

    As I said in a project call where someone was pumping up AI, this is just the latest bubble ready to pop. Everyone is dumping $$ into AI, a couple decent ones will survive but the bulk is either barely functional or just vaporware.

    • Fredselfish@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      3 months ago

      My new job even said they are using AI. It usurb every goddamm company shoving AI features on us.

      • Living_Dead@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        3 months ago

        My new job said this aswell. When I got into the position I found out it was actually a machine learning model and they were trying to use it but didn’t have the time to create a clean dataset for the learning so it has never worked. This hasn’t stopped them from advertising that they are using AI.

    • Melvin_Ferd@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      3
      ·
      3 months ago

      Isn’t that how innovation has always worked?

      I feel like all this AI hate is comparable to any other innovation cycle.

      Millions of light fabric and dowels wasted on crack pot “air heads” trying to design first ever flying vehicle

      • JTskulk@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        3 months ago

        I think there’s more AI hate because it’s being pushed onto users that didn’t ask for it and don’t want it from the likes of Microsoft, Google and Amazon. And I think it’s warranted!

          • JTskulk@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            3 months ago

            Google added it to their search by default, I had to change my default search to exclude it. Same with my Android phone, I got prompted to switch from Google Assistant to Bard and declined. Really glad I did since I later read about how awful it is. Yesterday I saw a copilot icon in Teams that I have to use for work. I clicked it out of curiosity and it showed an error and then wouldn’t let me use Teams for 5 minutes. When I finally got in the copilot button was gone lol.

            • Melvin_Ferd@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              3 months ago

              Yea I guess for me Google already sucks without AI and beyond that I don’t have issues or bugs anymore than usual. But I also use chatgpt for things to do I find it useful. Even right now I’m asking if to give me some prompts to code while I learn different design patterns. Like asking it what is a good decorator use case.

  • Phoenix3875@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    3 months ago

    The interviews revealed that data scientists sometimes get distracted by the latest developments in AI and implement them in their projects without looking at the value that it will deliver.

    At least part of this is due to resume-oriented development.

  • SomeGuy69@lemmy.world
    link
    fedilink
    English
    arrow-up
    11
    arrow-down
    6
    ·
    3 months ago

    That’s great. Like 5% more fails than regular software projects. Why do people see this as validation for AI failing? Lol