• christian [he/him, any]@hexbear.net
    link
    fedilink
    English
    arrow-up
    6
    ·
    2 months ago

    Then ‘RAG’ allowed the AI to read parts of your codebase and maybe even do a google search.

    I’m sure it’s reassuring to know that the entire process isn’t just having the AI talk to itself nonstop and that it does reach out to get opinions from a second AI from time-to-time.

    • ZWQbpkzl [none/use name]@hexbear.net
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 months ago

      Often they do that within the model’s architecture itself. You can save drastically on the filesize of the model itself by using this Mixture of Experts (MoE) strategy. Its how deepseek was able to break into the market.