• geneva_convenience@lemmy.ml
    link
    fedilink
    arrow-up
    8
    arrow-down
    1
    ·
    11 days ago

    For inference only. NVIDIA GPU’s are so big because they can train models. Not just run them. All other GPU’s seem to lack that capacity.

    • lorty@lemmygrad.ml
      link
      fedilink
      arrow-up
      6
      ·
      10 days ago

      And training them requires a LOT of VRAM, and this is why they do as much as they can to limit VRAM on their gaming cards: better market segmentation.