• bobs_guns@lemmygrad.ml
    link
    fedilink
    English
    arrow-up
    7
    ·
    11 days ago

    Not just memory quantity but memory bandwidth. The speed of computation in GPUs turns many problems from computationally limited to memory bandwidth limited. Tensor multiplication that underlies neural networks is among those problems.