Please create an account to participate in the Slashdot moderation system

 



Forgot your password?
typodupeerror
×
AI Technology

AI Needs Specialized Processors. Crypto Miners Say They Have Them (bloomberg.com) 23

When the Ethereum blockchain moved away from using a technique for verifying transactions known as proof of work last September, crypto market demand for the specialized processors that performed these calculations disappeared virtually overnight. Companies that used and hosted GPUs, or graphics processing units, saw a key part of their once-booming business vanish against an increasingly difficult backdrop for crypto. But now mining infrastructure companies like Hive Blockchain and Hut 8 Mining are finding opportunities to repurpose their GPU-based equipment for another industry on the precipice of a possible boom: artificial intelligence. From a report: "If you can reapply some of that investment in the GPU mining infrastructure and convert it to new cards and workloads, it makes sense," Hut 8 Chief Executive Officer Jaime Leverton said in an interview. GPUs -- designed to accelerate graphics rendering -- require constant maintenance and physical infrastructure not all users are prepared to provide. As such, Hut 8 and a few other miners have been using the chips to power high-performance computing, or HPC, services for clients across a range of industries. But inroads with the burgeoning and much-hyped AI sector -- which requires huge amounts of computing power -- represent the kind of transformational opportunity miners had been seeking when they originally bought the processors.
This discussion has been archived. No new comments can be posted.

AI Needs Specialized Processors. Crypto Miners Say They Have Them

Comments Filter:
  • by omnichad ( 1198475 ) on Thursday May 11, 2023 @09:03AM (#63513919) Homepage

    In other words, they can't cash out. I'm sure they had hoped to be able to sell the cards for over retail after they've been burned up. Too bad the next gen stuff is actually in stock and there are budget (ish) options available.

    • by evanh ( 627108 )

      They did and are selling the cards second-hand to gamers. That's one big reason for new GPU sales being so low for the last 10 months odd. It has really hurt AMD's and nVidia's bottom lines. Not to mention thoroughly stunted Intel's effort to enter GPU market.

      This is purely a marketing exercise to say they're interested in contract "AI" (neural nets) work.

      It won't last though. Just like with bitcoin, neural nets will move on to ASICs too. Or at least GPUs will spin off into NN processors with distinctl

  • by xack ( 5304745 ) on Thursday May 11, 2023 @09:09AM (#63513935)
    All over the internet there are pictures of shelves of unsold gpus necause they don't have enough vram for either games or AI. If I was NVidia i would recall them and solder some proper vram on them otherwise Nvidia's reputation will be permanently damaged.
    • Yeah they dropped the ball completely. But now they plan to solve some of those problems by introducing 4060TI with 16GB of VRAM. From my perspective this is the first card in their current lineup that makes sense. I ain't buying a 12GB card in 2023, no matter how fast and 4080 and 4090 pricing is insane.
  • by williamyf ( 227051 ) on Thursday May 11, 2023 @09:15AM (#63513945)

    The requirements of the mining industry were quite different from those of AI.
    The most important factors were, more often than not enough memory to hold the ledger (about 4G), and fast internal memory BW.

    The massive memory profiles needed for AI cards were not a concern.
    The fast execution needed for AI was not a concern (as a matter of fact, miners who knew undervolted and underclocked their cards).
    Bandwidth from/to the cards (i.e. PCIe lanes) were not a concern (the "raisers" industry was predicated on the fact to give only ONE PCIe lane per card).

    What are these guys going to do, throw good money after bad for new mobos and stuff?
    What are they gonna offer the AI crowd? Nvidia 2xxx series cards (that were more than enough to hold the ledger and do the calculations)?

    Give me a break. I whish said miners more losses to come.

    • You don't necessarily need huge amounts of memory, pipelining can work depending on the model. PCIe transfer between layers is not ideal, but not necessarily a dealbreaker either. The tokens/Watt is the most likely deal breaker

    • more often than not enough memory to hold the ledger
       
      I'm sure you are talking about Ethereum proof-of-work, which didn't use the blockchain/ledger when mining, it used a directed acyclic graph, commonly referred to as a "DAG"

  • by rsilvergun ( 571051 ) on Thursday May 11, 2023 @09:31AM (#63513993)
    so far it seems like AI is mostly going to be used to replace customer service reps. It also sounds like it's going to devour electricity.

    So we have a massive number of jobs getting killed while we're also going to massively increase the amount of electricity used (leading to more climate change, which'll hurt the people losing their jobs more than most).

    If we redistributed wealth from automation to the bottom 99 (instead of to the top [time.com]) I think I'd be Ok with it, but doing like this seems wrong.
    • by evanh ( 627108 )

      Sounds about right. The corporates can see an easy robotic solution to customer service. And that's probably the best use of such a mimicking tool too. Using "AI" for anything else will just blow stuff up.

    • AI is just corporate America (and China) pulling up the ladder behind themselves
    • What makes you think AI "devours" energy? Training hardware, sure. But inference hardware? No.

      • you need a *lot* of computing power to do AI. Just like with crypto mining that means a *lot* of electricity. The article isn't wrong, the workloads are very similar. It's why GPUs are often used for both. Not sure if their ASICs will work though since they're purpose built for specific crypto currencies though.
    • Service reps and most any paper pushing office workers, if you think all the offices are empty now, just wait 5-10 years.
  • by rsilvergun ( 571051 ) on Thursday May 11, 2023 @09:32AM (#63513999)
    than every light in the nation, and don't you let them make you forget it. It's still a *tremendous* waste of electricity, just a bit less of one at the moment.
  • And then combine it with marketing and advertising so we can suffer as much as possible, then find everyone responsible and leave their heads on pikes outside the town walls as a warning to those thinking of giving it another try. Disrupt the disruption.

  • "Sure sure, our special technique for turning shit into gold didn't work out, and some of us are likely facing lengthy prison sentences for stealing (we call it leveraging, haha!) our customers' shit reserves to borrow actual money and pad our on pockets, but on the plus side, we have all this excess toilet paper since our shit has now rotted, so we're looking for any way to hawk it to squeeze a final bit of profit out of our pyramid-shaped sphincters.

Ocean: A body of water occupying about two-thirds of a world made for man -- who has no gills. -- Ambrose Bierce

Working...