Follow Slashdot blog updates by subscribing to our blog RSS feed

 



Forgot your password?
typodupeerror
×
AI Music Technology

Nvidia Claims New AI Audio Generator Makes Sounds Never Heard Before (theverge.com) 49

Nvidia has introduced Fugatto, an AI music editor that can generate never-head-of audio combinations, including instruments mimicking animal sounds.

The tool processes both text and audio inputs to create music, sound effects, and modified speech. The system can isolate vocals, swap instruments, and alter voice characteristics.
This discussion has been archived. No new comments can be posted.

Nvidia Claims New AI Audio Generator Makes Sounds Never Heard Before

Comments Filter:
  • A Norwegian Blue Parrot with 4 million volts through it?

  • Casio 2024

  • by MpVpRb ( 1423381 ) on Monday November 25, 2024 @02:51PM (#64971405)

    AI has the promise to solve difficult problems and do really useful things
    Unfortunately, all the companies seem to release are crap generators

    • You want them to go from A to Z in one leap? How fascinating.

    • If you think unheard-of sound generators are crap, don’t go looking at the net worth of a few dubstep “artists” out there. That’ll really piss you off.

    • Crap makes money. Diamonds require a more discerning market.

      • Not really diamonds would be cheap if left to market forces. Remember Trump made his money by selling cheap properties to rich stupid people and then under paying labor costs.

        Something like 90% of multi millionaires are absolute idiots buying for appearance alone.

    • Re: (Score:3, Insightful)

      I agree (and with the other disappointed poster in another thread) - I actually do/teach sound design/music etc. for a living and the demo. in the video seems, to me at least, laughably bad/random/terrible quality, but I can see a lot of management etc types being fooled into making bad decisions (and churning out poor quality work) based on the shameless hype (/their lack of taste), or just wasting everyones time and energy with crap demos.
      What particularly irks me is that they have likely ripped off/not

      • I agree (and with the other disappointed poster in another thread) - I actually do/teach sound design/music etc. for a living and the demo. in the video seems, to me at least, laughably bad/random/terrible quality, but I can see a lot of management etc types being fooled into making bad decisions (and churning out poor quality work) based on the shameless hype (/their lack of taste), or just wasting everyones time and energy with crap demos. What particularly irks me is that they have likely ripped off/not credited/referenced a vast galaxy of extremely hard-working artists/musicians/sound designers/recordists to produce a (crap-spewing) plagiarism machine that will flood the zone/deprive people of interesting and fulfilling work (and do nothing to make the world a better place - there is no shortage of people wanting to do this work at a vastly better quality - even for a pittance!) - not to mention the vast amounts of energy/resources/capital consumed in the process etc etc. I guess some here though (perhaps with vested interests, wishing to take home fat checks or just wanting to continue doing what they see as valuable research - understandably) will disagree with/downvote me. I can see that AI has great potential to do actually useful work: eg. spotting patterns in datasets etc, but I dont understand the relentless focus on doing poor or unreliable creative or clerical work, as opposed to perhaps automating jobs that fewer people want to do (housework for example?). Perhaps that is too difficult a task and we are all destined to end up as cleaners/flipping burgers for our corporate overlords (I for one welcome the soulless boot crushing my face for all eternity! :) - also, call me old fashioned, but communication/art etc seems kind of pointless to me when there is no sharing of human experiences/endeavour/effort/craft?

        I've recently been assured that we will replace human communication with one another via the machines. The AIs will become our main mode of communication, and we'll be free of emotional response thanks to the wonderful gift of removing humanity from our sphere of influence.

        Those god damned commercials lately with people learning to talk to the AI have really started getting under my skin. It's like the tech companies spent the last couple decades teaching everyone to communicate only *through* them with oth

        • Wise words nightflameauto - seems a far cry from the global connection that was previously touted as an endpoint! :). I understand the innate drive to compete and excel and all (and the desire for progress/pushing technological boundaries), but what we currently ascribe value to/incentivise (and are calibrating our economies to further) just seems really messed up. The hamster wheels that tech peeps are busy knocking themselves out on seem geared toward desperately trying to keep the current strands of the

          • Wise words nightflameauto - seems a far cry from the global connection that was previously touted as an endpoint! :). I understand the innate drive to compete and excel and all (and the desire for progress/pushing technological boundaries), but what we currently ascribe value to/incentivise (and are calibrating our economies to further) just seems really messed up. The hamster wheels that tech peeps are busy knocking themselves out on seem geared toward desperately trying to keep the current strands of the whole crazy perpetual/exponential growth/VC capital/buyouts/amalgamations/monopolizations mechanic going in perpetuity, without considering other (perhaps more neglected) areas of growth that might be more helpful/useful (and even more profitable/sustainable in the longer term?). I hope at least that better uses for the technology become apparent/popular soon. I get the feeling that it might be a symptom of not having the best and brightest in control, or at least a certain personality type/thinking being disproportionately rewarded, but Im not sure how to fix that/how to maybe somehow give others (who maybe dont shout as loud/control the purse strings) a chance! (probs was always so to a greater/lesser extent)

            We've got kids raised on reality TV, where the biggest, loudest asshole always "wins," coming into adulthood and assuming the loudest, brashest idiot in the room must be the best. Hell, we just had an election that proves they've decided that reality TV was the blueprint for reality. We're not going to fix the direction we're traveling. We're going to slam the accelerator to the floor.

    • by narcc ( 412956 )

      AI has the promise to solve difficult problems and do really useful things

      AI is like a deadbeat dad when it comes to promises.

      Unfortunately, all the companies seem to release are crap generators

      You'll come to find that this is all you can really expect from generative AI.

  • by HiThere ( 15173 ) <.charleshixsn. .at. .earthlink.net.> on Monday November 25, 2024 @03:13PM (#64971461)

    There are lots of noises I've heard that I never wanted to hear and don't want to hear again. There are some that I do. Many are context sensitive.

    But why is "never heard before" automatically desirable?

    • Pairs well with "Oooh, Shiny!"

    • by dgatwood ( 11270 ) on Monday November 25, 2024 @03:34PM (#64971543) Homepage Journal

      There are lots of noises I've heard that I never wanted to hear and don't want to hear again. There are some that I do. Many are context sensitive.

      But why is "never heard before" automatically desirable?

      In my experience, "never heard before" is almost always undesirable. If a particular sound were desirable, someone would likely have created it in the 40-to-60-thousand years that humans have been making music. (Bone flutes actually predate written language, notwithstanding pictographs.)

    • by tlhIngan ( 30335 )

      But why is "never heard before" automatically desirable?

      And honestly, in the end it's really "just another synthesizer". Because that's what synthesizers are - they're making sounds "never heard before".

      Granted, there are many ways synthesizers work from subtractive to additive to FM modulation to wavetable or romplers, but still. Most sounds are just odd and not good, but sometimes you come up with a combination that works, and other times it's become so common it's hard to believe it started with someone

    • by Luckyo ( 1726890 )

      Same reason why electric guitars, keyboards, etc were great. They allow music composers to generate new kinds of music.

    • "There are lots of noises I've heard that I never wanted to hear and don't want to hear again" People speaking for the Heritage Foundation comes to mind. When they got "hacked", one of the higher ups was saying the about same exact bullshit word for word about the hackers that far right conservatives were saying about hippies back in the 1960s. Their mask falls off all too easy
    • But why is "never heard before" automatically desirable?

      It isn't. Who said it was?

      Just about anyone, with just about anything, can create some sound (or collection of them) that has never been heard before. Whether it's worth hearing is a matter of what the sound conveys from the creator to the listener. In short, what kind of intelligence the composition conveys.

      Music relied on humans striking, plucking, bowing, blowing, or singing for much of its history. Then the ability to record and play-back sound opened up new opportunities to create collages of sound tha

    • by Kisai ( 213879 )

      In a video game context, this might actually be useful.

      Think about No Man's Sky or Starfield, where you land on alien planets with lifeforms, yet why does everything still sound like a cat/lion or dog/wolf?

      it might be interesting to make some interesting alien sounds, but I think otherwise, it's just more generative AI trash that nobody asked for and nobody wants.

  • by Spinlock_1977 ( 777598 ) <Spinlock_1977&yahoo,com> on Monday November 25, 2024 @03:25PM (#64971513) Journal

    It also makes "sounds I don't want to hear". I listened to the demo - disappointing. The train didn't sound like a train, the lush orchestra was clearly on break, or tuning up their instruments, or butchering a pig - couldn't tell which. The high-pitched chirps were chirpless, and the vocal extraction resulted in some hybrid being that could sing with three mouths. I think they're some distance from a 1.0 release.

  • Here's a sound that has never been heard before.

    paplay --raw /dev/urandom

    • I would argue not, because that's not perceptually different than anybody listening to white noise anywhere. Yes, I know it's a novel sequence of sound waves.

      The tricky of course, as with any art, is to make something that's not only noticeably "novel," but also "good," which is awfully difficult because many people over many years have scoured the landscape of human interest. It's hard for me to see how AI could know what will sound fresh but also good to human ears.

  • by GoJays ( 1793832 ) on Monday November 25, 2024 @04:15PM (#64971669)
    You could use dogs barking as an instrument in Mario Paint on the Super Nintendo. What was that 30 years ago? A little late to the party Nvidia.
  • ... instruments mimicking animal sounds.

    This is 40 years old, configurable synthesizers were a thing, so many years ago. It obviously never gained popularity and now the sound engineer/band is a laptop in a teenager's bedroom, it still isn't popular.

  • by PuddleBoy ( 544111 ) on Monday November 25, 2024 @04:53PM (#64971819)

    Does anyone remember Bernie Krause - https://en.wikipedia.org/wiki/... [wikipedia.org] - who gave us (among other things) Gorillas in the Mix?

    He sampled lots of animal sounds (late 1980's), then used those samples as the basis of various (electronic) musical instruments. An elephant was the bass and even the tiny sound of a crayfish snapping its claw was used as the sound of a drum stick lightly tapping a cymbal.

    Seemed pretty cool at the time...

    • I remember and probably still have the Nonesuch Guide to Electronic Music by Beaver and Krause. A friend managed to get an in person Moog demo from Paul Beaver. I also saw what I recall as a Lucas/Skywalker demo reel with someone mic-ing a high voltage transmission tower guy wire and hitting it with a hammer to obtain the basis for a space weapon sound effect. The term "musique concrète" was a copy spoiler in my 5 WPM Morse code exam.
  • squealing over their lost valuation?
  • by thesjaakspoiler ( 4782965 ) on Monday November 25, 2024 @07:56PM (#64972307)

    and you'll hear sounds that cannot be unheard.

  • The brown note?

Top Ten Things Overheard At The ANSI C Draft Committee Meetings: (3) Ha, ha, I can't believe they're actually going to adopt this sucker.

Working...