Researchers Synthesize Real-Time Fracture Sounds 54
ChippedTeapot writes "Researchers at Cornell University have devised an algorithm for synthesizing sounds associated with brittle fracture simulations. Computers can now automatically generate synchronized sound, motion, and graphics for physically based fracture events, such as in future interactive virtual environments. The results will be presented at ACM SIGGRAPH 2010 in Los Angeles July 25-29. Check out the smashing results on YouTube."
Uses? (Score:2, Interesting)
From first thoughts and glancing at the article, it seems the first use that comes to mind is for sound effects in movies and the like. While it's great that you can not waste a perfectly good pot on a second-long sound effect, I'm wondering if there are any other implications.
Perhaps we can use this sort of things in reverse? Like "the audio from this emergency call indicates a lot of expensive china breaking! The china sounds like it is from midway through the Ming Dynasty! There's only one place in t
Re: (Score:1)
Re: (Score:3, Funny)
Next up...fingernails on chalkboards!
Because we care.
Re: (Score:1)
Movies? (Score:4, Insightful)
Not so much, there are entire ranks of Foleys who work under union rules to deliver most movie sound effects (although they probably have impressive Sound Engineer titles now).
This is much more likely aimed at environments like video games and battle-ground simulations, where any number of events can occur and the presence of a tightly aligned sound track is needed to produce a more realistic effect.
The sequences of events in movies are pretty tightly controlled, so I see this as having less use there
Re: (Score:3, Interesting)
Not to mention that games are designed to be flexible in what can happen with them now. Force Unleashed would be an example where glass or wood can shatter differently almost everytime, depending on even the slightest nuances. For something like this - it's difficult to asssing premade sound effects - you can record various ones for big, medum, and small fracturing, but you run the risk of exploding your game filesize by adding more sound effects, or you are leaving the sounds a little bland as they will ge
Re: (Score:2)
For games you can also use recorded sounds run through a random or fractal filter that changes them somewhat for different events.
Re: (Score:1)
Re: (Score:2)
Pure granular synthesis would destroy the sound, yes. I could see some aspects of granular synthesis used to vary sounds instead of going full-on. Have a look at the "graintable synthesis" used in the Malstrom synth [propellerheads.se]. It involves a lot of preprocessing of the sounds used, but an intelligent algorithm could do the trick.
Be that as it may, I think the gains of either of these synthesis methods over simply having 4 or more alternate sounds which play at random are minimal. Space is dirt cheap nowadays while
Re:Uses? (Score:4, Informative)
Harmonic Shells [youtube.com]
Re: (Score:2)
Thanks for that link!
I love this stuff too. I've wanted rendered sound for years. It always irked me that programmers would use so much effort to render graphics, and so little to render realistic sound. People will gladly run a raytracer for 8 hours to get a nice picture of a car, but I've never found anyone who run a physics simulation for 8 hours to get the sound of a piano right - even though I've never heard a decent synthesized piano sound in my life. What happened, why did sound get so little attenti
Re: (Score:2)
Probably because sound is already a lot easier generate, sample, cut, filter, mangle, and in general work with. Anyone who wants an electronic version of a high-end piano just needs to buy a CD with a sample (or few) of each key being struck and bingo. Sure, you'll always miss out on some flexibility and fidelity compared to the real thing but with today's technology, not too much.
Re: (Score:2)
This appears to be the attitude of most synth designers, unfortunately. The best digital pianos I've heard emulated sympathetic resonance for a couple of strings, but not nearly enough to give a credible sostenuto effect.
Re: (Score:2)
I did another search after writing this, and came over Pianoteq3.
!!!
OK, now I've heard a better digital piano! And I think I may actually be tempted to buy a trialware app for Linux for the first time in my life :-)
Re: (Score:1)
Having convincing sounds is very nice, but even sounds that are not 100% accurate can still be used for very creative purposes.
You're obviously the expert here, but the way I understood it I thought physical accuracy was not really a huge priority in the business. I read an interesting article once (at work, so I'm not gonna searchf or it now), were it was explained that the sound that subjectively fits best to the action is often made by something wildly different than what appears to make it on screen. E.g., the whiplash foley from Ben Hur was apparently a raw steak slapping against an exposed thigh.
I'm not disputing anything you
Re:Uses? (Score:4, Informative)
From first thoughts and glancing at the article, it seems the first use that comes to mind is for sound effects in movies and the like.
Generating realistic sounds of rigid objects is fairly straight forward. You know the material properties. You know the size and shape from your physics engine. You run it through some relatively simple set of equations to get the resonance frequency of the shard. Add in amplitude from the impact, natural damping over time, and you're done. Oh, but you have to do it for hundreds or thousands of objects, and each of those is impacting or fragmenting several times per second.
Producing realistic sound like that isn't very impressive. What is noteworthy is the optimization, generalization, and statistical modeling that they used to simplify that massive amount of computation into something that could be run in real-time on commodity hardware, rather than having to be backed by a supercomputer. Movie and special effects studios have those supercomputers and render farms at their disposal already. This work is intended to go hand and hand with the realistic and complex physics engines that games have started getting in the past few years.
Re: (Score:2)
I beg to differ. Where is the software that can do this accurately, instead of trying to do it realtime?
Re: (Score:2)
The midi files in question are performed by good pianists, they are midi conversions of recorded piano rolls. I'm concerned with good instrument sound.
Re:Uses? (Score:5, Insightful)
for me, as a physicist, it's fascinating that they were able to do it. the human brain is a great tool to test how "natural" various simulations are, and when you succeed in fooling it, it means your model is very close to reality in a certain way.
in the study of complex phenomena, any ability to model is an important insight, because we don't have the math to understand what's happening just by using first principles.
as a sidenote, the problem of turbulence was well-known before the revolution of quantum and relativistic physics; still, Kolmogorov's scaling law (one of the most important results in turbulence) came in the 1940s. these problems are hard, and I will take my hat off to anyone who is able to cheaply reproduce aspects of nonlinear phenomena.
Re:Uses? (Score:4, Insightful)
I think it depends on what people are accustomed to. Do silencers really work on guns as silently as shown in the movies? Or do punches really have the big "phwak" sound that you hear there? People are only good at determining "natural" sounds compared to what they are used to. They may not be realistic though.
Re: (Score:3, Interesting)
I've heard rumors that the common punching sound is actually a wrench smashing a cabbage.
Re: (Score:2)
Most people these days are perfectly aware that there's no air in space, but watching a space war in silence is pretty boring. So what if a punch from Indiana Jones sounds like a splintering telephone pole? It's obviously not real, but it sure is a lot more satisfying.
Even if people act stupid, they generally aren't. They know that a car can't bust through a brick wall and land on the roof of another building in one piece. Art isn't so much fooling the audience into thinking it's real, as it is making i
Re: (Score:2)
Re: (Score:2)
If there is any one lesson I've learned in game development, it's that you never have to actually produce what you want the scenario to be. Much like a movie or TV set, the only things that have to be right are what the user sees.
As computers have gotten more and more complex, its required more and more complex thinking to reproduce even the things that we would assume to be so simple. I remember listening to a talk on Epic Games and how much effort they put into Particle Effects in their engine. The reason
Condition monitoring and nondestructive testing (Score:2)
Just Use Samples (Score:2)
Hooh! HYUHHH! Hoo! Hoo! Hoo!
Re: (Score:2, Insightful)
In old video games where the graphics and physics were also the equivalent of samples, it was okay to have sampled sound, but so much work has been poured into graphics and physics these days and everyone has ignored sound. I'm sure a lot of the work that went into making more realistic physics can be used in making better sounds, since material properties, velocities and angle of impact are important to both sound
Re: (Score:2)
It's like saying "Just use rectangles" to display objects in the game.
Pixels are rectangles amirite
Re: (Score:2)
No, they fixed that. [slashdot.org]
I couldn't hear any difference (Score:2)
But do they get you high? (Score:2)
The Oklahoma Bureau of Narcotics will claim that they are a bigger threat than binaural beats: http://idle.slashdot.org/story/10/07/15/166220/Sound-As-the-New-Illegal-Narcotic [slashdot.org]
Cool demo... (Score:3, Insightful)
.
Re:Cool demo... (Score:4, Funny)
Or the cricket bat vs lemur.
Re: (Score:2)
Or lemur vs. cricket.
Though I can predict that one: CRRRUNCH.
Re: (Score:2)
Squeak!!
Re: (Score:2)
Wait for it.... (Score:2)
Missed opportunity (Score:5, Funny)
Re: (Score:1)
Regardless, it will be a smashing success.
SIGGRAPH? (Score:2)
Ob Nick Lowe (Score:2)
I Love the Sound of Breaking Glass" [youtube.com] from the album Jesus of Cool (1978).
Re: (Score:2)
for the best sound (Score:2)
Uh-oh. Patent infringement. (Score:1)
Missing something. (Score:2)
Very neat, but the generated sounds seemed a bit flat to me compared to the real thing. It's like they were missing some amount of reverberation at the end, like the sound was cut short. It is, nevertheless, impressive especially coupled with visuals that look very convincing. Modeling this stuff might be nothing new, but I'm always a sucker for this sort of thing.
Re: (Score:2)
You do realize roughly half the clips in that video were of actual things breaking?