Can You Recover Sound From Images?
소스 코드
- 게시일 2024. 04. 26.
- Is it possible to reconstruct sound from high-speed video images?
Part of this video was sponsored by LastPass: bit.ly/2SmRQkk
Special thanks to Dr. Abe Davis for revisiting his research with me: abedavis.com
This video was based on research by Dr. Abe Davis and colleagues. I found out about this work years ago and was fascinated by the way he was able to capture vibration information in image-only video. I always imagined the motions of objects would be visible as when recording a tuning fork in slow motion - so deriving sound from high speed images seemed a feasible task. But the reality is much more difficult.
Sound vibrations only cause objects to wiggle by about a micrometer. This is much smaller than a pixel, so the algorithm must understand the characteristics of the image. A move in one direction should cause some pixels to lighten slightly, while others darken - and this behavior is correlated along the edges of the image. So noise can be reduced because it's random over the image and there are enough places to sample that you can get it to cancel out.
Something I'm wondering now is - would it be possible to capture sound in a single image? I'm thinking it would have to be an image of a large object or space because the wavelengths of typical sounds are quite long. Maybe a high frequency sound could be imaged in a suitable medium...
Animations by Alan Chamberlain
Music from epidemicsound.com "Seaweed"
I absolutely loved the moment where he realized why he couldn't hear it. You get that a lot when programming and it always hits you like a train and gets you excited.
That kind of reaction without any vocal exclamations usually leaves the surrounding people baffled: "WHAT? WHAT? DID YOU FIND ANYTHING? WHAT IS IT?" :D
Oh boy I get that a lot. It's like "Wai-… I think… if I… no… no wait… how abou-…" and you're like simulating the entire universe in your mind while from your mouth you can't even say a single word.
@@sabikikasuko6636
Exactly. You can see how it should go, so you check every single part along the path and you will inevitably find the problem, assuming you are capable fixing the problem (aka, you know what to look for).
Sabiki Kasukō beautifully articulated
Exactly, familiar feeling ;)
"This video is sponsored by inaudible."
Good one
@@Noum77 Thank you. I try my hardest. ;)
HAHAHAHAHAHAHAHAHAHA!!!!!
What did you say?
Genuine laugh from an original joke I appreciated that
This is pretty interesting. Would like to see this used at a crime scene. "Your honor, I'd like to call my next witness...a crumbled up bag of chips"
Special evidentiary exhibit "criminal snackings"
@@f_USAF-Lt.G evidence!
Lmao
Omg this was the best !!
Still laughing. Omg I love it
😂😂😂😂😂😂😂
This guy: "My Camera isn't good enough."
Other guy: *Buys a new camera
This guy: "My laptop isn't good enough?"
...
Eureka!
LOL
Need some better speakers, give us a new chair
It's the house!
@@Kyanzes 🤣
Grown man shouting "Mary had a little lamb" at a crisp packet.
Chip bag.
Ethan Lamoureux
Same thing. Your dialect isn’t the only valid one. Besides, “crisp packet” sounds funnier
@@littlefishbigmountain I never said it was the only valid way, I just presented the alternative for those who don’t know. I didn’t even say it was my dialect or anything at all for that matter. But just so you know, to me “crisp packet” sounds like a very small bag (a packet) which is new (crisp).
Ethan Lamoureux
I think it’s in the way you said it. I know typing doesn’t translate well because of the ambiguity, but trust me it doesn’t read nicely. My comment came across harsher than I intended too
3Head
My favourite Cave Johnson quote: "we're throwing science at the wall here to see what sticks"
Very appropriate
Lol just finished portal 2 yesterday
@@mr.molduga THEY COULDVE DONE THE SOUND REVEAL AT THE END
The answer is, of course: the previous testers
Mine is "Science isn't about WHY. It's about WHY NOT. Why is so much of our science dangerous? Why not marry safe science if you love it so much. In fact, why not invent a special safety door that won't hit you on the butt on the way out, because you are fired."
"Not you, test subject, you're doing fine."
"Yes, you. Box. Your stuff. Out the front door. Parking lot. Car. Goodbye."
in the industry i work in, we use high speed cameras to record the displacement to figure out the frequency something is vibrating at, so that we can damp it if needed. we use super bright lights on the object in order to reduce the noise at the frame rates required. makes total sense that you can pull music from it! nice!
Materials sound stress analytics... But that's only guessing
Is that the same as motion amplification? I saw a video about that and I was astounded.
I’ve read the CIA has used this tech in the field
And what industry is that dude? Sounds fascinating! The mystery is killing me.
@@UnblockMind power generation
The CIA are like, "Dude, this is old tech."
and they send that msg to you by fax
It is the cia is probably using laser to get the Vibration from the window it should be very accurate
@@simonlibik LMAOOOOOOO
Yeah listening through telescopes old af
I also think they can develop retina images from murder victims.
You should get with the slow mo guys and try it at over 10,000 fps
bruh
@@edengibson1079 Indeed.
Or team with Destin from Smarter Every Day.
That mac will crash big time
scary stuff.. uncharted territory..
Screaming MARY HAD A LITTLE LAMB at a bag of chips.. absolutely hilarious.
2:28
It's like that guy yelling meow at an egg
Hahaha does that guy have a youtube channel?
@@danicarovo8818 I think so
Ikr that absolutely destroyed me
This is the kind of discovery that definitely will not be used for good
Just swipe
@@Solid_Snake88 nah, more like spying goverment officials secret connversations.
@@askreddit2431 seems like it would be more effective to just use a super sensitive mic that picks up sound we cant or smth
@@gramcrackag6342 bouncing a laser of a window works also.
no knowledge is inherently evil
This reminds me of when people in 2008 heard Édouard-Léon Scott de Martinville's unintentional 1860 sound recording for the first time in history by scanning the blackened paper he etched the soundwaves onto. I like seeing historic moments like these taking place and the senses of awe and accomplishment people feel when they make these discoveries.
unintentional? I take it you mean he did not know of a way to play the sounds back
Guy screaming at a Chips bag...it's called science!
wtf du bist überall
N. M huh?
Reminds me of that one viral video of a guy screaming meow at something lol
@@TheSentientCloud at an egg hahaha
Have you heard the phrase " there is logic in this madness "?
well this i not one of those cases.
2:29 *screaming at a bag of chips for Science.* 👍:)
@The Pay & Free Gamer 😢
Sure, when he does it, it's "science", but when I do it, I'm "off my medication" and "causing a scene at my niece's christening"
Imagine his neighbors hearing this.
That should have been the video title
take the context away now its a meme: trash whisperer
“You cant hear pictures”
**Spongebob bubble transisition noises**
“You were saying?”
*Doofenshmirtz Evil Incorporated!*
@@thecreatorofpc7929 *After Hours*
@@Liminality2022 doofenshmirtz holding a bucket
now i can hear text
man the absolute insane significance in intelligence and spying that he just casually dropped at the end
Decades ago I read about an eavesdropping rig that bounced a laser off a window and could detect the variations in the reflected beams to capture every spoken word inside the room. Curtains, blinds and such did not stop the glass from acting as a speaker diaphragm. Its only distance limit was the spread of the laser beam- the beam spot on the glass had to be some percentage smaller than the sheet of glass you were aiming it at.
@@christopherpardell4418 there's a youtube tutorial for that
@@christopherpardell4418 wouldn't some types of window severely degrade the quality. Frosted glass would diffuse the beam and provide a lot of noise, and I'd imagine that different types of glass would require unique calibration.
I'm unfamiliar with this, so I'd be grateful if you could provide me with a jumping off point
@@expertoflizardcorrugation3967 I don’t know a lot about this- but my understanding of how laser ranging works is that a frosted window would scatter the light, which would only make it easier to pick up the unique wavelength in more than one location. For example, soldiers using a laser target designator fire a laser at something they want a bomb to hit… the laser light reflects off in all sorts of directions, and the sensor on the bomb can detect this light and home in on the object reflecting the light. Because the laser light is a coherent beam from the designator- the bomb can’t see that beam and so won’t steer towards the soldiers, but it Can see the light that is scattered off of the object because it has been scattered off in all directions. The bomb can see the laser light bouncing off the object from anywhere.
Similarly, a laser eavesdropper would simply be looking for the interference pattern in the reflected light versus the initial beam to detect how the window pane is vibrating from sound inside the room. I would think the best way to interdict such a system would be to coat the windows in something like Fanta Black that absorbs ALL light that hots it… but then, it wouldn’t be much of a window, would it?
"The sounds were as loud as we could make them."
*"MARY!!! HAD!!! A LITTLE!!! LAMB!!! LITTLE‽‽‽ LAMB‽‽‽ LITTLE!!! LAMB!!!"*
Imagine going to work at the lab one day and your coworker tells you to yell that at the table
MrHatoi ok AGGHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
Coworker: I meant like yell words
It´s for science
The ghost of the Edison Dolls!
yeah lets not use a speaker 🥵
"Can you hear pictures?" sound like you should start with "Hey Veritasium, Derek here"
it's not 2011 anymore where the only interesting content on the platform was vsauce...
@@xl000 He is referring to the eccentricity of the question not to the interestingness of the content
benjamin buurgaard a few times I feel like he was just trying not to copy vsauce, but they do similar stuff so he can only be so different. Like he would jump up into the frame, etc...
[Ve]sauce
Veritasauce?
I remember first hearing about this concept about 20 years ago or so. It's amazing to see how far we've come.
Still trying to work the bugs out of having a laptop that can produce a sound for BT speaker, but not produce the sound from its preformance speakers... 🤔
I'd love to see a super high-speed footage of a speaker membrane processed through that software. See how much fidelity you can get back.
Just read the video orgasm off my lips instead.
Something about a man straight-faced shouting Mary Had a Little Lamb at a bag of chips is hilarious
How about Thomas Edison shouting into a cone+stylus+moving wax cylinder apparatus?
Otokichi786 Got video of that?
Any future film starring this man is clearly a job for Toast of London.
Hahaha, yeah, Geone!
"you gotta be careful that you're not ... confirmation bias"
Time stamp
@@JoseRojas-hl7sn 7:15
@@medusasound7396 thank you.
haha don't mean to ruin the joke, but I think he said "you gotta be careful that you're not confirmation biased"
@@atl663 It wasn't a joke
the fact that as cameras improve each year means that by each year this would be easier to do to the point where AI can possibly be able to do it with us not even needing a microphone.
The police-bots will be able to scan the sound the your soul. Make sure you are singing the correct tune.
yeah but would need a LOT more processing power, especially for any amount of precision. it'd just be a backup option that's only used if its microphone is damaged or removed
@@Acoustic-Rabbit-Hole you know when the people at the eye exam shine a light in your eye? the light actually had a 4k 1,000,000 fps camera hidden inside so they could listen to your soul
You’re telling ME?@@official-obama
I am neither man nor machine. I am Mansheen. @@official-obama
Very interesting video. Sure, the sound signal is subject to Nyquist sampling constraints. Each observation from the image is effectively the output from a planar microphone. Consider taking observations from >1 spot from the images. Observing multiple vibrations of the planar microphone across the surfaces will effectively multiply the sampling frequency by the number of observations. The wave pressure will be smeared in time across the image at the speed of sound. It might be possible to reconstruct some directional information as well by noting the progress of the wavefronts across the scene. Microphones arranged across multiple planes (e.g. x-y, y-z, x-z), will observe different signals. It might be possible to improve direction-finding accuracy by modulating the orientation of the planar microphones (like a dog cocking its ears). Since you know the medium (sound in air at some temperature), you are also getting information about how observed signals vary over time..
But is that how they could read the emotions of a Bobble-head in motion?
Can you team up with the Slo-Mo Guys to do this? It would be sick to see this done with 20,000 FPS!
But the size of server you need in order to analyze that amount of data...
44000FPS*
Depends on how the algorithm scales. If it does scale polynomial a regular Computer + some more Time should be enough. I mean a few days wouldn't be a problem.
@@leonardyeski8412 Team up with Linus Tech!
@@leonardyeski8412 just get one with a couple of Nvidia Titan video cards to crunch that data
Imagine being his neighbor and just hearing "MARY HAD A LITTLE LAMB! A LITTLE LAMB!" at random through the walls for like months while having no ide hes actually screeming at a bag of chips!
55tw45y45yhrt
imagine being his neighbor after figuring out why he was hearing "Mary had a little lamb" over and over and realizing that this neighbor can figure out everything you are saying in your house by how the curtain sways.
"while having no idea he's actually screaming at a bag of chips!"
I'm not sure that knowing he's screaming at chips would make it any better 😂
neighbor looks over the fence and sees him shouting at a bag of chips
neighbor's wife: what is it?
neighbor: oh this is much worse than we thought.
if only the neighbor knew then that would make it so much better
This is absolutely mental, i had never thought of this. Thanks for all the great content Veritasium
"This saves your valuable Brain space..." was mentioned during the promotion of last pass. This statement made me wonder if saving valuable brain space helps the brain in remembering more or not memorizing things makes your memory/brain weaker ... Another topic to explore :)
In my life, some of my ignorance has caused me to be able to do things that had not actually been done by my "heros". Not paying attention to some things can be an advantage. This must be true of attention span in some eccentric way. Look up Kim Peek. Industrialism largely ignores this, I think. Not just saving "space", but liberating orientation within and without dimension.
I feel like this was a good summary of software development: banging your head against a desk and then realizing what the stupid mistake was.
When I saw his face after he put the headphones on, I was like, I know that face. In fact it was the exact face I made before taking a break to watch this video.
yup, it's so relatable xD
Not just software, but any kind of debugging. Sometimes you've just got to remember to plug it in. I still make this mistake.
can confirm. am computer science student
I'm a mechanic and can also relate.
No electronics will work if the fuse is blown regardless of the integrity of the wiring and components for instance...
Plot twist this entire video was filmed with no sound.
it wasnt really a plot twist, you could tell in the first 10 seconds
This is confirmed in the first 3 seconds of this video.
I can't tell if these people are joking or not
:D
@@heinrichpreussen It's s joke tho. You can tell by how dirty, noisy and pitch shifted the reconstructed audio was. Good joke tho.
9:03 The reaction every single person in science ever has had when their brain has that "oh duh" moment. When a programmer sees the bug. Etc. Oh man I love and hate that feeling.
I really loved it. The guy looked like they would show programmers in films. There was a full set of ups and downs and rising tensions, with a satisfying climax. And when he realised what happened, it was just amazing, it's something I can relate to, when solving a problem and the answer suddenly comes up.
I could have worded this better.
_"MARY HAD A LITTLE LAMB, LITTLE LAMB, LITTLE LAMB"_
50 miles away, in an old abandoned mansion, a bookshelf begins to slide out of the way to reveal a secret passage...
My bookcase only opens for the Stevie Ray Vaughan cover.
The secret passage leads to an ancient brick-walled hallway, you can smell mud
and hear a dripping sound...
TunaMasterFish Interactive fiction? What is it from?
@@fllthdcrb yeah just go with it :)
Something you made up, then?
2:29 When your mom tells you to tell a bedtime story to your little brother
😂😂😂😂😂😂🤣🤣🤣
fuk you're good
This was just amazing, thanks for creating the video about this technique. Very cool the hear the effect and see what possible, these days.
Wow ... I'm an imaging engineer and never thought of that. The ability to remove the audio induced signal from the camera chips temporal noise, and from 'user-grade' camera too (i.e. not a cooled chip) is amazing. Thank you Veritasium for this video and enlightenment.
gotta love how, when it comes to title, everyone’s an engineer. My girlfriend is a human resources engineering. And you’re a lab tech
@@iwanttwoscoops Nope, have a Masters degree in Engineering, work for a major camera company and develop algorithms for focusing, geometric distortion correction, colorimetry, etc = Imaging Engineer, or Lab- Tech-Who-Does-Math. whichever...
2:29 *When your teacher tells you to read louder for the whole class*
Dafq that's accurate 😂😂😂
Not only was this video pretty cool, but that was one of the slickest transitions to a sponsor plug I’ve ever seen on KRplus! 👍
Hi
There's only one person who transition to the add better than this.
HALF AS INTERESTING.
LockPickingLawyer nice to see you here ;)
Yep
Actually surprised to see LPL here...
Super cool I had seen the crumble chips bag experiment before and I always wanted to try it. I think they used a rolling shutter at the time which would give a much higher sampling frequency if you extract the horizontal movements. Maybe 2 cameras at 90 degrees angle could give a nice result too!!
This is easily one of the best KRplus videos I've seen in a long time.
Nearby future:
"Yo duuude, are you still using those old condensor microphones? I use high fps cameras, they just sound way more realistic and warm. I love the jpeg saturation it adds to vocals and guitars, bruh."
Why would a camera record videos in jpeg format?
@@RexOrbis future is strange
@@RexOrbis well if you want to analyze picture by picture it might be handy to have every frame in jpeg comaperd to a whole video file. definitely possible
Nah I'd rather have those frames in RAW. Could play around with it more.
@@f1shmail raw stills at 180fps would be 21gb for 3 seconds of video lmao
"Can you hear pictures?" With enough drugs you can
You can hear picture if you convert picture pixels into sound frequency.
@HighOnOxy really?
*insert a picture of the Doofenshmirtz evil inc. tower*
also with synesthesia
Best comment loool i was laughing so hard at this 😂😂😂😂
definitely should have collaborated with slo mo guys on this one.
Yes, I read recently that there was some concern about spies being able to "listen" through window glass that way. So I'm glad you had something about that, at the end. Love the idea.
Veritasium and all viewers: This is insane, it's the coolest thing ever!
The American government: Aw how cute
MacGyver: pfft I could have done that with a bottle of water, two sticks and a CD player
Lol, yea. I was thinking didn't the secret agent people had something like that a few decades ago? They used a laser pointer and a sensor to detect the reflected laser. They could just point it to a glass window and the laser light reflected from the window will carry the vibration which gets converted into sound. I saw it on Discovery channel when discovery channel used to be cool.
@@phink9835 That's special measuring equipment though. Very different idea from an actual video.
@@Todesnuss Sorry i went off topic. Being able to use normal video is actually awesome now that i thought about it. I would have thought it was impossible if i hadn't seen this video on Veritasium. The vibration was smaller than a pixel and he still managed to detect it.
NSA can probably listen to your conversations by filming your front door with a sattelite😂😂
Ok, this video blew my mind.
The Exoplanets Channel
Okay
Check out Coldfusion hes covered this subject and thousands of other
Actually same
Make it two toy balls and you got me
F***n amazing!!!
Amazing. I've truly have learned something cool. So obvious (sound wave causing objects to vibrate), yet so unexpected.
Sir, you continue to produce the most top-quality science based videos on youtube. Thank you for keeping science FUN and engaging. You are contributing to our society in ways you may not realize :)
Plot twist, all his filming was filmed without sound
I can smell colors
See sound
*HEAR IMAGES*
POTATO
@@YUNGMAS hi..?
Images*
@@marceloabad8545 thanks
I'm tripping balls on LSD, can anyone else hear that image?
This I think is the most scientific video on KRplus. This is how KRplus should make scientific videos. Real, practical, and with both failures and success. Thank you.
Good work with the new and improved thumbnails. Now you convince my minds attention to come here, and I really like to be here.
i like the moment he realises the speaker of his laptop cannot play this frequency :)
Me too, when they were playing it. I was like "Nah, I don't need headphones". Couldn't hear anything, so I put some on, and I'm like O_O
Eureka - the happy moment after long effort and number of attempts, thats so nice
I didn't think I needed them. Just rewatched with headphones and I'm not disappointed
We scientists and engineers live for that moment. I would almost rather have to spend hours solving some issue with my experiment then have everything work perfectly the first time.
I think we all know what that feels like
This brings "I can hear images" to a whole new level
next up "images you can smell"
@@nemesisurvivorleon oh no
An image says a thousand words
This is the first video I've seen from this channel that was actually super cool. What an amazing little piece of work. Shouldn't this receive some sort of patent or award?
you mean his other videos weren't actually super cool?
As i understand, the FBI/CIA has been using laser to read-off the sound vibrations of objects in building. By shining it into the window. Government/Military trumps personal patents. (P.S.--Trump, 2024!)
5:31 is the most brilliantly simple way to explain the Nyquist Frequency I've ever seen 👍🏾👍🏾
MARY HAD A LITTLE LAMB. LITTLE LAMB. LITTLE LAMB.
I feel sorry for his neighbours.
Robert K Herr Kores?
His neighbors were probably Russian spies, they would have been real interested in what he was doing
@Please Complete All Fields Don't despair, there is more...
*sees that he is screaming it to a bag of chips* ok, time to call the mental hospital
In his writings, Thomas Edison recounts the 1878 phonograph recording:
"it was finished, the foil was put on; I then shouted ‘Mary had a little lamb,’ etc. I adjusted the reproducer, and the machine reproduced it perfectly."
"But the process is not easy."
- Starts up audacity~
Yoo audacity is the bomb man! Can't believe it's open source
Don't know why this made me laugh so hard
Audacity is good for cutting audio stuff, but it's bad for noise removal
@@dextermorgan2353 Open source stuff can be cool too, Like Blender, Linux and Godot!
"Sound vibrates things, but the vibration is extremly small"
My subwoofer: "Earthquake"
Great song! Tiny Tempa!
This is exciting, like trying to listen if the WOW signal will ever be heard again or if it had some kind of message that we haven't figured out how to listen to it.
Nobody:
This dude at 5AM: *MARY HAD A LITTLE LAMB, A LITTLE LAMB*
At a empty bag of potato chips
Lol
Neighbours be like *SHUTTTT UPPPPPPP!*
@@araigumakiruno meh
That was actually the first phrase Edison recorded when he invented the phonograph.
0:00 This video was recorded without sound
*Myself hearing the whole thing*: OMG IT WORKS!
r/wooosh?
@@The_Dcoder Guess I could have been clearer. I meant like I was listening with my eyes.
Your explanation was clear, but I was playing around with the concept of wooshing, since you fell for it but it was not an intentional joke :)
@@The_Dcoder r/quityourbullshit
Jamescawl r/ihavereddit
This was actually quite fascinating, and more than a little eerie
amazing work, with incredible but at the same time terrifying applications
'What are you boys doing down there?'
'I'm yelling Mary had a little lamb for science Mom! God...leave me alone'
"Man shouts Mary Had a Little Lamb at a bag of chips" doesn't sound like cutting edge science but some Buzzfeed headline
nah an onion article
If was from buzzfeed it was read:
Angry white man participating in male patriarchy science yells at bag of chips oppressing female diversity in workforce
😂😂
Imagine the mother walking in like “what the hell are you doing??” GET OUT MOM I AM DOING A SCIENCE!!! Then it just cuts away to her tearfully calling to get her son institutionalized coz he’s lost his mind.
Liberal media sucks.
"Man shouts meow to egg"
the doctor papper can, the fast typing, the eureka moments, this guy is so perfect
9:55 This was the moment I realized what a big deal his research is. Intelligence agencies around the world are no doubt taking notice and buying up the most expensive high frame rate + far zooming lens cameras they can get their hands on.
The police-bots will be able to scan the sound the your soul. Make sure you are singing the correct tune.
They dont need it. You realize you can extract audio from lasers pointing at a glass window right? They known this for years
@@honkhonk8009 No I didn't know that but this would be an additional technique that works in situations the laser wouldn't. A laser would essentially be amplifying sound waves that hit the glass, this technique requires no direct access to the sound waves at all. For example, this would work through multiple layers of glass or even through a vacuum.
I’m pretty sure they jumped on it as soon as cameras were capable of the frame rate
buying? i bet they aldy have it long time ago. consumer tech always fall behind
Steve Mould: how to use an led as solar panel.
Veritasium: how to use camera as microphone
Any higher bid?
cAlEnDar WaNts To AcCes YoUr CameRa!
@@filozofwielki1121 use microphone as camera?
It has already been done with wireless signals krplus.net/bidio/m6Z-f6OLZ5G0YaA
@@filozofwielki1121 How to use bubble gum as nuclear fuel
@@2canines bats uses their "microphones" (ears) as "cameras" (eyes)
In his writings, Thomas Edison recounts the 1878 phonograph recording:
"it was finished, the foil was put on; I then shouted ‘Mary had a little lamb,’ etc. I adjusted the reproducer, and the machine reproduced it perfectly."
7:38 "...we're dialing up the volume to... ELEVEN" Cheeky reference to Spinal Tap snuck right in! 😂
This is my favorite video so far, i think this is really cool.
8:41 This is what eureka looks like!!!!
Best feeling a human can feel
That frustrated happiness when he figured it out... all of us computer nerds know this feeling
It's horrible... Realizing our laptop can't produce the sound we program it to play, while still being able to BT that sound🤔?
5:00 I've watched many videos about the Nyquist-Shannon sampling theory and don't think I ever understood it the reason why it needs to be sampled at twice the frequency. Watching that 15 second clip made it seem so simple.
This was the subject of one of the original Twilight Zone episodes in the 1960s(I could never forget). Then, Seth(of Jane Roberts fame) wrote about a prehistoric civilization that could encode sound into images and art, so that if you touched the image, you feel the vibration of the sounds.
Thanks for this video!
I think i missed that one and want to see it now. Thank you for sharing!
Reminds me of an episode of Farscape where they tried to get accoustical readings of an ancient civilization that utilized sound frequency & one of them was transported back to that time & they had to go retrieve her. They also used sound for levitation as a rite of passage. One of my favorite episodes.
Impossible, I know, but imagine if we could recover the original on-set sound from an early silent film?
Too low image quality. While tape had medium resolution, silent films were only around 12fps or so.
@@rachelslur8729 Also, the resolution wasn't anywhere near high enough. You'd have better luck recovering sound from a potato.
may be not from old silent film but from current generation high resolution film.
the sound of shooting the movie
@@tanvirapu885 that's quite interesting
OMG YES!!!!!!!!!!!!!!!!!!!
This is, no joke, one of _the_ coolest videos I’ve ever seen on KRplus.
Guys what's up with this "one of the" meaningless expression? It's pointless to highlight "the" or to add "of all time" etc. if you opened with "one of" xd
You gotta say like "one of the 20 best X-things" or "one of the X-things which share the first place". Otherwise you're only signifying that it's better than average.
If you can measure what the sound wave should look like on its own, you should be able to take that and compare it to how it travels through the actual matter, and cross check the actual vibration.
It'd be a 3d sound projection, which is a great way to take the 2d imaging we use to visualize waves into their 3d shape.
Altogether though great stuff, and there is at least one positive result, even if it is choppy
There's a brazilian fiction book I read as a kid (don't remember the name, gotta search in my parents' shelf), back in around 2005 IIRC, which actually has some plot around using a device that can recognize writing machine keystrokes by sound. Just found it interesting coincidence you mentioned that idea in the lastpass ad.
2:30 Neighbors are probably thinking this dude has some really strange hobbies.
he has
meme worthy clip
Cole well, yelling at bag of chips is not a basic hobby.
Well they wouldn't be wrong
lmao
If fps is the limiting factor - someone tell the slow mo guys
Felix Onken I thought the same thing. They should so partner with this guy to see how clear of audio they can get with this.
Freyd this isn’t 2003 anymore.
SLO-MO cameras aren’t 100k, and can be rented quite cheaply.
Yea since they can have insane frame rate with 8k res.
Destin from Smarter Every Day would be a good choice.
@@UrbanPanic yea slo mo guys actually borrow his cam quite a bit.
If you tracked the path of the sound, you could recover more depth... ie: if sound is coming from one direction - you can get more information instead of just looking at a small segment. The small segment is good for the proof of concept. Then, colliding soundwaves for sounds coming from more than one location... it means tracking all possible moveable elements in the video and then you can use less frames because the more flexible material throughout the scene, the more you can capture per frame.
I liked the moment of the deep rhythm sound on my stereo at 9:17
Nice video!
I can recover screams from images of someone stepped on a lego brick.
Nailed it!
🤣🤣🤣🤣
Typical final project for arts degree 2:29
All these comments about 2:29 do make me LOL
The only sound that I recovered from this comment was -
*hhhhhhhhh*
new notification wav thx
So cool!!!! I put on my noise cancelling headset and I heard the low tones and the high times, soooo cool.
This was an episode in Fringe. We recently rewatched the entire series, so underrated and so good. It should really be more easily streamed, it's like X Files for Gen Y I reckon
And Spock was in it
yeah, but in that episode it was like that sound was kinda engraved into objects AFTER it was played. Like a quantum vinyl.
1999: There will be flying cars in the future
2014: Man yells at a bag of chips for science
😆😆
NoŤ Àboùt 2014?
@@tablesalt8746 He yelled...In 2014 check the video
1980* (instead of 1999)
1999: This joke was invented
2018: People still telling it on KRplus videos
++ Knock Knock,
Who's that?
++ NSA, we will continue the research from here
++ Thanks for your service
More like, "we've known this since the 50's.."
Sai Sujan, haha. 😳🤬❤️
The epic return of punchcard pc...
Recording car audio subwoofer could offer a much easier start (lots of movement and low frequencies; perfect for a fairly low speed footage). This could help adjust the software. I know it's not quite the same thing but pretty close and it allows you to adjust the volume and with that, the amount of movement; from minimal; similar to what they get with Al foil, to very visible; millimeters or even a few cm. Also, various objects or surfaces could be attached to the speaker's cone to see how they behave (maybe even with different lighting conditions) and this could also help improve the software.
Also; Applied Science has made a video, where he was able to record music from vibrations of a window of a room where the sound source was located. He used reflected laser light as a way to capture the movement.
Sound through a 3D structured object can be an alternative to describe images without light, only instead with vibration waves, such as sound, its a similarity to radar to Identity 3D over just seeing it, so sound will offer differ ways to identify, for example sonars, if ampified, can bypass limitations on some structure.
*_Hmm that intro reminds me of 2006 KRplus!_* *_”THIS VIDEO HAS NO SOUND”_*
2:25 Gotta appreciate the dedication of screaming nursery rhymes at inanimate objects
For the foil test you could use a foil membrane over the speaker with the shiny side up. Then you point a light to reflect of the foil and into the camera. Then as the speaker moves the amount of light received by the camera would change in correlation to the compression and rarefaction. Then you could correlate light levels to sound waves since it should be a very clear distinction. It's the same that was used here. But this way you can be certain that your camera will pick it up the first try.
Bro you're crazy. This video is mind blowing. I don't even know to start thinking about this idea.
MARY HAD A LITTLE LAMB LITTLE LAMB
Neighbors be like: God dammit what is he up to this time
Haha that made me chuckle
Who does he think he is, Thomas Edison?
Yeah, neighbors are trying to entertain company and are like this guy never shuts up
2:28 man yells at bag of chips
2019, colored
Wicked Potato **2014, colored
More like audioized
Thank you so much for your effort and hardwork.
it reminds me of the research involving wifi waves imaging, where with the waves behavior hitting objects, it's possible to see the objects. If it was high resolution enough, it could be possible to listen to sound hitting objects detected with the wifi waves... or maybe sound could directly affect the waves even.