Searching by Image Instead of Keywords 184
Content based image retrieval (CBIR), the technique to search for images not by keywords, but by comparing features of the images themselves has been the focus of much research ever since the web emerged. Consider for instance adding CBIR to Google Images, where you would be able to search for images similar to a query image instead of using keywords. A research project at Penn State University has recently been applied to the biggest aviation photo database in the world with close to 800,000 images. You can search for images similar to a photo already in their database (click "View similar photos") or submit your own query image. Some queries generate better results than others but CBIR is certainly here to stay and will be standard in many image applications of the future.
Think of the greatness to society! (Score:5, Funny)
Re:Think of the greatness to society! (Score:2, Insightful)
http://www.airliners.net/similarity/index.php?ima
BTW, if you want to post other searches, this URL format seems to work.
Skin Cancer Detection (Score:3, Interesting)
I always felt good about working on projects like this, gives a warm fuzzy feeling.
False positives (Score:3, Funny)
Its almost like telling someone to go to whitehouse.com
Re:False positives (Score:1)
Re:Think of the greatness to society! (Score:2)
Arm jokes... (Score:2, Funny)
Re:Arm jokes... (Score:1)
Location? (Score:5, Funny)
Old photos (Score:3, Interesting)
Re:Old photos (Score:2)
Re:Old photos (Score:3, Informative)
It's an amazingly scary experience to sit there at night when a large plane is landing.
Re:Old photos (Score:3, Informative)
In fact, there is a bar [sunsetbeachbar.com] located right in the flight path of the runway. I just met a guy who came back from there, and said it's quite interesting to have planes landing so close to you.
Re:Old photos (Score:2)
Amazing. Turning a nuisance into a selling point. And people buy it.
Re:Old photos (Score:3, Informative)
"The island is served by many major airlines that bring in large jets, including Boeing 747s, carrying tourists from across the world on a daily basis. This fuels the island's largest revenue source, tourism. The airport is famous
Re:Location? (Score:2)
It says where just below the picture.
Re:Location? (Score:2)
FULL THROTTLE! (Score:1)
Oh My ${deity}, the noise must be horrific! My ears are hurting just from *looking* at that picture.
Actually, engines aren't at full throttle during landing, so it's actually not that loud at all
Re:Location? (Score:1)
Re:Location? (Score:2)
1) These photos are not digitally edited. This beach and airport is real.
2) It is not an awful beach; it is the holy grail of aircraft spotting, and a place that most aviation enthusiasts (myself included) would like to visit someday
3) If you say 9/11 in relation to this subject, such as, "OMG! it's unsafe there will be terrorisms LOLZ", I will be forced to kill you.
Re:Location? (Score:2)
1) Never thought otherwise.
2) Presumably, the aircraft are the reason you want to visit this location. It's certainly not the sand and water. In short, I stand by my assessment.
3) I didn't say it, but somebody else did in reply to my post.
Re:Location? (Score:2)
2. Have you ever been under a plane? It's very very loud. A 'holy grail', where you're deafened every 10 minutes, I don't think so. Also plane-spotters are worse than train-spotters. They all look the same anyway.
3. If I wanted to cause a terrorist atrocity, that's the beach I'd go to. A simple rocket-launcher, in combination with
Re:Location? (Score:2)
2. When landing, their engines will be throttled back, and therefore much quieter than usual. Also, ever heard of earplugs?
3. First you have to get the terrorists and their rocket launchers TO the beach without being noticed. Might be kind of hard considering it's a popular tourist spot on a small island in the middle of the Caribbean.
Re:Location? (Score:2)
2. Have you ever been near an airport? It's not fucking quiet. Wear earplugs? Must be great having to wear earplugs 24/7. Do you realise those things hurt your ears?
3. Yeah, because terrorists are all dark-skinned and wear turbans and have names like Al-Sharaqa Jazeirain. You can see them a mile off. You can probably recognise them from a distance because they're the ones firing the mac
Girl wearing thong looking at something in the air (Score:2)
Same beach -- 747 landing (low) (Score:2)
This famous pic is the GIS for 747 and beach.
Re:Same beach -- 747 landing (low) (Score:2)
Wow (Score:5, Interesting)
It will be interesting if we ever get to a stage where we can just search for a random object (or person) in a database of photos. Then you could take pictures of everything with an always-on camera and if you need to find where you put your car keys, just do a search.
Re:Wow (Score:2)
Re:Wow (Score:2)
Dunno about that. Here's what I get after clicking on a picture of an A-10 Warthog: A Tornado, a 767, a 747, A Fokker F-7 turboprop, a Dassault Falcon business jet, a Luftwaffe A310, a Harrier, an F-18 Hornet, another Tornado, a Lockheed P3 Orion sub hunter, a Sikorsky Super Stallion helicopter, a Concorde... and soforth. No other A-10s. Hard to think of a more diverse crop of aircraft.
Most of these aircraft are airborne but a couple are on the ground. If I cli
Re:Wow (Score:4, Informative)
If you are only interested in searching for images on your own computer, have a look at imgSeek. http://imgseek.python-hosting.com/ [python-hosting.com]
It's been around for some time now. You can not only use an existing image to search, but also do a rough sketch. Check the screenshots: [sourceforge.net]
Nice complement to what has been presented in this article.
Re:Wow (Score:1)
http://imgseek.python-hosting.com/ [python-hosting.com]
Brilliant! (Score:1)
Re:Brilliant! (Score:2)
An open-source (GPL v 2) Content Based Image Retrieval program already exists: imgSeek [python-hosting.com].
To search a photo, you don't need a similar photo, simply draw a rough sketch. See this screenshot [sourceforge.net].
They would need major manpower to maintain this db (Score:3, Funny)
They would need a team of outsource Indian workers to go through each picture one by one!
I am not Indian but...can I apply for the image filtering job?
I said this first, I should get the job
Re:They would need major manpower to maintain this (Score:2)
Porn DOES however, make you spell better!
Top Search (Score:3, Funny)
Re:Top Search (Score:2)
Re:Top Search (Score:1)
Re:Top Search (Score:1)
Re:Top Search (Score:1, Redundant)
Re:Top Search (Score:2)
Hey, if that's what you're into. They always say there's someone for everyone!
security issues (Score:1, Offtopic)
Re:security issues (Score:2)
Re:security issues (Score:1)
Re:security issues (Score:2)
On what grounds could the TSA squelch photographers and their right to share their creative works (which is their livelihood)?
Re:security issues (Score:2)
Trainspotting seems to still be around as well, see http://www.railpictures.net/ [railpictures.net].
The ever popular 'Breast' option... (Score:1)
+"34b"
-"puffy"
Similar images (Score:2, Funny)
1. Airliners.net
A site with almost 1,000,000 aviation images.
Wow !!! I tested their Sample search [airliners.net] and all the results were aeroplane photos !!! Ok, ok the site only has airplanes but still
On a more serious note the alogorithms seem to look for similatity in the colors and lighting rather than the subjects (for example it shows the interior of a cabin in photos similar to a whole plane in the sky. To really see its effectiveness we need to test in in
The Human Brain (Score:1)
IANABP, I am not a bio-physicist but it seems very much like artificial intelligence to me.
And for 'lynx' users... (Score:5, Funny)
Some relevant research papers (Score:5, Informative)
* Finding Naked People [hmc.edu] (Fleck et al, 1996)
* Video google: A text retrieval approach to object matching in videos [ieee.org] (Sivic & Zisserman, 2003): web page demo here [ox.ac.uk]
* Names and Faces in the News [columbia.edu] (Berg et al, 2004)
* FACERET: An Interactive Face Retrieval System Based on Self-Organizing Maps [springerlink.com] (Ruiz-del-Solar et al, 2002)
* Costume: A New Feature for Automatic Video Content Indexing [www.irit.fr] (Jaffre 2005)
One more: automatic film character retrieval (Score:4, Informative)
Automatic Face Recognition for Film Character Retrieval in Feature-Length Films [cam.ac.uk] (Arandjelovic & Zisserman, 2005)
The objective of this work is to recognize all the frontal faces of a character in the closed world of a movie or situation comedy, given a small number of query faces. This is challenging because faces in a feature-length film are relatively uncontrolled with a wide variability of scale, pose, illumination, and expressions, and also may be partially occluded. We develop a recognition method based on a cascade of processing steps that normalize for the effects of the changing imaging environment. In particular there are three areas of novelty: (i) we suppress the background surrounding the face, enabling the maximum area of the face to be retained for recognition rather than a subset; (ii) we include a pose refinement step to optimize the registration between the test image and face exemplar; and (iii) we use robust distance to a sub-space to allow for partial occlusion and expression change. The method is applied and evaluated on several feature length films. It is demonstrated that high recall rates (over 92%) can be achieved whilst maintaining good precision (over 93%).
Re:Some relevant research papers (Score:2)
http://wwwqbic.almaden.ibm.com/ [ibm.com]
that first one is so pointless (Score:2)
Re:Some relevant research papers (Score:2)
and then we have reverse "Googling" for images.. (Score:5, Interesting)
One has to guess the search word which generated a given set of 20 images in google's image search [robinson.name]
When things are moving forward, we have soomthing to talk about "those good ole days" but frankly the game is interesting initially but later gets boring due to the frequent repetitions..
Re:and then we have reverse "Googling" for images. (Score:2)
http://www.spilth.org/pictures/girls/ceren/jkh-and -babe.jpg [spilth.org]
Impossible!
Is it just colour? (Score:5, Interesting)
What I got was an awful lot of red planes - some of which were actually Qantas planes, but I think more by coincidence (i.e., they're red) than design. Many images had nothing to do with Qantas, or even a red plane - they simply had a lot of red in the image.
This is impressive in some ways, but in others it seems like it's simply looking for similar patches of colour. I haven't done enough testing to see what happens if,say, I gave it a half red half green image.
Interesting, but not ready for public consumption just yet. A bit like A.L.I.C.E. the artifial intelligence system actually - neat, but not practical. Yet!
Re:Is it just colour? (Score:2)
Re:Is it just colour? (Score:2)
So the search system went looking for large red triangles on a white backgrounds. Obviously, there were none, so it settled for the next best thing - white non-triangular planes on light blue background or something.
Great! (Score:5, Funny)
eVision? (Score:1)
I guess eVision [evisionglobal.com] were just too early to market with their visual search engine. Here's a demo or three [evisionglobal.com] of eVe in action.
It sure was cool, just too far ahead of its time...
Several image viewers do this already (Score:1)
It's not quite "put in an image and find me all the similar ones" but the underlying technology is the same, usually creating some kind of "signature" of each image and then comparing the signatures to find others visually similar.
Great for de-duplicating your por^M^M^MPhoto Collection.
IP Enforcement Nightmare (Score:2, Interesting)
The big problem to me is specifying input. I know the "look" of the Mona Lisa's smile, but even with the best pen input methods I'd never be able
_Mind at Light Speed_ by David Nolte (Score:1)
However, he put forth the concept of replacing the bit as the common unit of data with actual images - best described as holographic images of light manipulated by light. A picture really _would_ be worth a thousand words in such a system!
He was my professor, it sucked. (Score:1)
This reminds me of Gibson's Pattern Recognition (Score:3, Interesting)
How does it do that? (Score:3, Funny)
more sophisticated than colour matching (Score:1)
There is a GNU project related to this GIFT (Score:5, Interesting)
The GIFT (the GNU Image-Finding Tool) is a Content Based Image Retrieval System (CBIRS). It enables you to do Query By Example on images, giving you the opportunity to improve query results by relevance feedback. For processing your queries the program relies entirely on the content of the images, freeing you from the need to annotate all images before querying the collection.
GIFT [gnu.org] It worked pretty well for me in the demos they linked too. I have been waiting for this type of application to gain momentum.
Sorry, someone else is currently using the system. (Score:1)
Would it work for animated .gifs? (Score:2, Interesting)
It says "multi lock on" and a date, but all Google reports is other forum posts looking for the creator of the image. Apparently, there's a high-res version of it too.
Apps Already do this. (Score:1)
It's db of airplane pictures, they are all similar (Score:1)
I guess anyone can get a research grant these days.
Pretty controllable test (Score:2)
Now, do this for something like Google Images or PBase or collections spanning infinite numbers of subjects and image sizes,
Re:Pretty controllable test (Score:2, Informative)
Look up Bombardier in the forums on airliners.net, they have frequently asked a photog for permission to use their photos (for pay), then later say they elected not to use them (and therefore no payment to photog). But then they use the photos anyways without payment or acknowledge
Re:Pretty controllable test (Score:2)
But based on the number of pr0n uses already, and predictably, identified in this thread so far, some people might LIKE that sort of thing ;-)
You can tell pretty quickly how they match (Score:1)
Music (Score:1)
Spotlight (Score:1)
Is this a joke? (Score:3, Interesting)
Next experiment: I took a picture of a highly distinctive plane, a harrier, climbing at a steep angle and viewed in profile. I got, in return, a list of passenger jets, and even a helicopter. Hardly surprisingly, all of the result pictures had the same bluish white sky as my original image. That was literally the only similarity.
According to the introduction on the search page the heuristics used compares colors, contrast and shapes in the images themselves. I saw no correlation whatsoever between shapes, and any correlation in contrast seems to be to be the result of the search engine simply looking for images that contain the same colors in a similar ratio to the original. In short, nothing to see here, move along.
On the other hand, one of the projects listed under the Penn State University link looks fairly fascinating. The Riemann a-LIP project [psu.edu] (automatic linguistic indexing of pictures) doesn't allow user input of images, unfortunately, but it does show some fairly fascinating attempts at verbally qualifying image data. For example, it describes a blue and orange mandelbrot as pattern agate shimer abstract scene, and a sunset over a lake as Berlin Devon Namibia landscape lake scene. Okay, it may still need some work, but it sure beats the hell out of the "find the same color airplane engine".
This tale has old roots... (Score:2)
Actually, this story (the veracity of I do not know) predates our modern concepts of "neural networks" - that is, multi-layer networks of nodes (typically three - input, output, and intermediary layers), in which the nodes simulate neurons via weighted thresholds and other mechanisms for "firing" an output based on inputs aggregated over time and/or frequency - coupled with back-propagation "learning"...
Instea
Oh, you mean like imgseek? (Score:4, Informative)
Purdue University's 3D Shape Search (Score:2, Informative)
altavista (Score:2, Informative)
Re:altavista (Score:2)
Uh-oh. (Score:2)
Of course, given the usual course of things, it will instead be deployed at JFK's formerly-TWA terminal, assigned facial recognition tasks, and immediately declare everyone to be among the 10-most-wanted terrorists. I can't wait.
Worked on something similar (Score:3, Informative)
I've not RTFA (not had the time), but our approach was to split the images into segments (based on colour and texture) which were assumed to be objects. The segments would then be analyzed for various feature vectors, such as shape, texture, colour etc. These vectors would then be added into a database of numbers, and finally the segments grouped, giving a collection of classified sections which (hopefully) represent similar objects.
From related metadata such as keywords, you could then hope to build up an idea of what keyword matches which section. You could also come up with a relevance between two images, and thus search for similar images.
We didn't have enough time to make it bulletproof by any means, but our limited results were very promising.
Sorry I can't find the paper, but we've got some screenshots of the application here [soton.ac.uk] and here [soton.ac.uk] (you can see false colouring applied to the original image to display the segments)
Some more screenshots (Score:2)
Reee diii cuuuu looooooooous ! (Score:2)
Image search will kinda work for airplanes in this database,as there are a very limited set of airplane model numbers, which are going to be attached to each photo.
But if the database didnt have these text clues the image search is going to be unlikely to see the similarity between an 747 in the air, as seen from the ground, with a head-on view of a 747, or one at the gate, or one in a hangar, or one in twilight, or one of a different color.
Maybe it could be done by outsourcing the task t
Too Literal (Score:2)
However, I think it would be better if it were able to realize what the 'background' was and filter it out. (Though I couldn't begin to guess how you'd do this.)
For example, I searched for this image [airliners.net]. Many of the results [airliners.net] are of something completely different, such as a white jet. Which is nothing like a camo helicopter. But the sky and the ground are pretty similar, and I think that's how it's matching.
It
CBIR is the same problem as AI (Score:2)
Even in the restricted context of aeroplanes this is not a trivial problem. Someone in the list of replies submitted an image of a warthog (A-10) and got nonsensical results. Somehow the
Re:wtf? (Score:5, Interesting)
Re:wtf? (Score:2)
I used to do research in CBIR, and in my image library I had 5 photos of a christmas tree. By any efficient metric, one of them was always way far away from the others.
Xcott
Re:wtf? (Score:2)
Re:wtf? (Score:2)
Re:wtf? (Score:2)
Search for yellow flowers gets pink flowers. The layout must be being analysed, surely?
Re:wtf? (Score:1, Funny)
Re:wtf? (Score:3, Interesting)