Desktop Search Engines Compared 361
nutterButter writes "After Google created a stir with its desktop search engine, other engines gained more awareness in the public eye. Slate did a comparison of them and Google was not their top pick; Copernic was. I tried it - and am quite impressed."
Copernic... (Score:3, Interesting)
Re:Copernic... (Score:2)
I know precisely where all my Gaim logs are stored, but that doesn't mean I can find a specific conversation when I want it. Given the choice between searching all the logs at once, and opening each one up and ctrl-F'ing through it, I'll take the
Linux anyone? (Score:5, Interesting)
I assume you get the picture :-)
---
Yeah, I'm like this on my blog [blogspot.com] too ;-)
Re:Linux anyone? (Score:4, Insightful)
Some GNOME folks look to be working on it. (Score:5, Informative)
The latest edition of the Beagle newsletter [beaglewiki.org] has just been released.
Re:Some GNOME folks look to be working on it. (Score:5, Funny)
Re:Linux anyone? (Score:2)
I name files descriptively since I'm not locked to 8.3 case insensitive names
Tom
Re:Linux anyone? (Score:3, Informative)
So for a practical example, I have about 120 collected pdf files of academic articles under filenames with the primary author and year. (I could put the title in there, but filenames between 16-25 characters seem to be rea
Re:Linux anyone? (Score:2)
I'm smart and use descriptive names for files.
Instead of
congr.sxw
I say "Gracenote Contract.sxw"
I also use these things called directories...
I'm a fucking genious I swear...
Tom
Re:Linux anyone? (Score:5, Interesting)
They use several filters to build an index of words in the various documents they have filters for.
When you ask Google Desktop, Yahoo Desktop, or other search engines to find documents that might be relavent to your search string, they compare the words in your search string with the words in the index they created earlier. From that index, they then provide you with a list of files on your system ranked by whatever algorythm the developers came up with.
If you happen to have a DVD ISO file on your system somewhere, copy it to a different partition to see how long just copying, not searching, that much material takes. It is not a non-trivial amount of time. Especially when you are looking to present a user with a list of matches in under a second.
Indexing is not just running a variation of 'grep' against your files. It is collecting a list of words from each document, identifying those words that are not 'common' (if, and, but, the, or, a, I, etc.) and identifying where in the document those words exist.
That way when you look for 'President Bush' on your hard drive, it can compare the proximity of the words 'president' and 'bush' and give a better match to those documents that contian both words, closer together. That way your disertaion on Teddy Roosivelt hunting in the deapest affrica will be less likely to come up with a match than your discussion of the relaventce of the first Gulf War to political dinners in Japan.
There are a couple tools out there that provide some of these features for Linux. You can use ht://dig to build a web based interface. If you would rather be able to use either a command line search, or a web based search, you might want to look into Glimpse.
Of course, this being Linux, dozens of people have taken a partial stab at doing this. You could probably work out a method from either the Learning Perl, or Learning Python books, as both are quite capable of building and maintaining indexes. The best part is that it would be optimized for your set of files, rather than just being a generic tool that you have to go out and find third party filters to make use of.
Then again, what do I know. If you think running grep against
-Rusty
Re:Linux anyone? (Score:4, Interesting)
If you're organized, then your docs will be on one general area. As such, running an egrep in there for a phrase really doesn't take much time at all. 20 minutes? hardly. A second, maybe 2. Try it some time.
What it allows me to do is make my
Is this practical, or even easily plausible, in windows? No. Does everyone know regular expressions? No. Am I saying that no one should use these tools? No. I'm just commenting on the poster that said grep couldn't do what these tools do - they were wrong.
locate doesn't search your emails, nor let you know which files containt things, you could recursive grep, but that doesn't find stuff in pdf files, and takes up a ton of cpu.
Locate - doesn't need to search my emails. gmail does that just fine. Egrep tells me what contains whatever I want. Can google's tool find files that have a line that starts with a number, has 2 words, then repeats the number again? No. Simple regex can blow away anything the google tool can do. I can most certainly find stuff in any binary or doc file, without taking up "a ton of cpu."
See? not saying my way is better for everyone else. Just saying someone who says my way doesn't work, is wrong - my way not only works, its more powerful.
Re:Linux anyone? (Score:3, Informative)
there's no reason to grep your entire damn harddrive for a single phrase. Use some degree of organization. The business world has limited use for someone who can't keep themselves organized.
finally - egrep will easily find patterns in all sorts of binary files. Creating a tiny lit
Re:Linux anyone? (Score:5, Informative)
flamebait (Score:2)
Re:Linux anyone? (Score:3, Funny)
Yeah... sounds like you need a Mac [apple.com]!
Humorless Moderators: It was a "Joke" (tm) (c)
Re:Linux anyone? (Score:5, Insightful)
Someday I'm sure that these crapware vendors will be producing their garbage for Linux, and dumb Linux users will be plagued with much the same sort of problems that windows users suffer today. It's almost a golden age now, knowing that the vast majority of Linux software is truly free libre software instead of the ugliness that freeware software will bring.
Re:Linux anyone? (Score:4, Insightful)
Of course they will. Like them or loathe them, the adware authors are doing it for money, and so target the OS with the largest install base (all other things being equal). Once Linux or MacOS has a more appreciable market share, they'll be targetted too.
Yes, Windows is more vulnerable to remote/local exploits, but that's not what we're talking about here - we're talking about trojans, malware-riddled software and other stuff that requires user intervention to get on to a system. If the hordes ever descend on Linux, so will the malware.
Re:Linux anyone? (Score:2)
Enjoy,
-Rusty
Re:Linux anyone? (Score:3, Interesting)
Some years ago, there was a product called "Excite for Web Servers" or "EWS". It was very good - I used it to index several hundred MB of text on my fire-breathing, 166 Mhz Pentium back in the day.
Unfortunately, it's getting real, real, real old and is almost impossible to get to work properly on a modern Linux install.
It's an excellent product, distributed with sources. Unfortunately, without a sufficiently
Re:Linux anyone? (Score:2)
Re:Linux anyone? (Score:2)
Apple's coming out with something like this... (Score:5, Interesting)
Re:Apple's coming out with something like this... (Score:3, Interesting)
Re:Apple's coming out with something like this... (Score:3, Informative)
Apparently it's a SQL Lite DB that stores Metadata.
Re:Apple's coming out with something like this... (Score:2, Interesting)
Re:Apple's coming out with something like this... (Score:3, Informative)
You're an idiot. There, I said it, and will probably get modded down just for that. But, honestly, QuickSilver having a bad interface? Bullshit. Your description sounds like you just looked at a screenshot and guessed at how it works. It's functionally no different than LaunchBar, Cmd+Space and start typing in the box cleverly marked "Type to search".
Yes, it's a *slightly* different approach than LaunchBar, but if you closed your yes, you
Re:Apple's coming out with something like this... (Score:2)
Re:Apple's coming out with something like this... (Score:5, Informative)
Actually, it is called Spotlight [apple.com].
Which will be a part of Tiger, the latest upcoming version of Mac OSX.
Re:Apple's coming out with something like this... (Score:3, Funny)
history search (Score:5, Informative)
The biggest use (and what makes it a necessity for me now) I have for a desktop search tool is searching for a webpage I partially remember visiting a few weeks ago, but need more information from. GDS indexes the content of all pages as you visit them, making finding them relatively easy - as far as I could tell (tested over half an hour), Copernic only indexed title and URL, which was of much less use.
A minor point for the geekier here - GDS can also be activated using quicksearch URLs from IE or Firefox, which is handy for those used to getting everything from one field.
Re:history search (Score:2)
But it still won't index pages you visited with Firefox, right?
Re:history search (Score:3, Informative)
Like this: Python proxy server [suttree.com] - a proxy server, written in Python, that uses Lucene/Lupy to do the indexing and searching.
oh shit (Score:4, Funny)
This is gonna make it really easy for your spouse to figure out what porn sites you visit....
Why is desktop search so hot? (Score:3, Interesting)
Re:Why is desktop search so hot? (Score:3, Insightful)
Re:Why is desktop search so hot? (Score:5, Informative)
Re:Why is desktop search so hot? (Score:2)
Re:Why is desktop search so hot? (Score:2)
Re:Why is desktop search so hot? (Score:2)
Re:Why is desktop search so hot? (Score:2)
Re:Why is desktop search so hot? (Score:3, Funny)
Re:Why is desktop search so hot? (Score:2)
Re:Why is desktop search so hot? (Score:3, Insightful)
This means that if you want to find all mp3's on your in the twenty different file sharing programs, and didn't have the foresight to organize them all into one set of directories. Than windows is going to search every
Re:Why is desktop search so hot? (Score:3, Informative)
Re:Why is desktop search so hot? (Score:2)
Because in Windows, the standard file search typically works like this:
MS's standard search is really, really bad (though they claim that the new MSN Desktop Search [msn.com] fixes that) -- and forget about using it to find stuff stored outside the filesystem, like in your e
Re:Why is desktop search so hot? (Score:3, Informative)
Re:Why is desktop search so hot? (Score:2)
I've tried products like Enfish, but they just wanted to be this huge bloated interface to 'how I work', when what I wanted was a fast search interface. Google Desktop's interface is small and fast. It's what I and I suspect a lot of other people want.
I once read an MSDN article by the guys who started the Window
Why would anyone trust this? (Score:2, Interesting)
Re:Why would anyone trust this? (Score:5, Insightful)
So, do you trust your OS vendor? If so, why, exactly? For that matter, do you really trust your antivirus vendor?
Re:Why would anyone trust this? (Score:2)
That's just so not true. When you install a good desktop search tool, it's like installing a spyware honeypot, whith only as much protection as the author of the search tool thought about putting in.
The whole point of having an advanced search tool is because it's too cumbersome to find imprecise information on your system with the regular search tool. But what applies to you also applies
Re:Why would anyone trust this? (Score:2, Insightful)
What is your CPU for? (Score:2, Insightful)
Maybe you don't trust Microsoft, but indexing and personal agents technologies are the futur.
Don't have a closed mind.
Re:What is your CPU for? (Score:2)
Maybe you don't trust Microsoft, but indexing and personal agents technologies are the futur.
So're spellcheckers.
Sorry --
the main problem i had with google (Score:5, Interesting)
i planned to sort out my music collection - so i searched for an artist - 87 results.
can i select them all and move them to a folder in one go? no.
for this kind of thing it's useless - i wonder if i can with copernic..
Re:the main problem i had with google (Score:2)
Even if you only use iTunes for that, it's worth it.
Re:the main problem i had with google (Score:3, Informative)
How neccessary is this for home users? (Score:4, Insightful)
If you do not put things in directories, and are really disorganized, I suppose it would be, but I suspect that most people are at least somewhat organized when it comes to computer files...
Then again, my perception may be skewed, since most people I come in contact with who use computers a lot are my college friends, and they are all pretty computer literate.
Re:How neccessary is this for home users? (Score:4, Funny)
Like this [nova.edu]??
Desktop Icons Suck! (Score:2)
As for I, when on windows, because I went nuts with the organization of icons in windows on my desktop, I use Blackbox for Windows [bb4win.org] which brings the black/fluxbox minimalist shell to windows by replacing explorer and creates the iconless environment that I always loved.
Re:How neccessary is this for home users? (Score:3, Informative)
You, sir, are completely wrong
Users HAVE NO CLUE where they put their files... ever.
Now whether or not a search tool will help them find the files they save is another question...
Re:How neccessary is this for home users? (Score:4, Insightful)
Would I ever need to search old email? Probably. Do I want to remember where every single email program I've ever used stores its mailbox files? Hell, no. If done right, these search tools can be really handy.
Re:How neccessary is this for home users? (Score:2, Funny)
Oh... and does anyone know how to bring your desktop background to the foreground? I can't see the nice green fields anymore
Re:How neccessary is this for home users? (Score:3, Interesting)
Yet I still desire a tool like this. Why? Because I forget thing- I may remember that two years ago I worked on a programmign project that displayed all the pictures in a directory- but I don't remember the filename, the project it's attached to, or the date I last used it.
I can search my programming directory, my backup directory, etc; eventually I'll find it,
Re:How neccessary is this for home users? (Score:2, Interesting)
Considering that these are people who get lost when a desktop shortcut vanishes - "who deleted solitaire?"
They dont have to think about where files get saved to anymore - they dont even have to think about what app they used to create it - the desktop tools find it for them and all they do is click the web link.
I also use Google desktop search (and Lookout), but google will be far better when they allow us to choose our own file extensions to search.
Re:How neccessary is this for home users? (Score:2)
Either
A. Save it to My Documents
B. Save it to C:\
Subfolders are right out.
DT Search (Score:3, Informative)
Only problem is DTSearch is hella expensive at $200.
But if you've got serious amounts of text that you need to search (I use it to search through 80gb of text on an external HD), its the only way to go.
Re:DT Search (Score:2)
I'm looking to index about 30-40 CD-R's and a couple removable hard drives (USB and one FIREWIRE).
Any suggestions for that so I can do a quick search and come up with all results for all disc's?
Re:DT Search (Score:2, Informative)
SHHH!! (Score:2, Funny)
Re:SHHH!! (Score:2)
Enfish (Score:2, Interesting)
Enfish has the best Windows integration, and X1 has a very snappy search. Enfish uses less memory for a large index and supports more data types.
Linux types can always use glimpse or roll something themselves with Lucene (an apache project)
Desktop search unnecessary (Score:5, Funny)
Simply use Google, which will have visited the web server on your compromised Windows PC- the same web server that is sharing everything on your hard drive with the rest of the world.
I bet those Linux weenies are jealous now.
Google (Score:2)
Add thunderbird and msn support!
I had a major problem with Copernic (Score:3, Interesting)
Search and Replace (Score:2)
Maybe it's a programmer-only thing, but I'm surprised none of the others will do replace (at least, if they do I didn't see it in the article).
Garg
Omea Pro? (Score:2)
It's from the makers of one of the best Java IDEs, IntelliJ IDEA.
Here's a link: http://www.jetbrains.com/omea/ [jetbrains.com]
FYI, Copernic contains adware. (Score:5, Informative)
Re:FYI, Copernic contains adware. (Score:2)
Re:FYI, Copernic contains adware. (Score:4, Informative)
It also says this:
# Keywords and result contents processed by Copernic Desktop Search
Copernic Desktop Search does not allow transmission of keywords or result contents to Copernic Technologies, Inc. or any of its partner for searches conducted by the user on his computer or corporate or home network. If the software ever requires collection and processing of data, such as user's profile, location, search history, fields of interest and tastes, these data should be processed only by the user's computer and not be transmitted deliberately to Copernic Technologies, Inc. or any of its partner.
I'd like to know how they reconcile the two. CDS does interface to web searches, though, so perhaps that's what they use.
I'm curious how much these apps affect performance (Score:2)
My machine is an otherwise speed-demonish laptop with a 4200 RPM hard drive, and I multitask like a demon... between fullscreen, 512-ram-using games and the Windows desktop.
Needless to say this causes a whole, whole lot of disk thrashing.
Do these desktop-search programs access the disk enough to compound my disk-swapping woes?
(On that note, I have a 7200 RPM external disk. Is there any way I can get WinXP to use it for at least some swap, or put
Copernic has some good developers (Score:2)
It's nice to see these guy's back on the map again.
Copernic - humm.. (Score:2, Interesting)
1. No thunderbird support
2. Why would I need to allow cookie from copernic if it is a *desktop* search?
Good thing is that it has firefox/mozilla support, which takes care of your browsing. Default options are set non-aggressively (like searching history is checked off by default, which is insightful), and this is something really good : option of NOT searching images smaller than 16x16 pixels, mus
Thematic desktop search (Score:2)
For those OS X users interested in thematic keyword search (either in desktop docs or on the Web), take a look at theConcept [mesadynamics.com]. Copernic Agent is a somewhat similar product.
</shameless promotion>
shameless plug (Score:2)
How big are these databases these create? (Score:3, Interesting)
Re:Desktop? (Score:2)
Re:Desktop? (Score:2)
Can your 'find' function search PDF files? Can it search _in_ files at all? Does your filesystem provide metadata to search on?
Your argument might be valid for users of OS X, but for the rest, these apps provide functionality that is not found in the OS.
Re:Desktop? (Score:2)
Re:Bias? (Score:2, Interesting)
Re:Bias? (Score:2)
Newsflash (Score:5, Insightful)
Re:Bias? (Score:4, Insightful)
Slate was very critical of MS during the anti-trust trial, has been reasonably critical of their software (even going so far, as another user mentioned, as to reccomend Firefox).
Re:Bias? (Score:2)
Re:Gnu (Score:2)
Re:Gnu (Score:2)
Supercharge (Score:2)
Re:Supercharge (Score:2)
Re:Supercharge (Score:2)
Re:thunderbird? (Score:2)
Yes. Copernic.
Take your pick (Score:5, Informative)
Launchbar [obdev.at] (the first)
Quicksilver [blacktree.com] The current favorite, and free.
Butler [petermaurer.de] About the same as Quicksilver, more features but not as slick.