Stories
Slash Boxes
Comments

News for nerds, stuff that matters

Slashdot Log In

Log In

Create Account  |  Retrieve Password

Google Prefetching for Mozilla Browsers

Posted by Zonk on Thu Mar 31, 2005 09:37 AM
from the two-great-tastes-that-go-great-together dept.
kv9 writes "A post on GoogleBlog reveals that Google has enabled results prefetching for Mozilla based browsers, which means that the top results of queries are being loaded in the background and pages will load faster. More info on the Mozilla Prefetching FAQ and the Google Webmaster FAQ"
+ -
story
This discussion has been archived. No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More
Loading... please wait.
  • Watch for this... (Score:5, Insightful)

    by grub (11606) <slashdot@grub.net> on Thursday March 31 2005, @09:38AM (#12099521) Homepage Journal
    I can see employees being confronted for browsing pages they never actually looked at. An obvious example: innocently searching for info on the silly Vin Diesel movie "XXX" turns up a nice mix of Vin and pr0n in the top results. Presumably a mix of both are loading up in the background
    • Prefetching is one of those things that seems like a really great idea on paper, but doesn't hold up so well in practice [incutio.com].

      The problem is that you have things like 'rel=next' that expect the user to go to some next "logical" page, but no structure to a site to encourage that logic. You get people upping bandwidth costs and slowing down browsing time because the site maintainer THINKS they'll go to some next page but the site design actually ENCOURAGES them to go to some other, unrelated page.

      In OSS, a lot o
      • You get people upping bandwidth costs and slowing down browsing time because the site maintainer THINKS they'll go to some next page but the site design actually ENCOURAGES them to go to some other, unrelated page.

        There are extensive studies from third parties on what people look at and do when they search on google. And you know what, they found people tend to look at and go to the top result, and don't even glance below the top few results most of the time.

        I'd expect that a company with the means to do the necessary research wouldn't go about implementing this kind of hackish "feature set" until it had thought things through a little better.

        I'd expect that Google has better figures on where people go to from Google's search pages than anyone else.
      • This isn't for pages WITHIN a site, where determining what is 'next' may be problematic. This is for search results.

        Here there is a logical choice to prefetch, namely, the top search result. This just autoloads the page to which "I'm feeling lucky" points.

        I still don't necessarily like it, it wastes bandwidth. Yes, I know I can turn prefetching off in about:config, but most people won't.
      • PS... (Score:3, Insightful)

        PS: Google on "google triangle" and you'll see why they picked this page to prefetch...

        Though I'd like them to prefetch the "next search page" as well... at least, that would tend to speed up *my* googling. I'm probably atypical, though, if they don't do it...
      • by bfields (66644) on Thursday March 31 2005, @09:58AM (#12099748) Homepage
        Prefetching is one of those things that seems like a really great idea on paper, but doesn't hold up so well in practice.

        The page you cite in support appears to be an argument specifically against prefetching pages with the rel=next attribute. As you say:

        The problem is that you have things like 'rel=next' that expect the user to go to some next "logical" page, but no structure to a site to encourage that logic.

        That's a flaw in firefox's prefetching logic, not in site-designers' use of rel=next, which was never intended to be used to indicate links the user was most likely to follow.

        In any case, google is actually using rel="prefetch", which *is* intended for that purpose. And google's use looks pretty sensible: "This tag is only inserted when it is likely that the user will click on the first link." From experimenting it appears that it's only used on some searches; e.g. the example they give is the first hit on a search for "stanford". So presumably they have fairly good evidence that a user is actually likely to click on such a link--I suspect they have enough data on this that they don't need to just guess.

        In OSS, a lot of the maintainers and coders are just "hackers" or college kids contributing bits and pieces of less broad knowledge over a bigger project team, not real software engineers who have been trained to really think through the consequences of certain design decisions.... I could see why someone at Google might think this is a good idea, but I'd expect that a company with the means to do the necessary research wouldn't go about implementing this kind of hackish "feature set" until it had thought things through a little better.

        I think you're making some huge generalizations here based on very little evidence.

        --Bruce Fields

      • by shaitand (626655) on Thursday March 31 2005, @10:00AM (#12099762) Homepage Journal
        In commercial development, a lot of the maintainers and coders are just "hacks" or college grads, who know how to write a resume and interview well, contributing bits and pieces of less broad knowledge over a smaller project team, not real experienced software engineers doing what they want to do and who have the brains or inclination to really think through the consequences of all design decisions.

        "and it can really cause problems when so many people are moving from professional browsers to more amateur ones that test out these features in what they THINK is a mainly geek-oriented audience."

        Precisely what browsers are you referring to? Perhaps you would care to let us know which browsers your highness believes to be "Professional" and which he believes are "more amateur". In general, I would contend the latter are actually superior browsers and that is why people move to them. Every browser I know of goes through a development, alpha, and beta stage to test features before final release. Also, google is implementing this, not a browser.

        "I could see why someone at Google might think this is a good idea, but I'd expect that a company with the means to do the necessary research wouldn't go about implementing this kind of hackish "feature set" until it had thought things through a little better."

        Perhaps they do not use rel=next attributes and believe they have a bit more data at their fingertips than you do. Maybe, just maybe, you are the one who has not performed any research and google has in fact examined a great deal of data. Maybe that data even tells them that the number of people who continue to the top search results is staggering.
      • by smallpaul (65919) <paulNO@SPAMprescod.net> on Thursday March 31 2005, @10:05AM (#12099821)

        Your post is confusing. First you say that prefetching doesn't work that well in practice and present a link to Simon Willison's blog. But the blog says that prefetching is an "excellent feature" except for a couple of quirks in Mozilla's implementation. Google does not trigger those quirks so they are irrelevant.

        Then you go off on a tangent about how "real software engineers" think through their design decisions more than "open source hackers". This is totally contrary to my experience. I would more highly rate the software engineering of Mozilla against Internet Explorer, Unix versus Windows or Apache versus IIS. I could go through a long list of brutal design decisions in commercial software that did not hold up in the real world but I'll just mention Clippy and the Windows registry as two high-profile examples.

        Finally, it is Google, a commercial software services company that is the topic of the article. So your whole argument is self-defeating. Either Google doesn't conform to your vision of real software engineering or the feature is not really at odds with real software engineering.

    • by Juvenall (793526) on Thursday March 31 2005, @09:40AM (#12099538) Homepage
      To be fair though, it's never appropriate to search for Vin Diesel.
  • MSIE/MSN (Score:5, Insightful)

    by mirko (198274) on Thursday March 31 2005, @09:39AM (#12099527) Homepage Journal
    Does somebody knows whether MSIE and MSN collaborate the same way?
    Anyway it could be obvious that Google tries to establishes such alliances against his main concurrent (besides Yahoo).
  • Padding? (Score:5, Interesting)

    by Quixote (154172) * on Thursday March 31 2005, @09:40AM (#12099542) Homepage Journal
    Would prefetching pad the click count for the ads that Google shows along the side? I know, the client (Moz) adds a
    X-moz: prefetch
    header, but how many server admins log this?
    • Re:Padding? (Score:4, Insightful)

      by nautical9 (469723) on Thursday March 31 2005, @10:10AM (#12099855) Homepage
      If you're referring to the sites that google's adding the prefetch links for, then no - since there's no "clicking" happening for anything but the result page. If anything, the impression to click ratios will go down, because the page (and the google image ads on it) are being loaded, but the client will never click on it because he never saw it.

      If you're referring to potential click-fraud that a malicious site may do by adding a bunch of "prefetch" links on their page that points to the ad, I seriously doubt it, since no one but the client's machine knows what the links are (since I believe they're loaded at the time the image is generated).

      Perhaps an enterprising fraudster may write some clever javascript that waits for the google ad to load, and then generates the prelinks - but I doubt the browser would then notice the change and go prefetch them. Besides, it'd be easier to just make an invisible frame and set it's href location. But again, I doubt you can dynamically figure out what the google ad click URLs are with javascript alone.

  • Link is broken (Score:5, Informative)

    by KinkifyTheNation (823618) on Thursday March 31 2005, @09:41AM (#12099548) Journal
    Replace the %23 with a # and the url will work.
  • by ... James ... (33917) on Thursday March 31 2005, @09:41AM (#12099560)
    Slashdot kills the # character in the URL: prefetching faq [tinyurl.com]
  • Ever heard of the concept "one click and you're guilty?" [wired.com] Users of this feature who unknowingly perform a search that returns results containting offensive/illegal content may find themselves being prosecuted by local, state or Federal authorities...

    Proof of concept: Google caught in anti-Semitism flap [zdnet.com]. Replace "anti-semitism" with "child pornography" and you'll understand what I'm getting at...
    • by Rakshasa Taisab (244699) on Thursday March 31 2005, @10:10AM (#12099851) Homepage
      Note to self; Remember to turn of network.prefetch-next when googling for "child pornography".
    • Even More Problems (Score:5, Insightful)

      by Valdrax (32670) on Thursday March 31 2005, @10:23AM (#12099981)
      Forget the Feds, you're much more likely to get nailed by your IT department for this. I wonder if a user who was unaware of this feature and got fired thanks to links loaded by it could sue the Mozilla Foundation. I can just see some malicious little asshole putting hidden (via color) links in their webpages that download utterly offensive crap just to see if they can get someone fired. I especially expect this sort of thing from the same sort of Slashdot trolls who posted that infinite pop-up of gay porn thing in the Firefox Hacks story.

      I also expect that this will be abused by unscrupulous websites who want to run up their ad revenue by having people preload a page full of ads. Many people have already expressed concerns for those who have slow connections or who do not have unlimited access. This could also be used by spammers to verify people who are smart enough to have web-bugs disabled via cookie and image blocking on emails but who don't know about preloading if the Thunderbird people enable this in email (which would be foolish beyond belief).

      I just think this concept is a horrible idea.
  • a href="http://www.google.com/help/features.html#pre fetch"
  • Ack! (Score:3, Interesting)

    by Anonymous Coward on Thursday March 31 2005, @09:47AM (#12099635)
    I'm using a modem you insensitive clod!
  • Comments (Score:5, Informative)

    by hendridm (302246) * on Thursday March 31 2005, @09:48AM (#12099653) Homepage

    3. I want to block/ignore prefetch requests. What should I do?

    To block or ignore prefetch requests (from Google and other web sites), you should configure your web server to return a 404 HTTP response code for requests that contain the "X-moz: prefetch" header.

    Sucks for those of us on shared providers, I guess, who don't want this so our bandwidth costs don't increase.

    I wish they had an option in the Google preferences to disable this, as I don't need a slower connection. Fortunately, you can disable it:

    Yes, there is a hidden preference that you can set to disable link prefetching. Add this line to your prefs.js file located in your Mozilla profile directory:

    user_pref("network.prefetch-next", false);

    It would be nice if there was an option in Firefox prefs to do this so I don't have to remember it every time I reload.

    • Re:Comments (Score:5, Informative)

      by justforaday (560408) on Thursday March 31 2005, @10:03AM (#12099800)
      It would be nice if there was an option in Firefox prefs to do this so I don't have to remember it every time I reload.

      Doesn't changing this value on the about:config screen do that?
    • Re:Comments (Score:3, Informative)

      Something like the following ought to work in .htaccess

      SetEnvIf X-moz ^prefetch prefetch_deny
      Deny from env=prefetch_deny
  • by Anonymous Coward on Thursday March 31 2005, @09:50AM (#12099679)
    Only when google is confident that the top result is the one you want - the one link that the vast majority of people actually click - do they include the prefetch link for that one resource. Go and try it for yourself, and look for prefetch in the source. For the vast majority of searches, it isn't there. Only when looking for the authoritive resource (such as stanford.edu for "stanford") is the prefetch link actually there.

    Sure, their metrics might be off at times, but the way this has been implemented is definitely a good way, and will be very helpful for users of all browsers implementing prefetching (which currently is gecko-based only afaik, but could easily enough include opera and safari and such as well in the near future).
  • by dave7e9q (773402) on Thursday March 31 2005, @09:50AM (#12099681)
    Type about:config ... then scroll down to network.prefetch-next ... double click it to "false" ... all done.
  • This is great! (Score:5, Insightful)

    by Slashcrap (869349) on Thursday March 31 2005, @09:53AM (#12099701)
    Unless :

    You have an ADSL line with a really stingy cap (for instance BT in the UK offer a cheap service with a 1GB/month cap). I'm sure their customers will be happy about downloading pages they won't read.

    You're a web admin that pays a lot for bandwith. I bet they'll be really happy that lots of people will be downloading their pages without ever looking at them.

    You're at work surfing through a proxy that does filtering / logging and there are some dubious sites that get pre-fetched for you. Enjoy getting sacked for something you didn't do!

    Well, I don't know about you, but I'm struggling to see any drawbacks to this great new technology!
    • The above post could only be considered insightful if you didn't read the article. If you look at how Google implemented this feature you'll see that, with a possible rare exception of the first point on certain searches, none of these arguments apply.
  • So , that means if I *accidentidly* search for a pron related topic, or pron is definatly in the top responses from google, It gets downloaded without me doing anything?
  • by rhh (525195) on Thursday March 31 2005, @10:02AM (#12099781)
    Not only could this get you in trouble by inadvertently downloading porn at work, but you could download even more incriminating things.

    Say for example you were searching for info on that convicted sex offender that moved into your neighborhood or searching for news on terrorist attacks. Prefetching could potentially have your computer downloading things you wouldn't otherwise download and that could get you in real trouble.
  • by jonr (1130) on Thursday March 31 2005, @10:08AM (#12099833) Homepage Journal
    I think it would make more sense if network.prefetch-next would be set to false by default. Then gearheads could turn it on if they wanted.
  • Another concern (Score:4, Informative)

    by DaveJay (133437) on Thursday March 31 2005, @02:16PM (#12102725)
    Other people here have already discussed the "you'll get in trouble from work/authorities for prefetching things on to your computer you don't even know you're loading" deal, so I won't touch that. They've also discussed the "You'll use more bandwidth" thing.

    Here's my complaint, from an entirely different direction: two years from now, is every default installation of Mozilla and/or Firefox going to require me to change a laundry list of preferences in order to avoid features I don't want?

    I mean, go ahead and put these features in, but don't activate them automatically: do what Opera does (asks if the user wants to activate a feature) or just leave them off by default, and add a menu option to turn it on.

    Having these things turned on by default is going to be an inconvenience going forward, and smacks a bit of elitist "we know what's better for your web browsing experience than you do" attitude, you know what I mean?

    At this point, I'd be thrilled with setting optional parameters like this to 'off' by default, and updating the default installation home page (visible on first execution of the app) to a page listing "Great optional features", along with buttons to turn them on and a quick note on how to turn them back off if desired.
    • Re:Links (Score:4, Informative)

      by sharkey (16670) on Thursday March 31 2005, @09:44AM (#12099598)
      BUGzilla blocks Slashdot referrers, not MOzilla.
    • ...that's just Bugzilla, anything else on the mozilla site accepts referrals from slashdot.org.
    • Re:Links (Score:3, Informative)

      Even if it WERE mozilla, rather than just bugzilla as mentioned above..

      Install tabbrowser extensions (TBE), and right click your quicklaunch type link at the top of firefox(which we all know we all have right? :D)...click tab settings..and make it always block referer. Or you can just make TBE do it for every site, though i dont.

      TBE and adblock make browsing in firefox about a thousand times better. Why firefox doesnt have good tab behavior in the first place is beyond me.

      With TBE closing a tab doesnt ju
    • I agree with you. What's worse is sometimes the first several sites are all the SAME worthless pages but with different URLs.

      I also like your idea of voting too. Every time you click on a site after searching Google you should have an opportunity to rate its relevance. That'd get rid of a lot of crap quite quickly
    • Re:Nice (Score:4, Informative)

      by KFury (19522) * on Thursday March 31 2005, @10:34AM (#12100093) Homepage
      Now every 56ker is going to move away from google.

      Why?

      Lie the article says, Moz/FFX only uses bandwidth you're not already using, so it won't make any other operation slower, and if you're on a slow connection then prefetching a page saves you even more time than if you're on a fast one. What's the use case that would have you moving to the door?