Wait.. BSD isn't dead?

Time for some legitimate competition for Apache, it's been a long time. A bit of competition, which they haven't had much of could help them too. I am curious if it is easier to configure than Apache, and how well does it integrate with a JEE containers for serving the static content?

But what a fucking name though. :) I found out it's supposed to be pronounced engine-x. Until I found out I called it enjinx. Reminds me of that movie 'That Thing You Do' where the band called themselves the Oneders at the beginning and everyone called them the 'oh-nigh-ders' or 'oh-need-ders'. Then they got a manager and he forced them to change it to the Wonders because it didn't look garbled. So I say, why not just call it EngineX. It still sounds cool and doesn't have that annoying 'I'm trying to look cool' thing going at the same time. Regardless, sounds like a good product.

The only thing that makes me dubious is that they're based in Russia, I hope Putin and his boys don't have a back door into it. But America is starting to look no better than Russia these days in terms of a government that actually cares about the people. Have you checked out the NDAA that Obama signed this week? It lets the American military arrest civilians inside America (heck Fox news AND democrat supporters are all screaming bloody murder about this one). So on second thought I think I'll give this jinx thing a try.

I am quite surprised. nginx may be a good product, but it's also lacking a lot of functionality that a web server used as a load balancer or cache should support. For example, it doesn't support HTTP 1.1 to the backend, thus it can't do name based virtual hosts on the servers it caches.

I *WANTED* to use nginx for a large multi-tennant website we were building, but it didn't support it.

Bullshit. Microsoft uses it on every site they have. The only reason that "web server identification" surveys like Netcraft say they run Linux is because, like all large websites, they utilise the services of a CDN such as Akamai.

And there are no "secret agreements". Most of the time the company forbids such things is because there is no support, or because there is no ability of the in-house technical support to provide assistance with it. We're a very large IT company here and we have maybe 3 RHEL servers (because Linux was the best option for the task) and a couple of thousand (including virtual) Windows servers. (There's also about 2 Solaris servers, 4 or 5 Oracle Linux servers, a SCO Unix server and 2 or 3 HP-UX servers). None of this is due to any "secret agreements". It's all because there's one person trained to work with Unix based systems, and about 8 to deal with Windows. We utilise quite a large number of open-source packages across our infrastructure if it's the best tool for the job.

In my last job, we had a client with an all Windows environment. We're talking 2 DCs, a file server, an exchange server and a dedicated IIS server on the other side of the firewall and off the domain.

One day, they decided to revamp their static HTML website (this was a government department trying to justify their existence, IT wasn't exactly at the top of their list). We talked to the outfit doing it, who told us they were using PHP. Great, I though. We can get rid of an old and outdated Windows server and replace it with a nice, lean little Linux box. Nope, I was told to install the PHP ISAPI module on IIS, because "we were a Microsoft shop", even though this server was quite literally doing nothing but serving up HTML and chewing up an unnecessary Server 2k3 license. So after much fighting, and arguing to explain that we may as well NOT go through the trouble trying to set up and debug PHP as FastCGI, another guy went behind my back and stuffed up the install, leading to me wasting 3 or 4 hours rolling it back and installing it properly. Anyway, it's all smoothed over, until I get the zip file I've been promised by the "website makers". It was indeed a website, 10 or so DreamWeaver files with the extension renamed to PHP. No Drupal theme, no Joomla install, nothing. -.- God I hate the people in this industry that like to sell themselves as professionals

curl -v www.microsoft.com
Server: Microsoft-IIS/7.5
X-Powered-By: ASP.NET
 
curl -v www.hotmail.com
Server: Microsoft-IIS/7.5
X-Powered-By: ASP.NET

What sites are those, exactly?

There's some truth to this.

Several years ago, GoDaddy switch all of their domain parking to IIS, explicitly to get microsoft's numbers up. Throw 10,000 cnames pointed at a single machine serving up parking pages, and boom - 10,000 websites running IIS.

I was also going to speculate/wonder if it was one of those "rigged" deals, like a few years back when IIS was declared as "overtaking firefox" and becoming #1 because "most web sites on the web used it". The actual reason was that GoDaddy (which hosts a vast majority of "parked" domains) was paid-off (or "otherwise incented" by Microsoft to switch to IIS. So when you considered a "www." to be a "unique site", and 99% of "unique sites" to be garbage parked-domains, IIS was not the leader.

So, I wonder if some other bizarre statistical work is at-play. For example, does someone like Akamai, who hosts a lot of other people's sites, use Nginx to skew these numbers??

Yep, it's mostly used for front-end duties like connection pooling, load balancing, SSL offloading, gzip, that type of thing. If you're running PHP stuff, it's still debatable whether you want to go FCGI or PDM instead of Apache's built-in module. There are ups and downs in both cases and you'll have to see what works best for your site. At my company we use Nginx up front (with server type obfuscated) for SSL offloading and gzip and connection pooling. From there it goes into a varnishd cache on the same server (stored in 100% RAM) which handles the static stuff. Varnishd then forwards remaining requests to an L7 load balancer appliance type thing which then drops requests to each of 10 web "application" servers which are a combination of Apache with mod_php, Tomcat and Jetty Java servers. We've also used Nginx as an IMAP proxy and cache and it works quite well for that.

Apache has a good architecture but it's horrible at handling a lot of simultaneous connections and recycling them (that will change in 2.4 but it's not out yet). Also, if you're using mod_php, over time each Apache process will take the total maximum amount of RAM your php process uses, and many of our PHP applications use 128-256M of RAM or more (data management type stuff). So you can run a server out of RAM if you're trying to maximize connections.

Nginx can handle 10K connections on a little box with very little RAM due to the way it threads stuff. It's basically a copy engine and it's very fast. Varnishd can also handle a lot of connections and can serve up content straight from RAM in less time than apache takes to build a connection. That being said, Apache is reliable, and has I feel better logging at the moment and just more of everything. It's a reference implementation. It's actually fine for most purposes but if you're handling 1000 users simultaneously and they are making 10-20 connections each with various service calls and static downloads, you gotta have something that can pool the conenctions on the front end and handle static content or you're going to spend a lot of money on RAM. And if you're serving up static content with Tomcat, Tomcat is absolutely garbage. I think it has to boot the whole JVM to serve up your one file. If not that bad, it's still awfully slow, and it REALLY benefits from caching up front. BTW, Nginx does caching as well but varnishd seemed more mature and elegant.

Now lastly, you can just go out and buy an F5 BigIP and it does all this stuff on specialized hardware (Ok, special board, intel chip) and it's out of the box. But even the little ones are $20K which is a lot of software dev hours and/or web server/database/storage hardware. Would be nice and fun to have but if you can't spend the money on hardware (and training!) the nginx/varnishd frontend is pretty much the best setup in my book at the moment. A little complex but once it's set up you just let it run. I made an internal nginx cache for all our internal sites, including some Java apps (e.g. Jira) and with requests going through the cache everything just flies. If you use sharepoint on IIS, you would be prettty stupid to not try a cache server up front, it's amazing. If nginx fixed mod_rewrite stuff to be the same as apache, it would probably be possible to make it into an application server, and we're going to get a test environment set up with php-fpm [php-fpm.org] and see how it fares. We'll see how managable it is though.

The ability to get your resume past HR and in front of someone who knows what any of that means. Sorry.