5 Things the Boss Should Know About Spam Fighting 168
Esther Schindler writes "Sysadmins and email administrators were asked to identify the one thing they wish the CIO understood about their efforts to fight spam. The CIO website is now running their five most important tips, in an effort to educate the corporate brass. Recommendations are mostly along the lines of informing corporate management; letting bosses know that there is no 'silver bullet', and that the battle will never really end. There's also a suggestion to educate on technical matters, bringing executives into the loop on terms like SMTP and POP. Their first recommendation, though, is to make sure no mail is lost. 'This is a risk management practice, and you need to decide where you want to put your risk. Would you rather risk getting spam with lower risk of losing/delaying messages you actually wanted to get, or would you rather risk losing/delaying legitimate messages with lower risk of spam? You can't have both, no matter how loudly you scream.'"
Nothing lost? (Score:4, Informative)
Their first recommendation, though, is to make sure no mail is lost.
Nice goal, but you are going to lose mail. It is either going to get buried in the pile of spam or misclassified as spam by your software and pitched. What you need to do is pick an acceptable level -- it is all about trade-offs.
I like to REJECT (not bounce!) spam, so when you accidentally mark good stuff as spam, the sender has a chance to get the message to you later.
Re: (Score:2)
I like to REJECT (not bounce!) spam, so when you accidentally mark good stuff as spam, the sender has a chance to get the message to you later.
Yeah, thanks. Then when someone fakes my email address as the return address, I get thousands of bounce messages.
Re:Nothing lost? (Score:5, Insightful)
Yeah, thanks. Then when someone fakes my email address as the return address, I get thousands of bounce messages.
Did you miss the part about:
I like to REJECT (not bounce!) spam
If I reject the mail, then you'll only get a message back if your SMTP server was the one that was sending it. If I bounce the mail, then you'll a message even if it was forged elsewhere.
People who bounce spam are almost as bad as the spammers. Rejecting spam is much better than just deleting it because it gives the sender a chance to fix your mistake.
Re: (Score:2)
Re: (Score:2)
Err, no. If you reject a mail, the SMTP server that tried to connect to your SMTP server (and got a 5xx response) will send a bounce message back to what it perceives as the sender - who is almost certainly forged in a spam e-mail.
Re: (Score:2)
I don't think you know what you are talking about.
Sure, if you have a bogus mail server which would just forward random spam, it would do that. But presumably your mail server does not.
Someone has to handle a misaddressed message. The way to handle it is as the OP said, to reject
Re:Nothing lost? (Score:4, Informative)
Just to be clear:
If Bob rejects the spam while in the process of receiving it from clueless.xxx, clueless.xxx would get a bad status code. Chances are the mail program is just a bot which would ignore the error (or retry the same message a couple of times). If Eve is using an MTA on clueless like exim or sendmail, and it is badly configured, then Alice might see a bounce message generated by clueless.xxx. Alice can complain to the administrators at clueless, or get clueless added to RBLs. The good news for Alice in this situation is that she isn't dealing with thousands of bots. In any case, Bob didn't send a bounce message, he just didn't accept the incoming mail.
Rejecting spam at the SMTP level is the best practice, and is different than bouncing spam.
Re:Nothing lost? (Score:5, Insightful)
Re: (Score:3, Insightful)
Re: (Score:2)
Re: (Score:3, Informative)
I know several people has said it on this thread and on almost all mail/spam threads, but it can't be stressed enough: Reject the message on the SMTP phase! DO NOT accept the message and then bounce it. I guess viruses you can discard if you want, but DO NOT bounce them!
Exchange admins, please configure your se
WTF? (Score:5, Interesting)
Re:WTF? (Score:4, Insightful)
Re: (Score:1)
Re:WTF? (Score:5, Insightful)
Do you really believe that a CIO understands all of the underlying technology in the IT department, even at a basic level? Trust me, most don't. It's near impossible, especially when most CIO's haven't been individual contributors for many years.
Re: (Score:2, Funny)
QFT... I'm in the process of customizing SugarCRM Open Source for our company's needs, and after I'd pitched a demo to my CIO to show him what we'd be able to do with it once finished, he was really impressed. A week later I hear him in a meeting with management: "Yeah, it's open source, which means it's the same guys that did this that wrote Linux.".
*shrug* At l
Re: (Score:2)
Re: (Score:1)
For example, a CIO I worked under advised us that we could increase the efficiency of our database-driven app by reading the records in a random-access manner, rather than processing the whole "file" of orders sequentially each time we wanted t
Re: (Score:2)
Oh man... I just spit something out of my nose! Did anyone correct your CIO? To me this sounds like the last time this dude had _any_ knowledge of IT, it was with COBOL/CICS type stuff.
:-)
May you be blessed my son
Re:WTF? (Score:4, Insightful)
Many high level concepts such as requirements, design, group management, etc can be managed by people and they don't have to have intimate knowledge of the latest technology. I am not saying that management should not learn it, but they should expect their employees to be the experts.
Why is it that there are a lot of people in IT who are so snobbish "omg!!!@!!!.... you don't know about xyz technology, you made a mistake hahahhadjhaflkdjfs luser." Are other technical/engineering fields like this? (not a knock on the parent post, just askin' in general).
Re: (Score:2)
Yeah, they are.
When you talk about the snobby people in IT, you're usually referring to those at the bottom of the heap, organizationally. These are the guys in the server room who don't really have the authority to make any decisions, and
Re: (Score:3, Insightful)
Re: (Score:2)
Re: (Score:2)
Spamers have stolen the usefulness of email away and if its not fixed real soon, it will be completely worthless to more and more people. I'm hearing from more and more people "oh, I don't check email much anymore, its all junk"
Re: (Score:2)
It's amazing how quickly Slashdotters switch from quoting the Bill of Rights in order to defend freedom of speech that they want to ignoring the Bill of Rights in order to to condemn freedom of speech that they don't want. It's no wonder American lawyers earn so much!
Commercial speech isn't protected the same way that non-commercial speech is. For example, advertisers are not legally allowed to lie about their products in television commercials, but I am legally allowed to lie about those same products all I want (as long as I'm not committing slander or libel). For example, without supporting evidence, I'm not allowed to say that drinking Coca-Cola causes cancer, but I am allowed to say that drinking Coca-Cola raises your IQ. The Coca-Cola Company is not allowed to
Re: (Score:2)
Re:WTF? (Score:5, Insightful)
A good manager should appear to have very little to do, because everything is so well organised.
A bad manager is very easy to spot. People under them feel unsupported, become over relient on rules and regulations, and everything takes so long to do that nothing gets done.
I've experienced both types of management, the bad type is painful. When I've managed (in medicine) I worked very hard to train my people to trust in their own abilities and take on and enjoy responsibility.
Nothing to do with spam in this post I realise, but then I hate spam, nasty fatty stuff.
Re:WTF? (Score:5, Insightful)
Because managers are there to manage, not to be technicians. The most effective managers should know something about what they manage, but they do not need to know the details. They are supposed to be "big-picture" people and leave the details to the experts they hire. When a manager knows too much about what they manage they tend to micro-manage and I am sure we all dislike that more than ignorant managers.
Personally I would rather have a manager that gives me the responsibility and flexibility to make the decisions that are within the scope of my job function who knows nothing about what I do and how I do it than one that is more knowledgable but ties my hands when it comes to getting things done. The CIO should dictate the overarching business strategy to the IS department and help ensure that their work helps accomplish the goals of that strategy. The details are for the rest of the department to figure out. Remember, the IS department is a supporting function, no different from accounting, marketing, or HR... it is not the business.
I'm sure I will be flamed for this response, but it is typical of technical people (not just IT, but in all functions) to have disdain for those in charge because they don't know what we know. But it isn't their job to, or else they would have no reason to hire us. A CIO position is NOT a technical position. Expecting a CIO to know everthing going on in the IS department is the same as expecting the CEO to know it as well.
Re: (Score:2)
Re: (Score:2)
It's all a matter of degrees. A CIO need not know how to configure a mail server for example, but SHOULD understand what a mail server does and have some idea of what sorts of things can be done by configuring. A CIO SHOULD know enough to tell the difference between a trivial and a herculean task. A CIO should understand enough that once something is explained, the gist of it is retained.
For another example, a CIO should be able to understand that spam filtering is a statistical process and so errors one
Re: (Score:2)
I have worked for 3 fortune xxx companies. None of the CIO/CTO have know _anything_ about IT. Nothing. All have been business people that were transfered from some other department. A lot of the bigger companies like to play "musical manager" where the "upper" level management gets moved around so they know more roles of the company. This gets them promoted faster... go figure.
I just recently went through a corporate re-org. The new CIO is actually a "financial" chick (though her know
Re: (Score:2)
Anyway, I took over the job when the fileserver crashed, and the CIO at the time didn't understand the difference between a workstation and a server, and couldn't figure out what "no backup" meant. Bless her soul, she's a great leader over a good many things. But she was assigned to the job because the commanding officer at the time was not IT-savvy, and said "it's just
Re: (Score:2)
What they actually do has little to do with it, this is especially the case in larger govt organisations where the CIO's are people with almost no understanding of computers.
Re: (Score:2)
Something for nothing and spam for free (Score:4, Insightful)
Trouble is how many CIO understand the technology they supervise enough to make a good business judgement?
The one thing I will tell them follows like this:
Trust your own I/T staff for maters of technical choice and direction, they have the most to gain, the most to lose and have to live with the consequences. Vendors know how to sell problems then the solutions, users know how to blame their lack of patience and personal issues on computers. I/T personnel often are the ones to eat the heat on organizational issues beyond their control. This includes the flawed systems we use today. Let I/T participate in business descisions, not to rule but nor to be a door mat for the next irrational business type having a conniption fit.
Re: (Score:2)
POP? (Score:3, Insightful)
SMTP and POP
Now, nothing against educating management... but POP? POP doesn't belong in the enterprise. Even at home I have my own IMAP server. POP is a relic of the dialup-time where you only had access to your own computer and nobody else (seemed) to have one.
A shame that gmail doesn't support IMAP, I'd prefer it that way instead of that poor POP3 hack they use...
Re: (Score:2)
Where I work we can use either. Inboxes on the mail server have a 16MB limit and they regularly fill up. Because I need to keep more than that I use POP.
Re: (Score:2, Insightful)
16MB? Wow... That's suckitude pure... My personal mailserver can cope 2Gig, and that's only because the /var is a separate partition of 2Gig. I don't know what it is at work, but I haven't reached it yet.... I get those funny videos all the time, but I delete them at once, so my space usage isn't all that big. Haven't heard complaints of the management types yet, so I think that the limits are very reasonable.
Frankly, tell IT to buy a few disks.... 16MB is about what I had as a student at the Univer
Re: (Score:2)
Every employee, outside of the factory, has their own computer to use at their desk, and if you need to bring files away from your desk frequently, it is not difficult to swap out your desktop for a laptop. (I'm not sure how much extra the laptop costs in a given manager's budget, but it's not much.) There are bigger network servers available for passing files around, but they are paid
Re: (Score:3, Insightful)
As a matter of fact, it is. Each backup diff file is compressed, encrypted, and stored on a server, every day.
People work from home and the road all the time. I've done it myself. You bring your laptop home with you, and tunnel into the company network via a VPN. People on call are issued Blackberries, and special accounts that expand to fill their needs. These people are in the extreme minority.
Re: (Score:1)
Re: (Score:1)
I understand that, but that falls in the category "dial-up".... On a LAN, the network lag should be insignificant. Sure, that 10M powerpoint from my boss, won't open immediately, but with POP it would take ages to download it in the first place. I just delete it without opening it ;-)
Re: (Score:2)
Re: (Score:1)
You can have some of both (Score:2)
This is misleading. There's no reason one spam filter cannot provide both higher sensitivity and higher specificity than some other inferior spam filter. Once you pick a filter then, yes, there is a tradeoff in selecting your decision boundary.
Why Is It? (Score:2, Funny)
Beware the combination of spam and UETA (Score:2, Insightful)
There
Re: (Score:2)
Delivered, yes. Received, no. Try serving a subpoena that way.
Five Things Everybody Needs To Know About Spam (Score:5, Informative)
1. Content filtering is not a solution.
I hate to say it, but it's the truth. Filtering mail based on what's in the e-mail message is a never-ending battle that does not work. It slows down mail service, causes legitimate mail to be blocked more often than using RBLs, and violates peoples privacy, costs more money to maintain and makes the mail system inherently less efficient and reliable.
E-mail used to be instantaneous. Now it isn't, because all the major ISPs toss their mail into big queues where they go over it and file it away or pass it on. If you send something to a Bellsouth users nowadays, they *might* get it 6+ hours later! Stupid, content filtering doesn't work and creates worse problems.
2. The Spam problem is mostly a law enforcement issue and not a technological issue.
99.9% of spammers break the law. The reason why spamming is such a problem is because national and international authorities won't get off their lazy asses and prosecute the spammers for the laws they break. In the end, you'll do more to reduce spam by petitioning your local district attorney to prosecute spammers than installing some obnoxious cpu-chewing filter that will become obsolete within two weeks. And no, the jurisdiction issue is bogus. Technology exists to track all these spammers right back to where they are. There are spammers all over the world and especially in the U.S. that can and should be in jail right now, but they're not because the Feds are more interested in going after people like Tommy Chong. Call your D.A. Call your Congressman. Complain that your reps aren't putting these guys in jail.
When I say "spam" I mean the big spam operations. The industry can easily police itself of low-level, incompetent opt-in schemes, but that's not the real "spam" problem we're talking about.
3. Don't listen to the anti-virus/anti-spyware software companies.
These companies make their living off of spam. There is an inherent conflict of interest in relying on Symantec or any other company to be trusted to help deal with the spam problem. They need spam and they'll never do what's necessary to stop spam from becoming more of a problem. This is analagous to why car manufacturers won't build more reliable/efficient cars when they are capable of doing so -- it's not profitable for them. Stop looking to McAffee or any of these other foxes to be trusted in helping you guard your henhouse.
4. Most anti-spam methods do nothing to stop spam, except relay blacklisting.
Spammers steal bandwidth, violate peoples' security, tamper with third-party computers and bog down the Internet. Content-based filtering does not hurt spammers. RBLs do. Relay blacklisting is the single most effective deterrent in the war on spam. PERIOD. No other method both stops spam, and makes it exponentially more expensive and troublesome for spammers to do their job.
Relay blacklisting works. If you don't like RBLs, chances are you just had a bad experience with a bad one. Try a different one or create your own. They work. They work exceptionally well and best of all, they save bandwidth and resources from the spammer's grimy hands. They also have the added benefit of stopping the propagation of worms and punishing irresponsible ISPs who allow their zombie users to pollute the Internet. There is NO BETTER THING CURRENTLY you can do to combat the spam war than by feeding and using RBLs (aside from following #2 and complaining that spammers aren't being prosecuted).
5. There are not that many spam operations. The spam epidemic is not unstoppable.
The amount of spam going around on the Internet has increased but only proportionally to the amount of user and bandwidth growth, and not due to more and more people getting into the spam business. A cursory examination of most spam clearly indicates that there are
Re: (Score:2)
Greylisting is quite effective as well; partially because it pushes the economics of spamming back on the spammers.
Re: (Score:2)
Greylisting works in the large end of the small market; it doesn't work elsewhere.
In order for greylisting to work:
Re: (Score:2)
Hmm, all the ones I've work with I explain that I induce a 3 minute delay on our side, that the other side may retry at a slow interval, but that after three good messages, there's no delay, and that it reduces spam by 75-80%. Every time I hear, "that's a no brainer!". I don't greylist internal mails.
I used to use postgrey but bdb eats itself whenever the moon is waxing - sqlgrey is rea
Re: (Score:2)
Spam cannot be solved with law enforcement. Even assuming we had a 100% reliable definition of spam, and it was illegal everywh
Re: (Score:3, Insightful)
1. Content filtering is not a solution.
Yes and no. It's not the "right" solution, but when all other available solutions have been exhausted, content filtering is better than the alternative. You're absolutely correct that it eats up resources - you can't just enable content filtering and walk away; you have to constantly keep writing new rules that will no longer work next week.
E-mail getting delayed 6 hours isn't strictly a problem with content filtering. Sure, if you eliminated content filtering, you'd probably also eliminate the 6 hour d
Strawman fallacy (Score:2)
The above rant is just a string of strawman arguments without an iota of evidence. It ascribes to filters disadvantages which do not exist, and to RBLs fantastic properties that also don't exist.
Maybe RBLs are useful in the fight against spam -- maybe not. To suggest that they obviate conten
Re: (Score:2)
The bottom line is that it takes an ongoing effort to update both RBLs and content-based filter. The main difference is, there is a FINITE amount of IP space, so the RBL war is worth winning. There is an INFINITE number of combinations of keywords and imagery that can be forged as spam. Common sense ind
Re: (Score:2)
I invite you, or anybody else who wishes to prove that (a) content filtering is hopeless and/or (b) RBLs are a slam-dunk, to demonstrate your superiority by participating in this test.
Guidelines will be posted shortly.
For further information email information@ceas.cc
Re:Heres a way to end spam. Completly. (Score:4, Insightful)
Not any more. The stock scammers can get their money without any contact information whatever in the spam.
Re: (Score:2)
If the SEC REALLY wants to enforce the law, all they need is a single email account to collect a bazillion pump and dump operations. It shouldn't be that hard to come up with a good list of suspects by watching what stocks get pumped, and then see who dumps. That alone could get rid of about 25% of the spam.
Re: (Score:2)
Even if people do it manually, this is going to sting legitimate people who have nothing to do with the spam.
mail is broken (Score:5, Interesting)
I worked out how much staff time we spend maintaining and supporting our mail server and was shocked. For a service that's commoditized and available for free from any number of vendors (never mind our uni's central IT service we're already paying for), and I worked out that last year we had spent ~100 hrs/yr of staff time. Looking back I realized that in years previous we had spent far less on a per year basis. IOW: staff consumption on mail service was growing while prices for commodity email service was plummeting (all the way down to near free).
Dumping email support is the only rational solution.
Where will this go? I think email (as in RFC822, etc) is doomed. The protocol is broken. It has no safeguards to confirm the legitimacy of the sender or recipient, no mechanism to secure the communication during transmission (like a real envelope), and as a result the protocol begs to be exploited by Internet fucktards. Which is exactly what's happening. Time to toss SMTP and start from scratch.
Re: (Score:2)
Re: (Score:3, Insightful)
If you really demand a uniform end-to-end authentication mechanism, X.400 is over that-a-way.
A full blown information war is being waged over email, and it's surviving quite nicely. I eagerly await your perfect solution that changes human nature itself. I tire of the pontifications of armchair architects.
Re: (Score:2)
Why not use DomainKeys, SPF, and SMTP over TLS instead of trying to rebuild all of the existing infrastructure?
Refusing connections from domains not using those technologies will
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
I'm also not the only one who feels this way. SMTP callbacks ARE abusive, and they can and do take servers offline
Re: (Score:2)
Re: (Score:2)
Have you ever used a x.400 gateway? It is not a reasonable alternative to anything other an over weight budget. Isode was great compared to some of the other x.400 options and its the poorest bit of software I ever tried t
Blue Frog (Score:1, Interesting)
Uhh... you can have both... (Score:5, Funny)
Re: (Score:2, Funny)
And I am going to ditch my firewall as soon as I get Vista because Bill says it will be a secure OS.
Re: (Score:2)
I think the most important thing is.. (Score:1, Funny)
Question (Score:2)
Re: (Score:2)
Spam fighting can be a source of income! (Score:2)
When it starts costing spammers more money than they make, they will stop. In my experience, asking spammers to stop nicely does not work. Filing a lawsuit usually is the only way to get them to stop. I have one spammer that still spams after get
Re: (Score:2)
Sort of. CAN-SPAM includes explicit language that carves out an exception
to the nullification --- that state laws that prohibit falsity and deception
can still survice.
Despite the 4th circuit opinion, I have a court that ruled that California law (17529.5) is not preempted by CAN-SPAM.
So, don't use verizon.com, etc.? (Score:2, Insightful)
If CIOs instituted a policy of disqualifying any vendor of Internet, data or communication services that appears anywhere on Spamhaus's top 10 list from doing any business with the company, Varshavchik feels, "the spam problem will pretty much disappear, mostly overnight."
That list (http://www.spamhaus.org/statistics/networks.lasso ) has verizon.com, att.net, serverflo.com, xo.com in spots 1, 2, 3, 4. Should CIO's stop using Verizon, ATT and XO until they clean up their act?
Re: (Score:3, Informative)
Should CIO's stop using Verizon, ATT and XO until they clean up their act?
Yes
What I know about spam fighting (Score:2)
It hurts more if you leave it in the can.
Triv
1 Thing the Boss should know about Spam (Score:3, Insightful)
Voila!
All Spam problems solved instantly.
Neat side effect: Your emails are safe and contract proof.
Re: (Score:3, Insightful)
I would say use PGP internally and enforce it, and include it in your spam rules. That way, clients who send encrypted/signed messages can be sure they get through, but clients are not required to use encryption.
Well for one thing ... (Score:2)
We almost have a Silver bullet (Score:3, Interesting)
We used an outfit called Red Condor. They offered external filtering by setting the MX to systems on their network, plus in-house filtering by way of an appliance that you can purchase and deploy. They allowed us a 60 day trial, which went extremely well. The bottom line is this, we now pay about ~$11k a year for ~10k mailboxes and get filtering every bit as good as what you get from the major email players like Gmail or Hotmail. The only downside is there are occasionally delays of up to 15 minutes. Hence it is almost, but not quite a Silver Bullet. These are issues that I expect can be somewhat resolved by purchase of additional appliances and load balancing.
This sounds like an ad, but I have no affiliation with Red Condor beyond being a customer. Spam and it's associated problems made 2006 the worst year of my 10+ year career and probably had contributed to more sleep deprived nights than any other thing for me. If you're like me and looking for a solution to what has become an epidemic, this is could be it.
Everyong saying Content filtering doesnt work? BS (Score:3, Interesting)
How can you say that knowing that Yahoo, Gmail, Hotmail and AOL all do extremely effective content filtering? They aren't perfect but they're very very good with a low false positive rate.
I haven't seen a single spam in years... literally (Score:2)
Yes you can, its called dspam [nuclearelephant.com], and it works beautifully.
I, and none of my users, have seen an single spam email in over 3 years. I added graymilter [acme.com] and Project Zen [spamhaus.org] fr
Re: (Score:2)
No, you're not getting both. You're just going for the risk of seeing something late, rather than the risk of losing something legitimate. Obviously, a quarantine means that you won't see the false positive until you specifically go check, but you won't lose it, unless you don't check for it before the quarantine's auto-delete timeout. Graylisting, by definition, introduces a delay in mail transmission.
Re: (Score:2)
There is no auto-delete timeout for the quarantine, not by default, and not that I can manually set without futzing in the code itself. I'm thankful for that, and so are my users.
A delay of 25 minutes is barely perceptable. Email is not I
Re: (Score:1)
Silver Ricochet.. (Score:2)
1. Sending email gets infuriating as your machine slows to a crawl anytime someone hasnt whitelisted you.
2. Maintaining a Taint Free Whitelist gets to be a bit tricky.
3. How is this going to work for services like Gmail and Yahoo? A minute of chug time on a machine is expensive if your offering it for free. If you whitelist them it doesnt do much good because then spammers just use those accounts
4. How does this work for people in poor areas
Re: (Score:2)
Anonymous Coward said:
Translation:
Thanks for spreading the problem, idiot.
Re: (Score:3, Insightful)
Let's also consider mailing lists. I manage a site that has tens of thousands of users, running on two MX boxes and one outbound SMTP box. I'd have to get a whole new RACK to handle the load
Re: (Score:3, Informative)
That is such a small number of users, that you anecdotal evidence is meaningless.
You don't get spam because you don't have many users sending mail, your users are in a controlled corporate environment that (probably) keeps their machines virus/trojan/spyware free, your users probably are somewhat careful to only use their "work e-mail" for "work-related" stuff, and you have a domain that isn't very widely-known.
Try running an ISP with hundreds of thousands of
Re: (Score:2)
You want to know the really scary thing?
Both you and grasshoppa are right... for the subsets of the spam problem that you have to address.
My credentials? I run the mailfilters at a university with +50k student addresses, and around 3000 staff addresses. We typically reject a couple of hundred thousand messages daily. So, while our situation would probably turn gras
Re: (Score:2)