by

Welcome to My World, Mr. Zuckerberg: Facebook Forays into Email with Fmail

Welcome, Facebook, to my home of the last thirty years — the wild, wonderful, wacky, wheels-within-wheels world of modern email!

It sounds like you plan to be here for the long haul, so I hope you brought everything you need:  good programmers  and deep pockets shouldn’t be a problem for you, but you also need people who understand the many important email standards (including the new and emerging ones for domain-based email signatures and non-western character sets for email addresses and domains), the complex interplay between spammers and spam-fighters, and the remarkable variety of ways that email composed on your system will appear on the hundreds of other platforms in the world that might receive it.

From the outside, email seems pretty simple — there’s a To, a From, and a few other relevant fields, right?  But almost every aspect of email harbors a “gotcha” — some fundamental, some a legacy of email’s evolution, but all critical if you want to “play nice” and have your email interoperate well with everyone else’s.

Unfortunately, most of these pitfalls are known primarily through Internet folklore; when old email hands get together at an IETF meeting, it’s likely that someone will pass out before anyone runs out of horror stories.  If you haven’t hired any experienced IETF email gurus, I urge you to do so, or to start sending your newer-to-email programmers to IETF meetings, or — best of all — both.  I hope I’m wrong, but the absence of any Facebook attendees (or anyone from their recent Zenbe acquisition) at the last two IETF meetings makes me fear you may not know what a tar pit you are stepping into.

Here at Mimecast, it is amazing how many violations of the standards we have to cope with every day.  When possible we try to work with the offending vendor to fix the problems, but sometimes we have no choice but to simply do our best to cope with their mistakes.  For example, imagine that you get a mail message that consists (irrelevancies removed) of:

In the absence of the key MIME header fields “Content-type” and “Content-transfer-encoding” there is really no correct way to interpret this message.    Both the body and the subject line violate the 8 bit restrictions of SMTP (assuming the 8 bith extension hasn’t been used), the subject violates header encoding rules from MIME, and the body itself should, technically, be interpreted as US-ASCII, which is just obviously wrong in this case.  Worse still, the line “sue@z.com” breaks the rules for continuation headers and, arguably, makes the subject part of the body!

For any specific example, a human being can usually figure out how to fix a message, but the variety of mistakes is unbounded and apparently impossible to anticipate.   A recent Internet Draft has begun to try to pool community knowledge about these mistakes; I hope your guys have read it carefully!

So, I welcome the facebook team to the never-ending struggle that is a smoothly-operating email service.  I look forward to the new ideas you are bringing to the table, and I hope that some of them will prove valuable enough to bring enhancements to the whole community (another reason to come to the IETF meetings).  I even hope that you succeed in revolutionizing the email world, because that would be fun to watch.  But I don’t think you have much chance of doing that if you can’t first deal with the complexity we all confront today.

  • http://twitter.com/alobbs Alvaro Lopez Ortega

    Geez.. sounds like Facebook is becoming a real threat for what you do.

    • http://www.justinpirie.com Justin Pirie

      Not at all! People are forever trying to reinvent email….

      What I think will be interesting is the effect it will have on the next generation- people who are comfortable with fmail.

      Is this wave reinvented?

    • http://guppylake.com/nsb/index.html Nathaniel Borenstein

      They’re absolutely no threat to us — we aren’t in the business of providing email clients or servers. We provide business email management services (security, archiving, discovery, disaster recovery, and more) that extend and manage traditional email systems. Today our customers use things like Exchange and Domino; if business use Fmail, we should be equally able to provide similar services to them.

  • http://dan.tobias.name/ Anonymous

    I’ve had a site up for years that discusses various aspects of e-mail formatting and the standards and practices of it: http://mailformat.dan.info/

  • http://twitter.com/explodingwalrus Carl Draper

    I heard FB are gonna use POP, useless without IMAP,

  • http://a-hackers-craic.blogspot.com/ NotZed

    Weird post. That desperate for marketing are we?

    Do you intend to write such posts for every company that decides to start working with email? If it’s like anyone else or the rest of facebook they no doubt just grabbed a free library to do it anyway.

    I spent 6 years working on everything to do with email and although it’s a bit of a hassle discovering the ways in which other mailers are broken, reasonable fallbacks are fairly simple in most important cases. Particularly for the type of unsophisticated users who use facebook and who’ve grown up with broken computer systems and are used to things being flakey. And I imagine with the fact that fewer emails are being produced by myCrapMailer 1.0 (or microsoft outlook!) and more by systems like gmail the problem is being somewhat overstated. Perhaps you should be addressing microsoft since they’re one of the main offenders in dealing with broken behaviour – you can pretty much ignore random mail libraries but you can’t ignore microsoft’s `interpretation’ of standards, although I guess nobody really cares what they’re up to anymore.

    Most of the work is in keeping users happy with front-end behaviour which has little to do with the standards and like gmail they will probably just ignore their users anyway and they’re already used to a sub-standard frontend.