On: So, that was a bummer

[marclove]

Right, I'm aware. Not everybody can afford a contract though, nor should they have to in order to avoid major outages like this.

But I would like to know if Foursquare has a commercial support contract with 10Gen. If they didn't, why not? especially for a service that big? If they did, how was it that 10Gen took that long to fix the problem?

[sachinag → marclove]

They share USV as an investor. I'd be astonished if they didn't.

[marclove → sachinag]

Heh...that's one hell of a commercial support contract then. Should be interesting to read 10gen's own detailed post-mortem.

[cyu → marclove]

If I was 10Gen, it would be in my best interest to offer support to 4sq, contract or not. People (like us) are watching.

[steveklabnik → marclove]

I'm sure that if you're the size of Foursquare, you can afford the contract.

Then again, it's no excuse for bad software. I've only used Mongo on small sites so far, and have been loving it.

[marclove → steveklabnik]

Its all fun and games until someone gets a shard in the eye.

[fizx → marclove]

I'm sure it was diagnosed quickly. Sometimes you have to copy data, rebuild indexes, etc.

[fauigerzigerk → fizx]

According to that blog post it hasn't actually been properly diagnosed yet. They see the symptoms but they don't know why they're seeing those symptoms.