Link here: http://tinyurl.com/7bckqm8
After going through the 32 slides, I think this is one of those presentations you really needed to be there for. The archiecture stack is by and large quite standard for high scale applications. The previous HN submission from YouPorn last month contained more descriptive information.
"I just want to let the devs know that Youporn.com relaunched two weeks
ago with Redis as our primary database. With @100 million page views per day, our cluster of Redis slaves are handling over 300k queries per second.
After the switchover we had to add some additional Redis nodes but not because Redis was overworked but because the network cards couldn't keep up with Redis."
So at least the Redis part is I/O bound apparently, that suggests an high degree of efficiency for this use case.
On the other hand, when trying to de-convolute an architecture a change of primary language often helps.
Does "we were substantially more confident of our ability to recruit sufficient PHP talent than Perl" seem like a reasonable rephrasing?
Additionally, I don't think speed was the primary drover behind the rewrite. I'm still waiting for the video/audio of the presentation, but he mentions the 'very complex architecture' of the PERL backend. So switching to a 'standard' architecture that fits on one PP slide seems liek a very good idea.
I've always wanted to tell people I work in porn but I somehow doubt that any of their job adverts directly say "This is porn".
any thoughts on why?
At least in Silicon Valley, people don't really care what you've worked on as long as you have the technical chops. Hell, look at all the folks working for defense contractors - their biggest problem is that it tends to lock them into a proprietary software stack, not that they've written software used to blow people up.
Look at the presenter's experience:
> Over a six month period, I lead the project to rewrite a top 100 website using a new software stack. Doing so, we used HAProxy, Varnish, Nginx, PHP-FPM, Symfony2, Syslog-ng, Redis and MySQL to create a platform that handles 100 million page views per day and has room to grow.
There are tons of companies out there eager to hire someone with that experience.
The reason why people say that they get locked into porn ( at least on the software producing side of the fence, mind you ) is very similar to the reason why people get locked into working for the finance industry. There are nuances but it essentially comes down to two things: money and attitude.
If you are good at engineering and if you are willing to work for this industry ( a small minority ) you can make crazy money. The industry is pretty meritocratic, long before that became a buzz word in Silicon Valley. If you generate millions of dollars in value for your company, you can take millions of dollars home. Very few industries allow you to make this kind of money, and since the people who work there are self selected to not mind, it's tough for them to leave. Some social factors sometimes compel them to move to other industries anyway ( such as starting a family ) at which point the second problem comes into play.
The second problem is your mindset. The porn industry ( sometimes similar to financial ) has the opposite relationship with it's customers from other industries. You treat the customers as bags of money that ought to be exploited. "After all, they are all wankers" is what you hear a lot. This may sound basic but if that's the reality you have spend a decade in, you will find it tough to adjust for startup life.
Especially startups are usually very good at finding a business model where their own success depends on the success of their customers ( Square, Stripe, my own Shopify, etc). Life is much happier in a setup like this but it's totally alien to people from the Industry.
These things are huge contributors at keeping people from the industry in the industry.
I honestly don't see a difference to most other industries - give or take a few idealistic startups.
Unless you meant to say the difference is that you're upfront and honest about it...
On the other hand when if I am browsing the ASP.Net section of stackoverflow and see Windows Azure ads rather than weight loss ones then I see that as a good thing.
Ironically it sounds like you don't have a problem with targeted advertising, you have a problem with the quality of it and want it improved, which is quite a different argument than "you shouldn't use my data, give me adds at random". It's not an exact science but it's undeniable that it's reducing the signal to noise ratio.
Whereas targeted advertising based on being on a particular public section of a public website feels much less intrusive.
I suppose it's like getting adverts on TV for items that are somewhat related to the show that you just watched vs getting letters through the mail advertising debt consolidation services because on the same day you also got mail from your bank telling you that your overdraft is maxed out and your credit card is overdue.
It seems likely this is the case to me, but again it's all conjecture. Personally I don't think it matters either. Experience is experience.
(And I'm not sure your supposition is at all true to begin with. The above assumes your supposition has some truth value.)
I worked for gay porn company for a number of years and I've never had issues finding work outside of that industry. At least not for companies I'd be interested in working with in the first place.
If anything it helps considering there is a lot of big scaling issues that need to be solved when the viewer base gets big enough.
"Supposedly" by who? I don't think it's real at all.
That implies they are caching very little. I'm comfortable in saying that I'd be shocked if your homepage on Facebook wasn't 90%+ in cache, if not 100%. A site like Facebook wouldn't survive without caching.