On: Planning for Another 100 Million Web Sites

[callmevlad]

Does anyone know where the 100MM number comes from?

According to Netcraft [1], there were over 600MM active sites [2] last month.

[1] http://news.netcraft.com/archives/2013/04/02/april-2013-web-...

[2] http://www.netcraft.com/active-sites/

[drusenko → callmevlad]

The 600MM number is hostnames, the active site number is 186MM. At the end of the day, we don't really feel like hostnames (non-active, parked) are relevant.

[the_economist → drusenko]

$5 billion/year is spent on parked hostnames. Wow.

[eCa → drusenko]

How many of the 15MM+ weebly sites are active? It seems a stretch that 15% of all web sites are created with Weebly?

[kalleboo → eCa]

And how many "active" sites are just spam? When the archiveteam tried to backup posterous, it felt like the majority of all pages were spam.

[arbuge → kalleboo]

There is a ton of spam on Weebly. We have a crowdsourced online shopping directory and 90% of the spam comments we get seem to involve Weebly sites. It's gotten to the point where we'll probably just write a simple spam filter that screens for "weebly" in our submissions.

[drusenko → arbuge]

Hey, we'd love to work with you on this. We have a full-time dedicated team that works hard on this and we have a zero-tolerance policy.

We work very hard to keep and maintain a high-quality network, and while the percentage spam is low across the network, even a low percentage can still be high volume for some.

Please email me (david+c@weebly.com) and I'll put you in touch with them, we are committed to taking a hard stance on spam.

[arbuge → drusenko]

Just emailed you an example.

[programnature → eCa]

Here is a more interesting question:

What proportion of all websites are created by engineers, versus by normal folk?

Its pretty clear that in the long run, the vast majority will be by regular folk using tools like Weebly. Theres just Billions more of them.

Maybe the tipping point has already come and gone.

[achillean → drusenko]

I have 150 million webservers alone in Shodan (i.e. 150 million IPs with a webserver - completely ignoring vhosts), so 100 million seems rather low. Many of them are embedded servers etc., but there's a lot of web content out there.

[callmevlad → drusenko]

I see, that makes perfect sense. Looks like I was reading things backwards this morning. Thanks David!

[marblar → callmevlad]

Fffff Ffxf . .r

.

L

[marblar → marblar]

My pocket must have written this. Sorry!