How many sites did you try this on? One?
In your existing setup, how many competitors could you take out now before Google notices the pattern you've adopted? Take a look at the footprint:
* Site suddenly acquires a new batch of incoming links
* Same site is reported for being a recipient of a paid-for links scheme
* Reporter uses the email address of (your email address here) -- I love the dichotomy of blackhats despising/hating Google, yet reaching out over and over again pretending to be a good citizen.
How many times and variations of that can you come up with before standing out? And when the pattern emerges, Google are in a position to re-address the balance.
This switch Google has done from inaction to penalty for spammy links has changed the spamming game. No positive benefit from spamming is a good thing. Spammers can only create negative damage with their existing setup, until they out themselves by being trackable/detectable.
I realized something powerful. I had the power to remove any website from Google. I could be a more evil Matt Cutt's. He can remove sites from Google and so can I.
It is a pretty awe inspiring power. It is like a terrible super power. I can "poof" a website gone from the source of around in my estimation about 90% of web traffic (Google's estimations are too low).
I was going to make a service offering my terrible super-power but decided not to. I relaunched the website I was working on and now never do anything dumb to myself. Now I pretty much only do social marketing because that is where Google is moving to. The days of lots of backlinks are pretty much over, I don't even bother except for making sure local profiles are all set up.
For a pure blackhat operation, it would simply be the newest competitor. Blackhatters rarely play the long game, they are used to burn-and-churn operations. They wouldn't have the patience to keep an unprofitable site running.
It's harder when it's a white-hat SEOer who is also comfortable wearing a blackhat-persona, they may have the patience and guile not to make it too evident. Because they know the long term payoff.
"When you report them for paid-links, you wouldn't use your real e-mail address, that doesn't make any sense."
And yet, using an email address that has zero previous visibility / fake-name generated looks suspicious too. Any thing where the sender is mostly anonymous is suspicious, particularly in answering the motive question. (Particularly silly would be using a free email provider, for example)
Again, Blackhatters aren't eager to put themselves on Google's radar, or any public spotlight. Only the naive ones use GMail / Analytics / Webmaster dashboard. They prefer operating behind the scenes and not drawing attention to themselves, because they have lots to hide.
It takes a bit of pre-planning, some good organisation, and a lot of patience to pull off a convincing online profile. Not really the hallmarks of the typical blackhatter.
Of course, if you're into identity theft, are you really willing to risk it ratting out a competitor. And you'll be in organised online crime territory
Plus the downside if the rest of the Blackhat community find out you've been snitching to Google. They may have loose morals and ethics when it comes to SEO, but they have some semblance of respect-earning.
None of this appeals to the blackhatter, seems an awfully contorted process to go through each time just to gain one ranking place (per competitor). Because it's a process that requires contacting a human at Google, it's also not something that's easily automatable or scriptable. Doesn't entirely fit the quick rinse and repeat / burn-n-churn of the typical Blackhatter.
Take out the scare-mongering of negative SEO, and examine what's left. Not much. In the wider picture, it won't even register a blip.
Now, the legal ramifications of someone being caught doing this. Motive and intent, destruction of business value, clear intent to deceive for financial gain. How many more elements are needed for this to be fraud?
Blackhatters may have loose morals or ethics, but they also know how to stay on the right side of the law. And also, not to drift too close towards the organised crime based operations.
Negative SEO won't be a regular tool for blackhat SEOers; too much risk, too much effort to pull off more than a handful of times without being spotted. Organised crime though, for extortion, most likely.
Just go to freelancer.com market. Buy several xRumer packages. Now do the same thing on Fiverr with some other various packages. Now go to Text-Link-Ads and buy some $8 dollar links and link them to your target website.
Personally, I do not do this except for a couple of years ago when Google first created negative seo. If you are trying to create backlinks to yourself it is too risky because Google will penalize you even if you are a small fry. I just make sure all of the local listings are set up (I only market small businesses that are local) and then do social marketing. Social marketing is the new backlinks. They don't last as long as backlinks and it is more effort, but that is where it pretty much is in my estimation now. To be successful in Google you can do it with about 10-30 backlinks and social marketing. Things have changed a lot since the Caffeine update.
This doesn't scale without drawing attention to yourself.
It doesn't scale for an individual SEOer as a repeatable approach to ranking ahead of your competition. Most likely, it's mutually assured destruction - SEOers destroying each other, taking their clients with them.
It doesn't scale across the SEO industry. Too many people take this up as a tool, and the quality of Google search results suffer. That's when Google takes further action.
The one main way negative SEO back linking survives as a reusable technique is if it's used in small unnoticeable doses, and doesn't affect the typical Google user. Because when it does impact mainstream Google users, then Google takes the next step forward.
If the nightmare scenario materialises where SEOers destroy search quality results for mainstream users with negative SEO campaigns, Google flips the "spammy link penalty" off, all those sites affected bounce back immediately.
And then Google will comb through the data they've captured in that time period, and have an improved idea of what link sources are spammy. Google will have a much better idea of the network of sites you used (to benefit yourself before the penalty, and to negatively affect your competition during the penalty). It will stand out.
SEOers are in a classical prisoners dilemma.
1. People ARE creating spammy links that point to competitor sites in the hopes of damaging their search rankings. - You have proven this.
2. As a result of a competitor creating spammy links to your site, your rankings in Google have been permanently negatively effected. - I don't think the data you present is sufficient to prove this. Correlation does not equal causation. Lots of moving parts in Google's algorithm, the internet, your site...
Did the site get warnings in Webmaster Tools? Did you go through the disavow links process? How long ago?
I use negative SEO regularly to drop sites out of the top 10 in Google. I only target low quality sites that shouldn't be in there anyway, but Google in all their algorithmic wisdom has ranked them, so... I knock them out.
Low quality 5 page Adsense sites shouldn't outrank actual, legitimate businesses so it's just a case of click click, BOOM. I never target the actual competitors of my clients.
Negative SEO is part of the toolkit of any competent SEO professional nowadays. It just has to be.
The fact that you feel you represent the SEO professional community and that it is part of the standard toolkit to me is proof positive that the whole SEO community is a morally bankrupt bunch. It's just shades of gray all the way to 'black', parasitic rather than symbiotic and a net negative.
How you guys sleep at night is a mystery to me.
Who are you to determine what a low quality website is?
We should be happy you exist so you can correct Google? And the fact that your paying customers rise accordingly is nothing but an unhappy coincidence?
> I never target the actual competitors of my clients.
A so you're the kind of SEO that as some kind of public service improves the google index for his own gratification. Sorry, I don't but that for a second.
Absolutely incredible this comment, but thank you for owning up to it.
Feel free to list your customers here so I can make sure to never ever do business with any of them.
I'm sure most of his customers have no idea what he's doing either. With these guys its don't ask don't tell relationship. "I'll get your rank up for XYZ keywords for $70k a month but don't ask any questions on how". They do 15 minutes of work a day maintaining some link wheels, maybe some shady stuff like knocking sites out of the rankings, and collect twice the average american salary each month from the client. With that kind of income to work ratio moral obligations are easy to ignore
Who is Google to? Google is no more neutral or accountable than SEO folk, and is just as much a profit-oriented business as they are.
Google makes the rules and the rest of us play by them. And surprisingly enough, Google encourages the behaviour it rewards. If Google's policies are pro-evil I'd rather that evil be done by competent, organized professionals (who will be able to turn it off when Google changes its policies to something better, and who create a somewhat level playing field, even if it's everyone paying rent to an SEO expert) than haphazardly by a bunch of amateurs.
On the other hand we could of course try to (reaching here) argue that these SEO's improve google because they are forcing it to up its game but I think the web as a whole would be better off without all this crap.
Theory: when a new dominant search engine emerges ways will be found to game it to such an extent that the damage to the web offsets any gains from the increased ability to find content.
The alternative is what, that the result you'd get for, I don't know, "home insurance" would be essentially random?
Google has some opinion on what properties the best result for that would have. Sites will naturally conform to the google policy (which is good when google promotes things that are good for the general web, like fast load times and accessible markup, and bad when google promotes things that are bad for the general web). The SEO industry just makes this process more efficient, meaning changes to what Google "wants" in results take effect faster. Even if Google's policies were effectively random (which I don't think they are), the worst-case result would be that businesses who paid attention to keeping their SEO up to date would appear higher in search results than businesses which didn't - which is at least some kind of barometer of a healthy business.
You are a marketer who is running a big physical sign in real life near some intersection, selling widgets. There are always 10 other signs there. There is one very overworked official who checks the signs to make sure they aren't overtly bad for people looking at them.
You notice that two of the signs competing with your client blatantly say that they sell widgets, that their widgets cure cancer, and that other cancer treatments are shams. You know that this sign will mislead or annoy people at the very least, and also that the officials who decide what signs stay up would probably removed it if they look closer.
It just so happens that you know that the overworked official will look closer at signs if you put a red flag on them. Putting a red flag on a "good" sign will make the official look closer but not do anything about it. But if the official notices the "bad" signs in question, he will probably take them down.
You do it self servingly, of course, but if the signs weren't on the "bad" side in the first place, then the official wouldn't take it down. It's arguable that its not immoral to flag those signs - the flag just tells the overworked official algorithm to look closer and a little more stringently.
To be clear: I don't do negative SEO or anything not 100% white hat in the little SEO work I do. But applying negative SEO to an otherwise "good website" is like putting weight concrete on the base of an already huge pillar. It can really only hurt borderline sites, as defined by Google's rules.
If you have a problem with signs near an intersection you petition the city council without touching the signs by your false-advertising competitors, but in the real world no flags are placed, but websites are forcibly removed from the index or pushed down so far that it does not matter. By analogy, you don't flag the bad signs, you go and burn down the signs by the competition leaving just your own.
This is one reason that during election times (when the tempers can run quite high) removing a sign of a political party can come with surprisingly high penalties.
BTW, if any company engages in false advertising there are other ways to resolve that.
> I don't have any skin in the game,
> I don't do negative SEO or anything not 100% white hat in the little SEO work I do.
I don't think we're going to agree on this.
It's a different thing entirely to take matters into your own hands and plant dynamite under the "bad signs."
Abusing your metaphor further: it would be more like spray painting the phone number of the shady business on every house in town. Certainly the officials would have to notice them then, thanks to your good works! Too bad for the home owners though...
Sorry for the delay, I don't come to HN very often.
I sleep quite easily at night. Google is very bad at what they do when it comes to spam. They deliberately under-resource their spam team and have maintained a fairly incompetent hack managing said team for a long time now. Their motivations? Anyone's guess, but that's the fact of the matter.
Search for payday loans and this result comes up on page 2:
This page is spam, pure and simple and falls foul of Google's own guidelines.
> Who are you to determine what a low quality website is?
Google puts out these guidelines so people can determine the quality of websites. Pure and simple.
Unfortunately, their own algorithm isn't good at recognising these bad actors.
This is where Negative SEO comes in. As stated elsewhere, nSEO is only genuinely possible where a site is sitting on the edge (as above) OR, unfortunately, to attack small businesses.
I'm NEVER going to attack a legitimate business. I AM going to attack spammers, and YES my clients do benefit.
I don't like spammers, you don't like spammers, and it just so turns out that Google is not so great at dealing with them, mostly because they don't care that much.
Quite frankly, I'm not going to sit around and wait for them to haul their asses into gear 18 months later to fix it.
I don't just do nSEO, I also report spam listings to TripAdvisor and any other site who listens to my spam notifications. Of course my competitors benefit when I remove spam to their advantage. Why shouldn't they?
Yes, because sabotaging your competitors with shady spamdexing practices fits most people's definition of "professional."
andrenotgiant: I am unfamiliar with this area, so I need evidence to convince me that this technique makes a difference.
matnewton85: I am personally familiar with this area, and my personal experience says that this technique works.
So, the answer to your question is: because your personal experience does not qualify as evidence to someone else.
Here is a typical example of a website that I think needs negative SEOing:
As long as google keep the ranking details secret (i.e. always, with good reason) then absolute proof is hard.
You're right that "Correlation does not equal causation" but it don't discount correlation entirely either. This evidence is enough to treat the claims that negative SEO does not happen with extreme scepticism. The burden of proof has moved.
Given that there are penalties for some links, what is the mechanism that makes negative SEO non-existent? And how do you prove that this mechanism is infallible.
You basically take competitors site and run a standard SEO link farm thing on it. Google picks it up and punishes the site, done. What am I missing? How can Google tell the real motive behind detected SEO activity?
Because of its privacy settings,
this video cannot be played here.
What else can he possibly say though? He can't explain how they protect against it, because it would negate the protection, and he can't say that don't do anything, because that would just raise a shitstorm.
I've done a fair bit of Cutts baiting in the past, but I do have absolute respect for the man, and the position he's in (we SEO's dont make it easy for him a lot of the time)
PS. This is a real question, not a "you should do it" post. I assume someone would already give it a go by now.
To do the same for mattcutts.com you would have to build hundreds of millions spam backlinks to "outspam" his millions of legitimate backlinks. This is nontrivial.
So the people at the mercy of Negative SEO are the people least equipped to defend themselves: small hobby site owners, webmasters with personal blogs, small businesses etc. You can easily knock out their sites from the SERPs and they would never know what happened. Larger sites are secure due to the nature of their large link profiles.
Personally I think all the fear over Negative SEO has been overblown. I've personally been able to knock sites out of the SERPs for a year or so, and so have many other blackhatters. However, people would much rather spend their precious time and resources improving their own sites to get to the top of the SERPs rather than knocking out the competition.
I don't think Negative SEO is ok. But I also don't think it's a big deal.
There's a filter you've missed there - those people are only at the mercy of negative SEO when they stand in the way of an SEO practitioner and financial gain.
In practice this is almost never. If you're SEOing in a small niche it's very easy to simply outrank the competition if you know what you're doing. It would take many more resources to knock out the dozen of sites in the SERPs above you, and even if you did it's not guaranteed that your own site would replace them.
The only time you would want to knock out your competition with negative SEO is if you're hovering around 5-10 on a high value high volume keyword, but in the real world sites that rank for those kinds of keywords have millions of legitimate backlinks, and it's next to impossible to negative SEO them.
So personally I've never seen a situation in which the time and resources expended in negative SEO would be justified. Even for reputation management it makes sense to rank dozens of your own sites rather than knock out all the "bad" competing site.
Is this really true? I struggle to imagine how generating legitimate and high-value backlinks is easy, even for a small niche.
The more negative SEO that happens, the more data that gives Google. Overtime, the negative SEO sources will be over-saturated, offering no benefit for either positive or negative SEO.
Driving down the positive and negative value of links makes all SEO link building efforts consequently worthless. Which in turns increases the importance of other ranking factors.
This is a natural evolution, in tiny tiny steps Google is nudging people into playing it's game - producing websites that have content. SEOers are slowly falling into line building private link networks, paying people to write content, afraid to spin/rehash existing content because it might leave a fingerprint Google can detect.
It's fascinating watching.
People do have emotions and act on them from time to time. I don't think it requires any assumptions about Cutts's ambitions, but rather about how much effort it would take an annoyed spammer/black-hat to point some of their tools at the highly visible source of their frustrations.
You have a highly optimistic take on this. I think history generally shows that staying one step ahead of criminals/spammers/up-to-no-gooders is a never-ending struggle that does not tend towards positive resolution.
What "other ranking factors?" If you knew what those were, or even knew for sure they existed, the SEOs would too and they would be exploiting them. It's an entire industry whose sole purpose is to understand and game Google's rankings, and just as all this fuss about negative SEO shows, they're not losing.
highly visible only in SEO circles. The rest of the world could hardly care less. It certainly wouldn't make any mainstream news bulletin.
"I think history generally shows that staying one step ahead of criminals/spammers/up-to-no-gooders is a never-ending struggle that does not tend towards positive resolution."
Google are not one step ahead, they are always one step behind, reacting to the next thing. One step ahead is dealing with a problem before it even becomes a problem - in chess they call it prophylaxis - defending before you need to defend.
History generally shows bad things prevailing by people sitting back and doing nothing.
What Google have done with spammy link penalties is to change the game SEOers are playing. It's a classic advice of if you can't win this game, change the game. (Similar to Honduras' World Cup football efforts: if you can't beat 11 men, beat 10).
For example, say I'm running xrumer and spamming forums to increase my ranking, which was common pre-penguin. Google releases penguin and my sites rankings start to tank. So instead I switch to spamming my competitors links and Google penalizes them also. Good luck as a site owner trying to remove thousands of junk forum links especially when the forum owner thinks you were the spammer.
Let me explain: When I crawled geocities and re-hosted it under reocities.com I was trying to achieve something positive. I did not realize how infested geocities had become with spammers, linkfarms and other trash.
Probably at least a few million of the accounts were either compromised or somehow tricked into placing low value links on their pages at the behest of SEO types that were engaging in 'scalable link building'. Comment spam and so on.
Very annoying. And I really did not know what to do about this, it felt wrong that I'd be contributing to these businesses somehow even in a peripheral way.
And then google decided to penalize 'spammy links'. So the tables are turned. Not a day passes without some whiny email from some SEO character that is trying to clean up after their past misdeeds. They try to automate this of course (imagine that their trickery would no longer scale) so they spam tons of automated emails to webmasters threatening to use the google disavow tool because they have been penalized.
So the tables are turned, for a change. Suddenly all those trashy links are degrading rather than enhancing the stature of these companies and their ill motivated SEO brethern.
So, I hope this stays, as far as I'm concerned google can shut down the disavow tool and those that lived by the sword should die by the sword. It's like an 'own goal' by the bad element in the SEO community.
At the same time google should be extra careful that it does now allow good websites to be penalized by activities from even shadier SEO types that turn around and use these facilities against their competitors (rather than to avoid being penalized by it themselves). Especially since if a competitor successfully uses google as an offensive weapon that they can remain unidentified or undetected. (Which makes me wonder about the motives of the OP not to disclose who this was, it would be a lot easier to verify the story, and any subsequent retaliation could be dealt with in the same manner.)
But overall this spammy links penalty is a good development.
The disavow tool is used as a threat against webmasters to take manual action to remove the spam that was placed in an automated way by the perps in the past, that's a really bad balance there.
I'm completely not impressed by these threats for reocities.com I only care that the content is online. I guess I could replace all the outbound links by 'nofollows' but that would hurt a lot of good sites as well and I really hope that google can tell the difference between 'good' and 'bad' links in this respect. (If they can't that would be a huge problem)
edit: the voting on this comment is interesting, 1->+9->+1->+9->+5
Never had a comment oscillate like that.
Anyways, a few of my articles blew up on hackernews, reddit, even on twitter (with smashing magazine tweeting it out), as a result, everyone and their grandma linked back to my articles when they discussed the topic it targeted.
What happened then? I looked at my link profile and I've a few thousand "dangerous looking" backlinks. All from people that had low-ranking blogs or 0 ranking blogs, or that used Tumblr's share feature (which blogged a link and an excerpt) to "bookmark" my site. And some from people that FULLY reblogged my site without permission. Meaning that they took the entire article. They weren't shady either, they had a big banner that said: "I repost articles for my own use to read in case the site goes down" or something to that effect with, obviously, a link back to my site as a source.
What happened? Penguin, Panda, and all the other animals killed most of these sites. Even considered some of them spam.
Now, I have a "dirty" link profile through no fault of my own, using no "shady" tactics.
This just pisses me off to no ends. I never "link built" anything, the links just happened naturally. Yet, I get penalized for it. It's fucking shitty. And I'm sure I'm not the only one.
Google makes this too easy. Through ill-considered changes to their algorithms they've provided a new weapon for the unscrupulous.
I've noticed a similar thing with my own personal site. For years it was on Google's front page for a bunch of things (niche topics that wouldn't translate into money). So was my name, which really surprised me. Lately, as it's gotten more links to it from higher profile sources, including some national magazine sites, it's rapidly fallen back in Google's listings.
Usually you can tell that it's because of that issue when a major penguin update goes out, and your rank suddenly drops. To confirm it, you'd disavow the bad links (so, the link farms that link back to you, the reposters, reblogers, spammy affiliate sites etc.) and see how it affects your ranking and exposure.
It worked VERY well for me once everything was said and done.
Great. that's what's supposed to happen, links accumulate naturally.
(I'm deliberately ignoring the inconsistencies in your story, BTW ;-)
"Yet, I get penalized for it. It's fucking shitty"
How are you being penalised? Did you get a warning of bad links in your Google Webmaster dashboard? If not, how do you know?
Links accumulate, and some disappear over time. That's natural on the web. If Google taking out a bunch of low quality sites affects your own site, that only means the value of your site is significantly positively affected by these sites, so your site was over-ranked. Now it's placed closer to where it should be.
Being linked to by big traffic sources also brings attention from less known sources - that's quite normal.
If someone copies your content, go after them, sue them if you have to and out them. Make sure that they realize that if they copy your content that it will hurt.
I have absolutely no idea what if any backlinks I have to my blog, nor could I care less about it. People will read it, or maybe they won't, like yours it id non-commercial, a way for me to practice my writing and to sometimes tell stories and share those with others. It does not make me money and it costs me time. What google makes of it is not my problem.
I would not think of paying someone to increase the visibility and it took many years to get to any kind of exposure at all.
Well, besides the fact that it's his prerogative to care about his blog's search ranking, I think the implications are pretty obvious; he's suggesting that if it could happen to him, it could happen to anyone, including someone who does have a commercial interest.
What sucks about this entire dilemma is that we're all looking at "lost revenue", no one is looking at "quality content going down the drain". Good search results disappear and are replaced by someone who has a ton of cash backing them whose content is meant to convert and monetize, make cash off the user and nothing else.
At least in my case, I want people to primarily read my stuff.
And it seems ridiculous to me that someone would say, "Who cares if people read your blog, it's not as if you're making any money off it!"
Can you imagine some of the most popular devs that have non-monetized blogs all of a sudden disappearing from google search with their insights and answers? Among others, there's Jeff Atwood and Scott Hanselman both of whom rank well but have non-monetized sites.
What would do it is: interesting articles, a userbase that likes what you write and passes it to their friends, a reputation for quality and useful articles, people linking to you because they found your content useful, engaging you audience and so on.
In contrast with that (which takes a long time to build up, that I will readily admit) google traffic seems so fickle.
If users no longer find relevant content then that is a real problem but I think that in this particular respect your goals and google's goals are very much in alignment. In other words, if they could do better they would.
* People stay in it permanently
* People link to others freely
* People have many non-commercial posts
* Making a will
* Selling a house
* Writing a resume
So I searched, and quickly found many articles by a site called Bible Design Blog. It's an incredible resource for bible printing and typography. I learned what I needed and got a bible.
And now I don't care about bible design, so I don't go to the site. I imagine he gets many similar visitors from organic traffic.
The problem sits there where you would not find good content to serve your needs. And if you feel that this update impacts that goal in a negative way then I think there is a good case to be made for this being a net negative. I see no evidence of that for now though.
The main incentive for negative SEO would be to let inferior content win, no?
I do agree in general that google works extraordinarily well for the user in most cases. Your point is clearer now.
For all you know a superior option existed but you don't know about it because 'bible design blog's SEO guy torpedoed them. I know that's reaching, especially given the subject matter but you get the point.
> The main incentive for negative SEO would be to let inferior content win, no?
I'm sure the SEO proponents would claim the exact opposite. We trust in Google to do the right thing here and I'm all for letting it be that way, but google is under no obligation to actually let the best content win. We hope they do, and we assume that our goals are aligned in this respect but frankly I have no idea how for the top 1,000,000 searches the actually achieved precision is. I would expect it to be quite high, but I have absolutely no way of verifying that and for all I know the results are junk. We will only know that that was the case when something better comes along and finds/ranks the content much better than Google does now. Comparing to Bing Google is doing ok, comparing to DDG is not fair given the relative sizes.
But I'd be one very happy person if a new search engine appeared that would give me exactly one page of results with all of them super relevant, even if it indexed only 10% of the web I would probably use it with some regularity. Quality is far more important than quantity.
FWIW I actually built a small search engine along those lines about 7 years ago, I never launched it because I simply don't have the resources to undertake such a project but I learned a ton about how hard the problem is that google tries to solve and even though I'm 100% at odds with them on the joint subjects of privacy and the way google+ gets rammed down my throat I do appreciate the difficulty of their position and the technical challenges involved in operating a search engine at this scale.
The biggest source of traffic on my blog is google. Links from elsewhere cause spikes at bests, but that is it. Search engine is what drives clicks.
If google no longer finds solutions on blogs that's a problem but that shifts the debate from the one that we originally had, which is that some blogs no longer receive the traffic they did in the past. If that means other blogs with relevant content receive that traffic instead then from the users perspective there is no change.
If the other blogs are less relevant then that is a problem, both for the users and for google.
I was just showing that Google certainly is not the last traffic source for bloggers, it's probably the largest traffic source. Sure a devoted userbase gets you traffic, but it doesn't really grow traffic. Having your articles on other outlets grows traffic. And Google is a very good outlet when someone is trying to find relevant information.
If that's a possibility then you already have your answer, I would not put this much time and effort into a discussion if I were merely doing this to piss other people off.
Trolls typically don't go around with their name and reputation in full view on controversial topics.
Of course it could happen to anybody. That is the one reason why you should never ever run a business that is dependent on a single source for customers. If you do that you don't have a business at all, just an extension of the ecosystem owned by someone else at whose whim you live or die.
Google is effectively a monopoly on this front, and at some level should have an obligation to the common good.
I highly doubt that in the use-case that you envision (which is indeed not one that I had in mind when reading the comment above) where you are providing to the point information about something you care about you'll find that your information gets drowned out by content that has been SEO'd to the hilt. But even if that were the case I'd blame the SEO guys, not the search engine.
Remember how altavista was spammed to death with on-page trickery and google came and it all suddenly was much better. At the time we did not realize that this would come at the price of the destruction of what made the web great, the links that would lead you from one place to another.
The fact that google is a monopoly is our collective problem, not google's, it's only a monopoly because we let them and because - for now - they are still the best way to get to relevant content.
The thing that could happen in your use-case is that someone would end up finding their information somewhere else or that they would engage with someone else. The only case where there would be a loss to them (your hypothetical visitor) is if they would not engage with anybody at all. But that can't really be true since we're theorizing here from the point of view where there is a glut of relevant content competing for a limited number of slots and then regardless of what the criteria are some of those sites will simply miss out on potential visitors.
The only real worry I have here is that the users would not find any relevant content or places to engage at all. And that's far from being proven.
Google does not have an obligation to the common good other than an ethical and a moral one, a real obligation is a legal one and I - in spite of being fairly harshly critical of google on lots of fronts - have no doubt that if they could solve the spam problem in an effective way would not need any prodding at all to go and do that immediately.
Demanding they do better is tantamount to dictating that an advance in technology be made, maybe the problem is harder than it seems?
Maybe, but the part that bothers me is that if you listen to Matt Cutt's he basically says that you should make good content, make a good user experience, build a relationship with your audience, and not think about SEO explicitly. This isn't true for large swathes of content types.
"The fact that google is a monopoly is our collective problem, not google's, it's only a monopoly because we let them"
This is like saying that we don't need antitrust laws because it's our own fault if we allow them to become a monopoly or get into some other situation where fair competition isn't possible.
"The thing that could happen in your use-case is that someone would end up finding their information somewhere else or that they would engage with someone else. The only case where there would be a loss to them (your hypothetical visitor) is if they would not engage with anybody at all"
No, there is a loss if the only content they find at the top of google is demand media style content with no good information but that is SEO'd to the hilt, and people with good and real content can't outrank them.
"Demanding they do better is tantamount to dictating that an advance in technology be made, maybe the problem is harder than it seems?"
I mostly agree, but I think this is a bit too simplistic. I worked on search engines for years and fully understand how hard this problem is. I don't know the answer to this problem, but I see a clear problem or problems. One of which is Google's PR which says "hey, just make a good site with good content and the rest will take care of itself". They aren't really being honest here. For years they dodged the question of negative SEO.
I'd go one step further and I'd say: stop making sites that only exist by the grace of search engines. Not that anybody will listen to that because after all it is easy money but it is very unwise from a business perspective. Do you see Apple spend time on checking their 'link profile' (new term I learned today)?
> This is like saying that we don't need antitrust laws because it's our own fault if we allow them to become a monopoly or get into some other situation where fair competition isn't possible.
No, anti-trust is about anti-competitive behaviour by a monopolist (or a de-facto monopolist), it is not about forcing companies to act in the public interest. They probably should but that's a totally different problem.
So anti-trust would be google squashing duckduckgo.com through some trick using their de-facto monopoly to get rid of a nasty little upstart.
> No, there is a loss if the only content they find at the top of google is demand media style content with no good information but that is SEO'd to the hilt, and people with good and real content can't outrank them.
Yes, and that's exactly the sort of thing that google is finally addressing. I loathe demand media and all the sites operating on that principle.
> I mostly agree, but I think this is a bit too simplistic. I worked on search engines for years and fully understand how hard this problem is. I don't know the answer to this problem, but I see a clear problem or problems. One of which is Google's PR which says "hey, just make a good site with good content and the rest will take care of itself". They aren't really being honest here. For years they dodged the question of negative SEO.
We agree on that they are dodging the question of negative SEO, and it is bad they do that but I can see that Google's image will take a nosedive if they admit that the issue is beyond their technical capabilities. They're essentially lying about this, but what else is new in corporate country?
I wished someone would find a way to make a search engine that uses a completely different aspect to rank pages than the link graph (maybe back to on-page?) and that that search engine would take away 50% of googles' share. That way the SEO dudes would be in for a much harder time.
You are aware that there are large (enormous) swathes of Internet users whose primary mode of navigation is typing whatever they want to visit into Google, trusting it'll correct their (terrible) misspellings, and click one of the first few links of the first result page?
There will type URLs there. Like "Apple.com". Because they don't know what URLs are for, any more.
It sounds to me, if you really suggest to stop making sites for these people, you're not actually aware how numerous they are. They are both the old, and the new generations.
Yes it's sad this is the case. But they are people. What if they are searching for some niche information (like a disease, as another poster already pointed out), but the honest blog post that'd be useful for them has been torpedoed out of the water with this "negative SEO", in favour of some scummy SEO site trying to sell them ineffective fake medicine (or whatever).
Is that too far-fetched? I don't know, but it seems to me that giving evil SEOers the power to blast sites from Google's index by abusing "negative SEO", is a bad thing in general. Your argument seems to be that it'll give SEOers a taste of their own medicine, which I agree that will probably happen. But there will be collateral too, and I don't think that's worth it.
"United States antitrust law is a collection of federal and state government laws, which regulates the conduct and organization of business corporations, generally to promote fair competition for the benefit of consumers. The main statutes are the Sherman Act 1890, the Clayton Act 1914 and the Federal Trade Commission Act 1914. These Acts, first, restrict the formation of cartels and prohibit other collusive practices regarded as being in restraint of trade. Second, they restrict the mergers and acquisitions of organizations which could substantially lessen competition. Third, they prohibit the creation of a monopoly and the abuse of monopoly power."
Honestly, I'd be a little surprised if they didn't.
It doesn't mean it's a bad idea to buy or build the gas station there.
And if people are not loyal that's a serious problem with either the line of business you are in or your relationship with your customer.
If it didn't work, we would have no gas stations. I don't know about you, but I'm not so loyal to a particular gas station that I would drive farther to reach it if there were others more convenient to me that offered the same service for the same price. That doesn't mean it's a bad business. It means there is competition with fairly exact substitutes, and location is a big part of success.
If I lost my search engine traffic that'd account for half of my daily traffic. (only around 500-600 people so not huge) If that happened that'd be pretty demotivating.
Ok, that's a good reason.
But when you started blogging you did not have any visitors at all, you must have done it for some other reason.
And when you have 1200 visitors (say a year from now) per day and you lose half your visitors per day (because they are search engine traffic) and you're back to 600 you could still argue that you lost your motivation.
How many visitors come to your site is just a number. What you get out of the engagement is the key imo, and in that sense 50 people that you engage with are worth 500 that just visit and look at what you write.
Or maybe they expected that if they blogged, they would get visitors? It's pretty well known that if you put good stuff on the internet, people will find it, including through google.
>And when you have 1200 visitors (say a year from now) per day and you lose half your visitors per day (because they are search engine traffic) and you're back to 600 you could still argue that you lost your motivation.
Yes, it's always true that it hurts to lose a source of traffic. I don't follow your point.
>How many visitors come to your site is just a number. What you get out of th engagement is the key imo, and in that sense 50 people that you engage with are worth 500 that just visit and look at what you write.
This is true, but you seem to be assuming that google visitors are less engaged. Why? My time on site is highest for organic search traffic.
Because networking is everything in life. Maintaining a good reputation, providing valuable information may not pay off immediately today, but you never know what you'll need tomorrow. If you are penalized today, you have no chance at tomorrow.
Networking is meeting and engaging people.
If there were an olympic event for mental gymnastics, you'd be dominating right now.
I checked to see if you have a point here, I submitted exactly one link out of the last 30 or so to my own site, the rest have been posted by others. If we go back 60 links that's approximately 300 days and there are still only 2 links, and both of these were in response to HN content, either articles or comment threads.
Suggest you re-read my original comment and then take your own nick as advice.
If you truly don't care about "what Google makes of it", why not block Google with your robots.txt file?
I'll tell you why: Because you do care, but you're pretending not to for the sake of arguing with a bunch of people on the internet. And the position you've taken in that argument appears to be based largely on spite rather than reason.
We get it, you don't like SEOs, but these changes clearly hurt innocent people who know little or nothing about SEO.
The rest of your comment seems to presume you know me better than I know myself so I'll leave that without a reply, but I'm happy that we have established that your original comment was a load of nonsense.
These changes are clearly hurting SEOers who practice massive link building regardless of quality, too. That is a good thing.
> At the same time google should be extra careful that it does now allow good websites to be penalized by activities from even shadier SEO types that turn around and use these facilities against their competitors (rather than to avoid being penalized by it themselves).
> The disavow tool is used as a threat against webmasters to take manual action to remove the spam that was placed in an automated way by the perps in the past, that's a really bad balance there.
OP is right in fact but this is a rarity, overall google search results improved and the fact that the whole SEO world is in panic about this (proof in my inbox) is fantastic news. That it can be used for bad purposes is obvious, those that were gaming before will game this just as much. But rather than being in denial about negative SEO google should simply come clean about the numbers, any kind of classification system has false positives, a categoric denial is simply something you should not believe.
And in spite of that Google should stay the course, they're not a court and nobody has an innate right to an x% of search traffic. If that were the case we could replace google with a link lottery.
It's the denial about false positives that is frustrating. If you're going to build in logic to penalize link farming, then one would hope you'd make an attempt at identifying malicious link schemes. By categorically denying the possibility even exists, it leaves most people assuming such an attempt hasn't been made.
If it works, then I get rankings and traffic.
If it doesn't then there is no harm to me and I can go try some new tactic
1. I already have spam links pointing to my site. It hurts me so I clean up the spam and make the world a little better.
2. I add spam links to my competitor who previous had no spammy links. Google notices the dates on the links and does not alter the PageRank of my competitor. The world is not made a little bit worse. I stop doing it.
So as long as there is some clear cut of date for spammy links (and hopefully some definition) then it seems workable. Any black hat SEO will know no to bother adding post-Penguin/panda links - for good or ill.
Precision and recall can't be 100% accurate given a large enough set of inputs. That would be magic. You can try to do better, of course. But it will never be perfect and you'll never make everybody happy. False positives are a given. Matt was wrong when he said that, he pretty much had to be wrong due to the nature of the problem.
That he stuck to his guns is imo a mistake, that google can be manipulated into dropping sites from their rankings at the behest of others is a serious problem. Such unscrupulous behaviour should be punished, but then you get yet another layer of complexity in the arms race.
Basically you can read this whole saga as Google having to come to terms with the fact that even though they were a cut above altavista they too will have problems that no algorithm will solve.
Admitting that is probably above Matt's paygrade.
There are two main ways of dealing with issues:
* Prevent them from happening
* Mitigate the risk so the fallout is minimised if it does happen
Because there are flaws in the first way doesn't mean the second hasn't been explored or carried out.
We mitigate risk all the time. Seat-belts, looking both ways before crossing the street, insurance. The entire banking system.
So you get hit with a manual penalty for spammy links. Deal with it. Document it in great detail, publish it, share it with Google. Then SEOers will have both the data they need and a Google rep to talk to. Plus, if it is as terrifying as SEOers keep telling us it is, the news headline boost alone will make up for the link profile damage.
I think I know why SEOers are in an uproar about this: they'll have to collaborate with Google on a new level of openness. Effectively, recipients of negative SEO attacks, who then notify Google, will also have a nice shiny Google light shone on their SEO tactics leading up to the negative SEO attack. And I guess almost all SEOers have done something they are not entirely proud of, or wish to be forthcoming about. It's the fear of being seen as something other than completely white-hat.
The ways to avoid reaching that uncomfortable point is:
* Hope their fellow SEOers don't hit them first with a negative SEO attack
* Hope Google reverses this decision, so they don't have to venture down that road.
It's a bit like that Simsons sketch where the whole family are in a shock therapy session:
The SEO fear is one of their fellow SEOers pressing the button.
Hopefully it will make them more forthcoming in cleaning up their industry. A bit of public naming and shaming would be nice.
The only thing search engines can do to stop SEO spam is to avoid giving any weight to spammy links.
Suppose that the natural situation, with no SEO at all, is that you have the #1 site on some keyword, and your competitor has a lower ranking.
With "positive" SEO, okay, your competitor might have paid a lot of money and bumped you to the #2 site, and that might be frustrating -- but you're still #2!
With "negative" SEO, your competitor pays a lot of money and now you're #100. And that sucks more for you.
Probably not important in the really big keywords where all the top sites have always paid big money for SEO -- then, sure, it's all just relative. But in the relative backwaters where lots of sites aren't engaging in SEO at all, having negative techniques work is a lot more frustrating to the people who just don't want to play the game.
That didn't work before. Zero weight for spammy links is gamed by spammers by spamming everything at full blast. There was no downside for them. There are better dials and switches than falling back to a known broken model.
With penalties in place spammers need to get those existing bad links removed for their own sites / or build from scratch new sites with clean link profiles (which they are doing anyway, slash and burn). Now they will need to multiply their efforts to negatively target sites above them (not just rank one site, but unrank several sites). Good luck doing that without leaving a detectable fingerprint/trace.
The history of when links are created - that will leave a clear beacon that a site has been targeted. Unless a spammer does it very slowly over the course of years. In which case, LOL.
Don't you think it would be noticeable that a site ranking well, with a clean back link profile suddenly starts attracting heaps and heaps of bad spammy links? That's a clear indication something is going on.
The better time to use negative SEO is when the spammer has already gotten ahead of his competitor. Then the influx of bad links might look like an effort to regain rankings. That would be more interesting.
That system isn't exploitable to sabotage another site's rank, but it also doesn't work at preventing link farms (as evidenced by most Google results before the recent change).
Basically fight source of bad links, not recipients.
Which only requires perfect spam link analysis /s (or no ability to rank sites).
Perhaps in your specific example, these links are old enough that you can be sure that they were originally done for "seo" purposes. But in many situations that is not the case.
Also, you are completely ignoring the possible situation in which a website was bought by an "ethical" company and now they are trying to clean up the misdeeds of the past.
And even trying to recover from the change, it's also very difficult. Even after disavowing any outside links, former SEO experts seem pretty clueless about how to improve visibility or even show up on the first few pages for Google now. Short of advice like "rewrite all of your product descriptions so that they don't match anything you have on ebay, so that you're not flagged as duplicating content", there's little help to be found.
Directors of companies are held responsible for the decisions they made. Delegating that decision to others does not abrogate their responsibilities.
If you are in the SEO industry, please stop hiding behind this. The SEO industry have had ample time and patience to clean itself up (naming and shaming these unethical SEO consultant for starters, offering up material small businesses and mom-and-pop operators, checklists in hiring an ethical SEO practitioner, checklists of methods/practices that should be avoided. How to write up clear statements of work).
And besides paying Google to exist, no one my parents ever talked to even seems to know what it takes these days to show up on Google anymore, because it's secret, so no worries because Google's moral crusade has been successful, never mind the collateral damage.
As you've seen, you can have the rug swept out from under you overnight and there's nothing you can do about it. That's why people are so dismissive of SEO, it (mostly) doesn't create actual value and it's subject to the whims of Google. Your parents fell into that trap.
As jacques said, "the most solid way to grow a business is to find your customers through references and to keep them happy." The old-fashioned way never fails. Get out there and make some people so happy they want to tell all their friends.
Interesting. Show me where in Google's guidelines Google says it outlaws affiliate marketing.
https://support.google.com/webmasters/answer/76465?hl=en -- seems to suggest it's okay in conjunction with a site that's producing good quality content.
In that sense I sympathize less with your parents than that I sympathize with the owners of the sites that got bombarded with links to your parents website.
Nobody has an automatic right to turnover based on intentions. The most solid way to grow a business is to find your customers through references and to keep them happy, treat any search engine traffic just like you would treat a walk-in new customer. Pamper them and make them happy, don't count on them coming but when they do make sure they stay.
Your parents actively pumped resources (money) into a fight that they could have chosen to simply not engage in. SEO's are a scummy bunch and I see their pitches on a daily basis so I don't fault your parents for falling for it. Even so, the loss of this traffic and the dent to their reputation is their own fault (doing business in unfamiliar territory comes with harsh penalties) and the fault ofthe SEO's who did it to them (though I clearly think the SEO's are vastly more at fault here).
Recovering from the change is hard for a reason, I fail to understand why your parents website should 'show up in the first few pages of Google', there is no automatic right to that and there are only so many subjects and 'first few pages' to begin with.
Rewriting your product descriptions may or may not be a good idea, I don't particularly care about having duplicate content on my sites because I don't particularly care about google traffic.
I understand that if google traffic is all you have that this could all be very hard to stomach and that it may even mean going out of business altogether. But if all the mom-and-pop stores that give a few $100 to shady SEOs would stop doing business online I know that my workload will go down by several hours per week at a minimum. So from that point of view I would not be too sad.
Still, I believe that your mom and dad may be able to survive this if they learn that relying on a single source of traffic is not a good idea. Much better to really build relationships with other online properties that carry weight with their prospective consumers, or to do it like everybody else is doing it: by spending their money on advertising instead of on trying to game organic search.
Advertising via adwords and things like that is a very expensive activity, with no guarantee of increasing legitimate traffic and interested customers. Prices have increased greatly over time in most categories, and though larger businesses might have the margins where losing a few tens or hundreds of thousands here and there on ineffective advertising might not be a problem, but it disproportionately is for smaller businesses.
The biggest problem is really that Google has a pretty effective monopoly on search, and can extort whatever prices they want for advertising, and can also make widespread secret changes that pretty much affect what sites are allowed to show up on the internet and which are not.
For the most part we are in agreement here (except for the 'legitimate reason to show up in results for certain search words', if there are 100 companies in a certain field then only 10 of them will show up on page 1, regardless of any reasons to show up).
> The biggest problem is really that Google has a pretty effective monopoly on search, and can extort whatever prices they want for advertising, and can also make widespread secret changes that pretty much affect what sites are allowed to show up on the internet and which are not.
This we also are very strongly in agreement on. Monoculture is bad. Monopolies are bad. And no, bing, ddg and so on do not count.
So, I hope this stays, as far as I'm concerned google can shut down the disavow tool and those that lived by the sword should die by the sword. It's like an 'own goal' by the bad element in the SEO community.
This wasn't the case of a content farm abusing SEO to ramp up their ad impressions: an innocent company was harmed by a black-hat SEO. The vendor handed in a report with rankings updates and number of links added every month, but nobody at the company was tracking the individual links and keeping track of the vendor's behavior.
I agree that spammy websites should be punished in their search rankings, but the link disavowal tool was integral to removing an innocent company's search penalties.
That seems to be what people are most upset about.
I'm surprised at you for ascribing evil to an entire online industrial sector; I'd think you'd take a more circumspect approach.
Y'know, given that the next line is tantamount to 'I perpetrated a massive copyright infringement on hundreds of thousands of people's online content'; that you might feel that even tortuous actions can sometimes be justified.
People do bad things in most (all?) areas of human activity; SEOs can do good too IMO. It decreases the impact of any analysis to ignore that SEO is a valid activity - albeit, yes, sometimes done in malicious, invalid and/or immoral ways.
I take it you have a similar attitude towards archive.org?
SEO's act the same way arms dealers act during an armed conflict. They will happily sell their weapons to all sides while they profit without creating any value for anybody. I don't care one bit about how much traffic google sends me on either ww.com, reocities.com or any of the other web properties that I maintain, I've yet to 'SEO optimize' anything and I feel that SEO's are as an industry just one notch above mass spammers. In some cases worse than spammers (because they actively destroy good websites).
I tend to be rather black-and-white about this because as a webmaster I have to fight these jerks on a regular basis and it tends to show in how I write about them. Consider me pissed off. I feel like I'm in the middle of a shoot-out between Google on the one side, and a bunch of over-active greedy script kiddies and their customers on the other.
If you feel SEO can do good show me an example where an SEO achieved value creation rather than shifting around a percentage in some zero sum game. The only value SEO's create is for themselves.
Your generalizations are really quite misguided. SEOs achieve value when they optimize sites to fit Google's guidelines, which as it happens also benefits humans. Converting Flash sites to HTML, reorganizing the URL structure to convert ?articleid=5 to /my-great-article/, adding alt tags for screen readers, optimizing page speed, creating sitemaps, cleaning up 404s. Whitehat SEOs are often the caretakers of the web.
It's easy to focus on the bad guys who spam keywords and buy likes, but it's ignorant to assume that's all the industry consists of.
I don't think it is so hard to see that value creation is something that can't exist without creation. So when you take a set of low value inputs and you combine them (say, raw materials + energy + labour) and you then get something that you can sell for more than the inputs were worth then you have created value.
Marketing by itself does not create value (other than that it diverts some funds to the marketeer and possibly some funds from consumers to companies whose products are being marketed). Marketing creates turnover, not value.
If business X is 5% cheaper than business Y then value for the customer is created if they go to business X rather than Y.
In your example, no value is created at all if the product never sells no matter how good it might be in theory
Typically marketing is used to put more expensive inferior products in the hands of more people rather than cheaper, higher quality products in the hands of more people.
So in that example value is destroyed, which is a ton easier (and much more likely) as a result of marketing than creating value (even if it is possible it likely is not going to happen, those that engage in marketing are rarely philanthropists).
Why is value much more likely to be destroyed as a result of marketing? Per unit of product I can see that this is the case as some of the value must be spent on marketing, but if more product is sold than would have been otherwise extra value can be created overall.
Engineers are also not philanthropists. I don't see what difference this makes
You got it perfectly.
> but if more product is sold than would have been otherwise extra value can be created overall.
But selling product does not equate to value creation, it equates to an exchange.
I'm not sure why I am incapable of communicating this point more clearly, but value creation is a totally different thing than increasing turnover or profits or taking more or less money out of the hands of consumers.
Maybe there is a double meaning to this that I'm not aware of but for me 'value creation' is a fairly narrowly defined term and marketing does not enter into it.
> Engineers are also not philanthropists. I don't see what difference this makes
Engineers don't claim to improve the world by marketing either, neither do they claim to 'create value' when they write a piece of software.
However that is much closer to my view on value creation than the view that a marketeer creates value by getting a consumer to spend money on some product.
I think this is the bit I don't understand. Will have a think and get back to you
That is a succinct description of a zero-sum game.
* Business X gains the same amount business Y loses.
There is no additional value!
Marketing effect can be difficult to quantify, but it's about more than ad
dollars and the bottom line is definitely not a zero-sum game. While SEO
doesn't lack for bad actors, white-hat SEO can help grow markets.
For example, if the number of customers can be the same but if they are served better or cheaper than the competition then value is created
While the SEO industry might be doing that also, that seems to be a fig leave for the actual activities.
Or is anyone making a living being the caretaker of the web, cleaning up 404s?
I used to be in house SEO for a large publisher (wont say which one but you would know the name) one project we did was a recovery after a botched transition of a property website (similar presence to Zillow or right move) they screwed up their browse structure migration
I also detected and got fixed a mistake on a large UK recruitment site that was costing them £500,000 in 5 days.
Btw I am available at reasonable rates for consulting/ explaining to your developers how to do their job properly
Considering reocities vs. archive.org and in light of copyright law:
Is reocities a registered non-profit organisation? Do archive.org do this - http://imgur.com/vKHha2M to pages to add donation links? (Answer: https://web.archive.org/web/20100218100003/http://www.geocit...). This used to be called "framing" and was considered about the scummiest thing domain owners could do - wrap other peoples content in a frame that was intended to harvest money, or rebadge, without doing anything else.
This was just a random page choice (the imgur.com) link. It's interesting to note they expected the page to be withdrawn, except now it's still here. Archive.org record, at least, that the content owner removed all content and the [new?] domain owner 302ed the site to http://www.ki-society.com/english/.
Archive.org, along with Google, at least at some point was committing copyright infringement in the USA I believe. In the UK (probably NL too by virtue of EU legislation) both these bodies, and the likes of reocities, definitely are still acting tortuously. In USA Field vs Google established a change to the Fair Use rulings that considered SERPs to be transformative and that cached copies - as temporary and unmodified (neither of which reocities pages are) - should be allowed in view of the transformative nature (the court effectively asserting that Google's copy wouldn't be used for content viewing !!).
Internet Archive were sued in 2007 by Shell, http://archive.org/post/119669/lawsuit-settled, and settled stating that Shell's copyright was "valid and enforceable". Internet Archive were sued in 2005 (Healthcare Advocates v.) for failing to remove past archives when a site owner had updated their robots.txt - clearly reocities have no way of assessing a current content owners wishes as to continued archiving.
There is a library exclusion in the USC for archiving digital content (http://fairuse.stanford.edu/2003/11/10/digital_preservation_...) but it requires the content to be kept off-line and only accessible by those physically present. This could be used, or donation of the content to Archive.org or such, if the purpose of the reocities project was simply preservation for posterity.
Aside: The facts of tortuous infringement aren't at all related to my ability to raise finance and sue you on behalf of those content creators whose content you copied without permission (AFAICT none of my content made it through FWIW). I have no wish to at this time. Although presumably I'd only need to issue a DMCA take-down notice as otherwise the domain itself could be targeted for take-down (as it's a .com). But, like Google, I don't think you care if reocities is copyright infringing, do you? You appear to consider the law to be errant and so choose to ignore it.
tl;dr reocities is not transformative (it's just a "framed" copy), is potentially modified without license, is commercial (ie is not registered non-profit and requests donations and is used for SEO purposes (eg footer links to an SEO!)). Ergo not Fair Use in USA (where the content was copied from).
As for the rest of your rather long comment, in creating reocities, I, right along with archive team and a bunch of others performed a public service, at considerable expense both in time and funds I might add.
If you feel that your content was copied unjustly then you are free to use the self-service tool to remove it, and if you can't use the self service tool then I'll remove it for you on first request (assuming you are the author of the content).
I've received many thousands of notes from people who were extremely happy their content got saved, and many thousands of requests to remove content, the vast majority of which have been honored. A few by people who are not the original creators were not honored (most of these: SEO scum trying to increase the visibility of their customers by attempting to force offline pages that they don't like).
If you feel like mis-characterizing this you're totally welcome to do so, but I fear that that says more about you than it does about me.
I was merely suggesting that the guy that did your website might not be the scum of the Earth you seem to believe all SEOs are and thinking that - as you appear to judge characters well in general, obv. not mine ;0) - he might be able to disavow you of that notion. When he designed your reocities layout he designed in on-page SEO ... horror! Indeed his prime motivation might well have been the footer link, perhaps he is evil after all.
OK, so 'everyone loves reocities' (many people love torrent hosts too); but it's still a massive copyright infringement. Personally I think the content that people cared about was saved, moved, backed up already and that very little would have been lost that was worth keeping. The real value was to harvest the content to stick an ad-block or donation wrapper around it.
The point where we started [my paraphrase of course] was that you ostensibly said "all SEO are scum" and I said that as you were able to see past your own tortuous activities to see your perceived good in them I found it strange that you'd classify everyone working in SEO, like your web-designer, that way.
I find it really hard to see how you think making sure a website gets a deserved position in the SERPs (yes SEO can be used nefariously too, I'm not denying that) is so evil. Yet you think wrapping someone else's work up in a donation and ad-banner that take up half-a-screen without so much a as a by-your-leave is fine.
If it's about saving content owners then you can simply announce "all content owners wishing their content to be retained on reocities contact us by December 2015; content we don't have a license to use will be removed at that date". You can even keep an offline copy of the archive if you're in to historic preservation. Even better, if you cared at all about not infringing on peoples copyright would be to have the content available and put it up at owners request - or if a fair use argument for a particular piece of content was made.
I've said it before - you're well off the mark both morally and legally with this one I'm afraid.
I'm really scared of finding my old homepage there. Dorkiness level off the charts...
Do you know if Fortunecity was ever re-hosted in a similar fashion? I had a Diablo 1 clan page there somewhere.
Hehe, let me know if you want it removed.
> Do you know if Fortunecity was ever re-hosted in a similar fashion? I had a Diablo 1 clan page there somewhere.
Web.archive.org may have it.
And the OP should bolster his case by naming names instead of hiding behind being afraid that he might become the target of exactly such an attack. I would say that would be easily resolved if the proof was strong enough.
In a perfect world, yes, that would be the case but we don't live in a perfect world. I think the OP is perfectly within their rights to not paint a bullseye on their back with zero assurance that google will protect them.
With the old system, a site could be scummy, and spammy, and get themselves to the top of Google by using questionable practices. This is still possible today (though only slightly more difficult than it was before), but it also gives a website the power to destroy a completely unrelated website's ranking.
In attempting to better control spam, Google has created a brand new weapon to use. One I feel has the potential to be even worse than spamming and link boosting.
In the short term, maybe. In the long term, no. How many times can this weapon be used before it leaves a nice juicy fingerprint, or sources of negative links become over saturated.
This negative-SEO feels very much like bottom-feeding. Last scrabbling for tiny chunks of change, or an explosion of self-entitled anger, we just need to wait it out. People do stupid traceable things when they are angry.
How many times can spamming and link boosting be uses before it leaves a finger-print, or the spam just gets over-saturated? Apparently infinite. If they haven't fixed positive SEO (and with these new updates spamming is still as effective as ever), I don't think they can add an entire new world of negative SEO and expect it to just work smoothly over time.
It hasn't stopped SEO from being a thing. We don't have a problem and solution now. We just have two problems. This one is definitely worse, because Google has now given other websites the ability to destroy your rankings. That just doesn't make sense.
Makes sense to me.
* Take a snapshot of the link graph
* Hit spammers hard with negative penalties.
* Wait for vengeful SEOers to target their competition with negative SEO, and for the search results quality for mainstream users to noticeably drop
* Switch off the negative penalty flag -- Innocent competitors targeted by SEO negative SEO bounce right back
* Compare the before and after link graph.
* Update the list of low-quality link sources.
* Google wins because it has found a lot more spammy link sources than before.
* Spammers lose because their sites drop even further as previously okay link sources are now determined to be spammy
When you play a incomplet-information game with Google, you need to make sure you are not inadvertently providing them more information by changing your tactics. By changing your link building habits because of a negative link penalty, you are giving Google more information than before, you are confirming more link sources are not natural.
The smartest thing you can do is not to be tempted into negative SEOing your competitors. You are only burning the back links Google haven't flagged as spammy yet. So either keep doing what you were doing before the penalty, or stop building spammy back links. But playing with negative SEO plays straight into Google's hands.
At least, risk someone else's private link network, rather than your own ones when doing negative SEO. :-)
Congrats on your geocities thing, I guess?
This comment would be better if, in addition to not being personally rude, it told us what the main point of the article really is.
edit: the voting on this comment is interesting, 1->+9->+1->+9->+5
Does that make sense?
That would be a first.
I don't usually find myself 'on the side of google' in any argument and I highly doubt that so many googlers would be unable to think for themselves but would blindly upvote anything supportive of their employer.
By the same token, I don't think 'everybody else' includes all the people working in SEO.
It doesn't all have to be "bad neighbor" linking. Negative SEO can be contacting the people who are lending authority to a link and getting them to "nofollow" or remove the link.
Negative SEO can also be convincing Google to AutoSuggest things that don't paint your competition in a good light. "Cheezy Poofs Calories" seems like things people might ask, but people will reconsider if they want Cheezy poofs if the top suggestions in Google's autocomplete is "Cheezy Poofs Explosive Diarrhea" or "Cheezy Poofs Rectum Rash" Or better yet both.
That all Said. Bad Neighbor penalties and the ability to get a site delisted by link bombing has been well known for a long time. Anything that you could do to try and get your self upranked but that is sketchy could also be used to get your competitor delisted.
One thing to note however, is that along the way typically that competitor gets insane rankings just before getting delisted. That isn't always worth it.
(I Google Bombed my Way to being Greatest Living American)
Maybe what website owners should do here, if they have lost considerable money, is file a class-action suit against Google. I'd actually be surprised if no one is doing this.
This is a really interesting subject, anyway. Thanks for the post. I would love to hear a follow-up about how people with web properties can guard against negative SEO. Maybe by keeping your site registered under multiple domains at a time? Or moving your content around on the same domain with permanent redirects? I dunno, it really seems like this is changing the whole industry.
1) Google massively discounted exact match domains, so if you were ranking well before because of an EMD, don't expect to now.
2) Negative SEO has always been a possibility, but a lot of sites aren't helping themselves either.
For like a decade now, there have been plenty of shady link networks where you could get millions of links. It would not be difficult to get millions of spam links with the same anchor text and make it look like Blue Widgets was spamming.
It's not important whether a link is spammy or not, it matters if it's helping you rank better, is being discounted, or if it's penalizing you.
It is possible that those links existed before the Google updates and were helping blue widgets.com rank better. Then Google discounted the spammy links and the EMD, and now the site isn't ranking.
It's also possible that Google is penalizing those links.
In the end, spam links don't come with a great big attribution of how they got there, who put them there, and what the intent is.
A link is a vote. Just like votes, you can stuff the ballot box or you can make it look like your competitor is stuffing the ballot box.
In the end nobody is entitled to rank well on Google search for any reason at all. They could order by rand() tomorrow and you're up a creek.
Why should slander and libel be illegal at all - why can't anyone say, claim, or publish anything they want whatsoever?
If you reflect on that the reason is fairly obvious.
Likewise, if negative SEO were illegal, it might have the same benefits.
Of course technically the standard would be much different from slander/libel, but the fundamental reason that we would limit free speech in this way is clear. It is just more damaging to the person being damaged than the limit on the free speech that it imposes costs us. (Which is taken seriously in the United States).
So, for this reason, there is a good argument to be made for specific, nuanced, laws against negative SEO in the form of civil penalties. I would support such a law.
It might help in some cases, but people doing this probably aren't that stupid and would use foreign entity to do the dirty work if there was such law in effect.
So that raises the question: How do you determine what's a good link or a bad link? Pretty soon you'd have people arrested for linking to somebody's site from a news article or to/from sites like ripoffreport.
By intent. Intent is something that law has always considered. No need for an exception here.
p.s. Just an example, I love Mcdonalds.
I realize they want to take away the incentive for spammers, but let's shift the burden of finding a better way to do that onto them instead of changing the laws about how the web works.
As long as Google's algorithm has punitive measures in it from something that happens off of your site, it stands to reason a competitor could do those things on your behalf.
It's going to be at-least another year until the exact methods are discovered though because of the reasons I detailed here:
Until then people's businesses will be burned and Google won't really do much about it, always slow to react!
Google is getting less usable by the day. Verbatim and code search don't work anymore and the relevance of results keep decreasing dispite the many revision animals they release.
Content, Improper site setup, canonical tags, robot.txt changes, there are a significant number of issues that can impact rankings.
Unfortunately, instead of checking these owners of the site would always speculate that the impact was due to some new factor that certain SEO firms would perpetuate for marketing purposes.
If your to learn anything from these types of articles, its know your audience and create content for them.
Absolute power corrupts absolutely. As such, no one person should occupy this seat for any significant tenure.
This comment is in no way a negative comment about Matt, just talking about the temptations one must face in such a powerful seat.