🔍 My Steemit.com SEO Experiment

in WORLD OF XPILAR2 years ago (edited)

image.png
Source

Introduction

Without going into my life story, SEO (Search Engine Optimisation) has always been of interest to me both professionally and whatever the non-professional equivalent is. I find the idea of getting a particular search term to the top of Google's rankings interesting and in my younger days, created various websites with attaining a high Google ranking as its sole purpose (without resorting to the darker-habits of hidden content for example). Many of these experiments went better than expected.

Whereas Google's rankings have always been a bit of a dark art, requiring a combination of technical skills (the ability to write good code) and copywriting skills (the ability to choose the best key words to target the masses or long tail), the complexity of the ranking system has increased as the years have passed, taking into account variables such as location, device, inbound links and where they're coming from.

I'm digressing slightly from the point of my post which isn't supposed to be a background to SEO. Instead, it's an experiment I ran on steemit.com to see if an unintended consequence of content being posted within communities is that we are damaging the ranking (and therefore visibility) of our content on Google.

👇🏼 Source
image.png
Separator-green.png

How Do Communities Affect SEO?

One thing that Google has always ranked is the URL of a site's content. With the domain name having importance, the section having importance and the page URL having importance. So if you have 2 pages on the same site and one has the URL:
https://steemit.com/jumbo-elephants/@elephant-man/why-i-love-jumbo-elephants

and the same content posted under the URL:

https://steemit.com/hive-000000/@tiger-lover/why-i-love-jumbo-elephants

A search for "Jumbo Elephants" would favour the first URL.

And this concept is the basis of my experiment.

👇🏼 Source
image.png
Separator-green.png

Hypothesis

Posting within a community has a detrimental affect upon your content's Google Ranking compared to a targeted username using an appropriate primary hashtag.

Separator-green.png

Method

I would use my existing @sporting-gorilla account to write some predicted lineups for last night's match between Real Madrid and Chelsea. The post would be written with specific keywords in mind.

A new account (@predictedlineups) would create a post with the identical content - identical title, identical content and identical hashtags.

@sporting-gorilla's post - https://steemit.com/hive-130734/@sporting-gorilla/real-madrid-v-chelsea-predicted-lineups
@predictedlineup's post - https://steemit.com/predicted-lineups/@predictedlineups/real-madrid-v-chelsea-predicted-lineups

The posts would be made at the same time on Thursday 7th April, 5 days before the match kicked off and for a site of steemit.com's content fluidity, enough time to get picked up and indexed by Google.

The page title ("Real Madrid v. Chelsea Predicted Lineups") is the initial search term to be analysed and if successful, quotes and other words could be removed and experimented with.

Within the posts, the number of variables have been kept to an absolute minimum - focussing on the URL as the key element to be tested. Potential variables that cannot be controlled are user comments, user votes and the posts' position in the "Trending" page.

Separator-green.png

Results

Searching for the term "Real Madrid v. Chelsea Predicted Lineups" returned no results until day 6 (today) with 3 results now being returned:

image.png

  1. https://chelseaviral.com/2022/04/12/real-madrid-v-chelsea-predicted-lineups-and-team-news/
  2. https://game.dclick.io/posts/@harddrive/on-point-man
  3. http://15.165.107.144/posts/@dimple-gh/inter-milan-faces-defeat-at-san-siro-tough-win-for-liverpool

Results 2 and 3 are where the post appears in the "Related" section of another user's older article.

Only result 1 was published within the past 2 months.

If we search specifically for the site steemit.com, we are returned the following:

image.png

So despite the article being written 5 days before the match and the match now having been completed (and therefore the article is somewhat irrelevant), Google has still not indexed the article.

Separator-green.png

Conclusion

It is not possible to make any conclusions based upon the initial hypothesis until either page has been indexed. Therefore, I will continue to monitor this search term until this happens and update you if/when the time comes.

Footer-Top-green.png

Closing Thoughts

I'm very surprised by my findings. I expected a site of steemit.com's nature to get crawled regularly and for much more of the content to get indexed. This lack of indexing perhaps explains why many of the articles that appear in Google's search results are 4 or more years old.

There are many things that could contribute to the lack of indexing. Putting steemit.com into this Google simulator shows what Google's web crawler sees. I've not spent much time analysing the results but I can instantly see that if a user's deterred by Steemit's home page, we're lucky compared to what Googlebot is seeing.

It's also interesting that the "Related" section of game.dclick.io is indexed before steemit.com's original articles are. It has crossed my mind that Google has penalised the steemit.com domain name but my understanding is that the consequence is a lower ranking, rather than not getting indexed.

It's also possible that the crawler is indexing the content on the site that it can find but it simply can't find my articles. Without access to Steemit's Google Search Console, I have no way of knowing.

I have many more thoughts on this topic and will no doubt share some of these with you in the future. For the time being though, I hope you enjoyed my little experiment and as always, I look forward to hearing your thoughts.

image.png
Source

Sort:  

Have you looked at the head entries on the Steemit.com site:

grafik.png

If it is forbidden to index the page, it cannot be found in the search index.
The only question is: Why does the Inc. do this? Unfortunately, I haven't yet found the place in the code on github to find out when this was inserted.

 2 years ago 

Oh wow - great observation and it hadn't crossed my mind that there'd be such madness in the template! It must have been a parting gift from the lot who created HIVE.

I was aware (or became aware) that there's a $10 minimum value before "nofollow" become "follow" links in a post (to prevent people from using Steemit's domain ranking to spam backlinks) but this is everywhere, irrespective of a post's value. Wow. I've DM'd steemchiller to see what he knows about it.

Wow.

Just wow.

I wonder how long that's been there for.

I'll ask the Steemit developer that I know too.

It must have been a parting gift from the lot who created HIVE.

I think so. There is no line in the code where these tags are inserted.
In https://github.com/steemit/condenser/blob/master/src/server/server-html.jsx is defined the html-frame.
That's where most of the meta-tags are defined.
Up to line 221, everything is the same as in the delivered page. After that, no more meta-tags are defined in the (visible) code. In the delivered page, however, there are the two lines shown above.

It is also strange that the entries have no "data-reactid"...

 2 years ago 

I've just had a look at the page source again and the 2 "nofollow, noindex, etc." lines have gone - do see them any more?

It's possible that it's been fixed already!

I don't see that any more.
I'm surprised it happened so quickly. But I would be interested to know how the entries came about and who changed them so quickly.

At least you can repeat your experiment in a few days.

 2 years ago 

I'll ask - it won't be a coincidence that it was highlighted and quickly fixed. It would also be interesting to know how long that code had been there, Steemit.com's ranking has fallen sharply in the last month and this has almost certainly contributed to it!

At least you can repeat your experiment in a few days.

I suspect that my experiment has been ruined! But in doing it and following up on a few things, I did learn quite a lot about how some bits of Steemit work which will warrant a follow-up post at some point (obviously referencing your great find!)

I look forward to reading more about your learnings :-)

 2 years ago 

Interesting experiment.

I haven't thought about SEO on Steemit for a long time.

If I recall in the past the Steemit posts used to pop up on the search engines much more regularly, but how well they fared in the search engines was related to the amount of voting they caught.

I very, very vaguely remember someone writing an explanation of this - but the details are lost in the deep recesses of my mind, so it might be a mismemory.

I wonder if the number of internal (and external) links to an article has any significant impact?

 2 years ago 

Interesting sidepoint.

I just tried a search for 'World of Xpilar' on Ecosia and got back a load of links on Pinterest, Twitter, Publish0x etc - but none from steemit.com !

Not sure what that tells us.

 2 years ago 

I very, very vaguely remember someone writing an explanation of this - but the details are lost in the deep recesses of my mind, so it might be a mismemory.

I'll see if I can find any old articles that might be of interest. There are a few other comparisons that I'm interested in too - I'll keep you posted 🙂

I wonder if the number of internal (and external) links to an article has any significant impact?

Inbound links definitely help, provided they're also from reputable sources. I think it's something that Google give a lot more importance to now because it's something that is so much harder to cheat at!

 2 years ago 

In the old days I used to always include links to my previous relevant posts at the bottom of each post.

I wonder if that helped generate useful internal links.

And to get external links, at a low level having a personal standalone blog with links could possibly help.

At a higher level it would be good if Steem ever reached the same sort of status as Medium which some companies use for announcements etc which then get linked to.

That may be a bit too ambitious...

 2 years ago 

I've found what you were referring to before - once a post hits a payout of $10, the links within the post can then be read by web spiders - in technical terms, by default, a link within your post has a "nofollow" attribute which changes to "follow" once $10 is linked. I'm not sure I've explained it very well but hopefully you get the gist.

So linking to your other articles would benefit them if your post reaches $10.

I've read quite a lot about it this morning and found an old post by steemitblog which talks a little bit about SEO. The idea of "the canonical URL" and how duplicate (sometimes plagiarised) content damages a site's SEO is something I've subsequently looked into.

A few years ago, there was some interest in Steemit and SEO which I'd like to look into more when I have some time. Steemit once ranked in the top 1,000 for Alexa Site Rank.... it's now nearly at 4,000 and is falling rapidly.

 2 years ago 
 2 years ago 

Nice tool - The entire domain "fails" but I can't imagine that was any different 4 years ago when pages were being indexed 🤔

Любопытно. В июле 2020 года когда я регистрировалась на Steemit информация в поисковиках по нему была только старая. Я сразу проверила находят ли поисковики мои свежие посты. Находили. Сейчас информации о Steemit много! Это радует.

Curious. In July 2020, when I registered on Steemit, the information in the search engines for it was only old. I immediately checked whether the search engines find my latest posts. Found. There is a lot of information about Steemit now! It pleases.

 2 years ago 

That's interesting - which search engine are you using (yandex)?

I searched for a couple of your posts on Google and got the same result as when I searched mine - (links in "Related" on https://game.dclick.io/)

Искала в Yandex и Google.
Когда я зарегистрировалась 2 года назад, искала информацию как поменять ключи. Нашла только старые посты, которые были мне непонятны. Поэтому сделала пост https://steemit.com/rusteemteam/@avoicest/smena-klyuchei-v-steemit-2020 (без сообщества). И сразу проверила смогут ли новые пользователи его найти. Его находил и Yandex и Google.

За эти 2 года я остыла насчет новых пользователей. Оказалось я в этом мало понимаю. Поэтому я больше не проверяла, видно ли мои посты в поисковиках.

Сейчас я снова попробовала найти тот же самый пост. Он почти невидим. В Yandex есть ссылка на комментарий к нему.

Зато, вот это сюрприз, в Yandex есть много статей и даже видео на эту тему. Ах! В Google тоже есть, поменьше. А ведь 2 года назад эти поисковики упорно не понимали какой Steemit я ищу.

I searched in Yandex and Google.
When I registered 2 years ago, I was looking for information on how to change keys. I found only old posts that were incomprehensible to me. So I made a post https://steemit.com/rusteemteam/@avoicest/smena-klyuchei-v-steemit-2020 (without community). And immediately checked whether new users would be able to find it. It was found by Yandex and Google.

Over these 2 years, I've cooled down about new users. I realized that I don't understand much about it. Therefore, I no longer checked whether my posts were visible in search engines.

Now I tried to find the same post again. He's almost invisible. Yandex has a link to a comment on it.

But, this is a surprise, Yandex has a lot of links and even videos on this topic. Ah! Google also has a smaller one. But 2 years ago, these search engines stubbornly did not understand what kind of Steemit I was looking for.

 2 years ago 

It's interesting that if I do the same search on Yandex for my experiment ("Real Madrid v. Chelsea Predicted Lineups"), I get a single result - https://goldvoice.club/steem/@predictedlineups/

Which does slightly support my hypothesis 🙂

Хотя сайт https://goldvoice.club не существует уже 3 года. Кто бы сказал об этом Yandex.

Примерно в то же время у Yandex обновился алгоритм поиска и индексации. Получили приоритет читаемые и комментируемые посты.

Although the site https://goldvoice.club it has not existed for 3 years. Who would say this to Yandex.

At about the same time, Yandex updated its search and indexing algorithm. Read and commented posts received priority.

 2 years ago 

This should help…. Steemit needs some good reviews here.

https://sourceforge.net/software/decentralized-social-media-networks/

16E8A364-6F04-4920-AA78-6ACFB383FC06.jpeg

C15EC734-F9C3-4C4C-93D5-91AC3F465C7A.jpeg

Coin Marketplace

STEEM 0.20
TRX 0.13
JST 0.029
BTC 60924.19
ETH 3382.45
USDT 1.00
SBD 2.54