Hardfork20 Curation Analysis

The Velocity hardfork included some significant changes to the Steem blockchain curation mechanics. In this analysis I take a look at the initial impact of these changes and what they mean for curation rewards.


HF20_curation2.png


Introduction

The Velocity hardfork included some significant changes to the Steem blockchain curation mechanics.

Under HF19 a reverse auction window operated for the first thirty minutes of any post. During this period an early voting penalty reduced the rewards awarded to the curator. The penalty started at 100% of the curation reward at time zero and scaled linearly down to zero over the thirty minute window. The amount of the penalty was awarded to the author of the post, increasing their overall rewards.

The aim of this system was to prevent automated bots from gaming the curation rewards by immediately upvoting popular authors, whilst also allowing curators sufficient time to find, read and make a decision on whether to upvote a post.

Whilst the broad mechanics of this system have been retained under HF20, two important changes have been introduced:

  • The reverse auction window has been reduced from 30 minutes to 15 minutes in duration:

This adjustment reflects the changing nature of content on the blockchain and responds to the view that curators no longer need 30 minutes to make their upvoting decisions for the majority of Steem posts.

  • The early voting penalty is now returned to the reward pool rather than being awarded to the author.

This change was made to level the playing field between the author and other curators. Awarding the early voting penalty to the author allowed them to upvote their own content immediately after posting and retain the rewards for doing so; a luxury not afforded to any other curator. It was hoped that this redistribution would adjust the balance of rewards between authors and curators.

So how have these two changes impacted curation in practice? I take a look at some early results from HF20 below.


Results and Conclusions

1 . Vote Timing

To begin, let’s look at the impact of the changes on the timing of votes. I have analysed the voting patterns from all posts created on September 1 (excluding comments) to illustrate a typical day under HF19. I compare this to October 1 as a representative day from HF20.

The HF19 chart preceeds the HF20 chart (and does so in all the comparisons that follow). I am focusing exclusively on the first hour of all posts, as this is where all the action is, but I add relevant statistics from outside this period as necessary. Each green bar is the value of votes added to all posts from each minute of voting, with all figures expressed in STU.

Sep1VotesOnly.png

Oc1VotesOnly.png

At first glance there are some obvious and expected changes:

  • On the HF20 chart the 15 minute reverse auction period has almost emptied out of votes.

The voting in the first minute is significantly reduced and the level of voting that follows throughout the first 15 minutes is also considerably lower than under HF19. For posts created on September 1, 23% of the total vote value obtained over the seven day voting period was added within the reverse auction period (the first 30 minutes). On October 1 the comparative reverse auction period figure, albeit measured over only 15 minutes, was just 6%.

Curation rewards are higher for earlier upvoters. A lower level of votes in the reverse auction window should result in lower curation penalties and potential for higher curation rewards at the end of the window. Both are good news for curation rewards.

  • The main spike in voting has moved from 30 minutes to 15 minutes in line with the change in the reverse auction window.

A large proportion of voting on Steem is automatic. I expect that much of the vote spike remaining at 30 minutes will move to 15 minutes as auto-curators update their trails.

2 . Self voting

The change in voting in the first minute, as illustrated above, suggests a substantial reduction in immediate author self-voting. Let’s have a look at the charts.

Sep1SelfVote.png

Oct1SelfVote.png

The HF20 chart shows a significant reduction in self-voting in the first minute (the silver bar) but a growth of self-voting around the 15 minute mark. These changes balance out. In fact the overall amount of self-voting was almost entirely unchanged, at 3.6% of the overall vote values cast.

However authors no longer have an ingrained advantage and, if choosing to self-vote, are now competing with other curators around the fifteen minute mark.

I would argue that this effect is as expected under the design change and represents more good news for the balance of rewards between authors and curators.

3 . Bid bots

Another significant change can be seen in the timing of bid bot paid voting services.

BidbotsSep1.png

BidbotsOct1.png

Under HF19 it was beneficial for authors to purchase upvotes early in the life of their posts. This tactic resulted in early voting penalties that would be passed their way rather than flowing to the owners of the bid bots. We can see in the HF19 graph a significant volume of purchased votes (the blue bars) arriving within the first 30 minutes.

This benefit no longer exists under HF20. Authors do not benefit from any share of the curation rewards within the first 15 minutes since the penalties are now passed to the reward pool. A high early post payout value may even be a deterrent to some curators.

So who benefits from this change? Again, it should be good news for curators:

  • Lower upvotes in the reverse auction period should mean higher curation rewards.
  • The possibility of bid bot front-running, an idea which had somewhat fallen by the wayside due to the large volume of early paid votes, could also make a comeback.

The HF20 curation changes are also likely to be good news for bid bot owners. Their own curation rewards should increase now that they are no longer losing early voting penalties to authors.

However the bid bot market is fairly competitive and due to its auction-based nature it is somewhat self-regulating in terms of profitability. It will be interesting to see how the market adapts. We could see lower levels of bids from vote purchasers, increased promotional offers from bot owners or higher payments to delegators.

4 . Curation rewards!

Having considered all of the above, let’s have a look at the actual curation rewards for our two representative days.

CurationSep1.png

CurationOct1.png

The above charts include an indicator of curation rewards. This has been calculated using the following formula:

"Curation rewards obtained from votes made in this minute (STU) / Value of upvotes made in this minute (STU)"

Simply put, the indicator represents curation rewards expressed as a parentage of vote values, so 100% would be a reward equal to the face value of your upvote.

The most interesting aspect of the chart comparison is the clear difference in the patterns of curation rewards. Under HF19 the average curation rewards for each minute are suppressed by early voting and never really rise above the long-term 25% level. Under HF20 there is a hump of curation around the 10-15 minute mark indicating the potential for high rewards.

Whilst the overall level of the curation reward indicator is also higher in the second chart I would note that this is mainly due to the increase in the reward pool since the start of October. The curation reward payouts on 8 October are from a significantly higher reward pool than the vote values on 1 October. Rebasing the votes and ratios using the rshares / STU exchange rate on 8 October produces the following chart:

CurationOct1Rebased.png

Whilst the long term ratio of rewards to vote values has returned towards 25%, as would be expected, the good news is that the initial hump and its promise of high curation rewards remains.

5 . Curation sweet spot

So in which minute is the HF20 curation sweet spot?

The HF20 chart above in section 4 suggests somewhere between 9 - 14 minutes, somewhat earlier than I had expected. However it’s worth noting that the volumes of upvotes at durations 9 - 13 minutes are low and the higher ratios may only be supportable for smaller votes.

As an alternative approach to deriving the vote-timing sweet spot I analysed the upvotes of the 100 top curators for October 1 (ranking excludes rewards from edge-cases and imposes a minimum overall upvote value for the day of 1STU). Here are the combined results:

top100.png

Lots of ratios above 100% for some nice rewards! What can we learn?

  • The curation ratios do not provide a clear view as to any particular sweet spot. It could be argued that each post must be judged on its own merits. Whilst 15 minutes would always be a theoretical latest-point-of-upvote there will always be posts that have been overlooked and can produce good rewards even at later durations. This analysis has also been conducted early in HF20 and it’s possible that some clearer trends will emerge after a few weeks.

The top curators were mainly upvoting around the 14-15 minute mark, as would be expected. Again this timing may evolve in the coming weeks as upvoting strategies mature.

Conclusion

Curation rewards are an important lever in the Steem blockchain mechanism for finding and rewarding the best content. Under HF19 it was clear that this mechanism did not function as required.

Whilst I do not believe that HF20 introduces a complete solution to this complex problem, the changes certainly appear a step in the right direction. The potential for higher curation rewards provides greater incentive for manual voting, and increased human interaction should lead to improved content discovery.

However it is unlikely that we will see a fundamental reshaping of the Steem economics from these changes, nor an end to the bid bot era. For such a restructure, a little patience is required until the arrival of SMTs.


Repository:

This analysis relates to the HF20 Velocity changes for the Steem blockchain. The repository is here:
https://github.com/steemit/steem


Tools and scripts:

gears_blockops_green.jpg

I used the block.ops analysis system to produce this study. Block.ops is an open-source analysis tool designed for heavy-duty analyses of the Steem blockchain data. It is currently under construction and this is the first complete analysis from its depths.

You can find the repository for block.ops here:
https://github.com/miniature-tiger/block.ops

(Note that the code for some of the functions required to produce this analysis is still to be tidied and committed to GitHub. This will take place in the next few days.)


Sort:  
Loading...

Conclusion: Vote at 15th minute.

Posted using Partiko Android

Conclusion: Vote just before everyone else does.

That's kind of hard to achieve.
:)

Posted using Partiko Android

Conclusion: Vote at 14min 57sec.

This has always been how the curation game was meant to be played.

Interesting.
:)

Posted using Partiko Android

You just planted 0.10 tree(s)!


Thanks to @ching-chong

We have planted already 4603.27 trees
out of 1,000,000


Let's save and restore Abongphen Highland Forest
in Cameroonian village Kedjom-Keku!
Plant trees with @treeplanter and get paid for it!
My Steem Power = 20577.87
Thanks a lot!
@martin.mikes coordinator of @kedjom-keku
treeplantermessage_ok.png

I'll be voting at 14min 56sec... :p

Lol, and everyone tries to get 1 second earlier

Posted using Partiko Android

You just planted 0.10 tree(s)!


Thanks to @ching-chong

We have planted already 4676.88 trees
out of 1,000,000


Let's save and restore Abongphen Highland Forest
in Cameroonian village Kedjom-Keku!
Plant trees with @treeplanter and get paid for it!
My Steem Power = 20577.90
Thanks a lot!
@martin.mikes coordinator of @kedjom-keku
treeplantermessage_ok.png

You just planted 0.10 tree(s)!


Thanks to @bsfmalaysia

We have planted already 4744.85 trees
out of 1,000,000


Let's save and restore Abongphen Highland Forest
in Cameroonian village Kedjom-Keku!
Plant trees with @treeplanter and get paid for it!
My Steem Power = 20577.72
Thanks a lot!
@martin.mikes coordinator of @kedjom-keku
treeplantermessage_ok.png

Thanks for the analysis. I couldn’t help but notice that your graphs look like they’re flipping the readers off 😂😂

I’m looking forward to SMT’s and have been using some of the apps to collect tokens.

Bar charts always remind me of cityscapes. I want to draw windows in all the skyscrapers and little matchstick people standing on the top waving.

But I can see the flipping thing too! Bad charts!

That's funny. I can see little buildings now too!

That was a great read! Could you re-do your research is few weeks to see if any new patterns occur? Also tipuvote! 5

I have plans to put out some regular stats on various items using the block.ops system, assuming I can get it all automated. I think the above would be a good starting point for that. In any case I'll definitely look at it again as people get accustomed to the changes of the new HF.

Thanks for the tip. Much appreciated!

Impressive analysis, please take an after 15 minute upvote from me. It's very important that people who want to curate and benefit from Steemit know this

Thanks! I'm glad it was of use.

fantastic. Good to see so many have changed their voting habits

"In fact the overall amount of self-voting was almost entirely unchanged, at 3.6% of the overall vote values cast."
But a little disappointed to see this ^

You mentioned "patience" and I am so glad you did. Wish more people could take this outlook. There is so much more to come from steem.

Thank you for this post. HF20 had many changes and its nice to see some reports now appearing about the impact

Thanks Paula!

Yes, I think the next 6 months will pass pretty quickly. People would probably be best served getting their heads down and working towards ideas related to SMTs rather than worrying overly about current problems. There are lots of interesting possibilities ahead!

hey @miniature-tiger, I'm late to the party here, but I just wanted to say: great work! The behavioral changes from the change of the reverse auction window was kind of expected, I guess. Seeing it now in the data confirms the expectations.

The potential for higher curation rewards provides greater incentive for manual voting

I'm a bit skeptical on that aspect. Is it really the human curators who get the higher curation rewards? But that's a question for an analysis on it's own, I guess :)

Cheers!

Loading...

Hey, @miniature-tiger.

Very informative, even if some of it was to be expected. As in, by shifting the fifteen minutes up, in turn, the best times to vote were pushed up.

The question becomes, how to realistically keep up with this without autovoting. The only thing I can think of is, I need to have more authors designated on GINAbot.

It's hard to ignore the curation percentages and where they increase. That is one thing I have been trying to do for the period of time I've been here. The problem is always getting there soon enough. I'm usually beyond 30 minutes anyway. Like now. :)

There is the possibility that, rather than higher potential rewards increasing manual curation, the shorter timescales force more people into voting automation. It would kind of negate improved content discovery.

I expect people will end up with a mixture of both. Key authors on an automated retainer system. But leaving some mana for manual curation and seeking out new content. We'll see!

Great insightful information! Thank you for your time in sharing the analysis for us curators!

No problem! Thanks for reading!

Well you're the guy to watch for curation reward tips!

Nice analysis!

I like the context: nothing major has changed!

Posted using Partiko Android

I'd say it's a couple of tweaks rather than a major overhaul. But it's in the nature of the beast that small changes to the rewards system can have large, and sometimes unexpected, impacts. I'd say that so far these elements of HF20 seem to be doing pretty much what was intended.

Fair point!

I'd say it's an improvement.

I really like yr approach to posting btw... quality technical posts.

I need to teach myself sql etc!

Posted using Partiko Android