How I replayed our full nodes in 18-19 hours instead of 2.5 days

in #steem7 years ago (edited)
Sort:  

It's a pity that only spammers are commenting under posts like these. I would like to see other witnesses/programmers/developers discussing what you did or atleast congratulte you on your succes or something. The main thing i'd like to see is the community learning from each other. Anyways, well done sir!

The audience for this type of post is tiny, so not super surprised. But those who find it helpful it is extremely valuable.

I'm trying out --follow-start-feeds=1524355200 for a node replay now, thanks for the tip

Let me know how it goes!

It just finished now, definately faster. I didn't time it properly but you could get a pretty close estimate from my comment timestamps (~31 hrs this time)

How long it take previously? Did you use the cache clearing of the block_log as well?

At least 2 full days on the previous replay, this time I rebuilt steemd with DSKIP_BY_TX_ID=OFF so that may have affected how long it took to replay. And I used the /proc/sys/vm/drop_caches trick

great story.i just loved it.

great your post

Gammer, weldon guy.

Keep it up boss. Your post is always encouraging. Have learnt alot from it and i hope to see more of it from you again @markymark

This post, with over $50.00 in bidbot payouts, has received votes from the following:

upmyvote payout in the amount of $113 STU, $248 USD.

For a total calculated bidbot upvote value of $113 STU, $248 USD before curation, with approx. $28 USD curation being earned by the bidbots.

This information is being presented in the interest of transparency on our platform @themarkymark and is by no means a judgement of your work.

Good post !!!

I suspect theoreticalbts is one and the same person with @theoretical who is one of the main authors of the SMT whitepaper.

Technical question (I'm trying to up my game and want to learn how to set up and run a witness): the steem blockchain produces 28800 blocks per day of up to 65 Kb each. That means that theoretically the blockchain could grow to up to 1.78 GB per day which means that by now, after 2 years, the full steem blockchain could (in theory, at maximum space utilization) be occupying 1.2 TB of disk space.

Now it is probably a lot smaller than that in reality but I was wondering, is there some kind of archiving solution already in place or it's considered too early to start thinking about that ?

Oh really sucha amazing news well done my friend , great job

Your post is always different i follow your blog everytime , your post is so helpful . I always inspire of your post on my steem work . Thank you for sharing @themarkymark

Follow my blog @powerupme

Hey Marky Mark, any interest in doing a slightly fluffy, slightly educational witness interview? I've done about 20-25 with some of our top witnesses in the past several months and looking for some other witnesses to take part, in an attempt to increase witness transparency