SteemWorld Update / SteemLogin / Improved Data Caching

in #steemworld4 years ago (edited)


In this post I want to inform you about a few recent changes on SteemWorld. There is currently a lot happening in background, but I won't list all things that I have been working on in the past weeks in here and will only talk about the major/visible updates today.

SteemLogin replaces SteemConnect


As SteemConnect will no longer be available in future and Futureshock (@futureshock, @future.witness) filled the gap nicely by providing an improved fork of the project on https://steemlogin.com, SteemWorld is now also using SteemLogin as replacement.

I also added direct links to SteemLogin and Steem KeyChain in 'Settings -> Security', so that newbies can now easier explore these great Steem tools with a click:

By clicking on the 'Steem KeyChain' link it will automatically open the related Extensions Store for your browser (Currently only works on Firefox and Chromium-based browsers like Chrome and Brave).

Caching Account History


A long time ago I planned to implement some kind of caching logic for the retrieved Account Operations, so that clients who run the Dashboard page multiple times a day do not need to request the same data again and again from the connected RPC nodes. Of course, caching the operations themselves would not work for all accounts, because the browsers default storage quota is way to small and 5 MB would be exceeded quite easily for most users.

I now have developed a solution that stores the data grouped by date (hourly) and only caches the required data for building the Monthly Rewards overview. For example, instead of 30 single curation_reward operations, which happened within the same hour, I group them by type (1 = curation_reward) and timestamp (without the minutes part), so that the 30 operations will result in just one entry in the cached data. This saves a good amount of storage space and the browser's quota will not be exceeded.

Additionally, I needed to find a way to cache the data for multiple but not an unlimited number of accounts, because otherwise the storage quota would be exceeded when using the Dashboard page for many different accounts. I'm still playing around with it to find the perfect settings, but for now it is set to cache the data for a maximum of 10 accounts per user. When opening the Dashboard, there is an automated clean-up routine being executed, which detects the by the user mostly watched accounts and removes the more irrelevant cached data automatically.


The result for a quite active account looks like this:
Total Size (MB)Transferred (MB)
Before (without caching)16.631.99
After (with caching)3.640,45

Implementing this was not as easy as one might expect, but I think the result speaks for itself. Imagine how much less data need to be requested from the Steem nodes in a day alone for all SteemWorld users... ;)

As stated before, I'm still working on optimizations and minor bug fixes, so it might still come to some unexpected results in the next few days.

Tools now better reachable from Dashboard


I updated the Tools section on the Dashboard page, so that we can reach all relevant tools directly from there with a click:

Exciting times ahead, more features and tools to come soon... ^^

Hopefully I will find time to finally run my own full Steem RPC node in the coming weeks. Also there is a new fully-decentralized Steem Chat with end-to-end encryption in the pipeline ;)

All rewards from this post go to @knitrias to further support the great Knitrias Project.

Have a refreshing week and Steem on!


If you like what I do and you want me to be your Steem witness,
please vote for @steemchiller on steemit.com/~witnesses or steemworld.org/witnesses.


Sort:  

Since I was born in the SteemWorld, any news on the developments are deeply appreciated in my heart. And I'm always impressed or the great efforts and excellent results from your work, so productive for the vast majority of users that have experienced your tools and information resources. Now with optimizations that will help the overall functionality on the blockchain. Thank you very much for this awesome Project and its developments!

I'm much honored for your attention, support and promotion for the work on the Knitrias Project and the invaluable help you are giving to its Members through your visits to their posts and now with this contribution of yours which rewards will go to the Project and its Members. This investment, you must know, will be well-used in the growth and presence of the accounts on the project.

Many emotions we've expressed in this week and surely happiness, creativity and good work will be achieved in the future. Thanks again FOR ALL!!

Best wishes for every project and life, @SteemChiller, and lots of satisfactions for your great work !!

Thank you! It feels so good to finally be able to help promising Steem projects like yours to succeed. You are really putting a lot of work into supporting new Steemians, voting their posts, writing meaningful replies and that highly deserves our support.

May more rewards be with you and help you on your way.
One for all, all for one ;)

Being able to help is a real value on the blockchain that we have learned to appreciate in this adventure. Thanks again for your confidence in this project. Great initiatives are surging and developments and applications too, we will enjoy!! :)

The Good and the Best for you!

Hi there @steemchiller! I have been away for a while and it is good to see these new features. You are really doing great so thank you for all your efforts!

One thing that I missed on my return is the steemauto that ceased its operation. Maybe you can consider having that feature integrated in steemworld.

Hi @macoolette, great to see that you are back! @steem-supporter is already working on a new steemauto service, but it may still take a few weeks until it is ready to be used.

Here you can read more:
News on Steemauto

thanks for the mention ... it might take few days only tho

Sounds good, people are already missing steemauto like crazy... ^^

Thanks @steem-supporter and @steemchiller for the news and action.
I like to have same service feature as steemauto like individual user setting with timing in seconds and all other features. Waiting .....

Thanks for the update. That is great to know. 👍

I checked Steem world after an year and Oh my boy... You (@steemchiller) have done some amazing work. I am glad that it is actually you guys that kept Steemit alive. Now as I am back, I will try to restart creating some content and help the community. But I am really happy to see your work. It was my go to place a year ago and it has became my favorite go to place again.

Thank you for your awesome work.

Thanks for your kind feedback!
Always working on a better world... ^^

Do you think Steem really has a future? I only recently started using it, am wondering if it's really doomed or if it's silly eople attacking it or...

As long as there is a witness running a node, this place will keep going.

Steem has many enemies. Those who know history know the past. Those who know the past know the future. I think sooner or later everything will calm down and Steem will have a future.

This is going to be like taking a party trip with the vehicle of the company, but what the hell!! This party is the most important at the moment!!
@tipu curate 3

@Knitrias is with lots of emotions right now, but she will come to visit this post and say Thank You Very Much @SteemChiller, as I do with all my heart!!

Best wishes, for projects and life!!

@steemchiller, you wrote a great post. I'm not a programmer and I know little about nodes and caching operations.
But I understand that you have done a grand job of improving Steemit.
And thank you for your help and support for our project #knitrias-project

🤗🤗🤗

When everyone started leaving, I just panicked when I thought: Oh my gosh, what if steemchiller is leaving?
So my joy was immense when I realized that you would stay in Steemit. I love SteemWorld and I am almost addicted to this tool.LOL.
Thank you @steemchiller happy and long life.

Als alle anfingen zu gehen, geriet ich in Panik, als ich dachte: Oh mein Gott, was ist, wenn Steemchiler geht?
Meine Freude war immens, als mir klar wurde, dass Sie in Steemit bleiben würden. Ich liebe SteemWorld und bin fast süchtig nach diesem Tool.LOL.
Danke @steemchiller, glückliches und langes Leben.

Thanks for your uplifting comment! As always, a pleasure to read :)

I just panicked when I thought: Oh my gosh, what if steemchiller is leaving?

Don't worry, that will never happen. They have set the account balances to zero for my own, my wife's and my family's account (in which I invested ~ 10k € when STEEM was trading over a dollar), but that was not the reason for staying on Steem.

I am not a big fan of clones in general, so a clone created by dark knights does not even sound a bit like an option to me. Dark to light on Steem, dark to dark on Hive. May everyone go their desired way of peace.

I love Steem but only the original one... ^^
Have a wonderful week!

I liked your words, they are beautiful, @steemkiller

Don't worry, that will never happen. They have set the account balances to zero for my own, my wife's and my family's account (in which I invested ~ 10k € when STEEM was trading over a dollar), but that was not the reason for staying on Steem

You first wrote:

I liked your words, they are beautiful, @steemchiller

Then you changed my name to 'steemkiller':

I liked your words, they are beautiful, @steemkiller

Did you do this intentionally?
I like 'steemchiller' better, because I'm a peaceful guy and no killer...

I liked your answer; it proves you are a patriot of Steemit, @steemchiller. This is my opinion.

Don't worry, that will never happen. They have set the account balances to zero for my own, my wife's and my family's account (in which I invested ~ 10k € when STEEM was trading over a dollar), but that was not the reason for staying on Steem.
I am not a big fan of clones in general, so a clone created by dark knights does not even sound a bit like an option to me. Dark to light on Steem, dark to dark on Hive. May everyone go their desired way of peace.
I love Steem but only the original one...

Ah, @steemchiller, please excuse me.
I am sure that you are a peaceful guy.
Have a beautiful day!

Good news here, especially that idea about Chat. I would like to see all these tools plus chat included in a future version of Condenser. lol this seemed crazy!

At least the basic chat functionality could be included directly in Condenser and other Steem platforms as well. Since it is a decentralized (Open Source) solution, everyone can start an own server similar to joining a public blockchain network. It is also possible to exchange data and messages with users of other platforms (like Discord) via so called 'Bridges'.

The chat is not developed by me, but it has a great team behind it that successfully accomplished their mission in laying the groundwork for building stable, decentralized and secure chat apps of the future.

I will soon make a post about what exactly I have planned ;)

Easily one of my most used tools. You are the best @steemchiller! Keep doing your thang!

Awesome work.
Thank you and a clear resteem.

Steemworld is the best! I've been using it for years!
Thank you for all your hard work and dedication <3

Coin Marketplace

STEEM 0.30
TRX 0.12
JST 0.032
BTC 59274.49
ETH 2983.07
USDT 1.00
SBD 3.75