Engineering Update: MIRA Testing in Production!

in #steem6 years ago

Hello Steemians, welcome to our latest Steemit Engineering Update. You can view our last engineering update here.

Condenser Improvements

We are continuing to let the wallet application soak so that people can become familiar with steemitwallet.com. During this process we are continuing to test and improve the Social Condenser application we have running in our development environment. We have also rolled out a number of small improvements to Condenser. We merged in the private key backup pdf we mentioned in our last update which will help ensure that people have a copy of all their private keys. Many users are solely using their Master Passwords when using steemit.com and only have that password stored in-browser. This exposes their Master Password to a malicious actor and also creates a risk that they will lose access to Steem if they lose access to their computer for whatever reason.

Coin Marketplace

On Monday we released the sidebar version of our “Coin Marketplace” so that people can watch their favorite cryptocurrencies without leaving steemit.com. We plan to improve this feature over time, including through the addition of a larger marketplace which will feature the top 200 coins. We will also look to migrate the backend service provider to @coingecko, an organization that has already demonstrated great commitment to the Steem community.

MIRA Testing in Production

We have now run a number of MIRA tests in our production environment! We are following a rollout similar to the approach we took with Hivemind which led to an extremely smooth transition. That process involved running the software in our production environment temporarily, accumulating data, and then rolling back the changes regardless of the outcome. We then analyze that data, determine what, if any, changes need to be made, rinse and repeat.

MIRA Hybrid In-Memory Reindexing

While we are running these live tests, we are continuing work on our hybrid-in-memory reindexing. RocksDB is a great database for enabling us to get the kind of performance Steem apps require but on commodity-hardware. However, those benefits only accrue after reindexing; the rebuilding of the database from scratch. For that function, RocksDB is not optimal.

There are certain parts of the reindexing process that are so resource intensive that no level of optimization can enable commodity hardware to rival the speed of something like an NVMe. By having MIRA perform those specific processes in-memory only during reindex, we believe we can approach our previous reindexing times with a significant cost reduction. Most importantly, once reindexing is complete the additional RAM demands will terminate. This will be hugely valuable for anyone looking to perform a reindex on commodity-hardware.

Let’s Thrive

It is extremely satisfying to see these important projects nearing their conclusion. These projects were necessary in order to ensure our survival as an organization. The speed at which we have been able to execute on the tasks and the degree to which we have been able to reduce our run costs, have exceeded our expectations. This, combined with the ad revenue we have begun generating, makes us very optimistic about our future as an organization.

While we were in “survival mode” we now feel confident in our sustainability going forward and are eager to begin thriving. We look forward to sharing our strategy for this new phase of growth as it is developed. We want to thank everyone for sticking with us during this difficult time, but we now feel that the hardest parts are largely behind us.

Full Steem Ahead!

The Steemit Team

Sort:  

Thank you for using CoinGecko API behind the Coin Marketplace feature! Our extensive market exchange tracking means we will always show the most aggregated average price of Steem.

Please do not hesitate to contact us for any help to implement CoinGecko API!

As a community member and witness on Steem, we're proud to be featured by steemit.inc on Steemit.com, We continue our commitment to contribute to this space.

We look forward to Steemit.inc's continuous improvement to Steemit.com, whilst making it possible for entrepreneurs and developer to built on top of the Steem Network.

Full Steem Ahead!

These projects were necessary in order to ensure our survival as an organization. The speed at which we have been able to execute on the tasks and the degree to which we have been able to reduce our run costs, have exceeded our expectations.

Fighting for survival releases lots of energy! ;-)

Great progress!

@steemitblog,
Personally I like the idea of moving to @coingecko instead of CMC! Coz, they help this community and we should give our credits for their solid work!
Hope MIRA will perform as you planned it and then SMT will be the focus! I urge to see that happening! Coz I believe that's the future, that's what we all waiting for and that's what we build to compete against ETH and EOS DAPPS as well! Yeah I know we still perform better than them with DAPPS, but I believe this might boost everything from every corner! Good luck and thanks for the update!

Cheers~

Very positive, cool comment.

Those price charts are a good step, but they need a lot of work for people to still not leave to check prices on other sites.

Steem is going to fall off the top 100 (unless things improve soon), and people won't be able to follow it on https://coinmarketcap.com anymore, so it's good to have a price indicator here on Steemit.

Ha, that is very true... and sad.

One of the new proposals that I value and like is the Coin Marketplace. Having the value of our coins at hand is an excellent idea, especially if there are some speculators trying to fish in troubled waters. Hopefully the next changes are for the good of the platform and especially for those of us who live here. May the good changes follow!

We will also look to migrate the backend service provider to @coingecko, an organization that has already demonstrated great commitment to the Steem community.

🖕We’ve waited for this moment for sometime now, thanks for reciprocating good relationship.

Lovely improvement throughout!

Posted using Partiko iOS

If only the news-circuit would report this just as hard as they did when Steemit Inc. lost 70% employees.

That's why we need to get out there on facebook and twitter and share important information like this! That's where they are and they will only report on what they see!

They also tend to pick up press releases put out by the team... Plus don't we have people that their job is to communicate news to the public?

That’s the truth 😀

Posted using Partiko iOS

Imma do my part and resteem it.

I like that posts and comments have a date and time, now. It's useful, and neatly tucked away (you hover over "1 month ago" and it tells you date and time). That's an upgrade I can get behind - thank you!

Feature request for Condenser: Add a voting mana and resource credit bar to the user interface please, maybe in the header, sidebar or in the user profile drop-down menu, because this information is so important and should always be visible somewhere.

Agreed. Voting power should be a no brainer on steemit.

Yes, I wonder why they haven't after all these times.


You just planted 0.11 tree(s)!


Thanks to @ucukertz

We have planted already
8451.00 trees
out of 1,000,000


Let's save and restore Abongphen Highland Forest
in Cameroonian village Kedjom-Keku!
Plant trees with @treeplanter and get paid for it!
My Steem Power = 24744.59
Thanks a lot!
@martin.mikes coordinator of @kedjom-keku
treeplantermessage_ok.png

That's would be cool!

Posted using Partiko Android

That’s freakin’ awesome! Can’t wait for SMT to come out in the near future! 💪🏼🙌🏼💯

WOAH wait did you read them say they have a Private Key PDF backup system? I hope that they arent just having users download a PDF with a private key to their desktop environment?

I have an old Github post answered by @smittyvb where I ask about backing up of owner keys and he explains how to remedy this situation with clever thinking:

this situation could also be helped by having @steemit store account keys for a few days after creation. Advanced users would be able to change their password to revoke Steemit’s access, but normal users would have a password reset functionality. This could also be implemented as giving the Steemit account owner authority, then have Steemit revoke itself.

https://github.com/steemit/condenser/issues/2921

Also

During this process we are continuing to test and improve the Social Condenser application we have running in our development environment.

@steemitblog can we PLEASE see a low res blurry screenshot of the new condenser social app? Please tell me you have updated the GUI like golos.io did at least? And also when will we get to skin the front end the way we want like winamp skins?

 6 years ago (edited)

We do not, never have, and never will store user's private keys for any period of time.

There are some other interesting ideas that could be discussed to help prevent lost keys, but storing keys for any period of time is not one of them

Yeah, I get you Justin. That's cool.
@ackza, it would take a DB at steemit.com to do what you propose, definately not cool.. Meanwhile, this is a difficult problem and writing a file to the user's disk, is not cool either. I propose (for lack of better idea?): 1) tel user to get 2 flash drives. 2) copy and paste directly to the flash drive, a new text file. 3) copy and paste the pass info to a new text file on a flash drive. 4) Copy the data from one flash drive, to the second flash drive. 5) Lock each flash drive into a safe in separate buildings.

 6 years ago (edited)

While that might not be a terrible idea for advanced users, it’s probably a big ask for average and new users.

An easier thing to suggest is that the PDF could be saved directly to a flash drive. It’s generated client side in the browser.

Yeah but allowing users to unsafely download their own private key as a PDF, which many will forget about, its irresponsible,

and i never said anything about storing the users keys, i dunno where you got that, its like you didnt even read what i wrote at all, I am talking about giving @steemit permission for a 30 day period over new accounts, incase they loose the keys, and giving users ability to opt out of this 30 day period, from the beginning, but its really important for all the people who loose their key

I read recently something about this and it is so vague and sounds dangerous

To help mitigate these issues in the short term, we have been working on a solution that renders a PDF containing all of a user’s Keys and their Master Password upon request, and strongly suggests that they print it out as a backup.

https://steemit.com/steemit/@steemitblog/engineering-update-condenser-split-key-backup-mira

I never said steenmit should save the key but you can still give @steemit owner permissions as discussed in the github page on condenser, im talking about a hypothetical future feature

i dont think giving people a PDF document is a very good idea, thats just going to be saved on the persons desktop or smartphone?