RE: Making SPAM fighting on Steem into a game of skill
And another interesting post...
Especially this paragraph that was deleted from the end of the post:
You might have to let go of things that you love and that you have been attracted to and you might have to let go of things that you know you will never be able to experience again. You might have to let go of things that you have been used to and you might have to let go of things that you will never be able to experience again. You might have to let go of a lot of things that you have been used to and you might have to let go of many things that you have been attracted to. You might have to let go of a lot of things and you might have to let go of a lot of people and you might have to let go of all the people and things that you know that you are supposed to have
Another rare mistake. What do you make of the same sentence being repeated 4 times? It definitely suggests some kind of automation.
Yeah, the sentences are not quite exactly the same, but it's like a "Mad Lib" where someone/something just inserted new clauses into the same sentence structure four times in a row.
My gut feeling is still that it's being crafted by GPT-2 or GPT-3. Especially because of the timing of the early posts. I seem to remember a number of Steem posts in the 2019/2020 time frame where people were experimenting with those tools. If I recall correctly, some of the people involved in those conversations later joined the Witness War hostilities on the Hive side.
Maybe near the beginning a human was proof-reading and fixing the worst parts, but as time went on and they continued to go unnoticed, perhaps they didn't need to bother with edits any more?
This might be useful, but I'm not sure how to interpret it yet. Found it linked from here and tried it out with a couple paragraphs from the top post on that same account. To my eye, the sample below looks similar in coloring to "machine*: unicorn text (GPT2 large)." Also, I note that there's no purple at all.
Here are a couple paragraphs from my own post, so I know they were written by a human.
I guess the more green and yellow you see in comparison to red and purple, the more likely it is that an AI wrote it. That article was published in 2019, so maybe there's a better tool available by now.
This is fascinating - I didn't know this existed and it's incredibly interesting. I'm probably going to get sucked in to it now and lose my day.
That would definitely explain why the articles appear to make sense but at the same time, they don't. One of the ones I read seemed to have a random thread that was totally unrelated to the main thread. In a coherent but totally illogical sense. I think you're right in that their posts are being generated in this way - it almost appears obvious now that my eyes have been opened!
These settings seem like they might be decent for distinguishing between human and whatever they're using... Now if I just had 8 or 10 million SP worth of downvote strength. ;-)
GPT-2(?)
Human
I still don't really know how to read those histograms. It would be nice if it could all be boiled down to a single number, instead of needing to take a SWAG from the coloring.
There was once a time when this kind of downvoting power was supporting the fight against abuse - unfortunately, it got too close to Tron towers and that support ended.
Although this look compelling, it's not the kind of slam dunk you get from plagiarism or spamming ☹️
Agreed. I would love to see an evaluator that produces some sort of level of confidence estimate. As AI gets better and better, this will be an increasing challenge in many areas, not just here. I can imagine it evolving into the sort of "cat and mouse" game that we currently see with malicious software detection.
Now that I know about it, I see a lot of posts and think "that's the kind of meaningless crap that gpt-2 produces".
I've had a bit of a play around with it now and it's really not very good - Although they might be using GPT-3 which I can't find much of for free.
All three of those points match my observations.
Still, GPT-2 is just good enough that there's always a nagging doubt for me, especially as to whether it might be due to a language issue caused by English as a second language or translation with something like Google Translate or DeepL.