RE: How to do bad statistics, and how NOT to do it, Part II (DaVinci)
Concerning the questionnaire, I had a very radical solution - but it wasn't accepted.
The basic premise is that translation must be as good as possible.
Clients must get the top quality, no discussion about that.
As all the translations will be perfect when finished - all the translations are equal. Scores will be equal.
As the consequence... Moderators are forced to get the best translators, in order to facilitate their own work.
The level of quality is going up, there are no sparks between translators and moderators as they are collaborators and not rivals. There is no bad blood between the teams concerning the scores *(as all scores are equal). Of course, if translators are bad - they will be replaced.
In the current system, there are several things which are not very logical:
- There is a mistake. Neither moderator nor translator notice the mistake. It's not fixed. Mistake still exists, it's not fixed - but the score is perfect.
- There is a mistake. Either moderator or translator notice the mistake. It's fixed. Mistake no longer exists, it's fixed - but the score is not perfect. It's 8 points lower
Or... We can see that all the parameters concerning quality are telling us that the translation is "so-so", but there is only one error. Ho-how... If it's bad - make it better. Imagine having 200-300 strings, 1 mistake and the quality is "meh... so-so". It's not very logical to me.
I also can't understand how some people are constantly making 10 mistakes per 1000 words. My answer is already 300 words long. Imagine 3-4 errors, made while writing in the native language. How is it possible - I don't understand.
Your idea is good, regarding the quality of translations. However, I believe that, within a group of professional, there are people that will be superior. Thus, there is no how the quality of work would be equal.
Some people have years of experience in translation, while some aren't. Yet, anyone can get better if the chance is given. As I have mentioned in my comment above, things are not really perfect now, but it would be better to look for a less strict way.
Also, anyone that provides way less quality could be replaced since we want good translations. We shouldn't nurture poor works.