AI is learning

… while we are editing. Some of the mistakes in the very first episodes are correct in the following ones. It’s understood we are always been its teacher (do you remember the “shadow user” that sometimes was with us on the same part we were editing/translating?) but this is a big step forward for it a (near?) future step down for us.
CMs must be very careful to choose good editors if they didn’t wish to sabotage its work :smile:

What is your experience?

2 Likes

I’m not 100% sure about them, but I couldn’t find any other explanations, so I right now believe that:

  • Their AI/software was trained with all the subtitles made by the volunteers over the years — I had some situations where I found it impossible for a software to translate in a so Romanian way; also, let’s not forget that Viki wanted at some point to introduce a translation bot but they dropped it after the huge backlash (I wasn’t around at that time, but it was told to me about it), so I will not be surprised if they actually kept working on it to improve it.
  • Yes, I believe that this AI/software is in a learning mode, and as we keep editing the pre-subtitles, it seems that it can get better for future pre-subtitles, but there is still a looot to work on.

So there are still many huge problems in my language:

  • Out of context terms or sentences — because, sometimes, some terms can have multiple meanings, but the AI will use the most common one, as it cannot see and understand the video. For example, „in-law” can have dozens of translations in Romanian depending on the relationship between the characters and also their gender and number; that’s why in Our Universe, the translation of this term was a total mess :joy: . I also saw in a costume drama the ”crane” term being translated in Romanian with the term for the crane machine, so yeah, our character was riding the crane machine instead of the bird :joy: . And I can post many others that the team I’m in is finding while doing TE.
  • The gender is probably the biggest issue right now — on my first channels (Love You Teacher and Our Universe) as the first editor (TE) to edit the pre-subtitles, I can say that the male characters were female most of the time, like 99%, and this led to some hilarious and cringe dialogs :joy:.
  • Well, like many other languages, Romanian is based on gender, number, and the formal/informal way of speaking, and we write as we speak. So, without clear instructions for the AI, it’s impossible to translate 100% correct without knowing what’s happening in the video. That’s why I always see issues with the way of addressing, having a mix of formal and informal. And also many scenes where the speaking should be in the singular/plural, but it’s otherwise. And I should mention that in Romanian, even the verb changes its form based on the number and the formal/informal addressing. And here is just a simple example with ”You are (Tu ești) a (o) beautiful (frumoasă) woman (femeie).”:
    • Tu ești o femeie frumoasă. — singular and informal
    • Voi sunteți niște femei frumoase. — plural and informal (You are all beautiful women. / but that ”all” is omitted like almost all the time when it’s about more people)
    • Dumneavoastră sunteți o femeie frumoasă. — singular and formal
    • Dumneavoastră sunteți niște femei frumoase. — plural and formal (but with the same issue as on plural and informal)
  • Their AI Romanian is not updated with the most recent official changes, so there are plenty of omissions, and I can assure you that most of the volunteers aren’t able to spot them if they aren’t also up to date with the changes. But I also don’t exclude the possibility of these mistakes being taken from the volunteers’ translations made over the years, especially when we think that they never had any quality check system or even just a little interest in allowing only the good volunteers to translate. So, yeah, I wouldn’t be surprised to have these errors/mistakes because of this. Personally, I checked this situation, and even after the ”TE” of the volunteers, those mistakes are still there.

For sure, they still need editors, but as we can see from the last few weeks, they have already stopped appointing CMs, except some and the same people here and there, so we can somehow predict our future.

1 Like

AI is getting right some specifical words we changed in the early episodes, like places (after 20 episode, though!). Even in Italian there are still many issues, but I see in the translation of The First Jasmine it got right the interaction between the two leads who don’t belong to the same social class and manage to keep it till the end of the episode (usually, it was a random choice).
AI is far to be perfect, but we all know our days as Mod/Editor in Viki are numbered.

1 Like

Well, we first experienced it (AI’s subs :robot:) long ago when Viki decided to finish the subtitles of most of the unfinished dramas in French & Spannish (if I remember correctly). The subs were awfull, really! :scream: These teams were supposed to be inactive, even though so many weren’t at all, working on the dramas almost everyday. :sob: To be honnest, back then, I couldn’t understand what was happenning. I had been working so hard on our drama with an amazing team, searching so many tricky words, as we were subbing a military one, and I had too little experience at the time…

But I remember that I had no idea there was a Discord server (I didn’t even know what Discord was, actually, I’m not gonna lie), and I didn’t know how to access to the discussion part of Viki by myself. Now that I do, and that I have some distance from the situation, I think maybe some seniors (I’m not talking about you, obviously :wink:) complained that most volunteers were not doing their job well, or not fast enough. But what do I know? As nobody had shown me then how to access the discussion’s topic, and certainly not invited to Discord VCC… :upside_down_face:

Anyway, I totaly agree with you on that point: AI is learning from our work, and it has from the pre-sub’s start. I had noticed it on my first pre-sub dramas, even though I didn’t have years of subbing experience then. So, of course it’s still learning. :stuck_out_tongue_winking_eye: And sure, even if we don’t like it, and it really needs editing, it’s getting better in most cases. So, I guess viewers complain less about it now.

However, can we really think we’re not needed anymore? This is a good question, indeed. But actually, I’ve heard or read so many times by our seniors that Viki was doing everything to get rid of us, volunteers, since I finally accessed to VCC Discord server, and later in the discussion of the website. At first, I would definately say “Of course not! What are you guys talking about?”

Unfortunately, some of our seniors have been criticizing Viki, Viki staff, and some persons in particular for so long… And they’ve been saying volunteers were doing a bad job, that they didn’t care at all about quality work, that they let their projects unfinished… Not to mention insulting some CMs, CEs, CSs or else in public. Oh, without naming them, of course, but giving just enough clues, so that everybody knew who they were talking about… and to let all volunteers appear as lazy dumb people… :sob:

So, I must say I got really lucky to meet amazing people on Viki. And from the start, I realised what a nice community these volunteers are. Most of them are really nice and help eachother. We can always find someone to answer our questions when we can’t find a solution by ourselves on specific situations. We are so many, we don’t have to know everyone very well, or being best friends with the other volunteers to help them, right? But what can Viki and Viki staff think about us all when some of our seniors show us as weak, lazy, bad in front of them?

I might not be “one of the seniors”, but I’d been on Viki as a viewer first, watching as many dramas as I could with my kids or friends, and I think I’ve got enough experience to give my opinon now.

I know I haven’t used the “leader” word to talk about our seniors, but I don’t consider all seniors as our leaders, as for me, a leader should be supportive and show good example to others. And I guess I need to know them at least a little to consider them as such. :sweat_smile:

Anyway, sorry for long reply, I had tried to stay silent for so long, not meddling in discussions, only helping whenever I could… Maybe it doesn’t help much, but at least, I said my mind. Some might not like it, but it’s okay.

I hope it doesn’t offend you. I consider you as a nice senior. And I’m sure you’re always willing to help or guide others when they ask or need any help or guidance. :smiling_face_with_three_hearts:

Anyway, let’s try to stay positive for now.
Have a lovely day guys. :heavy_heart_exclamation: :hibiscus:

1 Like

I played a bit of the first episode, and I must say it’s decent if I think about the degradation of the Romanian language among the audience. I mean, this is why they went with the AI subtitles over the ones made by us, the audience (most of it) is screaming for fast subtitles regardless of the quality. Personally, I will never watch something like this, especially for this genre, so I will stay with the English ones. In Romanian, there is a huge difference between the vocabulary, the way of translation for the costume genre, and the modern one. They butchered the entire vibe of the drama just for the sake of fast subtitles.

P.S.: I really dislike seeing only displayed text in front of the subtitles… I don’t get the logic of putting what the people are saying in the last place.

2 Likes

Let’s not forget that Viki also has paid editors that edit the AI subs before the show airs. They may not always be there or for every language, but at least Viki hired such people in the past. And in the times that paid subbers still coworked with us, they did read our Team Notes and adept to our rules. So even now, it’s not entirely impossible that some of the improvements in the presubs do come from human beings.
That said, AI definitely learns from whatever it’s fed and can get less horrible over time. Will it get good enough to replace us, though? Well, that depends on whom you ask. I know that it will never become completely acceptable for me, but it sure will to the most impatient viewers with the least amount of linguistic skills. And those are the people who are the loudest and whom Viki listens to.

Are you referring to this?

That was indeed (allegedly) dropped, but they did use “Vikibot” in the past as they mention, though it was before my time so I don’t know anything about it.

That doesn’t necessarily have to be the case. It could, at least in theory, be trained on speech, face recognition, and whatnot. We don’t know that. But Viki might indeed go for the easier/cheaper option and only feed it written subtitles… :woman_shrugging:

That is a vicious circle. People get used to AI subs and new generations will even grow up with it. So that degree of language quality becomes the viewers’ new standard. Add to that the fact that a lot of them have no patience whatsoever and Viki and their rivals will have less and less reasons to avoid AI.

Same here. I watch with any language where the subtitle quality doesn’t annoy me, as long as I at least for the most part can understand it. But English is usually the go-to if you want to avoid literally translated English.

Yes, and text in ALL CAPITALS!!! :unamused:

There have always been complaining viewers. Not all of them do it, but there has always been an amount of viewers that loudly express their annoyance with having to wait for subtitles. They often don’t even know that the subtitles are made by volunteers and even if they do, they usually don’t have a clear view of what that actually means. They are just like, “I paid for my subscription so I am entitled to subtitles right now!” So they start bothering either Viki or the moderators of the most popular languages. Those moderators get annoyed and take it out on the frontline teams (Segging and English). This was even more the case back when all OL teams had to wait until the English team had completely finished an episode. So while the frontline teams do their best to deliver good quality, they get harrassed for not being fast enough. In that regard, quality has never been a top priority at Viki. So Viki using AI for translation is not all that surprising. As long as the viewers, or rather the section of the viewers that actually express themselves, accept the situation, then Viki sees no threats to their source of income and continues whatever they do.

Me, too, for about one and a half year. I used to think I had to pay for even creating an account. :face_with_hand_over_mouth:

2 Likes

Piszę w swoim ojczystym języku. Mam nadzieję, że AI poradzi sobie z tym :). Moje wątpliwości budzi samo wyjaśnienie przyczyn. Skoro ma to być do 90%, to dlaczego Viki nie otwiera rekrutacji, lecz daje kolejne odcinki z AI?

Teraz zalety AI wg mnie. Widzę tylko dwie: szybkość i cena :).

Wady: AI nie przetłumaczy tego, czego nie ma w zasobach. Jak Polak szanuje język ojczysty, to wyśmieje AI za bzdury, przeinaczenia i to, że nie odróżnia rodzajów gramatycznych, robiąc z kobiety “pana” i na odwrót. Ostatecznie, jeśli tłumaczenie ma uwzględniać specyfikę języka postaci, stylistykę, idiolekt i idiomy, to AI nie poradzi sobie. Już na wersji po angielsku widać językowe bzdury i przeinaczenia. A polski jest niemal tak samo trudny jak chiński. Składnia, fleksja, frazeologia to skomplikowane pole… AI nie przetłumaczy też ironii…

1 Like