3 type of mode which demand for translation summarize

Brass Contributor

Thank you for all your reply! I once designed 3 different translation mode for different people in their different need:

bilingual mode (compare the original text with the translation text sentence by sentence) ;

TTS reading translation assistance (translation assistance while reading by TTS);

Video mode (Turn text to video automatically) (this mode is not only designed for bilingual reading, also for general article. I wrote a long passage about this, but not finish the English version yet. You can see my article in the Chinese Edge community【功能建议征集 | 异常问题反馈】Microsoft Edge *非官方* - Microsoft Community)

In general, I think we'd better develop the Android version of these 3 modes in your smartphone, making the article reading like a journey of listening to a music list! Some people just want to listen to some books while doing their boring job, like manufacture workers, cooks, waiters, taxi drivers, or safe guards. They can't read in PC, but they can read by their smartphone. 

Ok now I'm going to summarize these 3 mode in details:

 

1.Bilingual mode:

What is it designed for?

For those people who want to see both the original and the translation text.

What is special for this mode?

Different from other translation, this mode is compared sentence by sentence. First cut the whole article into sentence by the punctuations "." "!" "?" That will make the comparation between 2 text more in details.搜狗截图20201208082845.png

This mode majorly focus on text browsing. The whole text was read by users themselves, rather than by the TTS reader! It means that the reader can skip those text that they are not interest in, or slow down to read in details where they really care about. In other words, they totally control the process of reading like we read a Newspaper in the general way!

Further more, this mode automatically generate the audio for each sentence. Users can just listen to the audio by click of the trumpet icon! He can listen to the audio of the sentence as many times as he want! I was inspired by the idea of Longman dictionary reading! 

搜狗截图20201208083509.png

As you can see, they have audio of each sentence, and we can listen to the sentence reading as many times as we want!! That is perfect for language learning! But what if all websites online (News, books, and articles) converted into thus audio corpus? That is what Edge can do!

What's more? You can use this mode with dictionary extensions of Edge together. This mode won't contradict the dictionary extension of Edge. We can use the dictionary under this mode.

How can we realize this mode?

①Break sentences in the article with "." "?" "!"

②generate the Microsoft TTS audio of each sentence(Users can set the pitch, speed and announcer in advance)

③generate translation layer for each sentence

④generate the Romanization transcription or IPA transcription layer (Orthographic layer) of each word for those languages that don't adopted a Latin alphabet; (This layer should be open source so that we can import any sort of Unicode characters, for each person may have their own Orthographic for each phoneme in the same language)

User experience of this mode:

①Set up their native speech in advance; 

②Control the process of reading by themselves like reading a Newspaper in the general way;

③The translation script play as an important reference;

④Click the trumpet icon to listen to the audio as many times as they can which could make it a natural corpus;

⑤Won't contradict with the dictionary extensions of Edge.

 

2.TTS reading translation assistance

What is this mode designed for?

For those who want to read a book or article in a foreign language via TTS reading of Edge.

What is this mode special?

When you want to read something in a foreign language by the Edge TTS reading while you don't have fulling understanding of that target language so that you need the translation assistance to indicate the sentence and word being read now.

What is the difference between the Bilingual mode and TTS reading translation assistance?

Bilingual mode is an auto-translator of a website in a foreign language; While the TTS reading translation assistance is a assistance when you use TTS reader to read happened to come across a foreign sentence.

Bilingual mode default set to translate all the page into sentences and generate the audio of each sentence; While TTS reading translation assistance only appear when the TTS reader happen to reading a sentence in a foreign language!

How can we realize the TTS reading translation assistance?

① Add the layer of the sentence being read now;(green line in the picture below)

② Add the layer of the word being read now; (gold word "funneling" in bold in the picture below)

③ Add the layer of the translation of the word being read now; (The word in orange above the "funneling" in the picture above)

④ Add the layer of the translation of the complete sentence being read now; (The red line in the picture)

⑤ Add the layer of the Romanization of the sentence being read now(This was not demonstrated in this picture below; This layer is majorly target for those western people who want to read an article in a language that didn't adopted a Latin alphabet such as Chinese, Japanese, Uyghur, Tibetan, traditional Mongolian script etc.) You can put this layer on the top of the original sentence.

搜狗截图20201206145639.png

Make sure that all these 5 five layer's font, filling color, size, text box position, paragraph format, animation, sound effect could be DIY by users themselves

 

3.Video mode. In the mode all the text users selected in the page will automatically turn into video/audio, and a progress bar will be generated. The users should set the following issues in advance:

①Native language; whether you are a child; whether you are learning a certain target language

②setting for all sub tracts: Font, color, bold, font size, how to align it, format paragraph, text box position, text box format, text box color, enter/emphasize/exit animation and sound effects

③setting for all audio tracts: announcer; volume; pitch; speed of speech;

④background color; embedded picture and videos

This is a little complicated and I will write another article later, or you can see my previous article in Chinese

3 Replies

@GatesLover TTS reader assistance only appear when the reader come across a sentence in a foreign language instead of translate the whole page. When the TTS reader read a sentence in their native language that translation assistance won't appear there!

@GatesLover Under the bilingual mode all foreign website will be demonstrated in both the original sentence and the translated sentence. And each sentence will have a TTS audio. Once you click the trumpet icon the sentence will be played as many times as you want. And if you make a correction button it might help improve Bing translation

@GatesLover The TTS reader now have a major problem that it divide the whole page according to line rather than the natural sentence which make the sentence translation impossible. So the first step is to divide the whole page into sentences!