Forum Discussion

GatesLover's avatar
GatesLover
Brass Contributor
Dec 19, 2020

Speech search speech!

Traditionally, search engine search a text from a text. I wonder that why not we search speech in a voice(audio or video) from the speech from the user?

What is speech search speech use for?

There are more than 6000 languages all over the world. Most of them don't have a writing system. It might not that useful to search from text to text. For instance, if a native American speak an word in their language. Someone else speak the same word exactly in another video. The speech to speech will work in this situation.

How to realize speech search speech?

①Detect and collect all the voice in videos and audios in all webpage all over the world

②Speech Analyze all the voice into spectrogram and IPA with timeline.

③Analyze the users speech

④Match and rank the user's speech with the target counterpart from other pages

 

  • Well, one of the most areas in Canada today, the last one got tranlsation added to Bing Translator!!
  • We definitely have too many languages in the world,
    most of them are spoken by very few, might be even people with no access to the internet.
    • Deleted's avatar
      Deleted
      That is very true, but isn't the internet getting to more places?
      • HotCakeX's avatar
        HotCakeX
        MVP
        Yeah, but the time and money needed to develop necessary tools for those rare languages would be a negative factor
  • Rae_Rae's avatar
    Rae_Rae
    Steel Contributor

    GatesLover You have a WONDERFUL idea! I also believe it would be a TREMENDOUS help- especially for the blind community. :happyface::xd::smile:

    • Deleted's avatar
      Deleted
      yes I would agree, wasn't microsoft working on seomthing like this for transit users?
      • GatesLover's avatar
        GatesLover
        Brass Contributor

        I also works in non-human speech like dog bark, birds, cicadas, or sirens

  • Rae_Rae's avatar
    Rae_Rae
    Steel Contributor

    GatesLover If I m not mistaken, this IS actually being worked on. Isn't it? I bring 'this' up because, sometimes, when I use the Bing! App on my 'smartphone,' I can type in words OR use the little microphone option. And, I use the microphone option quite a bit. Also good to know is that when the 'answers' come back, they are spoken to me. Is this what you mean by "speech search speech!"?

      • Rae_Rae's avatar
        Rae_Rae
        Steel Contributor

        GatesLover Oh! You are talking about speech as in patterns of? What about using translators? Do you think those could help with your search? 

  • Yes I would agree since some countries use a oldern writing method or have a special delite.
  • Hi GatesLover, thanks for the suggestion. That's an amazing idea!

     

    Alyxandria (she/her)
    Community Manager - Bing Insiders

Resources