Wednesday, August 30, 2017

Alquist made it to the Alexa finals


The CVUT Alquist team managed to get with other two teams to the finals of a $2.5 million Alexa Prize, university competition. Our team has developed the Alquist social bot.

The whole team has met in the eClub during summer 2016. That time we have been working on a question answering system YodaQA. YodaQA is a somewhat complex system, and students learned the classic NLP. Of course, everybody wanted to use Neural Networks and design End to End systems. That time we have also been playing with simple conversational systems for home automation. Surprisingly Amazon announced the Alexa Prize and all clicked together.  We have quickly put together the team and submitted a proposal. One Ph.D., three MSc, and one BSc student completed a team with strong experience in NLP. In the beginning, we have been competing with more than a hundred academic teams trying to get to the top twelve and receive the 100k USD scholarship funding. We were lucky, and once we were selected in November 2016, we began working hard.  We started with many different incarnations of NNs (LSTM, GRU, attention NN, ....) but soon we have realized the bigger problem, a lack of high-quality training data. We tried to use many, movies scripts, Reddit dialogues, and many others with mixed results. The systems performed poorly. Sometimes they picked an interesting answer, but mostly the replies were very generic and boring. We have humbly returned to the classical information retrieval approach with a bunch of rules. The final design is a combination of the traditional approach and some NNs. We have finally managed to put together at least a little reasonable system keeping up with a human for at least tenths of seconds. Here started the forced labor. We have invented and implemented several paradigms for authoring the dialogues and acquiring knowledge from the Internet. As a first topic, we have chosen movies since it is also our favorite topic. Then, we have step by step added more and more other dialogues. While perfecting dialogues, we have been improving the IR algorithms. We had improved the user experience when Amazon introduced the SSML. Since then Alexa voice started to sound more natural.

While developing Alquist, we have gained a lot of experience. A significant change is a fact that we have to look at Alquist more as a product than an interesting university experiment. The consequences are dramatic. We need to keep Alquist running, which means we must very well test a new version. Conversational applications testing is by itself a research problem. We have designed software to evaluate users behavior statistically. First, a task is to find dialogues problems, misunderstanding, etc. Second, we try to estimate how happy are users with particular parts of the conversation to make further improvements. Thanks to the Amazon we have reasonably significant traffic, and while we are storing all conversations, we can accumulate a large amount of data for new experiments. Extensive data is a necessary condition for training more advanced systems. We have many new ideas in mind for enhancing the dialogues. We will report about them in future posts.

Many thanks for the scholarship go to Amazon since it was a real blessing for our team. It helped us to keep the team together with a single focus for a real task. Students worked hard for more than ten months, and it helped us to be successful.

Today we are thrilled we made it to the finals with the University of Washington in Seattle and their Sounding Board and the wild card team from Heriot-Watt University in Edinburgh, Scotland, with their What’s up Bot. Celebrate with us and keep the fingers crossed. There is a half a million at stake.

27 comments:

  1. Huge data is an important circumstance for education extra advanced systems. you have many new ideas in thoughts for enhancing the dialogues, I'm able to file about them in future posts and referred to others.

    ReplyDelete
  2. I really appreciate your professional approach.These are pieces of very useful information that will be of great use for me in future.

    ดูหนังใหม่

    ReplyDelete
  3. Hello Mr. Sedivy,
    First of all, I want to congratulate your team for this huge success.
    It great when our country is not well known just for our sportsmen and president.
    This success in IT is great.

    I read the article about it and I'm very interested to invite you or the whole team, to talk about it in our company name Actum, placed on Prague 4.
    We have our internal lectures called Actum Academy, where we're inviting internal and external speakers to talk about some interesting topics.
    As soon we're IT company focused on SW development and recently also for IoT, your story will be very interesting for us.

    If you'll be interested, you can reach me on my email (katerina.papezova@wmcgroup.cz).

    If not, anyway, I congratulate you and wish you more success in your future job.

    Regards

    Katka

    ReplyDelete
  4. Join us. We have now nice assets, free online movies a lot of experience and dollars to award you scholarships.

    ReplyDelete
  5. Great goods from you, man. I have understand your stuff previous to and you are just extremely magnificent.
    I really like what you've acquired here, certainly like what you're saying and the way
    in which you say it. You make it entertaining and you still take care of to keep it smart.
    I can't wait to read much more from you. This is actually
    a wonderful site.

    ReplyDelete
  6. kompasqq menyediakan 8 permainan dalam 1 id
    Bonus - Bonus yang di berikan Menarik Loh !
    Info Selajutnya kalian Bisa Add BBM
    Yohanna: 7BD4C69C
    Phone : +855011432145
    WA: 085220150616

    ReplyDelete
  7. We provide the technology infrastructure and marketing reach to help merchants, brands and other businesses to leverage the power of new technology to engage with their users selling on etsy,com from Pakistanand customers and operate in a more efficient way.

    ReplyDelete
  8. This is really a well-needed platform for the readers all over because you always come up with something interesting and new so that we could make an essential read from here. well about last night l visit Yummy kabob in Annandale and you know what From the spices of India and Doha, to the culinary traditions of Jordan to the hospitality of the UAE, Yummy Kabob uses the finest grades of Halal Meat and the freshest sea food.

    ReplyDelete
  9. Hey thanks for sharing this information.

    If you have any type of technical errors with you Facebook account and want to get overcome from it then make a call to our experts by dialing Facebook Support Number +(1) 877 207 4415

    ReplyDelete
  10. https://www.kitoinfocom.com/services/mobile-apps-development-company-india.php

    ReplyDelete
  11. If you want app with advance features then choose
    Mobile Android App Development Company Based in Delhi India who have experienced engineers of this field.

    ReplyDelete
  12. I went over this website and I believe you have a lot of wonderful information.Thanks for sharing. แทงบอลUFA800 แทงบอลออนไลน์ เว็บบอลออนไลน์

    ReplyDelete
  13. It is the kind of information I have been trying to find. Thank you for writing this information. It has proved utmost beneficial for me. SexyBaccarat ทางเข้าเล่นเว็บเดิมพันSexyBaccarat วิธีสมัครสมาชิกSexyBaccarat

    ReplyDelete
  14. Do you realize there is a 12 word sentence you can speak to your man... that will trigger intense feelings of love and impulsive attractiveness for you buried inside his heart?

    That's because deep inside these 12 words is a "secret signal" that triggers a man's impulse to love, please and guard you with all his heart...

    ====> 12 Words That Fuel A Man's Love Response

    This impulse is so built-in to a man's brain that it will make him work better than before to build your relationship stronger.

    In fact, fueling this all-powerful impulse is absolutely mandatory to achieving the best ever relationship with your man that as soon as you send your man one of the "Secret Signals"...

    ...You'll soon notice him expose his heart and mind to you in such a way he haven't expressed before and he'll recognize you as the one and only woman in the world who has ever truly interested him.

    ReplyDelete
  15. This content is so fantastic. This is full of useful information. Thank you so much. วิธีเล่นวางเดิมพันSexyBaccarat

    ReplyDelete
  16. Thank you for liking, press share
    I exactly got w hat you mean, thanks for posting. And, ข่าวฟุตบอลต่างประเทศ
    Thank you in advance.
    May I ask something.
    I am too much happy to find this website on the world of Google
    ข่าวฟุตบอลพรีเมียร์ลีก
    Thank you in advance
    ข่าวกีฬาต่างประเทศ

    ReplyDelete
  17. This is such a great resource that you are providing and you give it away for free. I love seeing blog that understand the value of providing a quality resource for free. สมัครufabetขั้นต่ำ10บาทไม่ผ่านเอเย่นต์

    ReplyDelete