Over a development team curry last Thursday (both of us!) we did a bit of planning towards the objective of having a polite.ai useable as an alpha by selected communities by the end of the year.
After early usability feedback, we’ve decided that a dialog based interface to report problematic interactions, and challenge dubious classifications is quite important at this stage.
Our early proof of concept embedded a link in each bot challenge which could be used to report inappropriate classifications and new issues. This works, but assumes the user is working on a platform where they have a browser and also takes them out of the chat context in order to report things through a traditional form based interface. In short, it was horrible and clunky.
If we are building a bot that can participate and understand language in a multi-party chat room then having it take the reports as inline dialogue is an important milestone before we release.
We are currently building dialogue support for room classification, reports and challenges into the personality server. Once complete this will allow basic interactions to be understood by both Matrix.org and Slack implementations.
To get a rapid prototype running, we are using Google’s Dialogflow API to do the NLP. We will however be implementing the state machine, context transitions and responses within our own code in the personality server, delegating just the entity and intent recognition to the Google API (it also has a nice line in smalltalk). That way, we can experiment with other tools and APIs in the medium term. In particular, I’m quite interested in experimenting with an Open Source model like Raza for the production service.
The MVP should be complete during the first few months of 2018, at which point we will be ready to start testing with selected communities. If you are interested in being an early test community then please get in touch.