Technical Definition

In machine learning, a Confidence Score is a number between zero and one that represents the likelihood that the output of a machine learning model is correct and will satisfy a user’s request.

Translating that to Conversational AI, Confidence Score represents the likelihood that your bot is returning the correct response to an utterance. Zammo translates the confidence score into a percentage between zero and one hundred percent.

https://s3.us-west-2.amazonaws.com/secure.notion-static.com/03fe5461-2a19-4425-b862-bc2f263bdee9/Untitled.png?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIAT73L2G45EIPT3X45%2F20220304%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Date=20220304T151311Z&X-Amz-Expires=86400&X-Amz-Signature=953591b28ea6c5a4c7e7afd5e6386f7c3403850be89d62d1de629421a12b9002&X-Amz-SignedHeaders=host&response-content-disposition=filename %3D"Untitled.png"&x-id=GetObject

Working with Confidence Scores

Answers that do not meet the confidence score threshold will not be returned by the bot. In addition to finding no matches or a weak match to an utterance, answers may have a low confidence score if too many matches are found. Therefore, it may be useful to lower the confidence score threshold rather than adding more question alternatives or new question-answer pairs.

Follow the step-by-step directions HERE to adjust the confidence score threshold.