The default prompt provided by the module instructs the LLM to reply XTRUE if the text contains the phrase we are validating for. The code in the constraint however only fails validation if the LLM responds XFALSE.
The module should be updated so it is clear to the user that the prompt should return XTRUE if validation passes and XFALSE if not, and the code updated accordingly.
Active
1.0
Other Submodules
@mrdalesmith - I think its good to have it check that the validation answers that its passing as well. Otherwise it should not be given as an example.
It would be great if you could add to make an option also so that if the LLM gives an unexpected validation it should fail.