Galileo's evaluation approach applies prompting best practices, elicits as much reasoning as possible from LLMs, and uses majority voting across multiple outputs for self-consistency.

“But we what we try to do from our side is essentially we try to follow the best practice of prompting, we try to exploit the reasoning as much as possible from this LLMs and then we use basically self-consistency by using multiple outputs and then taking a majority voting over there.”