DistFactAssessLM
Language models (LMs) encode extensive factual knowledge within their parameters. In the literature, factual knowledge assessment often relies on cloze sentences (e.g., “The capital of France is ____”), which can lead to erroneous conclusions due to the complexity of natural language (out-of-subject continuations, the existence of many correct answers and the several ways of expressing […]