Pre-training aware directed reasoning for closed-book knowledge base construction. The paper evaluated 18 open-weight models - the results differ significantly and the best model is not the largest one. The proposed approach improves the macro F1-score of the best model from 0.499 to 0.614.
Mikołaj Tym. Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026). 2026.