Program-of-Thought Prompting Outperforms Chain-of-Thought by 15%
A novel prompting technique, Program-of-Thought (PoT) prompting, has demonstrated a significant performance improvement of 15% over the widely adopted Chain-of-Thought (CoT) prompting method. This research introduces PoT as an innovative approach where large language models are guided to express their intermediate reasoning steps in a structured programming language, rather than conventional natural language. By leveraging the formal syntax, logical constructs, and inherent compositionality of programming paradigms, PoT facilitates more systematic, modular, and verifiable reasoning processes. This structured format offers several advantages, including explicit function definitions, parameter passing, and conditional logic, which enhance the model's capability to decompose and solve complex, multi-step problems more effectively. The improved performance observed across various tasks suggests that instructing LLMs with programmatic steps can unlock superior symbolic reasoning abilities, enable robust error correction, and lead to more accurate and explainable outputs, representing a substantial advancement in the field of prompt engineering and cognitive architectures for AI models.