Trustworthy and Efficient Machine Reasoning
with Foundation Models

Tutorial at PAKDD 2026

Hong Kong

Bo Han
Bo Han
HKBU/RIKEN

Abstract

Recent advances in foundation models have led to remarkable progress in machine reasoning, driving breakthroughs in mathematics, coding, and scientific discovery. However, these advances are meaningful only if the reasoning is trustworthy (capable, safe, and robust) and efficient enough for real-world deployment.

This tutorial aims to chart the path from raw capability to trustworthy and efficient reasoning systems. Rather than treating capability, trustworthiness, and efficiency in isolation, we synthesize recent progress across prompting, post-training, test-time scaling, agentic reasoning, and accelerated decoding, highlighting how these components jointly shape reasoning that is both reliable and deployable.

The tutorial is organized into four main parts. First, we trace the evolution of reasoning and motivate a five-pillar framework for trustworthy and efficient reasoning: capability, safety, robustness, explainability, and efficiency. Second, we present core techniques for trustworthy reasoning with foundation models, including prompting strategies, test-time scaling methods, and post-training approaches that enhance robustness and safety. Third, we extend the discussion to foundation agents, covering tool-augmented, multi-agent, and multi-modal reasoning, along with their unique trustworthiness challenges. Finally, we turn to efficient reasoning in diffusion language models, investigating parallel draft-and-verify decoding strategies that deliver significant speedups while preserving output quality.

Schedule

Date: 9 June 2026.
Venue: Room 5, Tai Po III Room, 2/F, Regal Riverside Hotel, Hong Kong.

Format: Two 90-minute sessions separated by a 30-minute tea break (3 hours total).

  • 13:30 – 15:00 — Session 1
    • Part I: From Raw Reasoning to Trustworthy and Efficient Reasoning with Foundation Models (Bo Han)
    • Part II: Methodology for Trustworthy Reasoning with Foundation Models (Zhanke Zhou)
  • 15:00 – 15:30 — Tea Break (The Riverside Ballroom, 1/F)
  • 15:30 – 17:00 — Session 2
    • Part III: Methodology for Trustworthy Reasoning with Foundation Agents (Chentao Cao)
    • Part IV: Techniques of Efficient Machine Reasoning with Foundation Models (Jiangchao Yao)

Organizer's Bio

Zhanke Zhou

Zhanke Zhou is a Ph.D. student in the Trustworthy Machine Learning and Reasoning (TMLR) Group at Hong Kong Baptist University, advised by Prof. Bo Han. He was a visiting student at the Stanford Trustworthy Artificial Intelligence (STAIR) Lab at Stanford University, working with Prof. Sanmi Koyejo. His research focuses on trustworthy machine reasoning with foundation models, including large language models (LLMs) and vision-language models (VLMs), to solve complex problems such as mathematics and coding, as well as to accelerate scientific discovery and applications in fields such as biology, chemistry, and healthcare. He believes that reasoning is an essential pathway toward achieving artificial general intelligence (AGI). Trustworthy machine reasoning encompasses key properties including reasoning capability, robustness, safety, and explainability.

Chentao Cao

Chentao Cao is currently a Ph.D. student in the Trustworthy Machine Learning and Reasoning (TMLR) Group at Hong Kong Baptist University, under the supervision of Prof. Bo Han, and collaborating closely with Prof. Zhun Zhong. His research primarily centers on developing trustworthy machine reasoning frameworks with foundation models, including large language models (LLMs) and vision-language models (VLMs). His goal is to create robust and reliable reasoning models capable of addressing complex problems, such as mathematics. By enhancing the trustworthiness of foundation models, he seeks to drive advancements in critical downstream applications, particularly in healthcare and safety domains, thereby enabling more effective and safer solutions in real-world scenarios.

Jiangchao Yao

Jiangchao Yao is currently an Associate Professor at Cooperative Medianet Innovation Center, Shanghai Jiao Tong University and a research scientist in Shanghai AI Laboratory. Before taking the faculty job, he was an algorithm expert in Data Analytics and Intelligence Lab, DAMO Academy, Alibaba Group, and received the dual Ph.D. degree in Shanghai Jiao Tong University and University of Technology Sydney in 2019. His research mainly focuses on trustworthy machine learning and reasoning with the applications towards AI4Science. He has more than 100 publications in top-tier conferences and journals (e.g., ICML, NeurIPS, ICLR and TPAMI), and one monograph about trustworthy machine learning. He is area chair of ICML, NeurIPS and ICLR, and action editor of Transactions on Machine Learning Research and the journal Neural Networks. He has been selected as an MSRA StarTrack Scholar in 2025.

Bo Han

Bo Han is currently an Associate Professor in Machine Learning and the Director of the Trustworthy Machine Learning and Reasoning Group at Hong Kong Baptist University, and a BAIHO Visiting Scientist of the Imperfect Information Learning Team at the RIKEN Center for Advanced Intelligence Project (RIKEN AIP). His research focuses on trustworthy machine learning. He has received multiple paper awards, including the Outstanding Paper Award at NeurIPS, the Most Influential Paper Award at NeurIPS, and the Outstanding Student Paper Award at a NeurIPS Workshop. He is also a recipient of the RGC Early CAREER Scheme, IEEE AI's 10 to Watch Award, IJCAI Early Career Spotlight, INNS Aharon Katzir Young Investigator Award, RIKEN BAIHO Award, Dean's Award for Outstanding Achievement, and the Microsoft Research StarTrack Scholars Program.

Related Tutorials