References

References

本文为论文《Search-o1：让推理模型学会边思考边检索》「论文原文」板块的对应章节，按 arXiv 官方全文逐字保留，层级与「中文全文翻译」板块一一对应。

Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.

Self-rag: Learning to retrieve, generate, and critique through self-reflection.

arXiv preprint arXiv:2310.11511, 2023.

Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei.

Language models are few-shot learners.

In Hugo Larochelle, Marc’Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, and Hsuan-Tien Lin, editors, Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual, 2020.

Junying Chen, Zhenyang Cai, Ke Ji, Xidong Wang, Wanlong Liu, Rongsheng Wang, Jianye Hou, and Benyou Wang.

Huatuogpt-o1, towards medical complex reasoning with llms.

arXiv preprint arXiv:2412.18925, 2024.

Xingyu Chen, Jiahao Xu, Tian Liang, Zhiwei He, Jianhui Pang, Dian Yu, Linfeng Song, Qiuzhi Liu, Mengfei Zhou, Zhuosheng Zhang, Rui Wang, Zhaopeng Tu, Haitao Mi, and Dong Yu.

Do not think that much for 2+3=? on the overthinking of o1-like llms, 2024.

Zehui Chen, Kuikun Liu, Qiuchen Wang, Jiangning Liu, Wenwei Zhang, Kai Chen, and Feng Zhao.

Mindsearch: Mimicking human minds elicits deep ai searcher.

arXiv preprint arXiv:2407.20183, 2024.

Kahneman Daniel.

Thinking, fast and slow.

2017.

DeepSeek-AI.

Deepseek-r1-lite-preview is now live: unleashing supercharged reasoning power!, November 2024.

Guanting Dong, Keming Lu, Chengpeng Li, Tingyu Xia, Bowen Yu, Chang Zhou, and Jingren Zhou.

Self-play with execution feedback: Improving instruction-following capabilities of large language models.

CoRR, abs/2406.13542, 2024.

Guanting Dong, Xiaoshuai Song, Yutao Zhu, Runqi Qiao, Zhicheng Dou, and Ji-Rong Wen.

Toward general instruction-following alignment for retrieval-augmented generation.

CoRR, abs/2410.09584, 2024.

[10]

Guanting Dong, Hongyi Yuan, Keming Lu, Chengpeng Li, Mingfeng Xue, Dayiheng Liu, Wei Wang, Zheng Yuan, Chang Zhou, and Jingren Zhou.

How abilities in large language models are affected by supervised fine-tuning data composition.

In Lun-Wei Ku, Andre Martins, and Vivek Srikumar, editors, Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2024, Bangkok, Thailand, August 11-16, 2024, pages 177–198. Association for Computational Linguistics, 2024.

[11]

Guanting Dong, Chenghao Zhang, Mengjie Deng, Yutao Zhu, Zhicheng Dou, and Ji-Rong Wen.

Progressive multimodal reasoning via active retrieval.

arXiv preprint arXiv:2412.14835, 2024.

[12]

Guanting Dong, Yutao Zhu, Chenghao Zhang, Zechen Wang, Zhicheng Dou, and Ji-Rong Wen.

Understand what LLM needs: Dual preference alignment for retrieval-augmented generation.

CoRR, abs/2406.18676, 2024.

[13]

Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, et al.

The llama 3 herd of models.

arXiv preprint arXiv:2407.21783, 2024.

[14]

Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, and Jonathan Larson.

From local to global: A graph rag approach to query-focused summarization, 2024.

[15]

Guhao Feng, Bohang Zhang, Yuntian Gu, Haotian Ye, Di He, and Liwei Wang.

Towards revealing the mystery behind chain of thought: a theoretical perspective.

Advances in Neural Information Processing Systems, 36, 2024.

[16]

Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt.

Measuring mathematical problem solving with the MATH dataset.

In Joaquin Vanschoren and Sai-Kit Yeung, editors, Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, NeurIPS Datasets and Benchmarks 2021, December 2021, virtual, 2021.

[17]

Tom Henighan, Jared Kaplan, Mor Katz, Mark Chen, Christopher Hesse, Jacob Jackson, Heewoo Jun, Tom B Brown, Prafulla Dhariwal, Scott Gray, et al.

Scaling laws for autoregressive generative modeling.

arXiv preprint arXiv:2010.14701, 2020.

[18]

Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, and Akiko Aizawa.

Constructing A multi-hop QA dataset for comprehensive evaluation of reasoning steps.

In Donia Scott, Núria Bel, and Chengqing Zong, editors, Proceedings of the 28th International Conference on Computational Linguistics, COLING 2020, Barcelona, Spain (Online), December 8-13, 2020, pages 6609–6625. International Committee on Computational Linguistics, 2020.

[19]

Zhen Huang, Haoyang Zou, Xuefeng Li, Yixiu Liu, Yuxiang Zheng, Ethan Chern, Shijie Xia, Yiwei Qin, Weizhe Yuan, and Pengfei Liu.

O1 replication journey–part 2: Surpassing o1-preview through simple distillation, big progress or bitter lesson?

arXiv preprint arXiv:2411.16489, 2024.

[20]

Binyuan Hui, Jian Yang, Zeyu Cui, Jiaxi Yang, Dayiheng Liu, Lei Zhang, Tianyu Liu, Jiajun Zhang, Bowen Yu, Kai Dang, An Yang, Rui Men, Fei Huang, Xingzhang Ren, Xuancheng Ren, Jingren Zhou, and Junyang Lin.

Qwen2.5-coder technical report.

CoRR, abs/2409.12186, 2024.

[21]

Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, et al.

Gpt-4o system card.

arXiv preprint arXiv:2410.21276, 2024.

[22]

Aaron Jaech, Adam Kalai, Adam Lerer, Adam Richardson, Ahmed El-Kishky, Aiden Low, Alec Helyar, Aleksander Madry, Alex Beutel, Alex Carney, et al.

Openai o1 system card.

arXiv preprint arXiv:2412.16720, 2024.

[23]

Naman Jain, King Han, Alex Gu, Wen-Ding Li, Fanjia Yan, Tianjun Zhang, Sida Wang, Armando Solar-Lezama, Koushik Sen, and Ion Stoica.

Livecodebench: Holistic and contamination free evaluation of large language models for code.

CoRR, abs/2403.07974, 2024.

[24]

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, and Lili Qiu.

Longllmlingua: Accelerating and enhancing llms in long context scenarios via prompt compression.

arXiv preprint arXiv:2310.06839, 2023.

[25]

Jinhao Jiang, Zhipeng Chen, Yingqian Min, Jie Chen, Xiaoxue Cheng, Jiapeng Wang, Yiru Tang, Haoxiang Sun, Jia Deng, Wayne Xin Zhao, et al.

Technical report: Enhancing llm reasoning with reward-guided tree search.

arXiv preprint arXiv:2411.11694, 2024.

[26]

Bowen Jin, Jinsung Yoon, Jiawei Han, and Sercan Ö. Arik.

Long-context llms meet RAG: overcoming challenges for long inputs in RAG.

CoRR, abs/2410.05983, 2024.

[27]

Jiajie Jin, Yutao Zhu, Yujia Zhou, and Zhicheng Dou.

Bider: Bridging knowledge inconsistency for efficient retrieval-augmented llms via key supporting evidence.

arXiv preprint arXiv:2402.12174, 2024.

[28]

Mandar Joshi, Eunsol Choi, Daniel Weld, and Luke Zettlemoyer.

TriviaQA: A large scale distantly supervised challenge dataset for reading comprehension.

In ACL, pages 1601–1611, Vancouver, Canada, July 2017. Association for Computational Linguistics.

[29]

Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, et al.

Natural questions: a benchmark for question answering research.

Transactions of the Association for Computational Linguistics, 7:453–466, 2019.

[30]

Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al.

Retrieval-augmented generation for knowledge-intensive nlp tasks.

Advances in Neural Information Processing Systems, 33:9459–9474, 2020.

[31]

Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay V. Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, Yuhuai Wu, Behnam Neyshabur, Guy Gur-Ari, and Vedant Misra.

Solving quantitative reasoning problems with language models.

In Sanmi Koyejo, S. Mohamed, A. Agarwal, Danielle Belgrave, K. Cho, and A. Oh, editors, Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 - December 9, 2022, 2022.

[32]

Chengpeng Li, Guanting Dong, Mingfeng Xue, Ru Peng, Xiang Wang, and Dayiheng Liu.

Dotamath: Decomposition of thought with code assistance and self-correction for mathematical reasoning.

CoRR, abs/2407.04078, 2024.

[33]

Xiaoxi Li, Zhicheng Dou, Yujia Zhou, and Fangchao Liu.

Corpuslm: Towards a unified language model on corpus for knowledge-intensive tasks.

In Grace Hui Yang, Hongning Wang, Sam Han, Claudia Hauff, Guido Zuccon, and Yi Zhang, editors, Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2024, Washington DC, USA, July 14-18, 2024, pages 26–37. ACM, 2024.

[34]

Xiaoxi Li, Jiajie Jin, Yujia Zhou, Yongkang Wu, Zhonghua Li, Qi Ye, and Zhicheng Dou.

Retrollm: Empowering large language models to retrieve fine-grained evidence within generation.

arXiv preprint arXiv:2412.11919, 2024.

[35]

Xiaoxi Li, Jiajie Jin, Yujia Zhou, Yuyao Zhang, Peitian Zhang, Yutao Zhu, and Zhicheng Dou.

From matching to generation: A survey on generative information retrieval.

CoRR, abs/2404.14851, 2024.

[36]

Xiaoxi Li, Yujia Zhou, and Zhicheng Dou.

Unigen: A unified generative framework for retrieval and question answering with large language models.

In Michael J. Wooldridge, Jennifer G. Dy, and Sriraam Natarajan, editors, Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada, pages 8688–8696. AAAI Press, 2024.

[37]

Lei Liang, Mengshu Sun, Zhengke Gui, Zhongshu Zhu, Zhouyu Jiang, Ling Zhong, Yuan Qu, Peilong Zhao, Zhongpu Bo, Jin Yang, Huaidong Xiong, Lin Yuan, Jun Xu, Zaoyang Wang, Zhiqiang Zhang, Wen Zhang, Huajun Chen, Wenguang Chen, and Jun Zhou.

Kag: Boosting llms in professional domains via knowledge augmented generation, 2024.

[38]

Hunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe.

Let’s verify step by step.

In The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net, 2024.

[39]

Bill Yuchen Lin, Abhilasha Ravichander, Ximing Lu, Nouha Dziri, Melanie Sclar, Khyathi Raghavi Chandu, Chandra Bhagavatula, and Yejin Choi.

The unlocking spell on base llms: Rethinking alignment via in-context learning.

In The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net, 2024.

[40]

Zhan Ling, Yunhao Fang, Xuanlin Li, Zhiao Huang, Mingu Lee, Roland Memisevic, and Hao Su.

Deductive verification of chain-of-thought reasoning.

In Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, and Sergey Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023, 2023.

[41]

Jingyu Liu, Jiaen Lin, and Yong Liu.

How much can RAG help the reasoning of llm?

CoRR, abs/2410.02338, 2024.

[42]

Jingyu Liu, Jiaen Lin, and Yong Liu.

How much can RAG help the reasoning of llm?

CoRR, abs/2410.02338, 2024.

[43]

Xinbei Ma, Yeyun Gong, Pengcheng He, Hai Zhao, and Nan Duan.

Query rewriting for retrieval-augmented large language models.

arXiv preprint arXiv:2305.14283, 2023.

[44]

Ning Miao, Yee Whye Teh, and Tom Rainforth.

Selfcheck: Using llms to zero-shot check their own step-by-step reasoning.

In The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net, 2024.

[45]

Yingqian Min, Zhipeng Chen, Jinhao Jiang, Jie Chen, Jia Deng, Yiwen Hu, Yiru Tang, Jiapeng Wang, Xiaoxue Cheng, Huatong Song, et al.

Imitate, explore, and self-improve: A reproduction report on slow-thinking reasoning systems.

arXiv preprint arXiv:2412.09413, 2024.

[46]

OpenAI.

Learning to reason with llms, 2024.

[47]

Ofir Press, Muru Zhang, Sewon Min, Ludwig Schmidt, Noah A. Smith, and Mike Lewis.

Measuring and narrowing the compositionality gap in language models.

In Houda Bouamor, Juan Pino, and Kalika Bali, editors, Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023, pages 5687–5711. Association for Computational Linguistics, 2023.

[48]

Runqi Qiao, Qiuna Tan, Guanting Dong, Minhui Wu, Chong Sun, Xiaoshuai Song, Zhuoma Gongque, Shanglin Lei, Zhe Wei, Miaoxuan Zhang, Runfeng Qiao, Yifan Zhang, Xiao Zong, Yida Xu, Muxi Diao, Zhimin Bao, Chen Li, and Honggang Zhang.

We-math: Does your large multimodal model achieve human-like mathematical reasoning?

CoRR, abs/2407.01284, 2024.

[49]

Yiwei Qin, Xuefeng Li, Haoyang Zou, Yixiu Liu, Shijie Xia, Zhen Huang, Yixin Ye, Weizhe Yuan, Hector Liu, Yuanzhi Li, et al.

O1 replication journey: A strategic progress report–part 1.

arXiv preprint arXiv:2410.18982, 2024.

[50]

Qwen, :, An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, Huan Lin, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jingren Zhou, Junyang Lin, Kai Dang, Keming Lu, Keqin Bao, Kexin Yang, Le Yu, Mei Li, Mingfeng Xue, Pei Zhang, Qin Zhu, Rui Men, Runji Lin, Tianhao Li, Tingyu Xia, Xingzhang Ren, Xuancheng Ren, Yang Fan, Yang Su, Yichang Zhang, Yu Wan, Yuqiong Liu, Zeyu Cui, Zhenru Zhang, and Zihan Qiu.

Qwen2.5 technical report, 2024.

[51]

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu.

Exploring the limits of transfer learning with a unified text-to-text transformer.

J. Mach. Learn. Res., 21:140:1–140:67, 2020.

[52]

David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R. Bowman.

GPQA: A graduate-level google-proof q&a benchmark.

CoRR, abs/2311.12022, 2023.

[53]

Jiejun Tan, Zhicheng Dou, Yutao Zhu, Peidong Guo, Kun Fang, and Ji-Rong Wen.

Small models, big insights: Leveraging slim proxy models to decide when and what to retrieve for llms.

arXiv preprint arXiv:2402.12052, 2024.

[54]

Qwen Team.

Qwq: Reflect deeply on the boundaries of the unknown, November 2024.

[55]

Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, and Ashish Sabharwal.

♫ musique: Multihop questions via single-hop question composition.

Transactions of the Association for Computational Linguistics, 10:539–554, 2022.

[56]

Prakhar Verma, Sukruta Prakash Midigeshi, Gaurav Sinha, Arno Solin, Nagarajan Natarajan, and Amit Sharma.

Planxrag: Planning-guided retrieval augmented generation.

arXiv preprint arXiv:2410.20753, 2024.

[57]

Jiaan Wang, Fandong Meng, Yunlong Liang, and Jie Zhou.

Drt-o1: Optimized deep reasoning translation via long chain-of-thought.

arXiv preprint arXiv:2412.17498, 2024.

[58]

Liang Wang, Nan Yang, and Furu Wei.

Query2doc: Query expansion with large language models.

arXiv preprint arXiv:2303.07678, 2023.

[59]

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al.

Chain-of-thought prompting elicits reasoning in large language models.

Advances in neural information processing systems, 35:24824–24837, 2022.

[60]

Ken C. L. Wong, Hongzhi Wang, Etienne E. Vos, Bianca Zadrozny, Campbell D. Watson, and Tanveer F. Syeda-Mahmood.

Addressing deep learning model uncertainty in long-range climate forecasting with late fusion.

CoRR, abs/2112.05254, 2021.

[61]

Siwei Wu, Zhongyuan Peng, Xinrun Du, Tuney Zheng, Minghao Liu, Jialong Wu, Jiachen Ma, Yizhi Li, Jian Yang, Wangchunshu Zhou, Qunshu Lin, Junbo Zhao, Zhaoxiang Zhang, Wenhao Huang, Ge Zhang, Chenghua Lin, and Jiaheng Liu.

A comparative study on reasoning patterns of openai’s o1 model.

CoRR, abs/2410.13639, 2024.

[62]

Siye Wu, Jian Xie, Jiangjie Chen, Tinghui Zhu, Kai Zhang, and Yanghua Xiao.

How easily do irrelevant inputs skew the responses of large language models?, 2024.

[63]

Shijie Xia, Xuefeng Li, Yixin Liu, Tongshuang Wu, and Pengfei Liu.

Evaluating mathematical reasoning beyond accuracy.

CoRR, abs/2404.05692, 2024.

[64]

Fangyuan Xu, Weijia Shi, and Eunsol Choi.

Recomp: Improving retrieval-augmented lms with compression and selective augmentation.

arXiv preprint arXiv:2310.04408, 2023.

[65]

Guowei Xu, Peng Jin, Li Hao, Yibing Song, Lichao Sun, and Li Yuan.

Llava-o1: Let vision language models reason step-by-step.

arXiv preprint arXiv:2411.10440, 2024.

[66]

An Yang, Baosong Yang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Zhou, Chengpeng Li, Chengyuan Li, Dayiheng Liu, Fei Huang, Guanting Dong, Haoran Wei, Huan Lin, Jialong Tang, Jialin Wang, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Ma, Jianxin Yang, Jin Xu, Jingren Zhou, Jinze Bai, Jinzheng He, Junyang Lin, Kai Dang, Keming Lu, Keqin Chen, Kexin Yang, Mei Li, Mingfeng Xue, Na Ni, Pei Zhang, Peng Wang, Ru Peng, Rui Men, Ruize Gao, Runji Lin, Shijie Wang, Shuai Bai, Sinan Tan, Tianhang Zhu, Tianhao Li, Tianyu Liu, Wenbin Ge, Xiaodong Deng, Xiaohuan Zhou, Xingzhang Ren, Xinyu Zhang, Xipin Wei, Xuancheng Ren, Xuejing Liu, Yang Fan, Yang Yao, Yichang Zhang, Yu Wan, Yunfei Chu, Yuqiong Liu, Zeyu Cui, Zhenru Zhang, Zhifang Guo, and Zhihao Fan.

Qwen2 technical report.

CoRR, abs/2407.10671, 2024.

[67]

An Yang, Beichen Zhang, Binyuan Hui, Bofei Gao, Bowen Yu, Chengpeng Li, Dayiheng Liu, Jianhong Tu, Jingren Zhou, Junyang Lin, Keming Lu, Mingfeng Xue, Runji Lin, Tianyu Liu, Xingzhang Ren, and Zhenru Zhang.

Qwen2.5-math technical report: Toward mathematical expert model via self-improvement.

CoRR, abs/2409.12122, 2024.

[68]

Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William Cohen, Ruslan Salakhutdinov, and Christopher D. Manning.

HotpotQA: A dataset for diverse, explainable multi-hop question answering.

In EMNLP, pages 2369–2380, Brussels, Belgium, October-November 2018. Association for Computational Linguistics.

[69]

Huanjin Yao, Jiaxing Huang, Wenhao Wu, Jingyi Zhang, Yibo Wang, Shunyu Liu, Yingjie Wang, Yuxin Song, Haocheng Feng, Li Shen, et al.

Mulberry: Empowering mllm with o1-like reasoning and reflection via collective monte carlo tree search.

arXiv preprint arXiv:2412.18319, 2024.

[70]

Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao.

React: Synergizing reasoning and acting in language models.

arXiv preprint arXiv:2210.03629, 2022.

[71]

Tian Ye, Zicheng Xu, Yuanzhi Li, and Zeyuan Allen-Zhu.

Physics of language models: Part 2.2, how to learn from mistakes on grade-school math problems.

arXiv preprint arXiv:2408.16293, 2024.

[72]

Ori Yoran, Tomer Wolfson, Ori Ram, and Jonathan Berant.

Making retrieval-augmented language models robust to irrelevant context.

In The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net, 2024.

[73]

Longhui Yu, Weisen Jiang, Han Shi, Jincheng Yu, Zhengying Liu, Yu Zhang, James T. Kwok, Zhenguo Li, Adrian Weller, and Weiyang Liu.

Metamath: Bootstrap your own mathematical questions for large language models.

In The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net, 2024.

[74]

Zheng Yuan, Hongyi Yuan, Chengpeng Li, Guanting Dong, Chuanqi Tan, and Chang Zhou.

Scaling relationship on learning mathematical reasoning with large language models.

CoRR, abs/2308.01825, 2023.

[75]

Eric Zelikman, Georges Harik, Yijia Shao, Varuna Jayasiri, Nick Haber, and Noah D Goodman.

Quiet-star: Language models can teach themselves to think before speaking.

arXiv preprint arXiv:2403.09629, 2024.

[76]

Zhiyuan Zeng, Qinyuan Cheng, Zhangyue Yin, Bo Wang, Shimin Li, Yunhua Zhou, Qipeng Guo, Xuanjing Huang, and Xipeng Qiu.

Scaling of search and learning: A roadmap to reproduce o1 from reinforcement learning perspective.

arXiv preprint arXiv:2412.14135, 2024.

[77]

Di Zhang, Jianbo Wu, Jingdi Lei, Tong Che, Jiatong Li, Tong Xie, Xiaoshui Huang, Shufei Zhang, Marco Pavone, Yuqiang Li, Wanli Ouyang, and Dongzhan Zhou.

Llama-berry: Pairwise optimization for o1-like olympiad-level mathematical reasoning.

CoRR, abs/2410.02884, 2024.

[78]

Jiayi Zhang, Jinyu Xiang, Zhaoyang Yu, Fengwei Teng, Xionghui Chen, Jiaqi Chen, Mingchen Zhuge, Xin Cheng, Sirui Hong, Jinlin Wang, et al.

Aflow: Automating agentic workflow generation.

arXiv preprint arXiv:2410.10762, 2024.

[79]

Yue Zhang, Yafu Li, Leyang Cui, Deng Cai, Lemao Liu, Tingchen Fu, Xinting Huang, Enbo Zhao, Yu Zhang, Yulong Chen, Longyue Wang, Anh Tuan Luu, Wei Bi, Freda Shi, and Shuming Shi.

Siren’s song in the AI ocean: A survey on hallucination in large language models.

CoRR, abs/2309.01219, 2023.

[80]

Yuxiang Zhang, Shangxi Wu, Yuqi Yang, Jiangming Shu, Jinlin Xiao, Chao Kong, and Jitao Sang.

o1-coder: an o1 replication for coding.

CoRR, abs/2412.00154, 2024.

[81]

Yuxiang Zhang, Shangxi Wu, Yuqi Yang, Jiangming Shu, Jinlin Xiao, Chao Kong, and Jitao Sang.

o1-coder: an o1 replication for coding.

arXiv preprint arXiv:2412.00154, 2024.

[82]

Penghao Zhao, Hailin Zhang, Qinhan Yu, Zhengren Wang, Yunteng Geng, Fangcheng Fu, Ling Yang, Wentao Zhang, and Bin Cui.

Retrieval-augmented generation for ai-generated content: A survey.

arXiv preprint arXiv:2402.19473, 2024.

[83]

Chujie Zheng, Zhenru Zhang, Beichen Zhang, Runji Lin, Keming Lu, Bowen Yu, Dayiheng Liu, Jingren Zhou, and Junyang Lin.

Processbench: Identifying process errors in mathematical reasoning.

arXiv preprint arXiv:2412.06559, 2024.

[84]

Tianyang Zhong, Zhengliang Liu, Yi Pan, Yutong Zhang, Yifan Zhou, Shizhe Liang, Zihao Wu, Yanjun Lyu, Peng Shu, Xiaowei Yu, Chao Cao, Hanqi Jiang, Hanxu Chen, Yiwei Li, Junhao Chen, Huawen Hu, Yihen Liu, Huaqin Zhao, Shaochen Xu, Haixing Dai, Lin Zhao, Ruidong Zhang, Wei Zhao, Zhenyuan Yang, Jingyuan Chen, Peilong Wang, Wei Ruan, Hui Wang, Huan Zhao, Jing Zhang, Yiming Ren, Shihuan Qin, Tong Chen, Jiaxi Li, Arif Hassan Zidan, Afrar Jahin, Minheng Chen, Sichen Xia, Jason Holmes, Yan Zhuang, Jiaqi Wang, Bochen Xu, Weiran Xia, Jichao Yu, Kaibo Tang, Yaxuan Yang, Bolun Sun, Tao Yang, Guoyu Lu, Xianqiao Wang, Lilong Chai, He Li, Jin Lu, Lichao Sun, Xin Zhang, Bao Ge, Xintao Hu, Lian Zhang, Hua Zhou, Lu Zhang, Shu Zhang, Ninghao Liu, Bei Jiang, Linglong Kong, Zhen Xiang, Yudan Ren, Jun Liu, Xi Jiang, Yu Bao, Wei Zhang, Xiang Li, Gang Li, Wei Liu, Dinggang Shen, Andrea Sikora, Xiaoming Zhai, Dajiang Zhu, and Tianming Liu.

Evaluation of openai o1: Opportunities and challenges of AGI.

CoRR, abs/2409.18486, 2024.

[85]

Tianyang Zhong, Zhengliang Liu, Yi Pan, Yutong Zhang, Yifan Zhou, Shizhe Liang, Zihao Wu, Yanjun Lyu, Peng Shu, Xiaowei Yu, et al.

Evaluation of openai o1: Opportunities and challenges of agi.

arXiv preprint arXiv:2409.18486, 2024.

[86]

Yujia Zhou, Yan Liu, Xiaoxi Li, Jiajie Jin, Hongjin Qian, Zheng Liu, Chaozhuo Li, Zhicheng Dou, Tsung-Yi Ho, and Philip S. Yu.

Trustworthiness in retrieval-augmented generation systems: A survey.

CoRR, abs/2409.10102, 2024.

[87]

Yujia Zhou, Zheng Liu, and Zhicheng Dou.

Assistrag: Boosting the potential of large language models with an intelligent information assistant.

CoRR, abs/2411.06805, 2024.

[88]

Yujia Zhou, Zheng Liu, Jiajie Jin, Jian-Yun Nie, and Zhicheng Dou.

Metacognitive retrieval-augmented large language models.

In Tat-Seng Chua, Chong-Wah Ngo, Ravi Kumar, Hady W. Lauw, and Roy Ka-Wei Lee, editors, Proceedings of the ACM on Web Conference 2024, WWW 2024, Singapore, May 13-17, 2024, pages 1453–1463. ACM, 2024.