Divide-or-Conquer? Which Part Should You Distill Your LLM? Apple Machine Learning Research
Recent methods have demonstrated that Large Language Models (LLMs) can solve reasoning tasks better when they are encouraged to solve subtasks of the main task first. In this paper we devise a similar strategy that breaks down reasoning tasks into a problem decomposition phase and… Read More »Divide-or-Conquer? Which Part Should You Distill Your LLM? Apple Machine Learning Research