Least-to-Most Prompting

This method improves on Chain-of-Thought prompting by first splitting a problem into smaller subproblems, then solving them in order from easiest to hardest. Unlike Chain-of-Thought, where steps are separate, here each solution feeds into the next prompt.

It works in two stages:

• Decomposition: The AI lists simpler subproblems, guided by examples.
• Solving: It tackles them sequentially, adding prior answers to help with the next.

Inspired by teaching kids step-by-step, it helps AI handle reasoning tasks like math or logic better than standard prompts.

It boosts AI accuracy on hard problems, like achieving 99.7% on SCAN benchmarks versus 6% with standard prompts, by enabling step-by-step reasoning without extra training.  This helps non-experts solve tough tasks reliably, improves generalization to new challenges, and makes AI more practical for real-world use like support bots or math problems.

Start by prompting the AI to break your problem into subproblems, using a few examples like: "Break this into steps: [problem]." Then, solve the first subproblem. For the next prompt, include the problem, prior subproblems, their solutions, and the new one: "Using these: [previous], solve: [next subproblem]."

Repeat until the original problem is solved. Combine with few-shot examples for best results. It's great for complex tasks like customer support queries or code challenges, where steps build logically. [Check each step for accuracy before proceeding.

‍

Problem: "A bat and ball cost $1.10 total. The bat costs $1 more than the ball. How much is the ball?"

Decomposition prompt: "Break into subproblems: [full problem]."
AI: Subquestion 1: How much more does the bat cost than the ball? ($1)
Subquestion 2: If the ball costs X, what is the bat's cost? (X + $1)
Subquestion 3: What is the total? Solve for X.

Solving prompts:

1. Solve subquestion 1: $1.
2. "Using: Bat = ball + $1. Solve subquestion 2 if ball = X." AI: Bat = X + $1.
3. "Using prior: Total = X + (X + 1) = 1.10. Solve." AI: 2X + 1 = 1.10 → X = $0.05. Ball costs $0.05.

‍