From b7a17eb9736c649b6147acbf403f7a755e332ad7 Mon Sep 17 00:00:00 2001 From: Santiago Lezica Date: Mon, 27 Feb 2023 13:07:34 -0300 Subject: [PATCH] Update prompts-advanced-usage.md It feels like the "let's talk about CoT next" paragraph should be just before the CoT heading. I was (briefly) confused when I came across it. --- guides/prompts-advanced-usage.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/guides/prompts-advanced-usage.md b/guides/prompts-advanced-usage.md index c0d54be..9d94c60 100644 --- a/guides/prompts-advanced-usage.md +++ b/guides/prompts-advanced-usage.md @@ -79,9 +79,6 @@ The answer is True. That didn't work. It seems like basic standard prompting is not enough to get reliable responses for this type of reasoning problem. The example above provides basic information on the task, even with the examples. If you take a closer look at the task, it does involve more reasoning steps. -More recently, chain-of-thought (CoT) prompting has been popularized to address more complex arithmetic, -commonsense, and symbolic reasoning tasks. So let's talk about CoT next and see if we can solve the above task. - Following the findings from [Min et al. (2022)](https://arxiv.org/abs/2202.12837), here a few more tips about demonstrations/exemplars when doing few-shot: - the label space and the distribution of the input text specified by the demonstrations are both key (regardless of whether the labels are correct @@ -124,6 +121,9 @@ There is no consistency in the format above but the model still predicted the co Overall, it seems that providing examples is useful in some places. When zero-shot prompting and few-shot prompting are not sufficient, it might mean that the whatever was learned by the model isn't enough to do well at the task. From here it is recommended to start thinking about fine-tuning your own models. +More recently, chain-of-thought (CoT) prompting has been popularized to address more complex arithmetic, +commonsense, and symbolic reasoning tasks. So let's talk about CoT next and see if we can solve the above task. + --- ## Chain-of-Thought Prompting @@ -399,4 +399,4 @@ This paper touches on an important topic related to prompt engineering which is --- [Previous Section (Basic Prompting)](./prompts-basic-usage.md) -[Next Section (Adversarial Prompting)](./prompt-adversarial.md) \ No newline at end of file +[Next Section (Adversarial Prompting)](./prompt-adversarial.md)