Prompt-Engineering-Guide/README.md

# Prompt Engineering Guide

This guide contains a non-exhaustive set of learning guides and tools about prompt engineering. It includes several materials, guides, examples, papers, examples, and much more. The repo is intented to be used a research and educational reference for practitioners and developers.

Table of Contents

- [Papers](#papers)
- [Tools & Libraries](#tools--libraries)
- [Datasets](#datasets)
- [Blog, Guides, Tutorials and Other Readings](#blog-guides-tutorials-and-other-readings)

## Papers

- Surveys:
  - [Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing](https://arxiv.org/abs/2107.13586) 
  - [A Taxonomy of Prompt Modifiers for Text-To-Image Generation](https://arxiv.org/abs/2204.13988)
- Applications:
  - [Legal Prompt Engineering for Multilingual Legal Judgement Prediction](https://arxiv.org/abs/2212.02199)
  - [Investigating Prompt Engineering in Diffusion Models](https://arxiv.org/abs/2211.15462)
  - [Conversing with Copilot: Exploring Prompt Engineering for Solving CS1 Problems Using Natural Language](https://arxiv.org/abs/2210.15157)
  - [Piloting Copilot and Codex: Hot Temperature, Cold Prompts, or Black Magic?](https://arxiv.org/abs/2210.14699)
- Approaches/Techniques:
  - [Ask Me Anything: A simple strategy for prompting language models](https://paperswithcode.com/paper/ask-me-anything-a-simple-strategy-for)
  - [Large Language Models Are Human-Level Prompt Engineers](https://sites.google.com/view/automatic-prompt-engineer?pli=1)
  - [Promptagator: Few-shot Dense Retrieval From 8 Examples](https://arxiv.org/abs/2209.11755)
  - [Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm](https://www.arxiv-vanity.com/papers/2102.07350/)
- Collections:
  - [Papers with Code](https://paperswithcode.com/task/prompt-engineering)
  - [Prompt Papers](https://github.com/thunlp/PromptPapers#papers)


## Tools & Libraries

- [OpenAI Playground](https://beta.openai.com/playground)
- [GPTTools](https://gpttools.com/comparisontool)
- [Lexica](https://lexica.art/)
- [Playground](https://playgroundai.com/)
- [OpenPrompt](https://github.com/thunlp/OpenPrompt)
- [Visual Prompt Builder](https://tools.saxifrage.xyz/prompt)
- [Prompt Generator for OpenAI's DALL-E 2](http://dalle2-prompt-generator.s3-website-us-west-2.amazonaws.com/)
- [AI Test Kitchen](https://aitestkitchen.withgoogle.com/)
- [Prompt Engine](https://github.com/microsoft/prompt-engine)
- [PromptSource](https://github.com/bigscience-workshop/promptsource)

## Datasets
- [PartiPrompts](https://parti.research.google/)
- [Real Toxicity Prompts](https://allenai.org/data/real-toxicity-prompts)
- [P3 - Public Pool of Prompts](https://huggingface.co/datasets/bigscience/P3)
- [WritingPrompts](WritingPrompts)
- [Midjourney Prompts](https://huggingface.co/datasets/succinctly/midjourney-prompts)
- [Awesome ChatGPT Prompts](https://huggingface.co/datasets/fka/awesome-chatgpt-prompts)
- [Stable Diffusion Dataset](https://huggingface.co/datasets/Gustavosta/Stable-Diffusion-Prompts)

## Blog, Guides, Tutorials and Other Readings
- [Prompt Engineering by co:here](https://docs.cohere.ai/docs/prompt-engineering)
- [Prompt Engineering by Microsoft](https://microsoft.github.io/prompt-engineering/)
- [Start with an Instruction](https://beta.openai.com/docs/quickstart/start-with-an-instruction)
- [DALLE Prompt Book](https://dallery.gallery/the-dalle-2-prompt-book/)
- [DALL·E 2 Prompt Engineering Guide](https://docs.google.com/document/d/11WlzjBT0xRpQhP9tFMtxzd0q6ANIdHPUBkMV-YB043U/edit#)
- [Language Models and Prompt Engineering: Systematic Survey of Prompting Methods in NLP](https://youtube.com/watch?v=OsbUfL8w-mo&feature=shares)
- [Learn Prompting](https://learnprompting.org/)
- [Prompt Engineering Topic by GitHub](https://github.com/topics/prompt-engineering)
- [Prompt Engineering Template](https://docs.google.com/spreadsheets/d/1-snKDn38-KypoYCk9XLPg799bHcNFSBAVu2HVvFEAkA/edit#gid=0)
- [Awesome ChatGPT Prompts](https://github.com/f/awesome-chatgpt-prompts)
- [Prompt Engineering: From Words to Art](https://www.saxifrage.xyz/post/prompt-engineering)
- [NLP for Text-to-Image Generators: Prompt Analysis](https://heartbeat.comet.ml/nlp-for-text-to-image-generators-prompt-analysis-part-1-5076a44d8365)
- [A beginner-friendly guide to generative language models - LaMBDA guide](https://aitestkitchen.withgoogle.com/how-lamda-works)
- [Giving GPT-3 a Turing Test](https://lacker.io/ai/2020/07/06/giving-gpt-3-a-turing-test.html)
- [Prompts as Programming by Gwern](https://www.gwern.net/GPT-3#prompts-as-programming)
- [AI Content Generation](https://www.jonstokes.com/p/ai-content-generation-part-1-machine)
- [How to Draw Anything](https://andys.page/posts/how-to-draw/)
- [How to write good prompts](https://andymatuschak.org/prompts/)
- [Prompting Methods with Language Models and Their Applications to Weak Supervision](https://snorkel.ai/prompting-methods-with-language-models-nlp/)
- [How to get images that don't suck](https://www.reddit.com/r/StableDiffusion/comments/x41n87/how_to_get_images_that_dont_suck_a/)
- [Best 100+ Stable Diffusion Prompts](https://mpost.io/best-100-stable-diffusion-prompts-the-most-beautiful-ai-text-to-image-prompts/)
- [Notes for Prompt Engineering by sw-yx](https://github.com/sw-yx/ai-notes)

# Lecture
Full tutorial and lecture coming soon!

---
Feel free to open a PR if you think something is missing here. Always welcome feedback and suggestions.
Update README.md 2022-12-17 00:07:07 +08:00			`# Prompt Engineering Guide`
Create README.md 2022-12-17 00:05:47 +08:00
Update README.md 2022-12-17 23:48:02 +08:00			`This guide contains a non-exhaustive set of learning guides and tools about prompt engineering. It includes several materials, guides, examples, papers, examples, and much more. The repo is intented to be used a research and educational reference for practitioners and developers.`
Update README.md 2022-12-17 00:07:07 +08:00
Update README.md 2022-12-17 23:55:13 +08:00			`Table of Contents`

			`- [Papers](#papers)`
			`- [Tools & Libraries](#tools--libraries)`
			`- [Datasets](#datasets)`
			`- [Blog, Guides, Tutorials and Other Readings](#blog-guides-tutorials-and-other-readings)`

Update README.md 2022-12-17 00:07:16 +08:00			`## Papers`
Update README.md 2022-12-17 00:07:07 +08:00
Update README.md 2022-12-17 06:23:01 +08:00			`- Surveys:`
			`- [Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing](https://arxiv.org/abs/2107.13586)`
			`- [A Taxonomy of Prompt Modifiers for Text-To-Image Generation](https://arxiv.org/abs/2204.13988)`
			`- Applications:`
			`- [Legal Prompt Engineering for Multilingual Legal Judgement Prediction](https://arxiv.org/abs/2212.02199)`
			`- [Investigating Prompt Engineering in Diffusion Models](https://arxiv.org/abs/2211.15462)`
			`- [Conversing with Copilot: Exploring Prompt Engineering for Solving CS1 Problems Using Natural Language](https://arxiv.org/abs/2210.15157)`
			`- [Piloting Copilot and Codex: Hot Temperature, Cold Prompts, or Black Magic?](https://arxiv.org/abs/2210.14699)`
			`- Approaches/Techniques:`
Update README.md 2022-12-17 23:48:02 +08:00			`- [Ask Me Anything: A simple strategy for prompting language models](https://paperswithcode.com/paper/ask-me-anything-a-simple-strategy-for)`
Update README.md 2022-12-17 06:23:01 +08:00			`- [Large Language Models Are Human-Level Prompt Engineers](https://sites.google.com/view/automatic-prompt-engineer?pli=1)`
			`- [Promptagator: Few-shot Dense Retrieval From 8 Examples](https://arxiv.org/abs/2209.11755)`
Update README.md 2022-12-17 23:48:02 +08:00			`- [Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm](https://www.arxiv-vanity.com/papers/2102.07350/)`
			`- Collections:`
			`- [Papers with Code](https://paperswithcode.com/task/prompt-engineering)`
			`- [Prompt Papers](https://github.com/thunlp/PromptPapers#papers)`
Update README.md 2022-12-17 06:23:01 +08:00
Update README.md 2022-12-17 00:07:38 +08:00
Update README.md 2022-12-17 23:48:02 +08:00			`## Tools & Libraries`
Update README.md 2022-12-17 04:22:23 +08:00
Update README.md 2022-12-17 04:35:27 +08:00			`- [OpenAI Playground](https://beta.openai.com/playground)`
			`- [GPTTools](https://gpttools.com/comparisontool)`
			`- [Lexica](https://lexica.art/)`
			`- [Playground](https://playgroundai.com/)`
Update README.md 2022-12-17 23:48:02 +08:00			`- [OpenPrompt](https://github.com/thunlp/OpenPrompt)`
Update README.md 2022-12-17 04:35:27 +08:00			`- [Visual Prompt Builder](https://tools.saxifrage.xyz/prompt)`
			`- [Prompt Generator for OpenAI's DALL-E 2](http://dalle2-prompt-generator.s3-website-us-west-2.amazonaws.com/)`
			`- [AI Test Kitchen](https://aitestkitchen.withgoogle.com/)`
			`- [Prompt Engine](https://github.com/microsoft/prompt-engine)`
Update README.md 2022-12-17 23:48:02 +08:00			`- [PromptSource](https://github.com/bigscience-workshop/promptsource)`
Update README.md 2022-12-17 04:22:23 +08:00
Update README.md 2022-12-17 04:35:27 +08:00			`## Datasets`
			`- [PartiPrompts](https://parti.research.google/)`
			`- [Real Toxicity Prompts](https://allenai.org/data/real-toxicity-prompts)`
Update README.md 2022-12-17 04:56:04 +08:00			`- [P3 - Public Pool of Prompts](https://huggingface.co/datasets/bigscience/P3)`
Update README.md 2022-12-17 04:49:57 +08:00			`- [WritingPrompts](WritingPrompts)`
Update README.md 2022-12-17 04:54:42 +08:00			`- [Midjourney Prompts](https://huggingface.co/datasets/succinctly/midjourney-prompts)`
Update README.md 2022-12-17 05:00:33 +08:00			`- [Awesome ChatGPT Prompts](https://huggingface.co/datasets/fka/awesome-chatgpt-prompts)`
			`- [Stable Diffusion Dataset](https://huggingface.co/datasets/Gustavosta/Stable-Diffusion-Prompts)`
Update README.md 2022-12-17 01:38:17 +08:00
Update README.md 2022-12-17 04:54:42 +08:00			`## Blog, Guides, Tutorials and Other Readings`
Update README.md 2022-12-17 01:43:59 +08:00			`- [Prompt Engineering by co:here](https://docs.cohere.ai/docs/prompt-engineering)`
Update README.md 2022-12-17 02:03:44 +08:00			`- [Prompt Engineering by Microsoft](https://microsoft.github.io/prompt-engineering/)`
Update README.md 2022-12-17 04:22:23 +08:00			`- [Start with an Instruction](https://beta.openai.com/docs/quickstart/start-with-an-instruction)`
Update README.md 2022-12-17 01:46:50 +08:00			`- [DALLE Prompt Book](https://dallery.gallery/the-dalle-2-prompt-book/)`
Update README.md 2022-12-17 01:53:36 +08:00			`- [DALL·E 2 Prompt Engineering Guide](https://docs.google.com/document/d/11WlzjBT0xRpQhP9tFMtxzd0q6ANIdHPUBkMV-YB043U/edit#)`
Update README.md 2022-12-17 23:48:02 +08:00			`- [Language Models and Prompt Engineering: Systematic Survey of Prompting Methods in NLP](https://youtube.com/watch?v=OsbUfL8w-mo&feature=shares)`
Update README.md 2022-12-17 03:56:47 +08:00			`- [Learn Prompting](https://learnprompting.org/)`
Update README.md 2022-12-17 02:22:49 +08:00			`- [Prompt Engineering Topic by GitHub](https://github.com/topics/prompt-engineering)`
Update README.md 2022-12-17 01:53:36 +08:00			`- [Prompt Engineering Template](https://docs.google.com/spreadsheets/d/1-snKDn38-KypoYCk9XLPg799bHcNFSBAVu2HVvFEAkA/edit#gid=0)`
Update README.md 2022-12-17 02:21:32 +08:00			`- [Awesome ChatGPT Prompts](https://github.com/f/awesome-chatgpt-prompts)`
Update README.md 2022-12-17 01:58:20 +08:00			`- [Prompt Engineering: From Words to Art](https://www.saxifrage.xyz/post/prompt-engineering)`
Update README.md 2022-12-17 04:54:42 +08:00			`- [NLP for Text-to-Image Generators: Prompt Analysis](https://heartbeat.comet.ml/nlp-for-text-to-image-generators-prompt-analysis-part-1-5076a44d8365)`
Update README.md 2022-12-17 03:48:23 +08:00			`- [A beginner-friendly guide to generative language models - LaMBDA guide](https://aitestkitchen.withgoogle.com/how-lamda-works)`
			`- [Giving GPT-3 a Turing Test](https://lacker.io/ai/2020/07/06/giving-gpt-3-a-turing-test.html)`
Update README.md 2022-12-17 04:22:23 +08:00			`- [Prompts as Programming by Gwern](https://www.gwern.net/GPT-3#prompts-as-programming)`
			`- [AI Content Generation](https://www.jonstokes.com/p/ai-content-generation-part-1-machine)`
			`- [How to Draw Anything](https://andys.page/posts/how-to-draw/)`
			`- [How to write good prompts](https://andymatuschak.org/prompts/)`
Update README.md 2022-12-17 04:49:57 +08:00			`- [Prompting Methods with Language Models and Their Applications to Weak Supervision](https://snorkel.ai/prompting-methods-with-language-models-nlp/)`
Update README.md 2022-12-17 04:22:23 +08:00			`- [How to get images that don't suck](https://www.reddit.com/r/StableDiffusion/comments/x41n87/how_to_get_images_that_dont_suck_a/)`
			`- [Best 100+ Stable Diffusion Prompts](https://mpost.io/best-100-stable-diffusion-prompts-the-most-beautiful-ai-text-to-image-prompts/)`
			`- [Notes for Prompt Engineering by sw-yx](https://github.com/sw-yx/ai-notes)`
Update README.md 2022-12-18 00:09:53 +08:00
			`# Lecture`
			`Full tutorial and lecture coming soon!`

			`---`
			`Feel free to open a PR if you think something is missing here. Always welcome feedback and suggestions.`