2022-12-16 16:07:07 +00:00
# Prompt Engineering Guide
2022-12-16 16:05:47 +00:00
2023-02-06 18:37:41 +00:00
This guide contains a set of recent papers, learning guides, and tools related to prompt engineering. The repo is intended as a research and educational reference for practitioners and developers.
2022-12-16 16:07:07 +00:00
2023-02-06 18:44:34 +00:00
Announcements:
2023-01-28 20:46:21 +00:00
2023-02-24 19:41:07 +00:00
- 🔥 We reached #1 on Hacker News on 21 Feb 2023
- 🎉 Prompt Engineering Lecture went live [here ](https://youtu.be/dOxUroR57xs )
- 📣 New set of deep tutorials coming soon
[Join our Discord ](https://discord.gg/SKgkVT8BGJ )
[Follow us on Twitter ](https://twitter.com/dair_ai )
2023-02-06 18:44:34 +00:00
---
2023-01-09 00:13:20 +00:00
2023-01-07 00:06:30 +00:00
## Table of Contents
2022-12-17 15:55:13 +00:00
2023-02-20 01:52:00 +00:00
- [Lecture ](#lecture )
2023-02-06 22:30:31 +00:00
- [Guides ](#guides )
2022-12-17 15:55:13 +00:00
- [Papers ](#papers )
- [Tools & Libraries ](#tools--libraries )
- [Datasets ](#datasets )
- [Blog, Guides, Tutorials and Other Readings ](#blog-guides-tutorials-and-other-readings )
2023-02-09 02:46:21 +00:00
---
2023-02-20 01:52:00 +00:00
## Lecture
2023-02-06 18:44:34 +00:00
2023-02-20 01:52:00 +00:00
We have published a 1 hour lecture that provides a comprehensive overview of prompting techniques, applications, and tools.
2023-02-20 22:36:13 +00:00
- [Video Lecture ](https://youtu.be/dOxUroR57xs )
- [Notebook with code ](https://github.com/dair-ai/Prompt-Engineering-Guide/blob/main/notebooks/pe-lecture.ipynb )
2023-02-20 01:52:00 +00:00
- [Slides ](https://github.com/dair-ai/Prompt-Engineering-Guide/blob/main/lecture/Prompt-Engineering-Lecture-Elvis.pdf )
---
## Guides
2023-02-06 22:33:08 +00:00
The following are a set of guides on prompt engineering developed by us. Guides are work in progress.
2023-02-06 22:30:31 +00:00
2023-02-09 03:56:56 +00:00
- [Prompt Engineering - Introduction ](/guides/prompts-intro.md )
2023-02-20 01:52:00 +00:00
- [Prompt Engineering - Basic Prompting ](/guides/prompts-basic-usage.md )
- [Prompt Engineering - Advanced Prompting ](/guides/prompts-advanced-usage.md )
- [Prompt Engineering - Adversarial Prompting ](/guides/prompt-adversarial.md )
2023-02-09 03:56:56 +00:00
- [Prompt Engineering - Miscellaneous Topics ](/guides/prompt-miscellaneous.md )
2023-02-06 22:30:31 +00:00
2023-02-20 01:52:00 +00:00
---
2022-12-16 16:07:16 +00:00
## Papers
2023-02-20 01:52:00 +00:00
The following are the latest papers (sorted by release date) on prompt engineering. We update this on a daily basis and new papers come in. We incorporate summaries of these papers to the guides above every week.
2022-12-16 16:07:07 +00:00
2022-12-17 20:05:44 +00:00
- Surveys / Overviews:
2023-02-03 09:33:41 +00:00
2023-02-17 06:42:29 +00:00
- [Augmented Language Models: a Survey ](https://arxiv.org/abs/2302.07842 ) (Feb 2023)
2023-01-28 20:26:52 +00:00
- [A Survey for In-context Learning ](https://arxiv.org/abs/2301.00234 ) (Dec 2022)
2023-02-03 10:07:27 +00:00
- [Towards Reasoning in Large Language Models: A Survey ](https://arxiv.org/abs/2212.10403 ) (Dec 2022)
2023-01-28 20:26:52 +00:00
- [Emergent Abilities of Large Language Models ](https://arxiv.org/abs/2206.07682 ) (Jun 2022)
- [A Taxonomy of Prompt Modifiers for Text-To-Image Generation ](https://arxiv.org/abs/2204.13988 ) (Apr 2022)
- [Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing ](https://arxiv.org/abs/2107.13586 ) (Jul 2021)
2022-12-16 22:23:01 +00:00
- Approaches/Techniques:
2023-02-15 02:31:11 +00:00
2023-02-24 02:42:09 +00:00
- [Active Prompting with Chain-of-Thought for Large Language Models ](https://arxiv.org/abs/2302.12246 ) (Feb 2023)
- [More than you've asked for: A Comprehensive Analysis of Novel Prompt Injection Threats to Application-Integrated Large Language Models ](https://arxiv.org/abs/2302.12173 ) (Feb 2023)
2023-02-23 02:28:44 +00:00
- [Guiding Large Language Models via Directional Stimulus Prompting ](https://arxiv.org/abs/2302.11520 ) (Feb 2023)
- [How Does In-Context Learning Help Prompt Tuning? ](https://arxiv.org/abs/2302.11521 ) (Feb 2023)
2023-02-21 05:52:12 +00:00
- [Scalable Prompt Generation for Semi-supervised Learning with Language Models ](https://arxiv.org/abs/2302.09236 ) (Feb 2023)
- [Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints ](https://arxiv.org/abs/2302.09185 ) (Feb 2023)
2023-02-17 06:42:29 +00:00
- [À-la-carte Prompt Tuning (APT): Combining Distinct Data Via Composable Prompting ](https://arxiv.org/abs/2302.07994 ) (Feb 2023)
- [GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networks ](https://arxiv.org/abs/2302.08043 ) (Feb 2023)
- [The Capacity for Moral Self-Correction in Large Language Models ](https://arxiv.org/abs/2302.07459 ) (Feb 2023)
2023-02-15 02:31:11 +00:00
- [SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domains ](https://arxiv.org/abs/2302.06868 ) (Feb 2023)
- [Evaluating the Robustness of Discrete Prompts ](https://arxiv.org/abs/2302.05619 ) (Feb 2023)
- [Compositional Exemplars for In-context Learning ](https://arxiv.org/abs/2302.05698 ) (Feb 2023)
2023-02-08 02:37:04 +00:00
- [Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery ](https://arxiv.org/abs/2302.03668 ) (Feb 2023)
2023-02-03 09:33:41 +00:00
- [Multimodal Chain-of-Thought Reasoning in Language Models ](https://arxiv.org/abs/2302.00923 ) (Feb 2023)
- [Large Language Models Can Be Easily Distracted by Irrelevant Context ](https://arxiv.org/abs/2302.00093 ) (Feb 2023)
- [Synthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Models ](https://arxiv.org/abs/2302.00618 ) (Feb 2023)
2023-01-31 15:19:29 +00:00
- [Progressive Prompts: Continual Learning for Language Models ](https://arxiv.org/abs/2301.12314 ) (Jan 2023)
2023-01-28 20:22:44 +00:00
- [Batch Prompting: Efficient Inference with LLM APIs ](https://arxiv.org/abs/2301.08721 ) (Jan 2023)
2023-02-01 07:06:47 +00:00
- [On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning ](https://arxiv.org/abs/2212.08061 ) (Dec 2022)
2023-02-01 08:29:20 +00:00
- [Constitutional AI: Harmlessness from AI Feedback ](https://arxiv.org/abs/2212.08073 ) (Dec 2022)
2023-01-28 20:31:43 +00:00
- [Successive Prompting for Decomposing Complex Questions ](https://arxiv.org/abs/2212.04092 ) (Dec 2022)
2023-02-01 08:29:20 +00:00
- [Discovering Language Model Behaviors with Model-Written Evaluations ](https://arxiv.org/abs/2212.09251 ) (Dec 2022)
2023-01-28 20:31:43 +00:00
- [Structured Prompting: Scaling In-Context Learning to 1,000 Examples ](https://arxiv.org/abs/2212.06713 ) (Dec 2022)
2023-02-01 06:24:22 +00:00
- [PAL: Program-aided Language Models ](https://arxiv.org/abs/2211.10435 ) (Nov 2022)
2023-01-28 20:22:44 +00:00
- [Large Language Models Are Human-Level Prompt Engineers ](https://arxiv.org/abs/2211.01910 ) (Nov 2022)
2023-02-03 07:20:11 +00:00
- [Ignore Previous Prompt: Attack Techniques For Language Models ](https://arxiv.org/abs/2211.09527 ) (Nov 2022)
2023-02-03 06:17:24 +00:00
- [Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methods ](https://arxiv.org/abs/2210.07321 ) (Nov 2022)
2023-01-28 20:31:43 +00:00
- [Teaching Algorithmic Reasoning via In-context Learning ](https://arxiv.org/abs/2211.09066 ) (Nov 2022)
2023-02-01 08:10:34 +00:00
- [Enhancing Self-Consistency and Performance of Pre-Trained Language Models through Natural Language Inference ](https://arxiv.org/abs/2211.11875 ) (Nov 2022)
2023-01-28 20:22:44 +00:00
- [Ask Me Anything: A simple strategy for prompting language models ](https://paperswithcode.com/paper/ask-me-anything-a-simple-strategy-for ) (Oct 2022)
2023-02-01 06:24:42 +00:00
- [ReAct: Synergizing Reasoning and Acting in Language Models ](https://arxiv.org/abs/2210.03629 ) (Oct 2022)
2023-02-01 07:18:36 +00:00
- [Prompting GPT-3 To Be Reliable ](https://arxiv.org/abs/2210.09150 ) (Oct 2022)
2023-01-28 20:22:44 +00:00
- [Decomposed Prompting: A Modular Approach for Solving Complex Tasks ](https://arxiv.org/abs/2210.02406 ) (Oct 2022)
2023-02-04 20:17:16 +00:00
- [Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought ](https://arxiv.org/abs/2210.01240v3 ) (Oct 2022)
2023-02-03 06:17:24 +00:00
- [Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examples ](https://arxiv.org/abs/2209.02128 ) (Sep 2022)
2023-01-28 20:31:43 +00:00
- [Promptagator: Few-shot Dense Retrieval From 8 Examples ](https://arxiv.org/abs/2209.11755 ) (Sep 2022)
2023-02-01 07:53:51 +00:00
- [On the Advance of Making Language Models Better Reasoners ](https://arxiv.org/abs/2206.02336 ) (June 2022)
2023-01-28 20:31:43 +00:00
- [Large Language Models are Zero-Shot Reasoners ](https://arxiv.org/abs/2205.11916 ) (May 2022)
2023-02-01 06:26:27 +00:00
- [MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning ](https://arxiv.org/abs/2205.00445 ) (May 2022)
2023-02-03 07:20:11 +00:00
- [Toxicity Detection with Generative Prompt-based Inference ](https://arxiv.org/abs/2205.12390 ) (May 2022)
2023-02-21 07:15:37 +00:00
- [Learning to Transfer Prompts for Text Generation ](https://arxiv.org/abs/2205.01543 ) (May 2022)
2023-01-28 23:29:57 +00:00
- [The Unreliability of Explanations in Few-shot Prompting for Textual Reasoning ](https://arxiv.org/abs/2205.03401 ) (May 2022)
2023-01-28 20:31:43 +00:00
- [A Taxonomy of Prompt Modifiers for Text-To-Image Generation ](https://arxiv.org/abs/2204.13988 ) (Apr 2022)
- [PromptChainer: Chaining Large Language Model Prompts through Visual Programming ](https://arxiv.org/abs/2203.06566 ) (Mar 2022)
2023-01-28 22:46:09 +00:00
- [Self-Consistency Improves Chain of Thought Reasoning in Language Models ](https://arxiv.org/abs/2203.11171 ) (March 2022)
2023-02-21 09:07:21 +00:00
- [Training language models to follow instructions with human feedback ](https://arxiv.org/abs/2203.02155 )
2023-01-28 23:29:57 +00:00
- [Rethinking the Role of Demonstrations: What Makes In-Context Learning Work? ](https://arxiv.org/abs/2202.12837 ) (Feb 2022)
2023-01-28 20:22:44 +00:00
- [Chain of Thought Prompting Elicits Reasoning in Large Language Models ](https://arxiv.org/abs/2201.11903 ) (Jan 2022)
2023-01-28 20:31:43 +00:00
- [Show Your Work: Scratchpads for Intermediate Computation with Language Models ](https://arxiv.org/abs/2112.00114 ) (Nov 2021)
2023-01-28 23:29:57 +00:00
- [Generated Knowledge Prompting for Commonsense Reasoning ](https://arxiv.org/abs/2110.08387 ) (Oct 2021)
2023-02-21 09:07:21 +00:00
- [Multitask Prompted Training Enables Zero-Shot Task Generalization ](https://arxiv.org/abs/2110.08207 ) (Oct 2021)
2023-01-28 20:22:44 +00:00
- [Reframing Instructional Prompts to GPTk's Language ](https://arxiv.org/abs/2109.07830 ) (Sep 2021)
2023-02-03 05:16:25 +00:00
- [Design Guidelines for Prompt Engineering Text-to-Image Generative Models ](https://arxiv.org/abs/2109.06977 ) (Sep 2021)
2023-02-03 10:07:27 +00:00
- [Making Pre-trained Language Models Better Few-shot Learners ](https://aclanthology.org/2021.acl-long.295 ) (Aug 2021)
2023-01-28 20:31:43 +00:00
- [Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity ](https://arxiv.org/abs/2104.08786 ) (April 2021)
2023-02-03 10:07:27 +00:00
- [BERTese: Learning to Speak to BERT ](https://aclanthology.org/2021.eacl-main.316 ) (April 2021)
2023-01-31 15:19:29 +00:00
- [The Power of Scale for Parameter-Efficient Prompt Tuning ](https://arxiv.org/abs/2104.08691 ) (April 2021)
2023-01-28 20:22:44 +00:00
- [Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm ](https://arxiv.org/abs/2102.07350 ) (Feb 2021)
2023-01-28 20:31:43 +00:00
- [Calibrate Before Use: Improving Few-Shot Performance of Language Models ](https://arxiv.org/abs/2102.09690 ) (Feb 2021)
- [Prefix-Tuning: Optimizing Continuous Prompts for Generation ](https://arxiv.org/abs/2101.00190 ) (Jan 2021)
- [AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts ](https://arxiv.org/abs/2010.15980 ) (Oct 2020)
- [Language Models are Few-Shot Learners ](https://arxiv.org/abs/2005.14165 ) (May 2020)
2023-01-28 20:22:44 +00:00
- [How Can We Know What Language Models Know? ](https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00324/96460/How-Can-We-Know-What-Language-Models-Know ) (July 2020)
2023-01-28 20:27:22 +00:00
- Applications:
2023-02-16 18:26:01 +00:00
2023-02-23 19:26:56 +00:00
- [How Generative AI models such as ChatGPT can be (Mis)Used in SPC Practice, Education, and Research? An Exploratory Study ](https://arxiv.org/abs/2302.10916 ) (Feb 2023)
- [Grimm in Wonderland: Prompt Engineering with Midjourney to Illustrate Fairytales ](https://arxiv.org/abs/2302.08961 ) (Feb 2023)
2023-02-17 06:42:29 +00:00
- [LabelPrompt: Effective Prompt-based Learning for Relation Classification ](https://arxiv.org/abs/2302.08068 ) (Feb 2023)
- [Prompt Tuning of Deep Neural Networks for Speaker-adaptive Visual Speech Recognition ](https://arxiv.org/abs/2302.08102 ) (Feb 2023)
2023-02-16 18:26:01 +00:00
- [The Capacity for Moral Self-Correction in Large Language Models ](https://arxiv.org/abs/2302.07459 ) (Feb 2023)
2023-02-09 02:46:21 +00:00
- [Prompting for Multimodal Hateful Meme Classification ](https://arxiv.org/abs/2302.04156 ) (Feb 2023)
2023-02-08 02:37:04 +00:00
- [PLACES: Prompting Language Models for Social Conversation Synthesis ](https://arxiv.org/abs/2302.03269 ) (Feb 2023)
2023-02-06 17:23:15 +00:00
- [Commonsense-Aware Prompting for Controllable Empathetic Dialogue Generation ](https://arxiv.org/abs/2302.01441 ) (Feb 2023)
2023-02-08 02:37:04 +00:00
- [Crawling the Internal Knowledge-Base of Language Models ](https://arxiv.org/abs/2301.12810 ) (Jan 2023)
2023-01-28 20:27:22 +00:00
- [Legal Prompt Engineering for Multilingual Legal Judgement Prediction ](https://arxiv.org/abs/2212.02199 ) (Dec 2022)
- [Investigating Prompt Engineering in Diffusion Models ](https://arxiv.org/abs/2211.15462 ) (Nov 2022)
2023-02-09 00:09:35 +00:00
- [Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering ](https://arxiv.org/abs/2209.09513v2 ) (Sep 2022)
2023-01-28 20:27:22 +00:00
- [Conversing with Copilot: Exploring Prompt Engineering for Solving CS1 Problems Using Natural Language ](https://arxiv.org/abs/2210.15157 ) (Oct 2022)
- [Piloting Copilot and Codex: Hot Temperature, Cold Prompts, or Black Magic? ](https://arxiv.org/abs/2210.14699 ) (Oct 2022)
2023-02-03 10:07:27 +00:00
- [Plot Writing From Scratch Pre-Trained Language Models ](https://aclanthology.org/2022.inlg-main.5 ) (July 2022)
2022-12-17 15:48:02 +00:00
- Collections:
2023-02-03 09:33:41 +00:00
- [Chain-of-ThoughtsPapers ](https://github.com/Timothyxxx/Chain-of-ThoughtsPapers )
2022-12-17 15:48:02 +00:00
- [Papers with Code ](https://paperswithcode.com/task/prompt-engineering )
- [Prompt Papers ](https://github.com/thunlp/PromptPapers#papers )
2022-12-16 22:23:01 +00:00
2023-02-20 01:52:00 +00:00
---
2022-12-17 15:48:02 +00:00
## Tools & Libraries
2023-02-03 09:33:41 +00:00
#### (Sorted by Name)
2022-12-16 20:22:23 +00:00
2023-02-03 10:07:27 +00:00
- [AI Test Kitchen ](https://aitestkitchen.withgoogle.com )
2023-02-03 09:33:41 +00:00
- [betterprompt ](https://github.com/krrishdholakia/betterprompt )
2023-02-03 10:07:27 +00:00
- [DreamStudio ](https://beta.dreamstudio.ai )
- [DUST ](https://dust.tt )
- [Dyno ](https://trydyno.com )
- [EveryPrompt ](https://www.everyprompt.com )
2023-02-03 09:33:41 +00:00
- [GPT Index ](https://github.com/jerryjliu/gpt_index )
2022-12-16 20:35:27 +00:00
- [GPTTools ](https://gpttools.com/comparisontool )
2023-02-03 09:33:41 +00:00
- [hwchase17/adversarial-prompts ](https://github.com/hwchase17/adversarial-prompts )
2023-01-05 03:50:47 +00:00
- [Interactive Composition Explorer ](https://github.com/oughtinc/ice )
2023-01-20 00:15:08 +00:00
- [LangChain ](https://github.com/hwchase17/langchain )
2023-02-03 10:07:27 +00:00
- [LearnGPT ](https://www.learngpt.com )
- [Lexica ](https://lexica.art )
2023-02-03 18:36:19 +00:00
- [loom ](https://github.com/socketteer/loom )
2023-02-01 04:22:48 +00:00
- [Metaprompt ](https://metaprompt.vercel.app/?task=gpt )
2023-02-03 09:33:41 +00:00
- [OpenAI Playground ](https://beta.openai.com/playground )
2022-12-17 15:48:02 +00:00
- [OpenPrompt ](https://github.com/thunlp/OpenPrompt )
2023-02-03 10:07:27 +00:00
- [Playground ](https://playgroundai.com )
2023-02-03 18:34:55 +00:00
- [Prodia ](https://app.prodia.com/#/ )
2023-02-03 10:07:27 +00:00
- [Prompt Base ](https://promptbase.com )
2022-12-16 20:35:27 +00:00
- [Prompt Engine ](https://github.com/microsoft/prompt-engine )
2023-02-03 10:07:27 +00:00
- [Prompt Generator for OpenAI's DALL-E 2 ](http://dalle2-prompt-generator.s3-website-us-west-2.amazonaws.com )
- [Promptable ](https://promptable.ai )
2023-01-23 20:11:31 +00:00
- [PromptInject ](https://github.com/agencyenterprise/PromptInject )
2023-02-03 09:33:41 +00:00
- [Prompts.ai ](https://github.com/sevazhidkov/prompts-ai )
2023-02-23 19:26:56 +00:00
- [Promptly ](https://trypromptly.com/ )
2022-12-17 15:48:02 +00:00
- [PromptSource ](https://github.com/bigscience-workshop/promptsource )
2023-02-24 06:19:23 +00:00
- [Promptist ](https://promptist.herokuapp.com/ )
2023-02-03 09:33:41 +00:00
- [Scale SpellBook ](https://scale.com/spellbook )
2023-02-03 10:07:27 +00:00
- [sharegpt ](https://sharegpt.com )
2023-02-03 09:33:41 +00:00
- [ThoughtSource ](https://github.com/OpenBioLink/ThoughtSource )
- [Visual Prompt Builder ](https://tools.saxifrage.xyz/prompt )
2022-12-16 20:22:23 +00:00
2023-02-20 01:52:00 +00:00
---
2022-12-16 20:35:27 +00:00
## Datasets
2023-02-03 09:33:41 +00:00
#### (Sorted by Name)
- [Anthropic's Red Team dataset ](https://github.com/anthropics/hh-rlhf/tree/master/red-team-attempts ), [(paper) ](https://arxiv.org/abs/2209.07858 )
- [Awesome ChatGPT Prompts ](https://huggingface.co/datasets/fka/awesome-chatgpt-prompts )
2022-12-21 19:44:18 +00:00
- [DiffusionDB ](https://github.com/poloclub/diffusiondb )
2022-12-16 20:54:42 +00:00
- [Midjourney Prompts ](https://huggingface.co/datasets/succinctly/midjourney-prompts )
2023-02-03 09:33:41 +00:00
- [P3 - Public Pool of Prompts ](https://huggingface.co/datasets/bigscience/P3 )
2023-02-03 10:07:27 +00:00
- [PartiPrompts ](https://parti.research.google )
2023-02-03 09:33:41 +00:00
- [Real Toxicity Prompts ](https://allenai.org/data/real-toxicity-prompts )
2022-12-16 21:00:33 +00:00
- [Stable Diffusion Dataset ](https://huggingface.co/datasets/Gustavosta/Stable-Diffusion-Prompts )
2023-02-03 10:07:27 +00:00
- [WritingPrompts ](https://www.reddit.com/r/WritingPrompts )
2022-12-16 17:38:17 +00:00
2023-02-20 01:52:00 +00:00
---
2022-12-16 20:54:42 +00:00
## Blog, Guides, Tutorials and Other Readings
2023-02-03 09:33:41 +00:00
#### (Sorted by Name)
2023-02-03 10:07:27 +00:00
- [3 Principles for prompt engineering with GPT-3 ](https://www.linkedin.com/pulse/3-principles-prompt-engineering-gpt-3-ben-whately )
2023-02-03 09:33:41 +00:00
- [A beginner-friendly guide to generative language models - LaMBDA guide ](https://aitestkitchen.withgoogle.com/how-lamda-works )
2023-02-03 10:07:27 +00:00
- [A Complete Introduction to Prompt Engineering for Large Language Models ](https://www.mihaileric.com/posts/a-complete-introduction-to-prompt-engineering )
2023-02-03 09:33:41 +00:00
- [A Generic Framework for ChatGPT Prompt Engineering ](https://medium.com/@thorbjoern.heise/a-generic-framework-for-chatgpt-prompt-engineering-7097f6513a0b )
- [AI Content Generation ](https://www.jonstokes.com/p/ai-content-generation-part-1-machine )
2023-02-24 06:19:23 +00:00
- [AI's rise generates new job title: Prompt engineer ](https://www.axios.com/2023/02/22/chatgpt-prompt-engineers-ai-job )
2023-02-03 09:33:41 +00:00
- [Awesome ChatGPT Prompts ](https://github.com/f/awesome-chatgpt-prompts )
2023-02-03 10:07:27 +00:00
- [Best 100+ Stable Diffusion Prompts ](https://mpost.io/best-100-stable-diffusion-prompts-the-most-beautiful-ai-text-to-image-prompts )
2022-12-17 19:51:29 +00:00
- [Best practices for prompt engineering with OpenAI API ](https://help.openai.com/en/articles/6654000-best-practices-for-prompt-engineering-with-openai-api )
2023-02-21 21:28:10 +00:00
- [Building GPT-3 applications — beyond the prompt ](https://medium.com/data-science-at-microsoft/building-gpt-3-applications-beyond-the-prompt-504140835560 )
2023-02-03 10:07:27 +00:00
- [ChatGPT, AI and GPT-3 Apps and use cases ](https://gpt3demo.com )
2023-01-05 03:44:33 +00:00
- [CMU Advanced NLP 2022: Prompting ](https://youtube.com/watch?v=5ef83Wljm-M&feature=shares )
2023-02-03 09:33:41 +00:00
- [Curtis64's set of prompt gists ](https://gist.github.com/Curtis-64 )
2022-12-16 17:53:36 +00:00
- [DALL·E 2 Prompt Engineering Guide ](https://docs.google.com/document/d/11WlzjBT0xRpQhP9tFMtxzd0q6ANIdHPUBkMV-YB043U/edit# )
2023-02-21 09:07:21 +00:00
- [DALL·E 2 Preview - Risks and Limitations ](https://github.com/openai/dalle-2-preview/blob/main/system-card.md )
2023-02-03 10:07:27 +00:00
- [DALLE Prompt Book ](https://dallery.gallery/the-dalle-2-prompt-book )
2023-02-21 09:07:21 +00:00
- [DALL-E, Make Me Another Picasso, Please ](https://www.newyorker.com/magazine/2022/07/11/dall-e-make-me-another-picasso-please? )
2023-02-09 07:23:07 +00:00
- [Diffusion Models: A Practical Guide ](https://scale.com/guides/diffusion-models-guide )
2023-02-03 09:33:41 +00:00
- [Exploiting GPT-3 Prompts ](https://twitter.com/goodside/status/1569128808308957185 )
2023-02-03 10:07:27 +00:00
- [Exploring Prompt Injection Attacks ](https://research.nccgroup.com/2022/12/05/exploring-prompt-injection-attacks )
- [Extrapolating to Unnatural Language Processing with GPT-3's In-context Learning: The Good, the Bad, and the Mysterious ](http://ai.stanford.edu/blog/in-context-learning )
- [Generative AI with Cohere: Part 1 - Model Prompting ](https://txt.cohere.ai/generative-ai-part-1 )
2022-12-16 19:48:23 +00:00
- [Giving GPT-3 a Turing Test ](https://lacker.io/ai/2020/07/06/giving-gpt-3-a-turing-test.html )
2023-02-25 02:33:30 +00:00
- [GPT-3 & Beyond ](https://youtube.com/watch?v=-lnHHWRCDGk )
2023-02-03 09:33:41 +00:00
- [GPT3 and Prompts: A quick primer ](https://buildspace.so/notes/intro-to-gpt3-prompts )
2023-02-03 10:07:27 +00:00
- [How to Draw Anything ](https://andys.page/posts/how-to-draw )
- [How to get images that don't suck ](https://www.reddit.com/r/StableDiffusion/comments/x41n87/how_to_get_images_that_dont_suck_a )
2023-02-23 01:07:10 +00:00
- [How to make LLMs say true things ](https://evanjconrad.com/posts/world-models )
2023-02-03 10:07:27 +00:00
- [How to write good prompts ](https://andymatuschak.org/prompts )
2023-02-21 09:07:21 +00:00
- [Introduction to Reinforcement Learning with Human Feedback ](https://www.surgehq.ai/blog/introduction-to-reinforcement-learning-with-human-feedback-rlhf-series-part-1 )
2023-02-21 21:08:54 +00:00
- [In defense of prompt engineering ](https://simonwillison.net/2023/Feb/21/in-defense-of-prompt-engineering/ )
- [Language Models and Prompt Engineering: Systematic Survey of Prompting Methods in NLP ](https://youtube.com/watch?v=OsbUfL8w-mo&feature=shares )
2023-02-03 10:07:27 +00:00
- [Learn Prompting ](https://learnprompting.org )
- [Methods of prompt programming ](https://generative.ink/posts/methods-of-prompt-programming )
2023-02-03 09:33:41 +00:00
- [Mysteries of mode collapse ](https://www.lesswrong.com/posts/t9svvNPNmFf5Qa3TA/mysteries-of-mode-collapse )
- [NLP for Text-to-Image Generators: Prompt Analysis ](https://heartbeat.comet.ml/nlp-for-text-to-image-generators-prompt-analysis-part-1-5076a44d8365 )
2023-02-16 22:05:37 +00:00
- [NLP with Deep Learning CS224N/Ling284 - Lecture 11: Promting, Instruction Tuning, and RLHF ](http://web.stanford.edu/class/cs224n/slides/cs224n-2023-lecture11-prompting-rlhf.pdf )
2023-02-03 09:33:41 +00:00
- [Notes for Prompt Engineering by sw-yx ](https://github.com/sw-yx/ai-notes )
2023-02-07 06:51:47 +00:00
- [OpenAI Cookbook ](https://github.com/openai/openai-cookbook )
- [OpenAI Prompt Examples for several applications ](https://platform.openai.com/examples )
2023-02-03 10:07:27 +00:00
- [Pretrain, Prompt, Predict - A New Paradigm for NLP ](http://pretrain.nlpedia.ai )
- [Prompt Engineering 101 - Introduction and resources ](https://www.linkedin.com/pulse/prompt-engineering-101-introduction-resources-amatriain )
2023-02-03 09:33:41 +00:00
- [Prompt Engineering 101: Autocomplete, Zero-shot, One-shot, and Few-shot prompting ](https://youtube.com/watch?v=v2gD8BHOaX4&feature=shares )
2023-01-23 20:11:31 +00:00
- [Prompt Engineering 101 ](https://humanloop.com/blog/prompt-engineering-101 )
2023-02-09 06:02:49 +00:00
- [Prompt Engineering - A new profession ? ](https://www.youtube.com/watch?v=w102J3_9Bcs&ab_channel=PatrickDebois )
2023-02-03 09:33:41 +00:00
- [Prompt Engineering by co:here ](https://docs.cohere.ai/docs/prompt-engineering )
2023-02-03 10:07:27 +00:00
- [Prompt Engineering by Microsoft ](https://microsoft.github.io/prompt-engineering )
2023-02-21 09:07:21 +00:00
- [Prompt Engineering: The Career of Future ](https://shubhamsaboo111.medium.com/prompt-engineering-the-career-of-future-2fb93f90f117 )
2023-02-03 10:07:27 +00:00
- [Prompt engineering davinci-003 on our own docs for automated support (Part I) ](https://www.patterns.app/blog/2022/12/21/finetune-llm-tech-support )
- [Prompt Engineering Guide: How to Engineer the Perfect Prompts ](https://richardbatt.co.uk/prompt-engineering-guide-how-to-engineer-the-perfect-prompts )
- [Prompt Engineering in GPT-3 ](https://www.analyticsvidhya.com/blog/2022/05/prompt-engineering-in-gpt-3 )
2022-12-16 17:53:36 +00:00
- [Prompt Engineering Template ](https://docs.google.com/spreadsheets/d/1-snKDn38-KypoYCk9XLPg799bHcNFSBAVu2HVvFEAkA/edit#gid=0 )
2023-02-03 09:33:41 +00:00
- [Prompt Engineering Topic by GitHub ](https://github.com/topics/prompt-engineering )
2022-12-16 17:58:20 +00:00
- [Prompt Engineering: From Words to Art ](https://www.saxifrage.xyz/post/prompt-engineering )
2023-02-17 06:42:29 +00:00
- [Prompt Engineering with OpenAI's GPT-3 and other LLMs ](https://youtube.com/watch?v=BP9fi_0XTlw&feature=shares )
2023-02-03 10:07:27 +00:00
- [Prompt injection attacks against GPT-3 ](https://simonwillison.net/2022/Sep/12/prompt-injection )
2023-02-03 09:33:41 +00:00
- [Prompt injection to read out the secret OpenAI API key ](https://twitter.com/ludwig_stumpp/status/1619701277419794435?s=20&t=GtoMlmYCSt-UmvjqJVbBSA )
2023-02-07 06:51:47 +00:00
- [Prompting in NLP: Prompt-based zero-shot learning ](https://savasy-22028.medium.com/prompting-in-nlp-prompt-based-zero-shot-learning-3f34bfdb2b72 )
2023-02-03 10:07:27 +00:00
- [Prompting Methods with Language Models and Their Applications to Weak Supervision ](https://snorkel.ai/prompting-methods-with-language-models-nlp )
2022-12-16 20:22:23 +00:00
- [Prompts as Programming by Gwern ](https://www.gwern.net/GPT-3#prompts-as-programming )
2023-02-03 09:33:41 +00:00
- [Reverse Prompt Engineering for Fun and (no) Profit ](https://lspace.swyx.io/p/reverse-prompt-eng )
2023-02-21 09:07:21 +00:00
- [So you want to be a prompt engineer: Critical careers of the future ](https://venturebeat.com/ai/so-you-want-to-be-a-prompt-engineer-critical-careers-of-the-future/ )
2023-02-03 05:08:49 +00:00
- [Simulators ](https://www.lesswrong.com/posts/vJFdjigzmcXMhNTsx/simulators )
2023-02-03 09:33:41 +00:00
- [Start with an Instruction ](https://beta.openai.com/docs/quickstart/start-with-an-instruction )
2023-02-03 10:07:27 +00:00
- [Talking to machines: prompt engineering & injection ](https://artifact-research.com/artificial-intelligence/talking-to-machines-prompt-engineering-injection )
2023-02-23 19:26:56 +00:00
- [The Book - Fed Honeypot ](https://fedhoneypot.notion.site/25fdbdb69e9e44c6877d79e18336fe05?v=1d2bf4143680451986fd2836a04afbf4 )
2023-02-03 09:33:41 +00:00
- [The ChatGPT Prompt Book ](https://docs.google.com/presentation/d/17b_ocq-GL5lhV_bYSShzUgxL02mtWDoiw9xEroJ5m3Q/edit#slide=id.gc6f83aa91_0_79 )
2023-02-23 19:26:56 +00:00
- [The Mirror of Language ](https://deepfates.com/the-mirror-of-language )
2023-02-03 09:33:41 +00:00
- [Using GPT-Eliezer against ChatGPT Jailbreaking ](https://www.alignmentforum.org/posts/pNcFYZnPdXyL2RfgA/using-gpt-eliezer-against-chatgpt-jailbreaking )
2023-02-20 03:06:18 +00:00
- [What Is ChatGPT Doing … and Why Does It Work? ](https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/ )
2022-12-17 16:09:53 +00:00
---
2023-02-03 09:33:41 +00:00
2022-12-17 16:09:53 +00:00
Feel free to open a PR if you think something is missing here. Always welcome feedback and suggestions.