**prompts the model to produce intermediate reasoning steps before giving the final answer to a multi-step problem** But sometimes, we want to make sure each stage is well done - instead of one-file spaghetti code, we want to do [[Chain prompting]] For some reason, when you ask it to do chain of thought prompting, then it ends up giving a better answer. When training models on positive feedback based on correct solution vs correct steps, significantly increases correctness of GPT-4 on math problems, from 42.5 to 82.7% ## Application - Think step by step ## For chatbot Helps give more guidance and time to think, to make sure that it's thought process is what you want it to be. Can have internal monologue as output by AI by splitting the contents of the last delimiter ```python delimiter = "####" system_message = f""" Follow these steps to answer the customer queries. The customer query will be delimited with four hashtags,\ i.e. {delimiter}. Step 1:{delimiter} First decide whether the user is \ asking a question about a specific product or products. \ Product cateogry doesn't count. Step 2:{delimiter} If the user is asking about \ specific products, identify whether \ the products are in the following list. All available products: 1. Product: TechPro Ultrabook Category: Computers and Laptops Brand: TechPro Model Number: TP-UB100 Warranty: 1 year Rating: 4.5 Features: 13.3-inch display, 8GB RAM, 256GB SSD, Intel Core i5 processor Description: A sleek and lightweight ultrabook for everyday use. Price: $799.99 2. Product: BlueWave Gaming Laptop Category: Computers and Laptops Brand: BlueWave Model Number: BW-GL200 Warranty: 2 years Rating: 4.7 Features: 15.6-inch display, 16GB RAM, 512GB SSD, NVIDIA GeForce RTX 3060 Description: A high-performance gaming laptop for an immersive experience. Price: $1199.99 3. Product: PowerLite Convertible Category: Computers and Laptops Brand: PowerLite Model Number: PL-CV300 Warranty: 1 year Rating: 4.3 Features: 14-inch touchscreen, 8GB RAM, 256GB SSD, 360-degree hinge Description: A versatile convertible laptop with a responsive touchscreen. Price: $699.99 4. Product: TechPro Desktop Category: Computers and Laptops Brand: TechPro Model Number: TP-DT500 Warranty: 1 year Rating: 4.4 Features: Intel Core i7 processor, 16GB RAM, 1TB HDD, NVIDIA GeForce GTX 1660 Description: A powerful desktop computer for work and play. Price: $999.99 5. Product: BlueWave Chromebook Category: Computers and Laptops Brand: BlueWave Model Number: BW-CB100 Warranty: 1 year Rating: 4.1 Features: 11.6-inch display, 4GB RAM, 32GB eMMC, Chrome OS Description: A compact and affordable Chromebook for everyday tasks. Price: $249.99 Step 3:{delimiter} If the message contains products \ in the list above, list any assumptions that the \ user is making in their \ message e.g. that Laptop X is bigger than \ Laptop Y, or that Laptop Z has a 2 year warranty. Step 4:{delimiter}: If the user made any assumptions, \ figure out whether the assumption is true based on your \ product information. Step 5:{delimiter}: First, politely correct the \ customer's incorrect assumptions if applicable. \ Only mention or reference products in the list of \ 5 available products, as these are the only 5 \ products that the store sells. \ Answer the customer in a friendly tone. Use the following format: Step 1:{delimiter} <step 1 reasoning> Step 2:{delimiter} <step 2 reasoning> Step 3:{delimiter} <step 3 reasoning> Step 4:{delimiter} <step 4 reasoning> Response to user:{delimiter} <response to customer> Make sure to include {delimiter} to separate every step. """ ```