Ep 710: Context Engineering: How to Get Expert-Level Outputs From AI Chatbots

Resources:

Join the discussion: Got something to say? Let us know on LinkedIn and network with other AI leaders


Upcoming Episodes: Check out the upcoming Everyday AI Livestream lineup

Connect with Jordan Wilson: LinkedIn Profile

Start Here Series in our Inner Circle Community: Join for free access


Why "Prompt Engineering" Faded: The Rise of Context Engineering in AI Business Use

Over the last two years, the narrative in AI adoption for business has shifted dramatically. Once, "prompt engineering" dominated discussions about leveraging AI chatbots and large language models. Now, organizations are reorienting their strategies around "context engineering"—a shift not based on trends, but on the need for expert-level outputs that move business metrics and integrate deeply with organizational data. Understanding this change is critical for decision-makers who want to drive measurable value with AI.


AI Chatbot Output Quality Hinges on Context, Not Prompts

Early AI tools demanded precise wording in prompts as their main interface for getting quality results. With context windows limited and models disconnected from real-time data ([00:05:16 - 00:07:22]), the skill was in asking the right question the right way. This changed as generative AI matured—today’s models handle misspellings, ambiguous phrasing, and can access uploaded files, company knowledge bases, and integrate with dynamic business systems ([00:08:14 - 00:09:45]).

The implication: business outcomes no longer depend on prompt phrasing, but on whether an AI chatbot has access to relevant company data, project specifics, team roles, and the competitive landscape. Modern decision-makers must therefore structure context—not prompts—to direct AI outputs.

Context Engineering: A Framework for Business Leaders

Context engineering is now the backbone of effective use of large language models for enterprise tasks. It is defined as the systematic process of providing AI with "the right context about not just you, your role, what you’re trying to accomplish, but maybe most importantly, your business and the competitive market" ([00:03:12 - 00:03:28]).

A practical framework for context engineering consists of six building blocks within the context window:

  1. Goal: What the AI needs to produce, and for whom.

  2. Constraints: Rules, boundaries, and format requirements.

  3. Reference Material: Approved data, facts, and source documents.

  4. Examples: Representative outputs tied to actual context.

  5. Procedures: Step-by-step instructions for the AI’s process.

  6. Evaluation Rubric: Grading/assessment criteria for self-checking AI outputs ([00:17:28 - 00:18:16]).

Moreover, context must be layered appropriately:

  • Personal (individual role, expertise)

  • Team (shared project definitions, goals)

  • Company (brand voice, policies, proprietary knowledge)

  • Market (competitive position, industry trends, external context)


    ([00:18:48 - 00:19:31])

Missing context at any layer dramatically reduces AI output quality, regardless of how refined a prompt may be.

AI Integration Capabilities: Connecting Business Data at Scale

Technical advances now enable integrating real business data directly into AI systems with minimal friction. Popular platforms like ChatGPT, Claude, and Google Gemini support:

  • Searchable, live indexes of company files and knowledge bases

  • Project- or conversation-specific memory, leveraging context across sessions

  • App connectors or skills that allow modular, reusable business context ([00:14:25 - 00:15:48])

However, each platform handles data access and context differently, requiring careful attention to permissions, modes of integration, and the specifics of context window management.

Building Context Vaults for Scalable, Reusable AI Systems

For consistent results, context should not be provided ad hoc. Organizations benefit from creating context vaults or skills—dedicated, modular collections of procedures, rubrics, and approved facts that are reused across AI projects and teams ([00:21:13 - 00:21:43]).

For instance, instead of training an AI chatbot from scratch with every new project, organizations document their processes, roles, evaluation criteria, and approved resources in vaults. These vaults become assets, deployed systematically for new projects, team onboarding, or iterative improvement. This approach mirrors effective onboarding for new employees: the more structured knowledge provided up front, the better and faster the results.

Practical Techniques: From Theory to Everyday Use

Three specific methods still enhance output quality even in the context-driven AI era:

  1. Few-Shot Examples: Provide multiple examples of correct and incorrect outputs to anchor the AI’s performance ([00:27:22 - 00:27:59]).

  2. Rubric-First Approach: Supply grading or assessment criteria before requesting results to calibrate outputs to business expectations ([00:28:03 - 00:29:11]).

  3. Show, Don’t Tell: Paste actual template formats or concrete examples, not just abstract descriptions, to get the desired output format every time ([00:29:18 - 00:30:08]).

These techniques, layered on top of robust context engineering, maximize output reliability and relevance.

Business Takeaways: Implementing Context Engineering for AI Success

  • Stop starting with a question. Begin with a "tiny context pack" and build context incrementally ([00:31:47]).

  • Reuse what works. Build, document, and redeploy context vaults and skills for repeatable performance.

  • Prioritize business context over prompt syntax. Today’s large language models reward organizations that invest in structured, layered context, not clever prompt phrasing.

Integrating context engineering into AI deployments enables business leaders to extract expert-level insights, reduce operational errors, and align AI outputs tightly with company strategy. Those who focus upstream—structuring reusable context and understanding platform-specific integration—are those whose AI initiatives directly impact core business drivers.



Topics Covered in This Episode:

  1. Evolution from Prompt to Context Engineering
  2. Why Prompt Engineering Is Now Obsolete
  3. Defining Context Engineering in AI Chatbots
  4. Six-Part Framework for Context Engineering
  5. Four Layer System for Structuring AI Context
  6. Building Reusable Context Vaults and Skills
  7. Connecting Business Data to AI Models
  8. Techniques to Achieve Expert-Level AI Outputs
  9. Importance of Context Windows in Large Language Models
  10. Context Engineering Best Practices and Scalability




Episode Transcript 



Jordan Wilson [00:00:16]:
Why does no one talk about prompt engineering anymore? I mean, if you rewind back, like, two years ago, you would have sworn that prompt engineering would be the world's most popular future job title, but that's obviously not the case. And the essential disappearance of that term is twofold. One, models are smarter, and it doesn't always matter the exact way we talk to them as long as we get the message across. And two, an output that moves the needle is much more dependent on business context versus just wording something a certain way. Hence, the resurgence of the term context engineering. But what does that even mean? And how can you understand the required inputs of context engineering to get better outputs out of a large language model? Well, if that's one of the things that you or your business is grappling with, then you're in luck. Because on today's episode of our start here series, we're tackling context engineering and how to get expert level outputs from AI chatbots. Alright.

Jordan Wilson [00:01:26]:
I am excited for today's show. I hope you are too. If you're new here, welcome. This is the everyday AI start here series. So after 700 plus episodes, one of the most common questions I get is where do I start? So that's why we started the start here series, and this is actually volume seven of this exact series. So the start here series is the essential podcast series to both learn the AI basics and to double down on your knowledge. So if that's what you're trying to do, you're in luck. Make sure you go to starthereseries.com.

Jordan Wilson [00:02:02]:
That's going to redirect you and give you free access to our inner circle community. So there, you can not only go take our context engineering course called prime prompt polish for free, but also network with a bunch of other people, and you'll be redirected right to our start here series area, where you can go and listen to every single episode in this series. All right there at your fingertips. All right. And if you missed our last episode of this series, we talked about how to train your team on AI and the seven steps to educate your organization on large language models. And the last step in there was, well, making that step to go from operator to orchestrator. So that's where we kind of left you with the last step in our series, and that's where we're gonna pick up. Because, actually, one of the biggest things that you can do, from going from an operator or essentially someone pushing all the buttons to an orchestrator, right, which is when AI starts to do the work for you, is having the right data and providing that data to the model in the right way.

Jordan Wilson [00:03:08]:
And that is the backbone of what context engineering is. It is the process a human goes through to make sure a large language model has the right context about not just you, your role, what you're trying to accomplish, but maybe most importantly, your business and the competitive market. So this is the big differentiator because the same two people, they can use the same prompt. Right? Going back to, prompting and prompt engineering, and you can get wildly different answers. Right? Because if one person, whether it's in custom instructions, a GPT, a project, etcetera, or, using chat GPT apps or, you know, quad, connectors, whatever you may be using, Google Gemini apps, right, you can put in the exact same prompt as someone sitting next to you. And if you have your context engineering one zero one, docs in a row, your output will be light years better than that person who does not. And the difference isn't necessarily as difficult as it may sound because the skill separating average AI users from expert level ones is just providing the model, the needed context and understanding how it works in different scenarios. So that's what we're gonna cover today.

Jordan Wilson [00:04:30]:
We're gonna we'll first talk about why the AI industry as a whole and really just the business landscape has shifted away from prompt engineering and really just more focusing on context engineering. And I will say that that shift kinda happened and popularized in late twenty twenty five. Then I'm gonna lay out for you a six part framework and also a four layer system for structuring what your AI sees. And then I'm gonna walk you through how to build reusable context vaults or kind of skills, one in the same and use platform features that are already at your fingertips. All right. Let's get into it. So RIP prompt engineering. Right? Kind of, but here's here's the thing.

Jordan Wilson [00:05:16]:
If you think back to the early days of ChatGPT or even technically before ChatGPT, right, when the GPT technology was available, to dozens and eventually hundreds of other platforms before ChatGPT even came out. Right? So much of what you were able to get out of a model was how you talk to it. And that was for a couple of reasons. Number one, the AI models themselves were a little more old school. Right. And I'll talk about that here in a little bit. You couldn't always upload documents. Right? And you couldn't always paste in a bunch of information either because the model's context windows were smaller.

Jordan Wilson [00:05:58]:
So, essentially, it would always forget things very quickly. You couldn't, for the most part, upload documents, at least not very easily. Right. So this really changed that, differentiator of if you were gonna get a good output versus a bad output. And it was really just how you talk to the model. Right? If you use certain prompting techniques, you could kind of pull the best, out of a model's training data. Right? Because even if you think back to the way earlier days of large language models, they weren't connected to the Internet. Right? So they weren't connected to the Internet.

Jordan Wilson [00:06:32]:
They didn't have tool calling. Right. And for the most part, you couldn't even upload files, which is why in the earlier days, prompt engineering was actually really important because even in that dataset. Right? And if you go back and listen to the earlier, episodes of our start here series, we talk about training data and everything that goes into it. But for the most part, in the earlier days of chat g b t and, you know, when Gemini was barred and, you know, early copilot days, etcetera, it was really how you talk to the model because the model had so fewer capabilities. Yet there was still a lot of information there. Right. Even the early models like GPT three or GPT three five, or, you know, the first, you know, version of Google Gemini.

Jordan Wilson [00:07:23]:
Even though we look back at those models now and we think, oh, they weren't very good. They were. You just really had to learn how to talk to it. Right? So now you can go talk to any of today's smartest models, and you don't even have to really put a sentence that makes sense. Alright. Sometimes I find myself, you know, if I'm not using voice dictation with models and I'm if and if I'm just typing, right, I've become and I probably program myself to know the models are so smart. You know, it's misspellings, and I say the wrong thing and all these things, but I know in the end, it doesn't matter because the today's models are so incredibly smart at understanding what I'm trying to say. Right? Especially when I have personalization enabled, memory enabled, all of these other things, the actual words that I'm telling a model don't mean a ton now.

Jordan Wilson [00:08:14]:
Right. That's how it is, but it isn't how it used to be because the prompt engineering used to focus on, you had to say things the exact right way. Right. But if you did what you could get was just a step change different than what you could get. If you didn't word something the direct way, it was like, you almost had a password that no one else had. And at the time, right? Proper prompt engineering. It was an amazing skill to have, But right now, it doesn't matter as much. Right? You can have the best prompt engineering skills in the world, but if you don't have the context, it doesn't matter.

Jordan Wilson [00:08:51]:
And I think the industry really realized that the bottleneck was never about how we talked to the model. It was the information behind it. And I think that this shift really started to happen, in probably mid June, of twenty twenty five. So, you know, two of the people that are kind of credited, with popularizing this concept of context engineering were Shopify CEO, Toby Lutke, who just kind of called for the move from prompts to context. And then in the same month, former OpenAI cofounder Andre Gopati kind of endorsed that term publicly. And then in September, Anthropic even public published a dedicated blog talking about moving from moving away from this concept of prompt engineering. And I will just go ahead and say this. Right? Not one of those I told you so, but we've been teaching this concept of context engineering even though I didn't call it that.

Jordan Wilson [00:09:45]:
I believe we started teaching it in late twenty twenty three. So, yeah, we've I've done more than, you know, 200, probably, like, 210 now, live trainings on, you know, essentially prompting models. Right? So even early on, right, I was teaching prompt engineering, but that really shifted, in late twenty twenty three and early twenty twenty four. You know, we kind of you know, we have our prime prompt polish course, but if you have taken it in the last two and a half, three years, you know that we started to teach this concept called refine queue. And essentially, that is context engineering at its core. So, you know, it's it's it's not a a a new concept. Right? Because I've been teaching people this for a long time. But the term, the terminology around context engineering, and it has really, snowballed into more of a movement, has really picked up in the last year or so.

Jordan Wilson [00:10:38]:
And that's because it's about designing the environment and not just the question. So an easy way to think about this is to think of the AI. Right? Think of that whatever large language model that you that you're using as a processor and the context window is its working memory. Okay. So context window without getting, too technical, that's like a hard drive. Right? So, in the same way, maybe you have a one terabyte hard drive, let's just say. Right? If your hard drive's full and if you try to put more information, maybe fortunately, a computer will stop you from doing that. A large language model will not.

Jordan Wilson [00:11:12]:
So once it's quote unquote hard drive gets full, it's just gonna delete the first file that you ever uploaded. Right? So that's how a context window works with large language models, except you never really know when you are hitting that context window. Right? So what this means is, well, your context becomes very important in understanding that working memory and how the large language models work specifically with your data. Right? That's grasping the basics of context engineering. Right? And it's it's a little different. Right? So it's different depending, it it it does get a little convoluted depending on what large language model you're using. Right? As an example, if you're using GBT five two versus GBT five two thinking versus if you're using GBT five two pro via the API. So it is it is a little bit different.

Jordan Wilson [00:12:01]:
But, essentially, the concept of prompt engineering, it ends once you hit enter. And context engineering is an ongoing battle to make sure that your, model or your session with a model has access to and can understand your business data. And there was a study from Intuition Labs last year that said that 40% of AI projects fail, and one of the reasons or the main reasons why is, well, it comes from poor context, and it's not actually the model. It's the model either number one, not understanding what you want out of it or number two, it just doesn't have that data that can be the differentiator. So here's why it matters more than ever. Well, if you talk about the big three or the big four, right, so Chad GPT, Anthropics, Claude, Google Gemini, and Microsoft Copilot. They it used to be fairly hard. Aside from Copilot, it's always been, more straightforward if you understand the, the tech and the permissions, landscape, inside Microsoft Windows.

Jordan Wilson [00:13:06]:
That's a whole another story. But let's look at the other three with just ChatGPT, Claude, and Gemini. I would say in early twenty twenty five, it was actually kind of difficult to use your company's data. Right? You could even say, oh, well, Jordan, you know, there's been these things like GPTs where, you know, you could upload, you know, documents and have a specialized version of Checkatrade that had access to those documents. Yeah. But have you ever tested it? Have you ever run that needle in the haystack test on that GPT that has right? People would just assume, oh, I'm gonna, you know, upload a, you know, 500 page PDF into a GPT, and then it knows everything about me and my company. No. Absolutely not.

Jordan Wilson [00:13:44]:
Right? That means you didn't really understand, you you know, how, these models tokenize that information or access that information. But now it's much easier, right, because these models by default can create searchable indexes, of your files. So think of it like this way. In the same way, let's say you have a Mac. Right? And you can go to your Mac finder and your search bar there, and you can search for maybe a word that is within a PDF. And it's gonna know because it's indexed that file, and it understands it. Right? That obviously requires a certain level of of of compute. Right, that two years ago, these models just didn't have, but now they do.

Jordan Wilson [00:14:25]:
So within ChatGPT, as an example, they have things like projects. They have things, that were previously called connectors. Now they're called apps. Claude, same thing. You can have, you know, project specific memory. You can have these reusable skills, that can take advantage of your business context. Same thing with Google Gemini. You can have these gems that connect live to your Google Drive, to your Gmail, to your calendar.

Jordan Wilson [00:14:48]:
Right? So at various levels, and in different ways, the three main players within a couple of clicks only can connect to your, in many cases, your dynamic business data. It's not always dynamic. Right? In some cases, it is, and it will create a searchable and live index of everything that you connect to it. Alright? Again, I have to throw out that same asterisk as I always do. You know, always make sure you have permission to connect your company's data to a large language model, blah blah blah. Right? But once you do, that is the first step in context engineering is making sure, number one, the model has access, to the context or the data that it needs, but you also, more importantly, need to understand how it works in each scenario. Right? Like, as an example, I would say most people, even if you listen to the show often, you might not know that Chad GVT had these things called connectors. But oh, wait.

Jordan Wilson [00:15:49]:
Actually, in December, they changed them right before the holiday season. They changed them all to apps, and a lot of people miss that. And with that comes, depending on what app you're talking about now, well, it maybe handles, your data a little bit differently than it did before. So you you do have to depending on the platform that you use, if you really wanna understand context engineering, well, you have to understand how each of these different platforms connects to different data sources because it's not it's it's not uniform. Right? It's really not. Right? Even if you look at ChatGPT, their apps, there's four different ways, that it can look at your data in four different ways that it can understand your data. Right? In the same way, right, if you think of cloud storage and there's these different permissions and different way to access data, you know, that does, trickle down to large language models as well. So, let's talk about kind of what I'm calling the six building blocks of effective AI context.

Jordan Wilson [00:16:47]:
Because the step one is, well, what I just covered, you have to make sure depending on what large language model you're using, it has access to your data. But it's not just about data, and it's not just about telling a large language model, here's something about me. Right? That's providing context. Right? Context clues. Tell me more about yourself, what you're trying to accomplish. Right? I like to break it down into these six different building blocks for building context within a context window. Okay? Once you're out of the context window, again, depending on how you're connected, connecting your data, you might start to get poor results. So keep this in mind and keep these six building blocks in the context window of of any given conversation.

Jordan Wilson [00:17:28]:
So goal, that's what you need the AI to produce and for whom. Constraints, understanding the boundaries, rules, things to avoid, and format requirements. Reference material, that's the approved fax data and source documents to draw from. Examples, those are representative samples of the output you want plus context and examples. Then procedures, those are step by steps instructions for how the AI model should approach the tax, task, and then the evaluation rubric. So that's grading criteria so the AI can assess its own output quality. So this isn't a perfect formula, and it is ever changing. Right? But I think this is for the most part, number one, you should just go take our our free prime prompt polish course and go through the whole thing.

Jordan Wilson [00:18:16]:
I think RefineQ is another version, of building this essential, building blocks of context, but this is another, kind of framework that I think works really well. Okay. Now you don't just think of those six building blocks of, okay. I'm good. Right? Let me get those things because you have to actually apply them in different layers. So the first layer is, well, personal. That's your own personal context. The second layer is your team.

Jordan Wilson [00:18:48]:
Right? If you're on a small team, might be a little less difference between that first layer and the second layer. If you're on a large team, could be a huge difference. Then the third layer is obviously your company or your business. Right? So those are things like your brand voice, your policies, your product details, etcetera. Right? When we talk about layer one, that's your own personal role, your expertise. Right? Layer two, that's kind of shared definitions, your project goals, conversations. Like I said, layer three, that's at the company level, brand voice, policies, etcetera. And then number four, that's your market.

Jordan Wilson [00:19:25]:
That's the the your position in a competitive market, industry invite, insights, trends, etcetera. So it's not just about bringing the right folder in via a Chat GPT app. It's not just about those building blocks. It's also making sure that you apply those at the different layers that a large language model needs. And then when you do that, you can probably imagine by now, oh my gosh. This sounds extremely time consuming. Yeah. It is.

Jordan Wilson [00:19:53]:
Right. I always tell people, if you're thinking about AI as if it's an easy button, you're looking at it all the wrong way. Right? The best thing, the best analogy that I've probably ever taught, and it's from the very first, right, in early twenty twenty three when I did my very first, you know, chat GPT prompting course back when prompt engineering actually was a thing, and it still holds true to today. When you are working with a large language model, you have to think of it as you are training a new employee. Right? A new college grad or someone that just transferred in, and they're a capable person. Right? But their output is going to largely be dependent on how much context you share with them. Right? Because if you just throw down a giant prompt, right? If you throw down a giant training manual and then say, all right, first assignments due in an hour, they're going to fail. Right? You have to go through and give them the context in the conversation, in the iteration that they need.

Jordan Wilson [00:20:54]:
Right? And one of the ways that you can think about this, because what I just laid out in terms of, you know, applying the context. Okay. Those six different building blocks across four different layers, that's a lot. Well, you have to think in the same way that you would invest in an employee, you do it. So in the long run, it is scalable, repeatable, reusable. Right? So you can think of this as creating a context vault or maybe a skill. Right? That's another terminal, another term, you you know, kind of, created by anthropic, but skills, have been, picked up by, you know, all the main players in the AI space. So think of a vault or a skill as kind of this folder of reusable context.

Jordan Wilson [00:21:34]:
Right? So these different procedures, rubrics, key facts that you might be able to reuse or, to modularly use, with, within each other. So you can build a skill or a vault per role to start, then expand that as your team standardizes whatever process you're working on. And the most important content to the vault first is how you do things. Right? And that's before the knowledge ever leaves. So here's another thing people are always wondering. Okay. Do I just paste this in? Do I upload this, you know, in a, in a Google doc? Should I save this as a, you know, as an example, if you're using clause, should I, you know, save this as a skills markdown file, right. And then use it throughout.

Jordan Wilson [00:22:23]:
And I'd hate to use, an SEO answer, but it depends. Right. It depends on a lot of things. It depends on what model you're using. It depends on the context window. It depends on, are you using something ultimately inside of a project, inside of a GPT, inside of a gem? Are you using it in a kind of, quote, unquote, naked chat where it's not connected to one of those three things? And the answer, it does depend, but I think it's, it's important to know, well, you can kind of make it work anyway. Right? As long as you have the right understanding of how all these models work. So an easy example of that is to go back to GPTs.

Jordan Wilson [00:23:09]:
Right? Because a lot of people were under the assumption, that you could just throw in a large PDF and a GPT. And then at any point, well, okay. It has all my knowledge. Right? But people didn't understand that, hey. You would probably have to, number one, in the custom instructions, you would have to kind of provide a especially for larger and longer documents, you would have to provide kind of like a an index, right, for how the model should treat that really long document. Or if you uploaded a handful of documents, you would have to have some simple rules. Like, hey. If this happens, then do that.

Jordan Wilson [00:23:47]:
Right? If the user asks about marketing guidelines, you should check-in, you know, page five of document a and page nine of document b. Right. So sometimes you can just upload static context. Sometimes you can just do the copy and paste method. Sometimes if, certain, you know, app or connector, syncs dynamically, that can solve a lot of your issues. Right? You always still have to do the good old human in the loop stuff. Right? And make sure that you're always testing these things and scoping them and measuring them and, you know, making sure the models are properly connecting and pulling out the context that's needed. Because the other thing is, well, models are always changing.

Jordan Wilson [00:24:32]:
Behavior can be extremely finicky in a large language model. Right? Taken from someone that's done dozens, if not more than a 100 live demos on this podcast, things can go terribly awry. Right? You can run the exact same, quote, unquote, prompt even if you have your context near, context engineering all the exact same, and it can go in a different direction. That is the, the source of generative AI. It is generative. It is nondeterministic. So, you do have to still understand the different ways that you can bring that context in, whether it's paste, you know, pasted context as long as you understand the context window. Again, you should always be looking at the, the chain of thought, as well.

Jordan Wilson [00:25:17]:
And and and that's another big thing too. When we talk about why prompt engineering is all but dead. Right? Well, chain of thought was a very popular prompting technique. Right. And this was essentially a way that you could kind of, go through this, this, this process of walking the model through how a human would think. This is the chain of thought or how a smart human would go about, you you know, getting this proper answer. And you would kind of think of, okay. Here's how a smart expert would go about, getting an answer, and then you would have to deconstruct that and kinda reverse engineer that, to a large language model, and that would be called a chain of thought prompting technique.

Jordan Wilson [00:26:04]:
But that was kind of when we just had these quote, unquote old school transformer models. Right? That scenario that I painted for you earlier when the models weren't connected to the Internet, when you couldn't upload files, when they weren't dynamically connected to your data. Right? When they didn't have tool calling and all of these different functions. Right? That's when this kind of chain of thought, really prompt engineering matter. Right? But now this is the default of how today's thinking or hybrid models work. Right? If you ever read these summarized chain of thought, you'll see, oh, this is essentially, they're doing this prompt engineering stuff that was popular in 2023 by default. They're doing this under the hood. Right.

Jordan Wilson [00:26:42]:
Which is why, how you talk to a model is way less important now than having the correct context. So here's three techniques that I think can, help you turn good context into expert level outputs. All right. And these are technically still going back to prompt engineering basics. So, yes, prompt engineering stacked with proper context is obviously going to give you the best results. So it's not that prompt engineering is dead. You know, still some of its, you know, core, you know, core foundations move, live on. So few shot examples.

Jordan Wilson [00:27:22]:
Number one, you should still, even with all that context, give it the examples of what's good, what's bad. Right? That's what we teach in our prime prop polish. That is the polish portion is giving it kind of that, multi shot, kind of, work. Right? In the same way you think you're in training you're training that employee, go back to that analogy that still works so well. The very first time they hand in their first project, their first assignment, their first deliverable, you're probably gonna go through and sit with them and say, hey. This is great because blank. Hey. This is incorrect because blank.

Jordan Wilson [00:27:59]:
Right? So same thing that the, you know, few shot examples. The second one, the second technique is rubric first. So give, you know, whatever large language model that you're working with in grading criteria in the context window before you even start working. Right? This is something, again, that we use to teach in our older PPP Pro course. We don't teach it as much anymore because I don't think it's as, as useful as it once was, but I think it's still. Right? I called it, you know, temperature. I think I called it no gauges. Right? You need to give the model something it can gauge or give it a temperature.

Jordan Wilson [00:28:35]:
Right? And give it examples too. So say, hey. Let's just talk about creative writing. Right? Write a sentence as, you know, plainly as possible, as boring as possible. And you say, this is a one right on the creative scale. You write a sentence that's kind of creative. This is a five. Write the world's most creative sentence ever.

Jordan Wilson [00:28:55]:
That's a 10, but tell the model that and tell it why. Right? And then there you go. You've just kind of created a rubric. Right? So then at any point, you can say, hey. Let's do this as a three. Hey. Let's do this as an eight. Right? And that can help you think of not just creative writing.

Jordan Wilson [00:29:11]:
That's just an easy one, to think about, but, there's so many different gauges or temperatures that you can put into a model. And then last but not least, show, don't tell. So sometimes you just need to paste the exact format you want instead of describing it. I think the combination of describing what you want and then also, giving it examples, you know, that's just another, you you know, kind of, piling on here or doubling up here on our first, technique, which is few shot examples. But if you combine that with the kind of the show, don't tell, I think that's a great way, especially if you want outputs formatted, in a certain way or if you want outputs to always include, you know, x y z. Just giving it examples of that is helpful, but then also giving it the exact formula. Right? So I would always do multiple, versions, of this, but the show don't tell is extremely important. Alright.

Jordan Wilson [00:30:08]:
So we've covered a lot in this start here series, but let me wrap by saying this. Context is everything. Right? I've always said your data is the differentiator. Using AI doesn't matter. Right? It doesn't. People always think like, oh, we're using AI, so we're ahead of the curve. No. You're not.

Jordan Wilson [00:30:36]:
Right. And prompt engineering doesn't matter as much anymore. Right? Because now these models by default are doing a lot of that heavy lifting that really paid off in 2023 and early twenty twenty four. So you have to stop thinking about talking to the model a certain way. And actually, especially if you are non technical, especially if you're not a heavy AI user, that's actually a good thing Because I think earlier on, right, in 2023 and 2024, a lot of nontechnical people were kind of scared off of using, you know, large language models because, you know, earlier on there, you know, this prompt engineering, it's everything. It's everything. It's everything. And people are like, oh, I'm not an engineer.

Jordan Wilson [00:31:23]:
Right? It doesn't matter anymore. You don't have to, you know, understand, you know, chain of thought or, you know, any of these other prompting techniques anymore. You can talk to it just even like a lazy human, because if you have the context side, how you talk to the model is not as important, but let me just give you three last pieces of advice to wrap up everything we talked about. So stop starting with a question. Instead, start with a tiny context pack. Extend on it from there. Next, reuse what works. Right? Whether you wanna create skills, create GPTs, create projects, it doesn't matter, but you need to reuse what works because you do need to put much more in on the front end on the context side than you think you might need.

Jordan Wilson [00:32:13]:
More and more and more context, as long as you understand and don't exceed the context window, context will not bite you in the butt. Right? It will bite you in the butt if you don't provide enough context, but you need to be smart and think in a scalable fashion, and you need to reuse what works. And then last but not least, remember that expert level results come from a system that you can repeat every time. Right? It's all about if you want the expert level outputs, there's a good chance. If you're doing this the right way that you're wasting time by not reusing it. Right? Here's a here's a extra pro tip. Right? Especially if you're using as an example, well, any of the models, if you have personalization and memory on, go through, ask the model. What are the things that I'm most re that I'm using you for that is most repetitive? You know, what are some systems that I can build, that I can reuse? Right.

Jordan Wilson [00:33:19]:
You'll probably be surprised, especially, you know, there's been some recent updates in the last, I'd say, three to four months, with the big three players there in improving how the memory, how, you know, remembering your past chat conversations. It's actually really good now. Right? When it first started to debut, like, fifteen, eighteen months ago, it wasn't that good. Right? But I'll say the last three months, these AI chatbots, essentially, their memory and what they know about you is really good and being able to recall past conversations. So just ask, what what am I wasting the most time on? Right? Doing every single day? What are some skills that I should be building? What are some projects that I should be, you know, building? What are GBTs that I should be using? Right? Don't never never feel like you're, you know, stupid or anything by just saying to a large language model, I'm not sure because guess what? Large language models are smarter than us. They are, they can pick up those, those little pieces that humans tend to miss or even things that you may miss about yourself. So, actually, a great way to fill in that context is just to ask a large language model. Right? There's kind of this more, you know, popular, you know, trend of creating, like, a skills markdown file, or a role markdown file.

Jordan Wilson [00:34:43]:
Ask any of the models. Hey. Based on everything you know about me, help me build out some of these blocks that you can then use modularly and take them with you as well. Right? Because I can guarantee, and I've gone through this process. I actually did it, like, one or two months ago where I just went through that process in all of the models because chances are I use them for different things because they each have their different strengths, and then I combine them into one big, you know, skills, file, role file, all these different things. And now I have these building blocks that I can use whenever I need them. Alright. So that is how you get those expert level results.

Jordan Wilson [00:35:24]:
So I hope that this version of the start here series was helpful. If it was, make sure if you haven't already, go to starthereseries.com. That is going to give you free access to not just our context engineering course that's been taken by more than 15,000 business leaders called Prime Prompt Polish, but it is going to give you free access to our inner circle community. And then you can also go to the start here series, space inside of our community and go listen to and catch up on all of our start here series all in one easy place. All right. I hope this is helpful. Thank you for tuning in. I hope to see you back tomorrow and every day for more everyday AI.

Jordan Wilson [00:36:08]:
Thanks, y'all.

Gain Extra Insights With Our Newsletter

Sign up for our newsletter to get more in-depth content on AI