What is Artificial Intelligence?
Theme
Palette
Download
Caption (tap to copy)
📖 Deep dive (full written explanation)
We'll close Day 1 the way every good lesson should end: with the mistakes. Most people don't fail at AI because the math is too hard — they fail because of a handful of thinking traps that feel completely reasonable in the moment. Learning to spot them now is cheaper than learning them through a failed project.
This post walks through the five that catch almost everyone: treating AI as a mind, over-reaching for LLMs, having no way to measure quality, confusing confidence with truth, and neglecting the data. For each we'll name the trap and the fix. Read it as a pre-flight checklist for your first real AI project — the issues here are the ones that quietly sink beginners.
Why front-load the mistakes? Because in AI, the failure modes are unusually sneaky. A buggy traditional program tends to crash or visibly misbehave. A flawed AI system often produces fluent, confident, plausible output that's quietly wrong — which means it can sail through a casual demo and only reveal its problems in production, with real users affected.
That asymmetry is exactly why these traps deserve a dedicated post. They don't announce themselves. You won't get a stack trace telling you 'you skipped evaluation' or 'your confidence is miscalibrated'. You'll just get a system that seems fine until it very much isn't. Treat the next five slides as the hard-won checklist that experienced practitioners run automatically — internalising them will put you ahead of most people who've been at this far longer.
Mistake number one, and the root of most others: treating AI as a mind. It's a statistical next-step predictor, not a reasoner. The instant you start believing it 'understands', you relax your guard and stop checking its work — and that's precisely when it hands you a confident, fluent, completely wrong answer that you then trust and ship.
The fix is a discipline, not a setting: verify, don't trust. Treat outputs the way you'd treat a fast but unreliable intern's work — useful, worth having, and always reviewed before it matters. This is especially vital with large language models, whose fluency makes them feel authoritative even when they're fabricating. Keep reminding yourself it's predicting plausible text, not consulting facts, and you'll catch the errors that fool people who anthropomorphise the machine.
Mistake number two: reaching for a large language model when something far simpler would win. Not every problem needs GPT-4. For structured, tabular data, a SQL query, a spreadsheet formula, or a ten-line scikit-learn model often beats an LLM decisively on cost, speed, accuracy, and reliability — and it's far easier to debug and maintain.
The instinct to apply the newest, most powerful tool to everything is understandable but expensive. LLMs are remarkable for messy, language-heavy, open-ended tasks; they're frequently overkill (and less reliable) for well-defined ones a classic method nails. The professional habit is to reach for the simplest tool that solves the problem and only escalate when it genuinely can't. 'I used the fanciest model' is not an achievement; 'I solved it reliably and cheaply' is.
Mistake number three is the silent project-killer: having no way to measure 'good'. Beginners tweak prompts and swap models based on vibes — 'this output feels better' — with no objective scoreboard. The problem is that without a real measure, you genuinely cannot tell whether a change improved things or you just got lucky on the one example you happened to check.
The fix is to build an evaluation set first: a collection of real inputs paired with known good outputs, so you can score any change consistently. It's the equivalent of writing tests before refactoring code. It feels like a detour when you're excited to build, but it's the single highest-leverage habit in applied AI. Teams that win at LLM products almost always have a solid eval set; teams that flounder are usually flying blind, optimising for a feeling.
Mistake number four is subtle and trips up even technical people: confusing confidence with truth. A model outputting a probability of 0.99 is NOT the same as being right 99% of the time. Models are frequently poorly 'calibrated' — their stated confidence doesn't match their real accuracy — so a high number can accompany a flat-out wrong answer.
The fix is to treat any confidence score as a soft hint, never as proof. If decisions carry real consequences, you verify regardless of how sure the model claims to be, and where possible you measure and correct calibration explicitly. This matters enormously in high-stakes settings like medicine or finance, where a confidently wrong prediction is worse than an honest 'I'm not sure'. Whenever a model seems certain, that's a cue to stay skeptical, not to relax.
Mistake number five is the oldest law in computing, and AI made it stronger, not weaker: ignoring the data. People chase fancier models and clever architectures while the real bottleneck — messy, biased, mislabelled, or insufficient data — sits untouched. Garbage in, garbage out. A simple model on excellent data beats a sophisticated model on poor data almost every single time.
The fix is to invest your effort where the leverage actually is: cleaning, validating, balancing, and genuinely understanding your data before reaching for a bigger model. It's unglamorous work, which is exactly why beginners skip it and experts prioritise it. If your results are disappointing, the odds overwhelmingly favour the data being the problem over the model. Fall in love with your dataset, not your architecture, and your results will improve faster than you'd expect.
Step back and notice the thread tying all five together: every one is really the same mistake wearing a different mask — trusting the output without checking the inputs, the data, or the score. Whether it's anthropomorphising the model, skipping evaluation, or believing a confidence number, the common failure is a missing verification step.
That's why AI rewards skeptics. The engineer who instinctively asks 'how do I know this is actually right?' ships far fewer embarrassing failures than the one who's dazzled by a smooth demo. This isn't pessimism — it's the same professional rigour that makes a good scientist or a careful surgeon. Cultivate the reflex to verify, and you'll find that most of these five traps simply stop catching you, because you've installed the one habit that defends against all of them at once.
This decision tree turns the lessons into a practical debugging routine for when an AI result looks wrong. The first fork is the most important: have you checked the input data? Overwhelmingly often, fixing the data resolves the issue, which is why it's the first question rather than the last. If the data's clean, the next question is whether you have an evaluation set to systematically find where the model fails.
What's powerful about a flow like this is that it replaces panic and random tweaking with a calm, ordered process. When something breaks — and it will — beginners flail, trying changes at random. Experienced engineers follow a checklist: data first, evaluation second, model last. Internalise this ordering and you'll debug AI systems methodically, fixing problems in a fraction of the time it takes someone poking at hyperparameters and hoping.
Here's the whole post distilled into a five-line cure you can pin above your desk. Assume the model can be confidently wrong, and verify its outputs. Use the simplest model that actually solves the problem. Build an evaluation set before you start tuning anything. Read any confidence score as a hint, never a guarantee. And spend your time on data quality first, model cleverness last.
None of these requires advanced math or a powerful machine — they're habits of mind, and that's what makes them so valuable. Adopt these five and you'll sidestep the great majority of beginner failures, and you'll look far more competent than people who've technically been doing this longer but never built the discipline. Good judgement in AI is mostly a small set of skeptical habits applied consistently.
That completes Day 1 — a full first day covering what AI is, why it matters, how it works, how to run it in code, and the mistakes to avoid. You've gone from a fuzzy buzzword to a genuine working foundation, and crucially you've built the skeptical, verify-everything mindset that will protect you through every topic ahead.
Tomorrow we start Day 2 with one of the most clarifying distinctions in the whole field: Narrow AI vs General AI. You'll learn why every system today is 'narrow', what real general intelligence would demand, and how to see straight through the AGI hype. Save this post so these five traps stay fresh before your first project, and follow along — Day 1 was the foundation, and it only gets more interesting from here.