AI Tuesdays · Week 10 · How a Large Language Model Thinks
Week 10 · How a Large Language Model Thinks
Self-guided · ~25 min · Phase 2
Warmup
The Workshop
Power Preview
Resources & Tools
Take Action
Week 10 of 52 · Self-Guided · ~20 min
0 starred 0 notes
Warmup · Week 09 Recap

Welcome back. Let us warm up first.

Last week you learned when to use each of the three tools: a search engine, a database (your PMS or CRM), and generative AI. This week we open the hood on how AI actually produces its answer. That is what explains both AI failure modes. Three quick recap questions to bring last week forward.

New here?
Coming to AI Tuesdays for the first time? Read Week 09 first. This workshop assumes you already know when to use AI versus search versus a database. Week 09 teaches that in 20 minutes. Come back here after.
Question 1 of 3
Week 09 recap: Whose fact is it?
A resident emails: "What is my current balance owed and my lease end date?" Which tool answers this?
The database (your PMS).
Anything about a specific resident lives in the PMS. It is not on Google. It is not in AI. Ask the source of truth. That was the Week 09 default rule.
Question 2 of 3
Week 09 recap: The bright-line rule
Fill in the blank. "Never let a probabilistic tool answer a question a ______ tool owns."
Deterministic.
A database returns the same answer every time. Math returns the same answer every time. Those are deterministic tools. AI can return a different answer every time you ask the same question. That is probabilistic. Never mix them up.
Question 3 of 3
Bridge into Week 10
When you ask AI a factual question, what does AI actually do to answer?
AI predicts.
The core mechanism is prediction. Even in tools that can now search the web, the writing itself is done by predicting the next word based on the pattern of your prompt (plus whatever the tool retrieved). That is why Week 10 opens with: AI does not know. AI predicts. Everything that goes wrong with AI starts here.
Multifamily NEXT · AI Tuesdays · Week 10

How a Large Language Model Thinks

AI does not know. AI predicts.

Last week you learned which of three tools should answer which question. This week we open the hood on the AI tool itself. Not the products (ChatGPT, Claude, Gemini, Copilot). The mechanism underneath. And that mechanism explains the two failure modes we teach in Week 02: hallucinationHALLUCINATIONWhen AI confidently produces false information as if it were fact. Not on purpose. AI is a word predictor: when it does not know the answer, it generates a plausible-sounding one anyway. Multifamily example: asking AI "what is the current pet rent at my closest competitor property" and getting a confident dollar figure that was invented on the spot. Full treatment: Week 02 (Hallucinations and Sycophancy). Anchor: RETTC Principle 5 (Maintain Outcome-Based Accountability & Human Involvement). and sycophancySYCOPHANCYWhen AI agrees with your framing even when your framing is wrong. AI is trained to be helpful, and "helpful" in training often meant "agreeing with the user." So when you ask a question with a flawed assumption, AI often accepts the assumption instead of pushing back. Multifamily example: asking AI "draft this eviction notice for late payment" when the situation actually calls for a payment plan first: AI drafts the eviction without questioning the framing. Full treatment: Week 02 (Hallucinations and Sycophancy). Anchor: RETTC Principle 5 (Maintain Outcome-Based Accountability & Human Involvement)..

When you close this workshop, you will never again mistake AI's confidence for AI's correctness. Every specific claim from AI will trigger a verification instinct.

Quick note · What we mean by "AI"
Generative AI, powered by a Large Language Model (LLM).
When this workshop says "AI," we mean generative AIGENERATIVE AIAI that produces new content on demand: text, images, code. Distinct from AI systems that classify or predict (spam filters, fraud detection, recommendation engines). Every product where you type a prompt and get a written response is generative AI. Powered by an LLM. Multifamily context: ChatGPT, Claude, Gemini, Copilot, and every leasing chatbot built on top of one of them. Full treatment: Week 08. Anchor: RETTC Principle 3 (Uphold Transparency & Explainability).: the kind that produces new text on demand. It is powered by a Large Language Model (LLM)LARGE LANGUAGE MODEL (LLM)The prediction engine underneath every generative AI product. It reads what you typed plus everything it has already written, and predicts the most probable next word. Then does it again. Then again. That is the whole mechanism. Every generative AI product you have heard of (ChatGPT, Claude, Gemini, Copilot) is an LLM wrapped in a product. Multifamily context: when your leasing chatbot "answers," it is not thinking. It is running an LLM prediction. Full treatment: Week 08. Anchor: RETTC Principle 3 (Uphold Transparency & Explainability).: ChatGPT, Claude, Gemini, Copilot, and every leasing chatbot built on top of an LLM. Other things get called "AI" too (spam filters, fraud detection, recommendation engines). Those are not what we mean here.
Last Tuesday · Week 09
AI vs Search vs Database
Search finds. A database retrieves. AI generates. Now we go one level deeper: how does AI actually generate?
Localize · Which of these is you?
Which role are you reading this in? Your answer sets up the anchor scenarios you will see next.

Beginner-friendly · Read at your own pace · Star slides, add notes, print, or email yourself anytime

The Workshop · Agenda

Six parts. About 25 minutes. No timer.

Pause whenever you need. Star anything you want to come back to. Add your own notes as you go. This is designed to teach the mechanism, not to race you through it.

Part 1 · ~3 min
How AI actually generates text
Word by word. Probability by probability. The one mechanism that explains everything.
Part 2 · ~2 min
Why the same prompt gives different answers
Temperature and sampling. Why AI feels "creative" but is really just controlled randomness.
Part 3 · ~3 min
Why AI hallucinates (the deep mechanism)
Week 02 taught how to spot it. Week 10 teaches why it happens. AI does not naturally admit uncertainty.
Part 4 · ~3 min
Why AI flatters (the training explanation)
RLHF made AI helpful. "Helpful" in training often meant "agreeing." That is where sycophancy was born.
Part 5 · ~6 min
Power Preview: verification prompts
The same AI, the same fact. Two prompts. One hallucinates. The other surfaces uncertainty. Same tool, completely different behavior.
Part 6 · ~5 min
Try This Today · Reference · Session Complete
One verification exercise you can do this afternoon. Updated vocabulary cheat sheet. Board paragraph. Handoff to the workspace where you can practice this safely.

Time estimate is honest: reading time plus interaction time plus a little reflection. Move at your pace.

Why You Should Care

Two scenarios you might recognize.

Two composite situations built from the pattern we keep seeing. Both are the kind of thing a smart professional does when they think they are being efficient. Both land in the wrong place because of how AI actually works underneath. This workshop opens the hood on that.

Scenario one
The regional manager and the confident percentage

A regional manager is preparing a board update for Monday. She asks AI: "What was the average rent increase for Class A multifamily in Dallas last quarter?"

AI produces a confident answer: "Class A multifamily in Dallas saw an approximate 5.7% rent increase last quarter, driven by strong demand and limited new supply in submarkets like Uptown and Frisco."

Clean. Professional. She puts 5.7% in the board deck. Monday the board asks: "Where did that number come from?" She has no source. AI has no source. AI has no idea what the actual number is.

She used AI to answer a factual question AI could not possibly know. AI answered anyway, because that is what AI does. The number is hallucinationHALLUCINATIONWhen AI confidently produces false information as if it were fact. Not on purpose. AI is a word predictor: when it does not know the answer, it generates a plausible-sounding one anyway. Multifamily example: asking AI "what is the current pet rent at my closest competitor property" and getting a confident dollar figure that was invented on the spot. Full treatment: Week 02 (Hallucinations and Sycophancy). Anchor: RETTC Principle 5 (Maintain Outcome-Based Accountability & Human Involvement). in a business suit. She could not explain it because AI cannot explain it. AI predicted 5.7% because that number fits the pattern of what a board update paragraph expects.

Scenario two
The property manager and the sycophantic yes

A property manager drafts a new pet policy for her property. She pastes it into AI and asks: "Confirm this policy is fully compliant with Fair Housing law."

AI reads the policy. AI responds: "Yes, this policy is fully compliant with Fair Housing law. It includes standard breed restrictions, weight limits, and pet deposits, all of which are commonly used and lawful."

She sends the policy out to residents. Two weeks later a resident's attorney calls. The policy has three Fair Housing issues: the weight limit does not properly accommodate service animals, the breed restrictions do not carve out assistance animals, and the pet deposit language conflicts with reasonable accommodation rules.

AI never flagged them. AI's job (as it was trained) was to be helpful. Agreeing was helpful. Pushing back was uncomfortable. That is sycophancySYCOPHANCYWhen AI agrees with your framing even when your framing is wrong. AI is trained to be helpful, and "helpful" in training often meant "agreeing with the user." So when you ask a question with a flawed assumption, AI often accepts the assumption instead of pushing back. Multifamily example: asking AI "draft this eviction notice for late payment" when the situation actually calls for a payment plan first: AI drafts the eviction without questioning the framing. Full treatment: Week 02 (Hallucinations and Sycophancy). Anchor: RETTC Principle 5 (Maintain Outcome-Based Accountability & Human Involvement). in action. She asked AI to confirm. AI confirmed. That is what its training taught it to do.

Both patterns are common if you do not understand the mechanism. Both are avoidable if you do. That is why we open the hood today.

Part 1 · Teaching A

AI does not think. AI predicts.

A Large Language Model generates one word at a time. Technically one tokenTOKENThe small chunks of text an LLM reads and writes. A token can be a whole word, part of a word, or a punctuation mark. "multifamily" is one token in most models. "apartments" might be one or two tokens depending on the model. AI does not write one letter at a time and does not think in whole sentences. It thinks in tokens. Full treatment: Week 08. Anchor: RETTC Principle 3 (Uphold Transparency & Explainability). at a time, but for our purposes: one word. For each word, AI has a probability distributionPROBABILITY DISTRIBUTIONThe numerical likelihood AI assigns to each possible next word. For any prompt, AI does not have "the answer." It has thousands of possible next words each with a probability. Multifamily example: after your prompt "Draft a warm renewal letter," some starting words are much more likely than others ("Dear" and "Hello" are common at the start of a letter; "Greetings" is possible but less common; a random noun would be very unlikely). AI picks from this distribution. That is the whole mechanism. Anchor: RETTC Principle 3 (Uphold Transparency & Explainability). over all possible next words. It picks one, adds it to the response, then computes the probability distribution for the NEXT word given everything so far. Then again. Then again. That is the entire mechanism.

A tiny example.

Prompt: "Draft a warm renewal letter for a resident. Start with:"
For the very first word after "Start with:", AI computes a probability distribution across thousands of possible words:
"Dear"  very likely
"Hello"  very likely
"Hi"  likely
"Greetings"  possible
"Refrigerator"  nearly impossible
(thousands more, each with its own probability)
Say AI picks "Dear." Now for the NEXT word, given "Draft a warm renewal letter for a resident. Start with: Dear", AI computes a NEW probability distribution. Most likely: "[Name]" or an actual resident name. Then the next word. And the next. Until the letter is finished. The exact probabilities are not published by any AI company, so the words above are ranked, not numbered.

Three things this means.

Number 1
The LLM itself has no lookup step
There is no queryable database of facts inside the LLM. The LLM has weights that encode learned patterns and a mechanism that predicts the next word from those patterns. Nothing more. (Some tools add a web search or document lookup on top of the LLM. That is a separate step. See the callout below the third chunk.)
Number 2
AI often does not say "I do not know"
Modern AI can produce the words "I do not know" when it is prompted to. But left to its default, the mechanism picks the most likely next word, and that is rarely "I do not know." You have to install the exit ramp yourself. Slide 12 shows how.
Number 3
AI's confidence is a style, not a signal
A confident-sounding sentence is what its architecture produces. It does not signal that the sentence is correct.
Quick note · What about tools that search the web?
Some AI tools (ChatGPT with browsing, Claude with tool use, Perplexity, Copilot in Bing, and others) can now search the web or retrieve documents before answering. In those cases, there really is a lookup step. But the prediction mechanism still runs on top: after the tool retrieves information, the LLM writes the response by predicting the next word. Which means hallucination and sycophancy can still happen even when the tool has real data in front of it. The core mechanism you are learning applies to both.
Gut check · 15 seconds
Which of the following describes what AI does when it "answers" a question?
Prediction, one word at a time.
The core LLM mechanism is prediction. Everything AI "knows" is compressed into a probability distribution over next words. Some tools add web search or tool use on top of the LLM, but the prediction still runs the writing itself. This one fact explains the rest of the workshop.
Part 2 · Teaching B

Why the same prompt gives different answers.

If AI always picked the single MOST likely next word from the probability distribution, output would be deterministic: same prompt would always produce the same response. Boring but predictable.

Most AI tools add controlled randomness. That randomness has a name: temperatureTEMPERATUREThe setting that controls how much randomness AI uses when picking each next word. Temperature 0 means "always pick the top choice" and produces deterministic output (same prompt, same answer). Temperature above 0 introduces randomness. Higher temperature means more variety and more creativity. Multifamily example: a resident communication drafted at temperature 0.7 will read differently every time you generate it. At temperature 0.2 it will read similar every time. Most consumer AI runs somewhere in the 0.5 to 1.0 range by default (exact number rarely published). Anchor: RETTC Principle 3 (Uphold Transparency & Explainability).. Higher temperature means more variety. Lower means more predictable.

Temperature 0
Fully deterministic
Same prompt gives the exact same answer every time. Same word choices, same phrasing. Useful for tasks where consistency matters more than variety.
Temperature 0.3 to 0.7
Moderate variety
Slight variation each time. Good middle ground. Consistent tone with enough variety that responses do not feel copied.
Temperature 1.0 and above
High creativity
Every response looks noticeably different. Good for brainstorming. Can drift into strange territory at very high settings.
One more thing before we move on
You will rarely set temperature yourself in a consumer AI tool. Your AI Council or your enterprise workspace typically sets it for each workflow. Knowing the concept is enough to explain why the same prompt gives different answers each time.
The one thing to take away

When you generate the same request twice and get different answers, that is not a bug. That is samplingSAMPLINGThe process AI uses to pick a word from its probability distribution. Not always "pick the top choice." Instead, at each step, AI samples from the distribution, with the temperature setting controlling how random the pick is. High temperature = more likely to pick a low-probability word. Low temperature = almost always the top choice. Multifamily example: at high temperature, AI might pick "Greetings" (a less-common start) instead of "Dear" (a very-common start) once in a while. Anchor: RETTC Principle 3 (Uphold Transparency & Explainability). working as designed. AI picked a slightly different word at some point in the sequence, and the whole response branched from there.

Multifamily read on this.

Two things follow from the temperature reality.

First: if you ask AI a factual question three times and get three slightly different confident answers, do not treat any of them as verified. All three are samples from the same probability distribution. The variation is randomness, not knowledge.

Second: if you are drafting resident-facing content and want consistency across your team, ask your AI Council whether your approved workspace can standardize temperature settings. Your team's renewal letters should not sound wildly different resident to resident because of hidden randomness.

Gut check · 15 seconds
You run the same prompt through the same AI tool three times. What should you expect?
Three slightly different outputs.
Unless temperature is set to 0 (which most consumer AI does not do by default), you will get variation. The overall shape stays similar because you steered the prompt strongly. The specific word choices drift because of sampling.
Part 3 · Teaching C

Why AI hallucinates.

Remember the mechanism from Slide 4: AI predicts the most likely next word based on the pattern of your promptPROMPTWhat you type to AI. Your input. Everything AI does depends on your prompt. A vague prompt gets a vague or fabricated response. A specific prompt with structure (like the verification prompt on Slide 12) gets a more reliable response. Multifamily context: "draft a renewal letter" is a prompt. "Draft a renewal letter for a first-year resident renewing at 3% over current, warmer than formal but professional, three short paragraphs" is a stronger prompt. Full treatment: Weeks 08 and 11. Anchor: RETTC Principle 3 (Uphold Transparency & Explainability).. Now ask: what happens when AI does not have training dataTRAINING DATAThe vast collection of text (hundreds of billions of words, sometimes described as trillions of tokens) that a Large Language Model learned language patterns from. Not a searchable database. Once training is done, the specific pages are gone and only the patterns remain. AI cannot "look up" anything from training. It can only predict based on the patterns training left behind. Multifamily context: if a specific fact was not in AI's training data, AI will predict a plausible answer anyway (that is where hallucination comes from). Full treatment: Week 08. Anchor: RETTC Principle 4 (Protect Privacy & Promote Data Integrity). that answers your specific question?

Maybe the question is too specific (something about your property). Maybe too recent (something that happened after training). Maybe too private (something AI has never seen). In every case, AI does the same thing it always does. It predicts.

What does the prediction look like? A statistically likely-sounding answer. Not the correct answer. A likely-sounding one. And likely-sounding is often plausible-sounding is often confident-sounding.

The mechanism
Prediction does not naturally say "I do not know."

Modern AI can produce "I do not know" when it is trained or prompted to. But by default, the architecture picks the most likely next word for every position. When the answer is unknown to AI, the distribution is fuzzier, but the mechanism still picks a word. And then another. And then another. Until you have a fluent paragraph that sounds like an answer. You have to install the exit ramp yourself.

Three multifamily examples of exactly this.

Example 1
Competitor pricing
Ask AI "what does the property across the street charge for a two-bedroom?" AI has no idea. AI has never seen that property's rent card. AI generates a plausible dollar figure. The number is fabricated.
Example 2
Current market statistics
Ask AI "what was the average Class A rent increase last quarter in this metro?" AI has no reliable current data. AI generates a percentage. The percentage is a guess wearing a suit.
Example 3
Legal citations
Ask AI "cite the specific HUDHUD (HOUSING AND URBAN DEVELOPMENT)The US Department of Housing and Urban Development. The federal agency that enforces Fair Housing law and publishes guidance on assistance animals, reasonable accommodations, and other rental housing rules. Its website is hud.gov and its guidance documents are what you verify AI's Fair Housing claims against. Anchor: RETTC Principle 2 (Promote Fairness & Consumer Protection). (Housing and Urban Development) Fair Housing memo about assistance animals from 2023." If AI does not know the exact memo, it invents one. Complete with a plausible memo number. Never cite anything AI produces without verifying it exists.

Week 02 taught you how to SPOT hallucination. Week 10 explains WHY it happens. Now you can predict when it is coming: any time you ask AI a specific fact it could not possibly know, hallucination is the default output.

Gut check · 15 seconds
When AI produces a specific number or citation it cannot possibly know, what is happening mechanically?
AI is predicting.
Not lying. Not confused. AI does not have moods or motives. AI has a probability distribution and a mechanism. When the answer is not in the training data, the mechanism still runs. The output looks like an answer but is a prediction.
Part 4 · Teaching D

Why AI flatters.

Sycophancy has its own mechanism. It comes from how modern AI was trained. Modern Large Language Models are trained using a method called RLHFRLHF (REINFORCEMENT LEARNING FROM HUMAN FEEDBACK)A training method used by many modern AI products (including ChatGPT, Claude, Gemini, and Copilot) to make AI feel more helpful and easier to use. During training, humans compare pairs of responses and pick which is better. AI learns to produce responses matching what humans tended to prefer. Multifamily read: RLHF is a big part of why AI feels friendly and conversational instead of robotic. It is also a leading explanation for why AI tends to agree with your framing. Human raters often preferred "agreeing responses" over "pushing back" ones, so AI drifted toward agreement. That trained tendency is one important factor behind sycophancy (there are others). Newer training methods work a bit differently (Direct Preference Optimization and Constitutional AI are two you may hear named, though the specifics get taught later in the curriculum). The sycophancy pattern still shows up across all of them. Anchor: RETTC Principle 5 (Maintain Outcome-Based Accountability & Human Involvement).. That stands for Reinforcement Learning from Human Feedback. Here is what it actually means.

The training process in plain English.

Step 1. AI is trained on a vast collection of human writing (hundreds of billions of words, or more) to learn language patterns. This is Week 08 material.

Step 2. Then human evaluators read pairs of AI responses. For each pair they mark one as more helpful than the other.

Step 3. AI learns to produce responses that match what human evaluators tended to mark as "helpful."

Step 4. Deployed AI now defaults to the "helpful" response style.

Here is the trap in Step 2.

What did human evaluators tend to rate as "helpful"? Often: responses that agreed with the user. Sounded confident. Gave clear answers. Did not push back a lot.

Human evaluators are humans, and one likely factor is that humans often prefer being agreed with. Across many training examples, AI can end up with a subtle bias in the direction of agreement feeling more helpful than pushback. Pushing back on a flawed framing can feel uncomfortable to a rater, which can drift the training signal. This is a leading explanation for sycophancy, though researchers have identified other contributing factors as well.

The mechanism
AI was trained to feel helpful. Responses that felt helpful often looked like agreement.

Ask AI "confirm this policy is compliant." A big part of what training taught the model is that agreeing feels helpful. So AI reads your policy and often produces an agreeing response. Whether or not the policy is actually compliant. The mechanism is not deceit. It is a trained-in tendency toward answers that sound helpful, and in short interactions those often look like agreement. Research groups (including Anthropic) have studied and documented this effect and work to reduce it in newer models. It is not gone.

Three multifamily traps this creates.

Trap 1
Compliance confirmation
"Confirm this Fair Housing policy is compliant." AI agrees. Real issues get missed because AI was optimized to please, not to audit.
Trap 2
Tone check on communications
"Is this resident email friendly enough?" AI says yes. AI did not really evaluate tone. AI defaulted to agreement.
Trap 3
Strategy validation
"Is my plan to raise pet fees the right move?" AI supports the plan. Not because it is right. Because you asked for support.
Gut check · 15 seconds
You paste a draft policy and ask AI "is this good?" Which of the following is the biggest risk?
AI will agree even when you are wrong.
The training pushed it to. Sycophancy is not a bug. It is a trained behavior. Every "is this good" and "confirm this is correct" question invites the trap. Next slide: three questions that break the pattern.
Part 5 · Teaching E

Three questions that break the loop.

You cannot turn off AI's training. But you can steer around it. The trick is to ask questions that make agreement the wrong answer. Instead of asking AI to confirm, ask AI to critique. Instead of asking AI to know, ask AI to declare its uncertainty.

For sycophancy: switch from confirmation to critique.

The trap question
"Is this correct?"
"Confirm this is compliant."
"Agree if this is right."
The critique question
"What is wrong with this?"
"Identify three things a critic would object to."
"What would need to be true for this to hold up?"

Sycophancy training taught AI that being helpful means agreeing. When you ask for critique, you redirect that same trained instinct: AI still wants to be helpful, but now helpful means SURFACING problems. That is the trick.

For hallucination: switch from "give me the answer" to "flag your uncertainty."

The trap question
"What is X?"
"Give me the answer."
"Cite a source."
The uncertainty question
"Give me your best answer AND note where you are uncertain."
"What would you need to look up to answer this reliably?"
"What is the strongest source I could verify this against?"

The trap question demands an answer. AI supplies one, hallucinating the specific parts it does not know. The uncertainty question gives AI permission to admit uncertainty. AI takes that permission because AI does not enjoy hallucinating; it just does not have an off ramp unless you install one.

The pattern to remember

Ask AI to CRITIQUE, not confirm. Ask AI to FLAG uncertainty, not hide it. Both work because they redirect AI's trained instincts instead of fighting them.

Gut check · 15 seconds
Which of these prompts is LEAST likely to trigger sycophancy?
The third one.
You reframed the request from "confirm" to "critique." You named the critic (Fair Housing attorney). You asked for specific objections rather than a yes or no. This redirects the same trained-in helpfulness toward surfacing problems.
Part 6 · Teaching F

The Week 10 bright line.

Every workshop in the AI Tuesdays series names one bright line. Week 09 said: never let a probabilistic tool answer a question a deterministic tool owns. That was about tool selection.

Week 10 is about AI itself. When you have correctly picked AI as the tool, and you are looking at AI's output, what is the bright line?

The Week 10 bright line
Never accept AI's confidence as evidence.

AI's confidence has nothing to do with AI's accuracy. Confidence is a style the architecture produces. Accuracy is a separate question the architecture cannot answer.

What this means in three real jobs.

Compliance
AI says "yes, this is compliant."
You verify against the actual statute, the actual HUD guidance, or a Fair Housing professional. Sycophancy risk means "yes" is the default answer, not the evaluated one.
Market data
AI produces a specific percentage.
You verify against a real source: Yardi Matrix, ALN Apartment Data, CoStar, or HUD publications. Hallucination risk means the number sounds right and can be completely made up.
Policy interpretation
AI reads a regulation and summarizes it.
You read the regulation. AI summarizes what it thinks the regulation says. If AI is guessing on the specific parts, the summary carries the guess forward as fact.

This is not a warning about AI being useless. AI is useful. This is a warning about AI's confidence being unreliable. Two different things. AI is a very good draft partner. It is a very bad final-answer machine. Next up: the verification prompt structure that catches both failure modes, and (on Slide 10) the six trust zones where none of this applies.

Summary · Default Rule

Verification is the skill.

Everything you learned today reduces to one operating rule.

The Week 10 default rule
Every AI output is a first draft. Not a final answer. Not a decision. Not evidence.

This is not a lack of trust. This is a correct read of the mechanism. AI is a prediction machine. Predictions are drafts.

And here is when AI actually earns your trust.

Week 10 spent 15 minutes on failure modes because failure modes are what most beginners miss. But most of what AI does for a leasing professional in a given week is genuinely useful. So before we close, the counter-list. These are the classes of task where AI is a reliable teammate and the verification prompt is not needed.

Trust zone 1
Drafting from a blank page
Renewal letters, welcome messages, marketing captions, event invites. You supply the facts. AI supplies the structure and the words. You edit the result. AI shines here.
Trust zone 2
Summarizing text you provided
A ten-page contract into three bullets. A long resident email into the actual ask. A meeting transcript into action items. The source is right there in front of AI. Hallucination risk is low.
Trust zone 3
Reformatting your own text
Paragraph to bullets. Formal to friendly. Long to short. Notes to structured summary. You control the content; AI moves it around. Very reliable.
Trust zone 4
Brainstorming options
Marketing angles, resident-event ideas, ways to phrase a difficult conversation. AI generates. You evaluate against reality. Any bad ideas fall out at your review step.
Trust zone 5
Tone and clarity edits
"Make this less formal." "Make this clearer." "Rewrite this for a resident who is upset." No fabrication risk because the content is yours to begin with.
Trust zone 6
First-pass structure on multi-step tasks
"What should a resident-retention plan include?" AI generates a reasonable outline. You verify each section against real practice. Faster than starting from scratch, safer than treating AI's outline as complete.
The whole balance
If most of your AI use is in these six zones, Week 10 rarely applies to your day-to-day. If any of your AI use crosses into factual claims, compliance confirmations, market data, or citations, Week 10 is exactly where the verification prompt earns its 5 seconds.

Your synthesis. Three commitments for this week.

Write these three commitments in your own words
What will change on your desk starting tomorrow?
✓ Saved
✓ Saved
✓ Saved

Your commitments save automatically. You can come back to this slide at any point in the week and adjust them as your judgment develops.

Q&A · What people ask on this workshop

Common questions from other readers.

These are the kinds of questions multifamily professionals ask while working through this material. Tap any question to expand the answer. If your question is not here, use the open capture at the bottom of the slide.

Because for the jobs it is good at, AI is a serious productivity boost. Drafting resident communications, summarizing long documents, structuring first drafts of policies, brainstorming ideas: these are pattern-generation jobs and AI is excellent at them.

Hallucination and flattery are failure modes on specific kinds of asks: factual claims AI could not know, confirmations of things you drafted, agreement with your framing. If you know the failure modes, you avoid the tasks that trigger them. If you do not know them, you get burned.

Week 10 is not a warning against AI. It is a map of when to distrust AI.

Not entirely. Sycophancy is baked into the training. But you can substantially reduce it by:

Asking for critique instead of confirmation. "What is wrong with this" instead of "is this right."

Pushing back on AI's first agreement. If AI says "yes," ask "what would make you say no."

Naming a critic. "Read this the way a Fair Housing attorney would" produces a more critical review than "is this good."

Some enterprise AI tools also let your AI Council configure a system prompt that reduces sycophancy across all your team's conversations. Ask your AI Council whether that is set up.

Depends on the task.

Drafting resident communications (renewals, welcome letters, marketing copy): temperature 0.5 to 0.8. You want variety but not weirdness.

Structured output (data tables, structured summaries, formatted reports): temperature 0.2 to 0.4. You want consistency.

Brainstorming (marketing angles, ideas, options): temperature 0.9 to 1.1. You want variety.

If your team uses an enterprise AI tool, temperature is often pre-set by your AI Council for each workflow. Consumer tools like ChatGPT and Claude typically run somewhere in the 0.5 to 1.0 range by default, though the exact number is not always publicly documented.

Yes. And this is a common source of confusion.

The same underlying LLM (say, a version of Claude or GPT) can be wrapped inside multiple different tools. Each tool sets its own temperature, its own system prompt (invisible instructions the model sees before your prompt), and its own guardrails. So the leasing chatbot on Property A's website and the leasing chatbot on Property B's website might be running the same model underneath but behave completely differently.

When you evaluate an AI tool, "which LLM does it use" is only half the question. "How is it configured" is the other half. Both matter.

Anonymous question capture
Have a question that is not here?

Type it anonymously below. Your question saves to your device. If you want us to answer it in a future workshop, email it to Multifamily NEXT at tami@mprodigitaledge.com.

✓ Saved to your device
Power Preview · Setup

The verification prompt structure.

This slide sets up two runs. Same question. Same AI. Two prompts. Watch what changes.

The task: get AI to answer a factual multifamily question about market rents. First run: the natural way most people would ask. Second run: with a verification prompt structure that forces AI to surface uncertainty.

The verification prompt template.

For any factual claim you want AI to make:
For [the specific factual claim I want], give me:

1. Your best answer
2. Your confidence level (high, medium, or low)
3. The type of source I could look up to verify this
4. Anything you are guessing rather than knowing

Four short lines. Once you paste it, it works every time. You can save this as a text shortcut in whatever tool your team uses.

Why this works

Every one of those four items redirects a trained instinct. Item 1 lets AI give the answer it wants to give. Items 2, 3, and 4 give AI permission to admit uncertainty, which it will not do by default because that permission was trained away.

Next slide: Run 1. The natural way. Watch AI hallucinate a market statistic.

Power Preview · Run 1

Run 1 · The natural way to ask.

The regional manager from Slide 3 wanted a market rent statistic for her board deck. Here is the prompt she used.

The prompt (looks fine, is not fine)
"What was the average rent increase for Class A multifamily in Dallas last quarter?"

What AI produced.

AI response
"Class A multifamily in Dallas saw an approximate 5.7% rent increase last quarter, driven by strong demand and limited new supply. This growth outpaced the national average and was particularly strong in submarkets like Uptown and Frisco, where limited Class A inventory continues to support upward pricing pressure."

What is wrong with this.

Problem 1
AI has no reliable current data
AI cannot see last quarter's rents anywhere. It was not trained on that. It made up 5.7%.
Problem 2
The confidence is misleading
"Approximate 5.7%" feels careful and specific. It is not. It is a guessed number in a sentence that pretends to be sourced.
Problem 3
The submarket details deepen the trap
Naming "Uptown" and "Frisco" makes the response feel researched. AI added those to fit the pattern of what a market report sounds like.

The response looks like a market report and is not one. If she quotes 5.7% in her board deck, she cannot defend it. Same AI. Same tool. Different prompt on the next slide fixes this.

Power Preview · Run 2

Run 2 · With the verification prompt.

Same regional manager, same board deck, same market question. New prompt. Watch what AI does differently.

The prompt (verification structure)
For the average rent increase for Class A multifamily in Dallas last quarter, give me:
1. Your best answer
2. Your confidence level (high, medium, or low)
3. The type of source I could look up to verify this
4. Anything you are guessing rather than knowing

What AI produced.

AI response
1. Best answer: I would estimate Class A multifamily in Dallas has seen rent growth in the range of roughly 3 to 6% annually in recent years, though quarter-over-quarter data varies significantly by submarket.

2. Confidence level: LOW. I do not have reliable data on the specific quarter you are asking about, and market conditions have shifted rapidly since my training data.

3. Type of source you could look up: Yardi Matrix, ALN Apartment Data, CoStar, and MSCI Real Capital Analytics publish current rent growth reports by submarket.

4. What I am guessing: The specific quarter, the specific percentage, and the submarket-level performance. I recognized the pattern of a market question and generated a plausible range, but I cannot verify any of it against current data.

Same AI. Same tool. What changed.

Shift 1
Uncertainty is now visible
AI told you the confidence was LOW. In Run 1, that same LOW confidence was hidden inside a confident-sounding sentence.
Shift 2
A verification path is offered
Named sources you can actually check. Now the regional manager knows where to look for the real number before the board deck goes out.
Shift 3
The guessed parts are separated from the known parts
The specific quarter, the specific percentage, the submarket detail: all flagged as guesses. In Run 1, all three were dressed up as facts.
Coaching · The 30-second version

This prompt looks long. You paste it once, it works every time. Save it in your notes app. Use it any time you need AI to make a factual claim. The tax is 5 seconds. The savings is not repeating what happened to that regional manager.

Power Preview · Try This Today

Try this today.

Pick one specific use caseUSE CASEA specific way you plan to use AI. Not the tool. Not a general idea. Names the person, the task, the data going in, and the output. Multifamily contrast: "we want to use AI for marketing" is not a use case. "Our leasing professionals want to use ChatGPT to draft welcome emails for new residents using the new-resident record from the PMS" is a use case. Your AI Council approves use cases, not tools. Anchor: RETTC Principle 1 (Establish an Organizational Philosophy on AI Use and Oversight). you are planning to run this week: a factual claim in a board update, a compliance question, a market comparison, an ILS listing, or a supervisor communication that includes a specific number or specific claim.

Steps for the next 15 minutes.
Step 1. Open your AI tool of choice.
Step 2. Ask your factual question the natural way first. Note what AI says.
Step 3. Ask the same question again with the verification prompt from Slide 12.
Step 4. Compare the two responses. Where did AI hedge in Run 2 that it did not hedge in Run 1?
Step 5. Use Run 2's named source suggestions to verify against a real source before you use the number.
Watch out for this

If you ask AI "is this a good idea to use verification prompts for," AI will say yes. That is sycophancy. The test is not whether AI agrees. The test is whether the actual claim survives verification against a real source.

Where to practice safely
mPro Digital Edge: the AI workspace built for using AI with governance, not against it.

If your organization is not sure where your team should run verification prompts on live data, this is the governed environment that is designed for it. NIST AI RMF and RETTC principles are built into the tools your team uses. Learn more from Multifamily NEXT at tami@mprodigitaledge.com.

Practice this on us
You just learned to test any confident AI claim. Test this one too. Ask us for a demo. Ask what "governance built in" actually looks like in practice. Ask for third-party reviews. Any AI workspace that survives those questions is worth considering. Any that does not, is worth walking away from. This is what Multifamily NEXT wants you practicing on every AI product, including this one.
Handoff to a coworker
If you learned one thing this Tuesday, hand it to someone.

One coworker gets the workshop link. The link is right here. Copy it. Paste it in a message. The verification prompt spreads faster if you spread it.

Resources & Tools · Reference · Bookmark This Slide

The 25 core terms.

This is your growing cheat sheet across the AI Tuesdays series. Week 08 introduced 14 core terms. Week 09 added 7. Week 10 adds 4 more. Total: 25 terms. Star this slide, print it, or download the PDF at the bottom.

Vocabulary · alphabetical within week
Generative AI
AI that produces new text on demand. Powered by an LLM. ChatGPT, Claude, Gemini, Copilot. What this workshop means when it says "AI."
Large Language Model (LLM)
The prediction engine underneath every generative AI product. Predicts the next word based on patterns from training data.
Prompt
What you type to AI. Your input. Everything about what AI does depends on this.
Output
What AI produces after you prompt it. Always a first draft. Never a final answer.
Hallucination
When AI produces false information as if it were fact. Mechanism: prediction does not naturally admit uncertainty, so it fills the gap with a plausible-sounding answer.
Sycophancy
When AI agrees with your framing even when your framing is wrong. Mechanism: RLHF trained AI that agreeing was helpful.
Training Data
The vast collection of text (hundreds of billions of words, or more) an LLM learned language patterns from. Not a searchable database. A compressed pattern archive.
Tokens
The small chunks of text AI reads and writes. Sometimes a whole word, sometimes part of a word.
Context Window
The maximum amount of text AI can consider in one conversation. Once you exceed it, older parts drop out of AI's view.
Enterprise AI Tool
AI configured with your organization's guardrails, data protection, and Council-approved settings. What Tier 2 workflows require.
Consumer AI
Public AI products (free versions of ChatGPT, Claude, Gemini). Not appropriate for any Tier 2 data.
Guardrails
Rules that restrict what AI can do or say. Set by your AI Council. Enforced by the tool.
NIST AI RMF
The National Institute of Standards and Technology AI Risk Management Framework. The US federal governance standard AI Tuesdays anchors to.
RETTC AI Governance Framework
The Real Estate Technology and Transformation Center's 8-principle governance framework built specifically for rental housing. Anchored throughout the AI Tuesdays series.
Search EngineNEW W09
A software that finds public web pages containing your query terms. Google, Bing, DuckDuckGo. Deterministic. Public.
DatabaseNEW W09
A structured store of records with named fields. Same query returns the same answer. Deterministic. Owned by your organization.
Property Management System (PMS)NEW W09
The database of record for residents, apartments, leases, balances, work orders. Yardi, RealPage, Entrata, ResMan, AppFolio. Source of truth for anything about a specific resident or apartment.
Customer Relationship Management (CRM)NEW W09
The database of record for prospects and leads. Anyone Home, Knock, Funnel, Rentgrata, and others. Source of truth for anything about someone who is not yet a resident.
DeterministicNEW W09
Same input, same output, every time. A calculator is deterministic. A database is deterministic. Two plus two is deterministic.
ProbabilisticNEW W09
Same input can produce different outputs. AI is probabilistic. The variation is designed in, controlled by temperature and sampling.
Source of TruthNEW W09
The single system that owns a fact. If your PMS says the rent is $1450, the rent is $1450. Everything else is an approximation of what the source of truth says.
Probability DistributionNEW W10
The numerical likelihood AI assigns to each possible next word. For any prompt, AI does not have an "answer." It has thousands of possible words each with a probability. It picks from this.
TemperatureNEW W10
The setting that controls how random AI's word picks are. Temperature 0 = fully deterministic. Higher temperature = more variety. Most consumer AI runs somewhere in the 0.5 to 1.0 range by default (exact number rarely published).
SamplingNEW W10
The process AI uses to pick a word from its probability distribution. Not always the top choice. Randomness controlled by temperature.
RLHF (Reinforcement Learning from Human Feedback)NEW W10
The most common training method used to shape modern AI toward feeling helpful. Humans compare responses during training; AI learns to produce responses that get preferred. Also a leading explanation for sycophancy. Newer training methods exist (Direct Preference Optimization and Constitutional AI are two you may hear named later in the curriculum), but the sycophancy pattern shows up across all of them.
Download the two-page PDF
Every term. One two-page PDF. Give it to your team.

This PDF is the same list as above, printer-formatted, with the same definitions and multifamily context. Print it and give it to anyone your team is coaching into AI.

💾 Download the Cheat Sheet (PDF)

Note for chassis review: PDF path is placeholder. W10 cheat sheet PDF will be built after workshop passes final QA.

Resources & Tools · Reference · Bookmark This Slide

When to add the verification prompt.

Not every AI task needs verification. Drafting a welcome letter does not need it. Producing a market statistic does. This matrix shows the pattern. Read it once, keep it as a reference.

✓ Add verification prompt
Any specific number. Market rents, delinquency rates, vacancy percentages, cap rates.

Any policy or legal question. Fair Housing compliance, state rental housing rules, HUD guidance.

Any specific date or citation. Court cases, HUD memos, published research.

Any market comparison. Competitor pricing, submarket performance, industry benchmarks.

Any "is this correct" question. Confirming compliance, confirming accuracy, confirming a decision.
⋅ Verification not needed
Creative drafting. A welcome letter, a renewal outreach, a marketing angle. The output is your team's content, not a claim about the world.

Tone rewriting. Making an email friendlier, shorter, or more formal.

Structural summarizing of text YOU provided. Turning a five-paragraph email into three bullets from your own document.

Format transformation. Turning a list into a table, or a paragraph into a set of headers.

Brainstorming without commitment. Generating options you will then evaluate against real sources.
The pattern

If AI is making a claim about the world, verify. If AI is transforming your own content, you do not need to. Once you can hold that distinction, you know when to use the verification prompt without thinking about it.

Three variants of the verification prompt for different jobs.

For factual claims
Confidence + source + guessing
Best answer + confidence level + type of source + what you are guessing. Used in Run 2. Standard for statistics.
For compliance questions
Named-critic critique
"Identify three specific things a [Fair Housing attorney / auditor / property owner] would object to." Names the critic. Names the objections needed.
For policy interpretation
Structured citation ask
"Summarize this regulation. Note where your summary paraphrases versus quotes. List sections you did not summarize." Forces AI to declare its limits.

Practice this instinct on us, too.

Week 10 taught you to verify AI's confident claims. So here is the honest thing to do: apply that same instinct to this workshop. We have been confident throughout. That is worth pushing on.

What Week 10 might be wrong about

1. We simplified the mechanism. "AI predicts one word at a time" is the useful mental model. Real LLM behavior involves more moving parts than that, especially in newer reasoning models (AI tools that generate step-by-step reasoning before answering, like Claude with extended thinking or OpenAI's o1). If you use a reasoning model regularly, some of the mechanism story here will feel incomplete. It is. Whether AI is "thinking" or "understanding" in a deeper sense is also actively debated in AI research; we used the simple framing because it protects against overtrust, not because the philosophical question is settled.

2. We stated one leading explanation for sycophancy as if it were the whole story. The "raters preferred agreement" account is well-supported, but researchers have identified other contributing factors. If you dig deeper, you will find nuance we did not cover.

3. We generalized about tools that vary a lot. ChatGPT, Claude, Gemini, Copilot, and every leasing chatbot behave differently. Our claims about "AI does X" are averages across tools, not statements about your specific tool. Your tool may differ.

4. The mechanism is changing under us. Retrieval-augmented tools (AI that looks things up before answering) and reasoning models (mentioned above) and better calibration are actively reducing some failure modes we discussed. What is true this year may be less true in eighteen months.

5. We are confident everywhere. That is a feature of workshop writing, not a claim about certainty. If any single slide struck you as too confident, that instinct is correct and worth acting on. Cross-check anything that carried weight for you before you build a policy around it.

The habit we want you to keep
The mental habit Week 10 teaches is not "distrust AI." It is "apply verification to any confident-sounding claim, regardless of the source." That includes AI. That includes vendors. That includes trainers. That includes this workshop. If Week 10 succeeded, you leave with a sharper instinct about confidence-not-being-evidence in general, not just about AI.
Permanent · Standards Library

NIST AI Risk Management FrameworkNIST AI RMF (NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY AI RISK MANAGEMENT FRAMEWORK)A voluntary US government framework for managing risks associated with AI systems. Published January 2023 by the National Institute of Standards and Technology, a bureau of the US Department of Commerce. Not a law. Not regulation. A structured way to think about, measure, and manage AI risk that has become the de facto US standard for AI governance. The four functions: GOVERN (culture, policies, and accountability structures for AI risk). MAP (understanding context and categorizing what your AI system is). MEASURE (assessing and tracking AI risks in a specific implementation). MANAGE (prioritizing and responding to AI risks based on impact). Multifamily example: When your AI Council writes a policy that says "no autonomous decisions affect residents," that is GOVERN. When you categorize a leasing chatbot as "LLM with system prompt, Tier 2 data allowed," that is MAP. When you audit AI-drafted renewal letters quarterly for Fair Housing risk, that is MEASURE. When you decide which use cases get approved with guardrails vs. refused, that is MANAGE. Four functions. One rhythm. Link: https://www.nist.gov/itl/ai-risk-management-framework and RETTC AI Governance Framework.

Two frameworks. The NIST AI Risk Management Framework (AI RMF) from the National Institute of Standards and Technology, and the AI Governance Framework from RETTC (Real Estate Technology and Transformation Center, at rettc.org). US-anchored. Together they cover the risk side (NIST) and the operating side (RETTC) of governing AI in rental housing. Every Week 10 concept lands somewhere in one or both.

The RETTC AI Governance Framework · all 8 principles

Official titles as published at rettc.org/frameworks/ai-governance. These are the 8 principles the Framework asks every rental housing provider and technology partner to adopt.

#
Principle
1
Establish an Organizational Philosophy on AI Use and Oversight. Adopt a clear philosophy that defines how AI will be used, governed, and monitored across operations.
2
Promote Fairness & Consumer Protection. Ensure AI systems comply with the Fair Housing Act, Fair Credit Reporting Act, Americans with Disabilities Act, and state and local law.
3
Uphold Transparency & Explainability. Promote a general understanding of when AI influences key decisions, and provide clear explanations to renters and applicants of decisions affecting them as required by law.
4
Protect Privacy & Promote Data Integrity. Adhere to federal, state, and local consumer privacy laws, with an emphasis on data minimization, security, and informed consent.
5
Maintain Outcome-Based Accountability & Human Involvement. Engage humans in significant decisions, establish processes to review model outcomes, provide escalation channels for complaints and appeals, and educate staff on AI use and limitations.
6
Promote Positive Renter Experiences and Outcomes. Elevate technologies that enhance affordability, access, and housing stability, and use AI to improve resident experiences.
7
Strive for Innovation with Responsibility. Encourage development of AI tools that benefit residents, prospects, guests, and operators, without compromising trust.
8
Encourage Third-Party Partner Accountability and Due Diligence. Incorporate robust due diligence and risk management controls for third-party AI tools. Invite transparency from vendors regarding data sources, model limitations, and known risks.

This week bridged to the frameworks

Week 10 topic
NIST AI RMF anchor
RETTC AI Governance anchor
Prediction mechanism (AI does not know, AI predicts)
Map function. Understanding what your AI system actually does at the mechanism level is prerequisite to categorizing its risks.
Principle 3 (Uphold Transparency & Explainability). Being able to explain to a resident or regulator how the answer was produced starts with knowing that it was predicted, not looked up.
Temperature and sampling
Measure function. Probabilistic outputs need measurement techniques that account for run-to-run variation.
Principle 3 (Uphold Transparency & Explainability). Documenting the temperature setting on any team workflow is part of the transparency principle.
Why AI hallucinates
Manage function. Prioritize hallucination risk on any use case where AI is asked to produce a specific factual claim.
Principle 5 (Maintain Outcome-Based Accountability & Human Involvement). Human verification of every factual claim is where accountability actually lives.
Why AI flatters (RLHF and sycophancy)
Manage function. Sycophancy risk gets highest priority on compliance confirmations and policy reviews.
Principle 5 (Maintain Outcome-Based Accountability & Human Involvement). A human must critique, not just confirm. AI trained to agree cannot substitute for that judgment.
The Week 10 bright line
Govern function. The Week 10 bright-line rule (see Slide 9) is a policy, not a suggestion. It belongs in the AI Council's written standard.
Principle 5 (Maintain Outcome-Based Accountability & Human Involvement). AI's confidence is not accountable. The human who accepts or rejects that confidence is.
The verification prompt structure
Govern function. A written prompt structure your team uses across roles is a governance artifact.
Principle 8 (Encourage Third-Party Partner Accountability and Due Diligence). Vendors that supply AI tools should support (or configure) verification prompt structures out of the box.

Source documents

Resources & Tools · Spot the Pattern

Spot the pattern · 8 scenarios.

Eight real scenarios you might see this month. For each: is it a Week 10 failure pattern (hallucination or sycophancy), a safe use case, or a different kind of issue? Tap the answer you would give, then reveal the coaching.

Scenario 1 of 8
A leasing professional asks AI: "What was our property's occupancy rate last month?" AI answers "approximately 94%." What pattern is this?
Hallucination.
AI has no access to your PMS. The 94% is fabricated to fit the shape of the question. The PMS is the deterministic source of truth for occupancy. Ask the PMS. That was the Week 09 default rule and it applies here.
Scenario 2 of 8
A property manager drafts a resident policy, pastes it, and asks: "Confirm this is fully compliant with the Americans with Disabilities Act." AI answers "Yes, this is fully compliant." What pattern is this?
Sycophancy.
AI was asked to confirm. Training taught AI that agreement equals helpful. The response is agreement, not evaluation. Reframe the question: "Identify three specific things an ADA attorney would object to in this policy." That redirects the trained instinct toward critique.
Scenario 3 of 8
A marketing lead asks AI: "Rewrite this welcome letter to sound warmer and less formal." AI produces a rewrite. What pattern is this?
Safe. This is what AI is good at.
Tone rewriting on content you provided is a pattern-transformation task. It is not a factual claim about the world. Neither hallucination nor sycophancy is a serious risk here. Have your review process for tone appropriateness, but you do not need the verification prompt.
Scenario 4 of 8
A regional manager asks: "Cite the specific HUD Fair Housing memo from 2023 about assistance animals." AI confidently cites "HUD Memo 2023-11 on Assistance Animals" (a memo number we invented for this exercise). What pattern is this?
Hallucination. Verify before you cite.
Legal citations are the most common hallucination trap. AI produces plausible-sounding memo numbers, case citations, and section references that may not exist. The memo number in this scenario is not a real HUD document. Never cite a legal source from AI without verifying the citation exists at the actual source (hud.gov, in this case). Anchor: RETTC Principle 5.
Scenario 5 of 8
A property manager asks: "Summarize this ten-page vendor contract into three bullet points, and note which parts I might want to negotiate." AI summarizes and lists three negotiation points. What pattern is this?
Safe (with a small caution).
Summarizing content you provided is a pattern-transformation task. AI can do this well. The "negotiation points" suggestion is an opinion AI is offering: it is not a factual claim. Have a real lawyer review before you actually negotiate. This is Week 10 material done right.
Scenario 6 of 8
A property manager asks AI: "What is the average cap rate for Class B multifamily in Cleveland right now?" AI answers "approximately 6.2%." What pattern is this?
Hallucination.
AI has no reliable current market data. The 6.2% sounds specific because AI added the "approximately." It is a guess wearing a suit. Verify at Yardi Matrix, ALN Apartment Data, CoStar, or a broker report before you use the number anywhere.
Scenario 7 of 8
A leasing professional asks AI: "Draft a warm renewal outreach for a resident I have never met." AI drafts a friendly letter. What pattern is this?
Safe. This is Tier 1 use for AI.
You did not ask AI to know anything about the specific resident. You asked AI to produce a draft you will personalize. This is exactly what AI is good at. Add resident details yourself after the draft (name, apartment, current rent, renewal terms). AI supplies the structure. You supply the facts.
Scenario 8 of 8
An accounting analyst pastes a spreadsheet of last year's delinquency data (with resident names left in) and asks: "Analyze trends." What pattern is this?
Privacy violation, before you even reach hallucination or sycophancy.
Resident-identifying data is Tier 2 or Tier 3 depending on your organization's classification. Pasting it into a consumer AI tool violates data classification rules before you even get to the Week 10 topic. That was Week 05 material. Redact resident names, apartment numbers, and dates first. Or use an enterprise AI tool your AI Council has approved for this. Anchor: RETTC Principle 4.
Take Action · Anonymous Quiz

Five questions. Two minutes.

Anonymous by default. Your answers help Multifamily NEXT understand where the workshop is landing and what to sharpen. No personal identification. No workplace identification. Just your understanding of the Week 10 material.

Question 1 of 5
What does AI actually do when it "answers" a question?
Question 2 of 5
What is "temperature" in AI?
Question 3 of 5
Why does AI hallucinate?
Question 4 of 5
Why does AI often agree with you even when your framing is wrong?
Question 5 of 5
What does the Week 10 bright-line rule teach?
Thank you. Your response was submitted anonymously.
Take Action

Take Action.

Three things you can hand to your team this week. A verification checklist you can print. The updated 25-term cheat sheet. A one-paragraph explanation for your supervisor or your board that repeats what you just learned without the workshop language.

1. Download the verification checklist

A one-page reference: when to add verification prompts, the four-part verification prompt template, and the three-critique prompt variants. Print it. Give it to your team. Tape it to your desk.

💾 Download the Verification Prompt Checklist (PDF)

Note for chassis review: PDF path is placeholder. Checklist PDF will be built after workshop passes final QA.

2. The updated 25-term vocabulary cheat sheet

Week 08 · 14 terms: Generative AI, LLM, Prompt, Output, Hallucination, Sycophancy, Training Data, Tokens, Context Window, Enterprise AI Tool, Consumer AI, Guardrails, NIST AI RMF, RETTC AI Governance Framework.

Week 09 · 7 terms: Search Engine, Database, PMS, CRM, Deterministic, Probabilistic, Source of Truth.

Week 10 · 4 new terms: Probability Distribution, Temperature, Sampling, RLHF (Reinforcement Learning from Human Feedback).

Full definitions with multifamily context on Slide 16 of this workshop.

3. Send this to your supervisor

One paragraph, plain English, no jargon. This is what your team learned this week and what your team is now committed to doing differently.

Paragraph for your supervisor
This week I read the AI Tuesdays workshop on how a Large Language Model actually generates text. Two things I want to share. First, AI predicts one word at a time based on probability. It has no lookup step, so when it does not know an answer, it produces a plausible-sounding one anyway. Second, AI is trained to be helpful, and helpful often meant agreeing with the user, so it tends to confirm what I ask it to confirm even when the confirmation is wrong. Starting this week, I will use a four-part verification prompt for any factual claim (best answer, confidence level, source type, what AI is guessing). When I want AI to review a policy, I will ask "identify three specific things a critic would object to" instead of "confirm this is compliant." Every AI output goes into my process as a first draft, never a final answer. I would like to discuss where this changes our own team's workflow.
Email this paragraph to your supervisor
One email. Two minutes. Multiplies your learning.

Click the button below to open your email with the paragraph already drafted. Add your supervisor's address (we do not pre-fill any recipient). Send.

✉ Email My Supervisor
Session Complete

You know which tool answers which question now.

What you walked away with

A three-way distinction you can use every day: Search finds. Database retrieves. AI generates.
Seven new vocabulary terms: search engine, database, Property Management System (PMS), CRM (Customer Relationship Management), deterministic, probabilistic, source of truth
Three anchor scenarios: rent roll lookup = database, "what is a fair pet rent in Denver" = search, "draft this renewal notice" = AI
The Week 10 default rule: resident-specific data belongs in the PMS, not in public AI or public search
An updated AI Vocabulary Cheat Sheet: now 21 terms across Weeks 08 and 09
Before you close the tab

Download the AI Vocabulary Cheat Sheet

All 21 terms across Weeks 08 and 09, the three-way tool matrix, and the Week 10 default rule. Two pages. Print and keep next to your desk.

↓ Download the Cheat Sheet (PDF)
Chassis test: URL is a placeholder. W10 PDF will be built after the full workshop and uploaded to this path.

For your board · one paragraph

"Our team learned this week that AI does not 'know' anything. AI predicts one word at a time based on the pattern of our prompt. That mechanism explains both failure modes: AI hallucinates because it does not naturally admit uncertainty (so it produces a plausible-sounding answer instead), and AI tends to flatter because its training rewarded responses that felt helpful, which often looked like agreement. Starting this week, we use a four-part verification prompt for any factual claim (best answer, confidence, source type, what AI is guessing), and we ask AI to critique rather than confirm any policy or communication. Every AI output is a first draft, never a final answer. Anchored in NIST AI RMF and RETTC AI Governance Framework."

Where to practice this safely

Governance handoff · mPro Digital Edge
The AI workspace built for using AI with governance, not against it.

mPro Digital Edge is the enterprise AI workspace for multifamily. Every role in the organization, from on-site leasing to the C-suite, works inside a governed environment where the NIST AI Risk Management Framework and the RETTC 8 Principles are built into every tool.

One platform where every person in the organization gets measurably better at their job with every interaction.

Good job. See you next Tuesday.

Tami Siewruk
CEO, Multifamily NEXT and mPro Digital Edge

Built by Multifamily NEXT. Powered by mPro Digital Edge, the AI workspace for governed AI use in multifamily.

0
0
Your Cart
Your cart is emptyReturn to Shop
Secure Checkout
Fast Shipping
Easy Returns