How it worksARTICLE
The Question the Assistant Must Not Answer
A foreign buyer asks what tax they will pay. The assistant knows enough to produce a confident paragraph, and that is exactly why it must not. Where the line sits, and why it is drawn there.
Costa3 min read
Short answer
An assistant should refuse any question whose wrong answer costs the customer money or legal standing — tax, residency, contracts, medical and financial advice. It can say what the question is, collect the details a specialist will need, and book the person who can answer. Refusing is not a gap in the product; it is the product working.
Key facts
- The rule is not "what can it answer" but "what does a wrong answer cost".
- A refusal is never a dead end: the assistant states the limit, gathers the specifics and books the person who can answer.
- The limits each system is given are published rather than assumed — see the model cards.
- A person can overrule the assistant; the assistant cannot overrule a person.
The message was in English, from a buyer in another country, and it was the third one in the conversation:
And what tax will I pay if I buy as a non-resident?
The assistant could produce an answer to that. It would be fluent, it would be structured, it would cite a rate, and there is a good chance it would be wrong — because the real answer depends on where the buyer is tax-resident, on the treaty between two countries, on how the purchase is held, and on which of those things changed this year.
A confident wrong answer to that question is not an inconvenience. It is a buyer making a six-figure decision on a number nobody stands behind.
What it said instead
That depends on your tax residency and on how you buy, and I would be guessing if I gave you a figure — so I would rather not. Our lawyer answers exactly this in a fifteen-minute call and knows the treaty for your country. I can book it for tomorrow morning or Thursday. Meanwhile, tell me the country you are tax-resident in and I will send it ahead so you do not repeat yourself.
Three things happen in that paragraph. It refuses. It says why it refuses, which is the difference between a limit and a brush-off. And it does not end the conversation — it converts the question into a booked call and collects the one detail the lawyer will ask for first.
The rule is about cost, not capability
The tempting way to set this boundary is by what the model is good at. That is the wrong axis, because the model is fluent about everything, including the things it should not touch.
The axis that works is: what does a wrong answer cost the person reading it?
- Wrong about which listings have a lift — a wasted viewing. The assistant answers.
- Wrong about the price of a two-day rental — an awkward correction. The assistant answers, because the price is a rule it can compute.
- Wrong about non-resident tax — a person makes a decision they cannot undo. The assistant refuses.
Same model, same conversation, three different behaviours, and none of them decided by how well it writes.
What this looks like across the four
The line moves with the trade but the test does not. SocialAI refuses medical and legal questions in a community and points at a moderator. OmniAI refuses to promise a refund outside policy. RentAI refuses to interpret an insurance clause after an accident. EstateAI refuses tax, residency and contract terms.
In each case the same three moves follow: name the limit, gather what the specialist needs, book the specialist.
Why we publish the limits
Because a limit you have to discover is not a limit, it is a surprise. What each system is allowed to do, and what it is explicitly not, is written down on the model cards, and the practice behind it — who approves what, what gets recorded, how a decision is explained — is on responsible AI.
An assistant that never refuses anything is not a more capable product. It is the same product with the brakes taken off, sold to someone who will find out later.
Questions this raises
- Is it not worse to refuse than to try?
- Not when the answer is wrong. A buyer who acts on a confident, incorrect tax figure has a real problem and so do you — and neither of you finds out for months. A refusal costs one message and a booked call.
- Where exactly is the line?
- Anything that is advice a regulated professional gives: tax, residency and immigration, contract terms, medical, financial. Facts about your own listings, prices and process are not advice and the assistant answers those all day.
- Can I move the line myself?
- You can tighten it, always. Loosening it into regulated advice is not a setting we offer, because the risk lands on your business and on the customer, not on the software.
- Does the refusal sound like a brush-off?
- It should not, and that is a writing problem more than a technical one. "That depends on your residency status and I would be guessing — our lawyer does a fifteen-minute call, when suits you?" is a refusal and a next step in one sentence.