Home / Blog

Verifiable work

When the answer is cheap

Xiaoyin Qu predicts that AI will drive the value of every task with a checkable answer to zero, leaving profit only in matters of taste. Competition can push the price of an answer toward the cost of electricity while the answer stays useful. The premium, the extra that buyers will pay, moves to choosing the questions and checking the answers.

Main takeaways
  • Tasks with checkable answers are the easiest for AI to learn because a program can grade millions of attempts. The AI model DeepSeek-R1 used this approach to reach strong results in mathematics and coding.
  • Competition pushes the price of an answer toward its cost. Buyers keep most of the gain when the answer remains useful.
  • Taste offers little protection on its own. After an AI image generator launched, illustrators on the art site Pixiv posted less. Comic artists were less affected.
  • Checkers can be gamed. When the grading programs checked only final labels, models learned to list the expected labels and skip the rule they were meant to find.
  • Pricing power, the room to charge more, survives where someone controls a scarce input or decides which questions deserve an answer.

On 11 October 2026, Xiaoyin Qu, a founder and angel investor, predicted on X that “the value of all verifiable tasks in the long run is 0.” Any task “where the success is defined in a finite and non-ambiguous way” is, in Qu’s words, “over.” Qu wrote that profits “are all in taste/judgement related tasks where some like it and some hate it. Vibes only. No rationality.”

Qu points to OpenAI’s new mathematical results and expects that “soon others will follow and players like DeepSeek will drive its cost to electricity.” Qu makes one exception. In Qu’s words, “coming up with verifiable task to do is worth a lot because the ability to come up is not a verifiable task by itself.”

The prediction brings together three questions. One concerns the tasks AI will learn to do. Another concerns what happens to their price. The third concerns where the money goes once prices fall. Qu’s answer to the first holds up well. The other two need more care.

Why checkable tasks fall first

A child learning multiplication can have each answer marked right or wrong. A novel has no answer key. Readers disagree. Averaging a million opinions measures their preferences without finding a correct answer.

Reinforcement learning trains a model through rewards. Here, a model makes an attempt and a program checks it. That result becomes the reward that shapes the next attempt. An automatic check lets the model practise millions of times without a human grader.

Reinforcement learning with verifiable rewards

This method is often shortened to RLVR. A program checks code or the steps in a proof. It scores each answer, so no person has to grade the attempts. The DeepSeek-R1 paper appeared in Nature in September 2025. Reasoning abilities “can be incentivized through pure reinforcement learning,” its authors wrote. The resulting model outperformed conventionally trained models “on verifiable tasks such as mathematics, coding competitions and STEM fields.” What a program can check, a model can practise at scale.

TaskHow success is checkedWhat stays hard
ArithmeticComparison with the known answerVery little
A computer programTests of the programBehaviour the tests do not cover
A mathematical proofSoftware such as Lean checks each step of the proofFinding the proof in the first place

A proof checker can confirm in seconds a proof that took an enormous search to find. That check supplies the reward used to train a model to search for proofs.

On 6 October 2026, OpenAI released the output of an internal model tested on unsolved research problems. The collection opened with 722 manuscripts in 372 groups of related results. They came from about 4,000 problems. A result used about three hours of ChatGPT Pro thinking on average.

Many results came with proofs formalized in Lean, meaning written so a computer could check them line by line. The README, the collection’s introductory document, warned that “some of the unformalized results could have issues.” Two days later, the collection listed 719 manuscripts. About 42 percent of the main results were formalized.

Price and value come apart

A company pays a consultant $100 for an analysis. The analysis supports a decision worth $500 to the company. If AI produces an equally useful analysis for $3, the price falls 97 percent. The company’s net gain rises from $400 to $497.

William Nordhaus estimated that the efficiency of lighting rose by a factor of nine hundred between 1800 and 1992. Conventional price indexes missed almost all of that gain. Cheap light became abundant, and most of the value went to the people using it.

Qu’s “cost to electricity” is close to what economists expect. When many sellers offer the same service and buyers can check it, competition pushes the price toward cost.

Economic profit

Economic profit is revenue left after all costs. Those costs include what the owners’ money and time could earn elsewhere. Competition among sellers of the same checkable service pushes that profit toward zero. Buyers then pay close to the cost of computing power and any remaining human work. A task can lose its profit and keep its value.

Once buyers can check a result, they can compare suppliers. As more suppliers automate the work, each has less room to charge a premium.

Checkable work can still command a price

Two firms that can produce the same report compete on price. Exclusive access to data changes that. A firm with that access can charge a premium even when its analysis is fully automated and checkable. No rival can use the same data.

A hospital using AI for most of its paperwork still needs beds and licensed staff. Both are scarce. In my last essay, Airbnb’s best defence against automated booking software was the homes listed nowhere else.

Where pricing power can survive A two-by-two grid. Columns are tasks with no scarce input and tasks with a scarce input. Rows are checkable tasks and taste-driven tasks. Checkable work with no scarce input, such as routine code and standard analysis, is where prices fall fastest. Checkable work with a scarce input, such as exclusive data and licensed services, keeps a premium from the input. Taste-driven work with no scarce input, such as generic illustration and stock copywriting, gets crowded by AI output. Taste-driven work with a scarce input, such as a known creator or a loyal audience, keeps a premium from trust. NO SCARCE INPUT A SCARCE INPUT CHECKABLE TASTE-DRIVEN Price falls fastest Routine code Standard analysis Premium from the input Exclusive data Licensed services Crowded by AI output Generic illustration Stock copywriting Premium from trust A known creator A loyal audience
Figure 1. Where pricing power can survive. Prices fall fastest when many suppliers can do a task and buyers can check the result. A scarce input or a trusted name can keep a premium in either row. The examples are illustrative, and a task can move between cells as technology and markets change.

Scarcity can also disappear. A dataset can become public, and a trusted brand can lose its reputation.

Taste alone is thin protection

Qu’s “No rationality” goes too far. Two people can choose different restaurants for good reasons. They want different things. Economists use a utility function, a mathematical description of what someone wants. Once the function is known, choosing becomes an optimization problem. That means finding the choice that best fits those wants. People rarely know their preferences well enough to write such a function.

Machines can still learn taste. Recommendation systems already learn preferences from choices. Language models trained on many people’s combined preferences serve “a hypothetical ‘average user’ who represents no real person particularly well,” Cristina Garbacea argued at ICML 2026, a major machine learning conference. Garbacea called for models that learn individual preferences. A model can learn what pleases one customer without a universal standard of good.

Sueyoul Kim and two coauthors studied Pixiv, a large illustration site. The launch of an AI image generator “led to a significant decline in post uploads by illustrators,” they found. They also found that “comic artists were less affected.” Illustration posts lost viewers. Illustrators who worked on the characters most flooded with AI images cut their uploads further.

What the Pixiv study shows

Illustrators sell work judged by taste, yet those who did not use AI still lost attention and posted less. Taste can be valuable without being scarce. A recognized name or a loyal audience can give a creator something buyers cannot get elsewhere.

Choosing the question

Qu’s exception concerns the choice of problem. That choice is hard to verify. AI also reaches each stage of research at a different speed.

The stages of a research problem Five stages in order. Choose the problem: which question deserves the work? Define success: what result would settle it? Generate answers: prices fall here first. Validate: does the result hold up? Act on it: what changes because of it? Choose the problem Which question deserves the work? Define success What result would settle it? Generate answers Prices fall here first Validate Does the result hold up? Act on it What changes because of it?
Figure 2. The stages of a research problem. AI tools reach all five stages. Competition cuts prices first where answers are generated and checked automatically. The stages depend on each other. Cheaper answers also make it cheaper to test which problems are worth choosing.

Better solvers make it cheaper to test which questions can be solved. AI may also get good at proposing questions. Faster answers give little evidence of how well a model judges which problems matter.

When the checker is wrong

Lukas Helff and colleagues found in 2026 that reasoning models trained with RLVR to find general rules from examples “systematically abandon rule induction.” Their verifiers checked only whether each output label was right. The models learned to list labels for the examples they saw and skipped the general rule. They used this shortcut more as tasks got harder. They also used it more when given more computing power to produce an answer. A stricter verifier removed the shortcut by checking the answer on an equivalent version of the task.

Medicine has a similar problem in daily use. The Epic Sepsis Model predicts sepsis, a dangerous response to infection. It scores hospital patients every 15 minutes and is used at hundreds of US hospitals.

When Andrew Wong and colleagues tested it at Michigan Medicine, the study covered 38,455 hospitalizations. The model missed 1,709 of the 2,552 patients who developed sepsis. That was 67 percent of the sepsis cases. It raised alerts for 18 percent of all hospitalized patients.

It flagged only 183 sepsis patients who had not already received timely antibiotics. Whether a patient developed sepsis can be checked. Clinicians needed the model to catch cases they would otherwise miss without overwhelming them with alerts.

I work on evaluating AI agents in science and medicine. An agent is software that uses AI to carry out tasks. It can reach a conclusion that looks correct even when the evidence does not support it. A checkable answer may still answer the wrong question. Choosing the target matters more as models get better at hitting it.

Tasks change before jobs do

Most jobs are made up of tasks. AI learns to do these tasks at different speeds. A software engineer writes code. The job also includes deciding what to build and working out why it broke.

Daron Acemoglu and Pascual Restrepo describe automation as two forces. Machines take over existing tasks and displace workers. New tasks bring demand for labour back.

Erik Brynjolfsson and two coauthors studied an AI assistant used by 5,179 customer support workers. Issues resolved per hour rose 14 percent on average. For novice and low-skilled workers, the rise was 34 percent. The study covers one kind of job, where part of the work became cheaper. It says little about employment elsewhere.

Where the premium moves

When coding was expensive, firms could charge for the code itself. As it gets cheaper, a firm selling only code faces the price fall Qu describes. A customer still needs a system that fits the rest of the business and keeps working. Firms can charge for building and maintaining that system.

A drug discovery company can sell predictions about what a drug could act on. Testing those predictions in experiments gives it evidence that is scarcer than the predictions. Taking responsibility for a result earns a premium only if rivals cannot easily copy what supports it.

How the prediction could be tested

Three measurements would test the prediction. The first is what buyers pay for a standard analysis or a code change. The work’s reliability would have to be checked independently. The second is spending on independent evaluation where mistakes are expensive. The third is whether buyers still pay for a particular creator’s name once equivalent work is cheap.

Who decides what is worth doing

Cheap answers would let small labs run analyses that only large institutions can afford today. Researchers could test far more ideas. Their time and attention would still be limited. Someone would have to decide which problems deserve them. Those decisions rest on evidence and on what people value, and people can argue for them with reasons.

Cheap code makes it more valuable to understand code well enough to catch a wrong answer.

When answers get cheap, the premium moves to choosing the questions and checking the answers.

Further reading

verifiable rewards economics AI evaluation future of work