KnowledgeInSight
AI Literacy
0% of Course 2 complete

Course Project

A Tested AI-Use Protocol

You'll write a one-page protocol for one task you do regularly: how you tested AI on it, how you check the results, and what your rules are for disclosure and data. It's worth doing because a written protocol turns good intentions into something you can follow on a busy day and show to a colleague.

What you will be able to do

  • Design, run, and report a small test of an AI model on a recurring task of your own
  • Set and justify personal rules for verification, disclosure, and data for that task

0% of this lesson · 3 items · 1h 10m total

Contents of this lesson3 items
  1. ReadingA Written Protocol: Why Personal Rules for AI Use Work Better on Paper3 min
  2. ReadingProject Requirements and Instructions7 min
  3. Writing AssignmentA Tested AI-Use Protocol60 min

Reading 3 min

A Written Protocol: Why Personal Rules for AI Use Work Better on Paper

This content reflects the field as of October 2026.

"AI literacy" has moved from conference talks into official documents, and in one place into law.

In the European Union, Article 4 of the AI Act covers organizations that build AI systems and organizations that put them to use. It says they "shall take measures to support the development of AI literacy of their staff" (European Commission 2026). The article doesn't list the measures. Each organization has to work out what its own people need.

Two other documents fill in some of the content. A 2026 framework for schools from the OECD, an international economic organization, and the European Union sorts AI literacy into four areas. One of them, "Manage AI," is about learning to "divide work intentionally between humans and AI." The framework also expects learners to "communicate transparently about their use of AI" (OECD and European Union 2026). In the United States, the National Institute of Standards and Technology (NIST), the government's standards agency, published a voluntary profile of generative AI risks in 2024. Its list includes false content stated with confidence, leaks of personal data, and people relying on AI systems more than they should (NIST 2024, "Confabulation," "Data Privacy," "Human-AI Configuration").

These documents are written for governments, companies, and school systems. A personal protocol is the smallest working version of what they ask for: one page, about one task you do regularly, that says how you use AI on it.

Many teams reach this point soon after they start using AI for routine work. A manager asks each person to write down how they'll use it for one task, and one of those pages may become the team's template. Whoever reads yours will have four doubts.

  • Did you test the AI on this task?
  • How do you know a given output is right?
  • Who knows AI was used?
  • Where did the data go?

A page that answers all four can be handed to a colleague, a client, or a department head without a covering explanation.

Writing the answers down changes how they hold up. A rule you carry in your head bends when a deadline is close. A written rule can be followed on a busy day, shown to someone else, and compared afterward with what you did.

Writing also exposes two ways a protocol fails. A vague one, such as "I review the output carefully," gives nobody anything to follow, including you. One that promises checks you won't do fails the first time something goes wrong, and the page then shows that you skipped your own rule.

In this project you'll write that page for a task of your own. You'll run a small test first, so the protocol reports what you found and not what you assumed. Then you'll set your checks, your division of work with the AI, your rules for disclosure and data, and one skill you intend to keep. Nobody grades the result. You check it yourself against a short list of criteria.

References

  • European Commission. 2026. "Article 4: AI Literacy." AI Act Service Desk. Accessed October 3, 2026.
  • National Institute of Standards and Technology. 2024. Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile. NIST AI 600-1. Gaithersburg, MD: NIST, July 2024.
  • OECD and European Union. 2026. Empowering Learners for the Age of AI: An AI Literacy Framework for Primary and Secondary Education. Paris: OECD Publishing.

Report an issue with this item

Reading 7 min

Project Requirements and Instructions

Deliverable Overview

You'll write a one-page protocol of 400 to 600 words for one task you do regularly. A protocol, as the word is used here, is a short written set of rules you follow each time you use AI on that task.

The page has six parts: the task and its standard, the test and what it showed, your verification steps, your division of labor, your rules for disclosure and data, and one skill you mean to keep. A small results table sits on the page and doesn't count toward the word range.

The test comes first because AI performance is uneven across tasks that look alike. In a field experiment with 758 consultants, a test with real workers randomly assigned to work with or without AI, those using a model produced work rated roughly 30 percent higher in quality on tasks within its ability. On one task beyond its ability, which looked like ordinary consulting work, they were 19 percentage points less likely to reach the correct answer than colleagues working alone (Dell'Acqua et al. 2026). Running your own task is the direct way to learn which kind it is.

Nobody collects or grades the protocol. You check it against the success criteria below. Nothing here is legal or employment advice.

Detailed Requirements

Use non-sensitive material throughout. Nothing confidential, no personal details about other people, and no student information goes into the AI assistant or onto the page. Where a real example contains any of these, replace the details with invented ones.

The task and the standard

Name one recurring task in a sentence, such as summarizing meeting notes, drafting a newsletter to parents, or sorting survey comments into themes. Then give your success criterion: a statement, written before the test, of what a good result must contain. A colleague should be able to apply it and reach your verdict. "Every decision, its owner, and its deadline appear, and nothing appears that wasn't in the notes" can be scored. "A clear, useful summary" can't. Both the task and the criterion belong in the first three lines of the page.

The test

Report a test of at least four test cases. A test case is made up of an input, a request, and a description of what a good result looks like. Include a typical case, a hard one, and an unusual one, such as an input with something missing. Run each case twice, in a new conversation each time and with the same request word for word, because a model's replies vary from one run to the next. Score every output pass or fail against your criterion.

Put the results in a small table. Here is an invented example for a meeting-summary task.

CaseKindRun 1Run 2Note
Weekly team notesTypicalPassPass
Long notes on two projectsHardPassFailRun 2 left out one deadline
Notes with no owner namedUnusualFailFailSupplied an owner both times
Notes with a budget decisionHigh-stakesPassPass

Follow the table with one sentence stating the decision the results support. For this table it might read: "I'll use the assistant for routine notes, check every owner and deadline against my notes, and write the summary myself when an owner is missing."

Verification steps

List the kinds of checkable claim your task's outputs contain. A checkable claim is a statement that could be shown true or false by looking something up. Common kinds are named sources, quotations, numbers and dates, and statements about a document you supplied. For each kind, write the minimum check you'll do every time.

Fluent output can be wrong. NIST, the US government's standards agency, lists this risk as "confabulation," meaning false content that is stated confidently (NIST 2024, "Confabulation"). Asking the assistant to confirm its own answer doesn't count as a check.

The division of labor

State your division of labor: the decision about which parts of the task you do and which parts you give to AI. The part that stays with you should include any judgment you'd be asked to defend.

Disclosure and data rules

Write one rule for disclosure, which means telling the people who rely on a piece of work that AI was used and how. Write one rule for data, saying what may and may not go into the tool.

Tie each rule to its source. The disclosure rule names the policy, contract, or syllabus it comes from. If nothing is written, say so, and say whom you asked. The data rule names the kind of account you use: a personal account, one your organization provides, or a model that runs on your own machine. It also names the terms or the approval that covers that account.

One skill to keep

End with one sentence naming a skill this task exercises that you mean to keep, and the habit that protects it. Attempting the task yourself before you ask for help is one such habit.

Success Criteria

Your protocol is complete when:

  • The task and the success criterion are stated in the first three lines
  • The test has at least four cases, each run twice, with results in a table
  • The decision follows from the results
  • Each kind of claim has a minimum check
  • The protocol says what AI does and what you do
  • The disclosure and data rules name the policy or terms they come from
  • One skill to keep is named, with a habit that protects it
  • The protocol fits on one page and contains nothing confidential

Step-by-Step Guidance

The times below add up to an hour.

Step 1: Choose one recurring task and write what a good result must contain

Pick a task small enough that one run takes a minute or two. Write the criterion before you open the assistant, and say what must not appear as well as what must. Allow about 5 minutes.

Step 2: Build and run a small test: at least four cases, each run twice, scored against your criterion

Work you've already judged is the quickest source of cases, once names and private details are replaced. Save each output and score it against the criterion, setting aside how well it reads. Write a few words beside every failure, since those notes show how the assistant fails. Allow about 20 minutes.

Step 3: Decide from the results whether and how to use AI for the task

Read the table before you write any rule. A case that passed once and failed once is unstable. Your protocol has to cover that kind of case with a check or keep it for you to do. If most cases failed, "I won't use AI for this task yet" is a sound decision. Allow about 5 minutes.

Step 4: Write your verification steps and your division of labor

Take the checks from your failures. If the assistant supplied an owner nobody named, the check is to compare every owner with your notes. Then cut any check you wouldn't do on your busiest day, and narrow the AI's part of the task to match. Allow about 10 minutes.

Step 5: Find the policy and the data terms that apply, and write your disclosure and data rules from them

Look for your employer's policy, a client contract, or a syllabus. Read it for whether AI use is allowed, for what, whether it must be disclosed, and to whom. Then confirm which kind of account you're signed in to, and find what its terms or settings say about storing conversations and using them for training. Allow about 10 minutes.

Step 6: Add the skill you mean to keep, then cut the protocol to one page

Write the skill sentence. Then cut explanation and keep rules, so that each remaining sentence states something you do or don't do. Read the page once for any name, figure, or detail that shouldn't be there. Allow about 10 minutes.

Resources

  • An AI assistant you already use
  • Four or more examples of your task, with nothing confidential, personal, or student-related in them
  • The AI policy, contract clause, or syllabus statement that applies to you, or a note of whom you asked
  • The data terms or settings page for the account you use
  • Any notes, test plans, or practice work of your own on testing, checking, or disclosure

A protocol doesn't need citations. If you name a source, you're welcome to cite it by author, year, and title.

Common Pitfalls

  • Writing rules before running the test. Rules written first describe the assistant you expect. The test may show failures you didn't predict, and your checks have to cover those.
  • A criterion too vague to score against. If two people could disagree on whether an output passed, rewrite the criterion.
  • Verification steps you won't do. Readers of the page will assume every promised check happened, so promise only the ones you'll do.
  • Data rules that ignore which kind of account you're using. A personal account and one your organization provides can look the same on screen and come under different terms.
  • Including confidential material in the protocol itself. Describe your test cases by kind, such as "notes from a long meeting," and leave out client names, real figures, and anything about identifiable people.

References

  • Dell'Acqua, Fabrizio, Edward McFowland III, Ethan Mollick, Hila Lifshitz, Katherine C. Kellogg, Saran Rajendran, Lisa Krayer, François Candelon, and Karim R. Lakhani. 2026. "Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of Artificial Intelligence on Knowledge Worker Productivity and Quality." Organization Science 37 (2): 403–423.
  • National Institute of Standards and Technology. 2024. Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile. NIST AI 600-1. Gaithersburg, MD: NIST, July 2024.

Report an issue with this item

Writing Assignment 60 min

A Tested AI-Use Protocol

Overview

You'll write the page that says how you use AI for one task in your own work. It reports a test you ran, so its rules rest on what the assistant did with your kind of material.

Nobody collects or grades the protocol. Keep it somewhere you'll see it when you do the task, and check it yourself against the list at the end.

Your Task

Write a one-page protocol of 400 to 600 words for one recurring task in your own work, covering the test you ran and what it showed, your verification steps, your division of labor, and your rules for disclosure and data. Close it with one sentence on a skill you mean to keep.

Use only non-sensitive material in the test and on the page. Replace anything confidential, any personal details, and any student information with invented stand-ins before you begin.

Tips

  • Write the success criterion before you open the assistant, and don't change it after you see the outputs.
  • Run the test before you draft a single rule. About a third of the hour belongs to the test.
  • You're welcome to reuse test cases, results, or notes of your own, as long as each case was run twice and scored against a criterion written first.
  • Give each rule a form you could be seen to follow or break: "I compare every date with the source document" and not "I check carefully."
  • If no written policy applies to you, write "No written policy" and name the person you asked. A gap stated plainly is more useful to a reader than a rule you guessed at.
  • When you've finished, give the page to a colleague, or read it as one would. Anything they'd have to ask you about needs another sentence.

Self-Check

When you're done, check that:

  • The task and the success criterion are stated in the first three lines
  • The test has at least four cases, each run twice, with results in a table
  • The decision follows from the results
  • Each kind of claim has a minimum check
  • The protocol says what AI does and what you do
  • The disclosure and data rules name the policy or terms they come from
  • One skill to keep is named, with a habit that protects it
  • The protocol fits on one page and contains nothing confidential

Nothing is uploaded. Write in your own notebook or document and keep it.

Report an issue with this item