Site icon thoughts.xavierdecarvalho.com

Using GPT-3-era tools at work: useful tasks and verification limits

Using GPT-3-era tools at work: useful tasks and verification limits 1 2026
Photo by Kelly Sikkema on Unsplash

This article concerns the GPT-3 and early ChatGPT period. It is a historical perspective, not a guide to the features or model lineup available today. My interest remains practical: where can a language tool save useful effort, and what must we check before acting on its output?

GPT-3 and ChatGPT are different kinds of names

GPT-3 names a language-model family. ChatGPT names a conversational product. At its November 2022 launch, ChatGPT was fine-tuned from a model in the GPT-3.5 series. OpenAI’s original announcement explains that history and warns that the system can produce plausible-sounding but incorrect answers.

That distinction matters. A product can change the models and tools it offers over time. A statement about the original text-based ChatGPT should not automatically be treated as a statement about every later version.

Useful tasks have bounded inputs and reviewable outputs

Drafting alternative headlines, restructuring approved copy and summarising a supplied document are reasonable experiments. The person reviewing the output should be able to compare it with a source or a clear brief. Even a summary can omit a qualification or introduce a claim that was not in the original.

For marketing work, I would start with material the organisation is authorised to use and a task that is easy to reverse. A draft email is easier to inspect than an unattended system that changes customer records or publishes claims. Measure editing time and error rates, not just how quickly a first draft appears.

Fluency creates a verification problem

These systems generate text; they do not make every sentence true. An answer can invent a quotation, misdescribe a product or reproduce a bias in its training data. Asking for a confident tone or a list of sources does not establish accuracy. Check that a cited source exists and actually supports the associated claim.

Natural language understanding and natural language generation are broad language capabilities, not independent fact checks. A better control is to ground the task in approved sources, check material claims against those sources and test the workflow on representative examples.

Separate misuse from ordinary mistakes

A text system can assist spam, impersonation or disinformation by producing messages at scale. In the original text-only context, it did not itself create audiovisual deepfake recordings. It could contribute scripts or supporting text to a wider pipeline using other tools. Keeping that distinction prevents a real risk from becoming an exaggerated technical claim.

Bias and employment effects also deserve attention, but they are not settled by saying a model is powerful. Examine the particular task, who bears the consequences of mistakes, what supervision is required and how work changes for the people involved.

Controls I would put around a workplace pilot

Choose a defined task and approved data sources. Confirm what the provider retains and how the organisation permits sensitive information to be handled before submitting it. Restrict access to tools and records to what the task needs. Require review before publishing material claims or taking consequential actions.

Keep examples of failures as well as successes. Monitor performance after changes to the model, prompt or source material, and keep a straightforward way to stop the workflow. These controls reduce risk; they do not guarantee correct answers or prevent every misuse.

The opportunity is useful assistance with a clear responsibility boundary. For examples of why that boundary matters, see the AI-writing experiment and synthetic advertising imagery and its limits.

Exit mobile version