Self-service, AI and consumer rights: Who carries the risk when technology goes wrong?
Self-checkouts were only the beginning.
Customers now book appointments themselves, place orders through apps, enter their own information, manage accounts online, communicate with automated systems and increasingly interact with AI-powered customer service.
For businesses, these systems can reduce administration, improve convenience and allow transactions to happen at almost any time.
They also change who performs parts of the transaction. But there is an important distinction: Changing who performs the task does not necessarily change who carries the legal responsibility.
The rise of the self-service customer
Self-service now appears across almost every part of the economy, including supermarket checkouts, online retail, automated bookings, banking platforms, customer portals, electronic forms, subscription services, automated renewals, AI chat and support tools, online quoting and digital contracting.
Often the customer is doing work that was once performed by an employee. That can make a process more efficient. It can also introduce new points of failure.
A customer may enter incorrect information. The interface may be confusing. A price may be displayed incorrectly. An automated system may provide inaccurate information. A cancellation process may not work as expected. An AI system may produce an answer that the business never intended to give.
The legal question is therefore rarely as simple as: “The customer used the system, so it’s their responsibility.”
Does self-service transfer responsibility to the customer?
Not automatically. The outcome will depend on the circumstances.
A genuine customer mistake can be very different from an error caused or contributed to by misleading information, unclear instructions, a defective process, incorrect pricing, an automated system, inadequate warnings or a failure to comply with statutory obligations.
Businesses therefore need to think about the whole customer journey, not just the final click accepting the transaction.
Terms and conditions still matter
As transactions become more automated, clear contractual terms can become even more important. They may address when a contract is formed, payment obligations, cancellation, refunds, customer responsibilities, delivery, warranties, limitations of liability, dispute procedures and use of online accounts.
But terms and conditions are not a universal escape hatch. The legal effectiveness of a term depends on matters including the type of transaction, how the term was incorporated and applicable legislation.
Standard-form consumer contracts are also subject to New Zealand’s unfair contract terms regime under the Fair Trading Act.
Businesses therefore should not assume that placing a broad disclaimer deep inside online terms automatically resolves the underlying risk.
The customer experience and legal framework need to agree
Imagine a business advertises one thing prominently during an online transaction but attempts to qualify it through dense terms several screens later. The legal issue is not necessarily solved simply because the qualification exists somewhere.
Similarly, a beautifully drafted set of terms will not fix an automated process that gives customers materially misleading information.
Legal drafting and user experience increasingly need to be considered together. The contract is no longer just the PDF. It may also involve the screens, instructions, prompts, representations and choices surrounding the transaction.
What about AI customer service?
Businesses are increasingly experimenting with systems capable of answering customer questions, recommending products, processing information or guiding customers through transactions.
Questions to consider include: What information can the AI access? What representations might it make? Can a customer reasonably rely on its answer? What happens when it is uncertain? When does a human become involved? How are errors corrected? What information is being collected? What records are retained? Do the business’s terms reflect the actual process?
The technology may be new. Many of the underlying legal questions are not.
Build an error path, not just a happy path
Digital systems are often designed around the ideal transaction: customer selects, customer pays, system confirms, transaction completed.
Legal risk often lives outside that path. What happens when the customer selects the wrong option, the system displays the wrong price, payment is duplicated, an automated answer is incorrect, an order cannot be fulfilled, the customer disputes what they agreed to, a cancellation request fails or a vulnerable customer needs human assistance?
A business introducing automation should therefore consider how problems are identified, escalated and corrected.
A practical business review
Before introducing or significantly changing self-service, automated or AI-assisted customer processes, consider reviewing:
Terms and conditions
Do they reflect how customers actually transact with the business today?
Customer instructions
Are important obligations and choices clear at the point the customer needs them?
Pricing and representations
Is the information displayed through the customer journey accurate and consistent?
Contract formation
Is it clear when the customer and business become legally committed?
Error correction
Can genuine mistakes be identified and corrected sensibly?
Complaints and escalation
Can customers reach a person when the automated process cannot resolve the problem?
Privacy and information handling
What information does the system collect, where does it go and who can access it?
AI governance
If AI is involved, what can it say, what can it decide and when must the matter be escalated?
Technology should reduce friction, not move it into a dispute
There is nothing inherently problematic about self-service or automation. The risk arises when the customer-facing technology evolves but the legal framework underneath it does not.
The answer is not to stop innovating. It is to make sure the legal arrangements keep pace.
Canterbury Legal advises businesses on commercial contracts, terms of trade, business structures and disputes.
Talk to us before an efficient new process becomes an expensive old-fashioned dispute.
Related legal services
This article provides general information only and is not legal advice. Consumer, contractual, privacy and other obligations depend on the particular transaction, business and circumstances.
