AI, Software Development

Blockchain for Data Provenance: When It Fits and How to Build It

By James KillickOctober 31, 2026

TL;DR: Blockchain makes a provenance record tamper-evident, but it does not make the data true. Keep the data off-chain, put only a hash on-chain, and use a chain only when several parties that do not fully trust each other share one record. For a single business, a signed append-only log is usually enough.

Blockchain can make data provenance tamper-evident. Each record of where data came from and who changed it is chained to the one before. A quiet edit to history then shows up. But a chain does not make the data true. And it is not always better than a well-run normal database. Here is how it works, what to store on-chain, where it breaks, and how to decide. We focus on Australian teams.

What data provenance is, and how it differs from lineage

Data provenance is the recorded history of a dataset: where it came from, how it was made, and who touched it. The Australian Research Data Commons calls it documentation of where data came from and the processes and methodology used to produce it. It answers why, how, where, when and by whom.

Lineage is a close cousin. Google Cloud describes lineage as a map of a data asset's lifecycle: origin, movement, changes and current location. Provenance is more granular. IBM draws the same line: lineage follows movement and change through systems, while provenance centres on source, authenticity and auditability.

In practice, lineage tells you which pipeline made a report. Provenance tells you whether you can trust the record at the start of that pipeline, and prove it to an auditor.

How blockchain records and verifies provenance

CSIRO's Data61 defines a blockchain as a distributed database replicated across nodes that jointly operate the system, without a single trusted third party in control. Three parts matter for provenance.

Chained blocks. Records are grouped into blocks. A PVLDB paper says block headers hold a previous-block hash, a transaction digest and a state digest. Nodes recompute these and add a block only when they match. Change one old record and every block after it breaks.

Signed transactions. NIST explains that a transaction can carry an identifier, a public key and a digital signature. References to prior events provide provenance while signatures prove control of the referenced input.

Independent checks. Anyone with access can check the chain. In NIST's smart manufacturing model, a creator fingerprints the data and records it. A consumer then fingerprints the received data and queries the repository. No match points to bad registration or tampering. A match returns the provenance details.

That last step is the heart of the design. Checking is a hash comparison, not a leap of faith.

What goes on-chain and what stays off-chain

Most provenance systems should not put the data itself on a ledger. CSIRO Data61 says to keep large or private data off-chain and record its cryptographic hash on-chain. You can then check integrity later without publishing the data.

A workable split:

ItemWhere it livesWhy
Raw files, datasets, model filesOff-chain storage you controlSize, cost and privacy
Hash of each file or recordOn-chainTamper evidence
Who registered it, when, and in what roleOn-chain, as IDs not personal detailsAccountability
Pointer to the off-chain locationOn-chain or in the registryRetrieval
Personal informationOff-chain, ideally not in the record at allPrivacy duties

One catch: be careful with hashes of personal data. The OAIC says information is de-identified only when there is no reasonable likelihood of re-identification in the relevant context. Hashing hides an identifier. It does not remove it. A hash of an email address is still a risk if someone can guess the email.

Where blockchain provenance fails

Here's the thing. The list of limits is longer than most vendor pages admit.

Garbage in, permanent garbage. Australia's National Blockchain Roadmap warns that records are immutable even when incorrect or fraudulent. Clean data entry and good governance matter most. An Australian aquaculture study found that blockchain cannot by itself fix unreliable source data, missing entries, weak product identification or partly paper-based processes.

Privacy and removal. The same roadmap flags Privacy Act 1988 concerns, because personal information is hard to remove from a shared ledger. The OAIC says the Australian Privacy Principles are technology-neutral. They apply however the data is held.

Scale, write speed and cost. CSIRO Data61 names confidentiality, privacy and scalability limits, poorer write performance and potentially higher costs. A 2024 review lists high implementation and maintenance costs and a lack of standardisation and regulation as barriers. The consensus method matters too. Research notes performance and security challenges for proof-of-work.

Metadata is not truth. The Australian Cyber Security Centre (ACSC) says signed content credentials can track origin and edits. But metadata alone does not establish that content is true.

Do you need a blockchain at all?

The aquaculture study found blockchain gave at most incremental benefits compared with a traditional centralised database. That is a good place to start. Test it with five questions.

  1. Do several organisations write to the record? If only you write and read it, a signed, append-only audit log in your own database is simpler and cheaper.
  2. Do those parties lack a neutral operator they all trust? If one regulator, platform or lead can run it, you may not need shared consensus.
  3. Will outsiders need to verify records without asking you? This is where a shared ledger helps most.
  4. Is the data captured reliably at the source? If not, fix capture first with sensors, scans and checks.
  5. Can you live with records that cannot be changed? If records may need fixing, add a correction as a new entry. Keep personal data off the ledger.

Yes to the first three means a permissioned blockchain is a serious option. If not, a normal design is likely better engineering. For the log-based route, these audit log best practices cover schema, correlation and a staged rollout.

Provenance for AI training and fine-tuning data

This is where provenance moves from nice to have to expected. The ACSC's AI data security guidance (updated 23 May 2025) says provenance tracking can trace AI data origins and its path through a system, and signed immutable change records help identify malicious modification. It covers training, fine-tuning, alignment and RLHF. It also recommends signed records and an append-only ledger for changes to AI data.

The same guidance warns that web-scale datasets should not be assumed clean. Check a dataset before ingestion, and sign it when it comes in. For an AI product, that means:

  • Hash and sign every dataset version when it enters your pipeline.
  • Record which dataset versions fed which model version, so any output can be traced back.
  • Log changes to prompts, retrieval sources and fine-tuning sets, not just code.
  • Keep personal information out of the ledger entries.

The model side is in our guide to AI model versioning in SaaS. The data rules side is in data governance for AI and AI software compliance explained. For a wider view on the same problem, the AI Orchestrators piece on AI data governance is a good read. Teams building a management system may also look at AS ISO/IEC 42001:2023, which sets requirements for establishing, implementing, maintaining and improving an AI management system.

Design checklist for founders and CTOs

CSIRO Data61 says to assess blockchain as part of a whole system, including interfaces, key management, off-chain databases, communications and processing. The chain is rarely where projects fail. Weak key handling and weak data capture are.

1. Define what you are proving. Origin, integrity, custody or consent? Each needs different fields. Write the question an auditor or customer would ask, then design backwards.

2. Choose the network type. A permissioned ledger suits a known group. Public chains add openness but raise cost, privacy and speed concerns.

3. Fix data capture. Check at the source, give each item a unique ID, and remove paper steps. This is the weak spot the aquaculture study found.

4. Plan key management. Signatures only prove something if private keys are controlled, rotated and recoverable.

5. Decide where data lives. The ACSC's guidance says to establish where data, logs and backups are captured, processed, stored and accessed. Check where ledger nodes run.

6. Keep metadata usable. Provenance should be readable by people and machines. Geoscience Australia says metadata should be associated with provenance.

7. Plan the integration. Provenance only helps if the systems that handle the data write it automatically. Our notes on AI platform integration and platform architecture show where those hooks usually sit. If a smart contract holds the records, read smart contract security first.

Our perspective

We build AI platforms and the data layers under them, and we have shipped more than 200 apps. Our view on provenance is simple: use the lightest thing that works.

First, start with the audit question, not the tech. When a client asks for blockchain provenance, we ask who needs to verify what, and who has to trust whom. Often the answer is one business and its auditor. A signed append-only log with hashed records does that job for far less cost.

Second, when several parties share a record, hash-on-chain is a strong fit. We do this work through our blockchain and dApp development. The chain stays small, the data stays in storage you control, and checking is a simple comparison.

Third, provenance for AI is a data pipeline problem before it is a ledger problem. If you cannot say which dataset version trained which model version, no ledger will save you. We build that tracking into the pipeline from the first sprint. Our wider thinking is in Blockchain and AI: where they fit and what to build first.

Build provenance into your platform with Devwiz

If you are adding provenance, audit trails or blockchain parts to an AI product, we handle the whole build: discovery, architecture, the data layer, integrations, launch and support. Our AI program and platform development covers AI-first platforms and the data work underneath. Our app development team covers the build, and we also run blockchain development in Sydney.

Worth a chat? Talk to us and we'll tell you plainly whether you need a blockchain or something simpler.

Frequently asked questions

What is data provenance?

Data provenance is the documented record of where data came from, how it was produced and who changed it. The ARDC describes it as metadata that supports authenticity, reuse, quality assessment and reproducibility. It answers why, how, where, when and by whom.

What is the biggest problem with blockchain for provenance?

It records what it is given, accurate or not. Records stay immutable even when wrong, so poor data capture and weak governance undermine trust whatever the technology. Privacy, scalability and cost are the next constraints.

Should I store my data on the blockchain?

Usually not. Keep large or confidential data off-chain and record only its hash on-chain. A consumer can then hash the data they received and compare it with the ledger entry. Avoid putting personal information on the ledger at all.

Is a blockchain better than an audit log?

Only in specific cases. If several organisations share a record and none controls it, a blockchain helps. For a single organisation, a signed, append-only audit log is typically simpler, cheaper and easier to correct.

About James Killick

10+ years building digital products · 200+ apps shipped since 2015

James is a co-founder of Devwiz and an AI product specialist. Since 2015 he has helped ship 200+ apps for founders, businesses and government, including work for NSW Government, Briometrix and Huskee. He builds AI-first platforms and writes about turning a proven program into software. He also hosts the Up in the AI podcast.

More articles by James · James's personal site · LinkedIn · AI Orchestrators

Tags: Blockchain, Data Provenance, Data Governance, AI Architecture

Browse all Devwiz articles·See our case studies