Training a model looks like experimentation. There are runs, metrics, iterations and failures. But a training loop is a development process, and AusIndustry and the ATO both warn that a systematic-looking process is not the same as an experiment. The question is whether the result of training was knowable before you started.
Where the unknown usually sits
For a model trained from scratch or built on a custom architecture, a genuine knowledge gap tends to come from one of three directions:
- The data regime. Very few examples, heavy label noise, extreme class imbalance, or a distribution that published datasets do not resemble.
- The deployment constraint. A latency, memory or power budget, for example an edge processor or a phone, where published accuracy figures assume data-centre hardware.
- The architecture itself. AusIndustry's AI guidance gives, as an example that may be core, testing an architecture against domain-specific performance limits when it is not known whether it can cope "with the available data regime".
The law looks for an outcome no competent professional could determine from worldwide knowledge, pursued through a systematic progression from hypothesis to conclusion. "We have never trained one of these" is not that.
A new data regime is a context, not a gap
Moreton Resources [2019] FCAFC 120 held that applying existing technology in a new context can be a core activity. In ML terms, a standard architecture applied to data unlike any published benchmark can qualify. But Moreton is not a free pass: you still need evidence that the published results could not predict behaviour in your context, and a planned way to find out. Record why your data differs and why that difference matters to the outcome.
What stays routine
AusIndustry lists several AI tasks as unlikely to be core: monitoring and dashboards using established tools, cleaning data to a model's documented input requirements, regression and acceptance tests with known expected outcomes, and parameter changes whose effect is well understood. The ATO's software alert TA 2017/5 adds testing the efficiency of algorithms already known to work. Feature engineering with standard transforms usually belongs on the same list, unless how a transform behaves on your data is itself the open question.
Edge cases specific to training
- Labelling. Building a labelled set for an experiment can be supporting work; labelling to keep a production model fresh is not. The wider data question is on the data pipelines page.
- AutoML and architecture search. The tool searches; it does not hypothesise.
- After it works. Once the uncertainty is resolved, training the final model at full scale for release, and retraining it on schedule, is usually productionising. The core activity ended when the uncertainty did. If scaling up raises its own unknown, such as whether a result found on a subset holds on the full dataset, that question is assessed on its own.
- Licensed weights. Expenditure on acquiring core technology, meaning technology the R&D sets out to build new knowledge or products on, cannot be notionally deducted (s 355-225(2)). Licensed pretrained weights you build on may be core technology; ordinary compute and API spend used in the experiments is a separate question. Your accountant decides.
- Runs that went nowhere. Keep them with the variant each tested. They support the case that the outcome was unknown when the plan came first, but do not prove it alone; see failed experiments.
Adapting a pretrained language model is a narrower question, answered on the LLM fine-tuning page. For how AI companies scope activities overall, see R&D for AI companies.