How Do Licensing and Closed-Provider Terms Affect Model Distillation?

Oren CohenSources reviewed September 23, 202612 min read

They decide whether the distillation is allowed at all, what the resulting model may be called, where its training data may be stored, and whether it survives a change in any of those terms. Four separate agreements apply, and a pipeline that satisfies three of them is still not clear.

This is part 42 of the closed-to-open model transfer series. It is not legal advice. It maps the four layers of terms a closed-to-open transfer runs under, quotes what the reviewed documents say as of 2026-09-23, and describes a practical posture: written review before training, a receipt per dataset version, and a rule for what happens when rights lapse.

The short version

Treat licensing as a gate with a receipt, not a footnote. Before training a customer-facing model on closed-model outputs, get written review of the provider's output-use terms, the base model's license, and the host's data terms, then record the versions against the dataset. A lapse in any of them invalidates the examples that depend on it.

Distillation touches four agreements at once

Distillation, in the practical sense used in this series, means using a closed model's outputs, or examples reviewed against them, to train a smaller open model. The closed provider's terms govern what its outputs may be used for. The open base model's license governs what you may do with the weights and what you must call the result. The fine-tuning host's terms govern what you may upload, how long it is kept, and what you may export. The customer's own data rights govern whether the conversations behind the examples may be used this way at all.

Each layer can independently block the pipeline. A base model with a permissive license does not help if the provider's terms forbid the use of its outputs. A provider that permits the use does not help if the customer's terms with its own users do not. The review has to cover all four, and it has to be written down, because the answer changes over time and someone will need to know which version of which terms the dataset was built under.

Layer one: the closed provider's terms on output use

The closed providers' terms address this directly, and they differ in wording. Anthropic's commercial terms, as reviewed on 2026-09-23, state that customers may not use the services to build a competing product or service, including to train competing AI models. Google's Gemini API additional terms, reviewed the same day, state that users may not use the services to develop models that compete with the services. OpenAI's terms of use contain a comparable restriction on using output to develop models that compete with OpenAI; read the current text, because that document could not be retrieved for this review.

The word that carries the weight in each clause is competing. A customer-specific agent model, trained to do one customer's task and never offered as a general model, is a different thing from a general-purpose model trained on frontier outputs. Where that line falls for a given project is a question for counsel with the current terms in hand, not for an engineering team reading a summary. The practical consequence is that the review has to happen before generation at scale, and its conclusion has to be recorded.

Layer two: the open base model's license

Open-weight does not mean license-free. The Qwen3 dense models, as stated in the Qwen team's release post reviewed on 2026-09-23, are released under the Apache License 2.0, which permits commercial use, modification, and redistribution with attribution and without a naming requirement. The Llama 4 Community License, reviewed the same day, permits use and fine-tuning but requires that a model built from Llama materials include Llama at the beginning of its name and that Built with Llama be displayed on a related website, interface, or documentation.

Those requirements pass through to the fine-tuned model. A customer that does not want a third-party name on its product has a base-model constraint before any capability question is asked. Read the base model's license for the exact version being fine-tuned, record it, and confirm that the hosting and serving plan satisfies its attribution and naming terms. Part 37 covers choosing the base against capability; the license is a filter applied before that choice.

Layer three: the fine-tuning host's terms on input, retention, and export

Managed fine-tuning providers have their own terms, and they cover three things a distillation pipeline cares about. What may be uploaded: some terms restrict the content of training inputs, and generated data may sit close to those restrictions. How long uploads and adapters are retained, and whether inference-time retention commitments extend to training data. Whether the trained adapter can be exported, or only served on the host.

The export question decides ownership in practice. An adapter that can only be served on one host is owned on paper and rented in fact. Part 35 treats ownership as a product question; here it is a terms question, and the answer is in the host's documentation for the specific fine-tuning method used. Read it for LoRA adapters specifically, because full-weight and adapter export terms can differ.

Layer four: the customer's own data rights

The conversations that become training examples belong to the customer's relationship with its users, and that relationship has its own terms. A customer whose privacy policy promises that conversations are used only to provide the service has not promised its users that conversations will train a model, even a model that serves only them. De-identification helps with some regimes and not others. Contract language with the customer's own users may need to change before the pipeline is allowed to start.

There is a symmetric obligation on any vendor in the loop. A vendor whose standard terms promise not to train on customer data cannot run this pipeline on that customer's data without a written, customer-specific election that overrides the default. That election has to be scoped: which agent, which data, which model, tenant-exclusive, and revocable. A vendor that trains without it has breached its own terms regardless of what the provider or the base license allow.

Layer
Closed provider terms
What it governs
Use of the closed model's outputs
Reviewed example (2026-09-23)
Anthropic and Google restrict training competing models; OpenAI comparable
Record per dataset version
Provider, terms date, counsel conclusion
Layer
Open base model license
What it governs
Use, modification, naming, attribution
Reviewed example (2026-09-23)
Qwen3 dense under Apache 2.0; Llama 4 requires naming and Built with Llama
Record per dataset version
Model id, license version, obligations
Layer
Fine-tuning host terms
What it governs
Upload content, retention, adapter export
Reviewed example (2026-09-23)
Host-specific; read for the exact method
Record per dataset version
Host, terms date, export right
Layer
Customer data rights
What it governs
Whether user conversations may train a model
Reviewed example (2026-09-23)
Customer privacy terms and vendor no-training defaults
Record per dataset version
Election scope, date, revocation rule
Layer
Teacher receipt
What it governs
Which model produced which outputs
Reviewed example (2026-09-23)
Model id and version at generation time
Record per dataset version
Receipt hash per example
Layer
Rights lapse rule
What it governs
What happens when any layer changes
Reviewed example (2026-09-23)
Dependent examples reassessed or withdrawn
Record per dataset version
Lapse event, affected examples, action

Written review before training, not after

The order matters because generation at scale spends money and creates data that may then be unusable. Run a small pilot to establish the pipeline, take the four-layer review to counsel with the pilot's actual artifacts, and get a written conclusion that names the provider terms version, the base license version, the host terms version, and the customer election. Then scale. A review after training either blesses a dataset already built or writes off the spend, and neither is a good position.

Written means a document, with a date, that a later reader can find. Verbal comfort from a meeting does not survive a personnel change or a terms update. The review is part of the dataset's lineage, alongside the source runs and the reviewer decisions that part 12 describes.

A receipt per dataset version, and a rule for lapse

Every dataset version should carry a receipt: the teacher model id and version that produced or was reviewed against each example, the dates and versions of the four sets of terms it was built under, and the counsel conclusion. When any of those inputs changes, the receipt tells you which examples are affected. A provider terms update that tightens output use affects every example whose teacher was that provider. A customer revoking its election affects every example from that customer's runs.

The lapse rule should be written before the first lapse. The conservative rule is that a lapse invalidates dependent examples and any dataset version or model trained from them until the examples are reassessed under the new terms or withdrawn. That may mean retiring a model. It is a real cost, and it is the cost of building on terms that can change; the receipt makes it bounded rather than existential.

Practical posture for a team that wants to proceed

Start with the customer election, because it is the layer the team controls. Then read the base license and rule out any model whose obligations the product cannot meet. Then take the provider terms to counsel with a clear description of the model's scope: one customer, one task, not offered as a general model, tenant-exclusive. Then read the host's terms for the exact fine-tuning method and confirm adapter export. Record all four conclusions against the pilot dataset version, and only then generate at scale.

None of this makes a project slow if it is started early. It makes a project impossible if it is started after the model is trained and a customer is waiting. This article describes what the reviewed documents say and how to organize the work; what they mean for a specific project is a question for the project's counsel.

Where Converra fits

Converra's default terms forbid using customer data to train, fine-tune, or improve any model, and that default holds unless a customer makes a written, tenant-exclusive election for a specific agent. Its fine-tuning workflow keeps that scope explicit: datasets are versioned, each example carries its source run and reviewer decision, and the training job and gate result are recorded against a dataset version so the receipt this article describes has somewhere to live.

Converra does not run training and does not provide legal review; the four-layer review is the customer's, with counsel. No open-weight production verdict for a customer agent has been published. The trust page describes the data handling defaults; a model transfer that changes them starts with the written election, not with a training run.

Frequently asked questions

Is it legal to fine-tune an open model on outputs from GPT, Claude, or Gemini?

Whether fine-tuning an open model on closed-model outputs is permitted depends on each provider's current terms, which as of 2026-09-23 restrict using the services to train or develop competing models, and on how a customer-specific agent model is characterized under them. Get written review from counsel with the current terms before generating training data at scale.

Does the open-weight model's license matter for a fine-tuned agent?

The open-weight model's license matters because its obligations pass through to the fine-tuned model. Apache 2.0 models such as the Qwen3 dense family carry attribution only, while the Llama 4 Community License requires Llama in the derived model's name and a Built with Llama notice.

Can a fine-tuning provider keep or use my training data?

A fine-tuning provider's retention and use of training data is set by its own terms, and inference-time zero-retention commitments do not automatically extend to uploaded training files or trained adapters. Read the host's terms for the specific fine-tuning method and record the version against the dataset.

What should be recorded about licensing for each training dataset?

Each training dataset version should record the teacher model id and version per example, the dates and versions of the provider terms, base model license, and host terms it was built under, the customer's written election, and the counsel conclusion. That receipt identifies which examples are affected when any of those terms change.

What happens to a fine-tuned model if the data rights lapse?

If the rights behind training examples lapse, the conservative rule is that those examples, and any dataset version or model trained from them, are invalid until reassessed under the new terms or withdrawn. Writing that rule before the first lapse, and keeping a receipt per dataset version, makes the cost bounded.

Stop reading dashboards. Ship the fix.

Converra diagnoses the failure, tests the fix in simulation, and verifies it worked on your real traffic. Connect your production data and see it on your own agent.