Methods and limitations
Spec section 7 calls this page non-negotiable "given how easily this kind of tool is
over-read". This project has more to disclose than most.
Two label sets, and only one of them means anything.
513 of 854 positives were labelled by
sequence similarity (EC 3.1.1.101 via ECO:0000256). A sequence-embedding model
reproducing those is close to tautological, and one does: AUC 1.000. That is a circular result,
not a good one. The other 341 carry experimental evidence,
mostly from PAZy, whose criterion for inclusion is that activity was measured on a plastic and
published.
Trained on the measured set alone, the activity head reaches AUC 0.976
(± 0.021) across 45 independent sequence clusters, with average precision
0.987 and a Brier score of 0.052, against 0.829 for a classifier using
amino-acid composition and length only. That is the first defensible activity signal in this
project: experimental labels, a split by cluster rather than by sequence, and a real margin over
the composition baseline instead of a tie.
Until PAZy was loaded the measured positives numbered 17 across 5 clusters, too
few for the protocol below to run. The head was not scoring badly; it could not be scored.
Positives by evidence tier
| Tier | n |
| EC-auto-annotated | 449 |
| PAZy-measured | 312 |
| ESTHER-family-predicted | 50 |
| ESTHER-family-protein-evidence | 14 |
| EC-experimental | 7 |
| UniProt | 6 |
| HGMP-measured | 5 |
| PDB-construct | 2 |
| Zhang et al. 2024, Nat. Commun. 15:1417 | 1 |
| Tournier et al. 2020, Nature | 1 |
| Three-directional engineering of IsPETase (PDB 8H5K) | 1 |
| Son et al. 2019, ACS Catal. | 1 |
| Reported relative to LCC-ICCG in the 2025 PET-hydrolase review | 1 |
| Lu et al. 2022, Nature (MutCompute) | 1 |
| Directed evolution of flexible loops, Cell Rep. Phys. Sci. 2023 | 1 |
| Cui et al. 2021, ACS Catal. | 1 |
| Austin et al. 2018, PNAS | 1 |
Training runs
| Head | Pos | Neg | Clusters |
AUC | Composition baseline | Evidence |
| pet_activity | 152 | 26 |
7 |
0.493 |
0.398 |
measured-only |
| pet_activity | 305 | 26 |
44 |
0.850 |
0.651 |
measured-only |
| pet_activity | 300 | 220 |
45 |
0.976 |
0.829 |
measured-only |
| pet_activity | 13 | 220 |
1 |
not evaluable |
- |
experimental |
| pet_activity | 500 | 220 |
25 |
1.000 |
0.778 |
mixed |
The composition baseline uses amino-acid fractions and length only. Any model claim
must clear it as well as the retrieval baseline.
Pipeline runs
| Stage | Label | Status | In | Out |
Discarded | Started |
| pazy | v1-within-family-negatives | done |
467 | 29 |
438 | 2026-08-05T14:27:59Z |
| embed | esm2-t12-35M | done |
1,477 | 1477 |
0 | 2026-08-05T13:20:22Z |
| pazy | v1-within-family-negatives | done |
467 | 26 |
441 | 2026-08-05T13:19:43Z |
| seeds | variants-confirmed | done |
17 | 17 |
4 | 2026-08-05T13:03:00Z |
| seeds | variants-confirmed | done |
17 | 15 |
2 | 2026-08-05T13:01:24Z |
| seeds | variants-confirmed | done |
17 | 13 |
2 | 2026-08-05T12:59:08Z |
| seeds | cut190-resolved | done |
14 | 9 |
5 | 2026-08-05T12:10:12Z |
| pazy | v1-PET | done |
501 | 312 |
8 | 2026-08-05T09:31:16Z |
| recall | gut-v2 | done |
5,341 | 1 |
5,340 | 2026-08-05T05:10:20Z |
| recall | gut-v2 | done |
6,101 | 0 |
6,101 | 2026-08-05T05:10:14Z |
| recall | gut-v2 | done |
5,939 | 0 |
5,939 | 2026-08-05T05:10:06Z |
| recall | gut-v2 | done |
10,657 | 0 |
10,657 | 2026-08-05T05:09:45Z |
| recall | gut-v2 | done |
6,736 | 0 |
6,736 | 2026-08-05T05:09:30Z |
| recall | gut-v2 | error |
0 | 0 |
0 | 2026-08-05T05:07:43Z |
| recall | gut-v2 | done |
11,534 | 2 |
11,532 | 2026-08-05T05:07:26Z |
| recall | gut-v2 | done |
6,668 | 0 |
6,668 | 2026-08-05T05:07:18Z |
| recall | gut-v2 | done |
12,345 | 0 |
12,345 | 2026-08-05T05:07:02Z |
| recall | gut-v2 | done |
7,387 | 0 |
7,387 | 2026-08-05T05:06:55Z |
| recall | gut-v2 | done |
9,752 | 0 |
9,752 | 2026-08-05T05:06:43Z |
| recall | gut-v2 | done |
48,787 | 1 |
48,786 | 2026-08-05T05:05:49Z |
Data sources
| Source | Version | Records | Licence | Retrieved |
| HGMP-SciDB | PMID 39551294 |
5 | see publication | 2026-08-04T22:32:55Z |
| PAZy | Buchholz et al. 2022, Proteins 90(7):1443-1456 |
320 | see publication | 2026-08-05T09:31:37Z |
| UniProt | REST |
6 | CC BY 4.0 | 2026-08-05T13:03:04Z |
Limitations
- Positives number in the low hundreds and most carry family annotation rather than measured PET activity.
- Published activity data is not harmonised across assay formats. Absolute rate predictions should not be trusted.
- Crystalline PET degradation at 37 °C by any known enzyme is slow. PANTS ranks relative promise, not therapeutic viability.
- Predicted structures are predictions. Cleft geometry on a metagenomic sequence with no close homologue carries real uncertainty, and a brittle version of that measurement scored IsPETase's own prediction at half its crystal value before being fixed.
- AUC 0.976 is measured against hard negatives from other α/β-hydrolase families.
Tested against the near misses instead it reaches 1.000, which is a warning rather than a
result: every near miss is a single ESTHER family (Cutinase), and one homogeneous family
separates as a block (composition alone scores 0.910). Neither contrast shows that the head
ranks PET activity within the polyesterase family.
- The within-family question has no dataset. It needs PET-inactive polyesterases,
measured and published, and databases record what works: nobody systematically publishes a
failed assay. That is publication bias, not a curation gap, and more database mining will not
fix it.
- Nothing here addresses delivery, immunogenicity, biodistribution, or what happens to liberated TPA and EG in vivo.
- Metagenomic candidates may come from unculturable organisms, may not express in a standard host, and may be fragments or misassemblies.
- Cleft width currently separates a fungal cutinase from the polyesterase family, but does not order that family by PET activity. Family-level separation is a much easier task than the one that matters.
Recent manifests
| Stage | Model | Schema | Commit | Wall (s) | Written |
| pazy | - |
6 | 4771ede |
21.2 | 2026-08-05T14:28:20Z |
| embed | facebook/esm2_t12_35M_UR50D |
5 | 2ea7a67 |
93.6 | 2026-08-05T13:21:55Z |
| pazy | - |
5 | 2ea7a67 |
21.5 | 2026-08-05T13:20:04Z |
| seeds | - |
5 | 6f53a24 |
3.5 | 2026-08-05T13:03:04Z |
| seeds | - |
5 | 6f53a24 |
3.5 | 2026-08-05T13:01:27Z |
| seeds | - |
5 | 6f53a24 |
3.7 | 2026-08-05T12:59:12Z |
| seeds | - |
5 | 1cc70fe |
4.6 | 2026-08-05T12:10:17Z |
| pazy | - |
5 | e40f81c |
21.4 | 2026-08-05T09:31:37Z |
| recall | - |
5 | 5c70f30 |
3.6 | 2026-08-05T05:10:24Z |
| recall | - |
5 | 5c70f30 |
5.8 | 2026-08-05T05:10:20Z |
| recall | - |
5 | 5c70f30 |
8.5 | 2026-08-05T05:10:14Z |
| recall | - |
5 | 5c70f30 |
19.4 | 2026-08-05T05:10:06Z |