MolMini small, chembl_test_macfonts
Failure breakdown
Attempted: 3000 | exact: 2578 (0.859)
| failure mode |
n |
share of all |
share of failures |
what it points at |
| unparseable output |
10 |
0.003 |
0.024 |
decoder emitted a string RDKit cannot read |
| stereochemistry only |
196 |
0.065 |
0.464 |
skeleton correct; wedge/hash reading wrong |
| right formula, wrong bonds |
11 |
0.004 |
0.026 |
atoms counted correctly, connectivity misread |
| other structural error |
205 |
0.068 |
0.486 |
a genuinely different molecule |
Accuracy by molecule size
| heavy atoms |
n |
exact |
valid |
| <=10 |
9 |
1.000 |
1.000 |
| <=15 |
84 |
0.786 |
0.976 |
| <=20 |
324 |
0.914 |
1.000 |
| <=25 |
741 |
0.911 |
0.997 |
| <=30 |
741 |
0.884 |
0.996 |
| <=35 |
576 |
0.825 |
1.000 |
| <=40 |
327 |
0.823 |
0.997 |
| >40 |
198 |
0.672 |
0.990 |
Accuracy by rendering style
| style |
n |
exact |
valid |
| clean |
1000 |
0.917 |
0.996 |
| degraded |
1000 |
0.771 |
0.994 |
| varied |
1000 |
0.890 |
1.000 |
Sequence length
- Reference SMILES length, all attempted: median 47 tokens
- Reference SMILES length, correct predictions: median 46 tokens
Longest failures
| reference |
predicted |
CC(=O)OC[C@H]1O[C@@H](O[C@H]2[C@H](OC(C)=O)[C@@H](OC(C)=O)[C@H](S(N)(= |
CC(=O)OC[C@H]1O[C@@H](O[C@@H]2[C@@H](OC(C)=O)[C@@H](OC(C)=O)[C@H](OC(C |
CC(=O)OC[C@H]1O[C@@H](O[C@H]2[C@H](OC(C)=O)[C@@H](OC(C)=O)[C@H](S(N)(= |
CC(=O)OC[C@H]1O[C@H](O[C@H]2[C@H](OC(C)=O)[C@@H](OC(C)=O)[C@H](OC(C)=O |
C[C@H]1[C@@H](c2cc(C(F)(F)F)cc(C(F)(F)F)c2)OC(=O)N1CC1=C(c2cc(-c3ccc(C |
C[C@H]1[C@H](c2cc(C(F)(F)F)cc(C(F)(F)F)c2)OC(=O)N1CC1=C(c2cc(-c3ccc(C( |
C=C(C)[C@H]1C[C@@H](C[C@@]23C[C@@H](/C=C/C(C)C)C(C)(C)[C@@](CC=C(C)C)( |
C=C(C)[C@H]1C[C@@H](C[C@]23C[C@H](/C=C/C(C)C)C(C)(C)[C@](CC=C(C)C)(C2= |
C=C(C)[C@H]1C[C@@H](C[C@@]23C[C@@H](/C=C/C(C)C)C(C)(C)[C@@](CC=C(C)C)( |
C=C(C)[C@H]1C[C@@H](C[C@]23C[C@@H](/C=C/C(C)C)C(C)(C)[C@@](CC=C(C)C)(C |