Competition Generalist Track
Generalization is a matrix, not one score.
G0–G7 separates same-context debugging from unseen perturbation, donor, state, laboratory, disease and combination tasks.
G0–G7
Leakage-safe externalization ladder
| Level | Held-out unit | Current state |
|---|---|---|
| G0 | Random-cell split in one context | DEBUG_ONLY_NOT_PRIMARY |
| G1 | Same context, unseen perturbation target | IMPLEMENTED_HEPG2 |
| G2 | Unseen gene family or pathway | REGISTERED_SPLIT_DATA_NOT_EXECUTED |
| G3 | Unseen donor | REGISTERED_DONOR_RESOLVED_TRUTH_MISSING |
| G4 | Unseen cell type or differentiation state | REGISTERED_MATCHED_TRUTH_MISSING |
| G5 | Unseen dataset or laboratory | REGISTERED_HARMONIZED_TRUTH_MISSING |
| G6 | Unseen disease background | REGISTERED_DMD_PERTURBATION_TRUTH_MISSING |
| G7 | Unseen modality or combination | REGISTERED_OBSERVED_DOUBLE_TRUTH_MISSING |
Permanent controls
Every advanced model must beat the Baseline Zoo
training_response_mean
IMPLEMENTED_NATIVEridge_residual
IMPLEMENTED_NATIVEnearest_neighbour_transfer
REGISTERED_NOT_IMPLEMENTEDpathway_module_mean
REGISTERED_NOT_IMPLEMENTEDsimilarity_weighted_pseudobulk_transfer
REGISTERED_NOT_IMPLEMENTEDadditive_double_perturbation
IMPLEMENTED_NULL_PREVIEW_NO_OBSERVED_DOUBLERegistered architecture · not trained
Context-set encoder + perturbation encoder + residual and distribution heads
Context cellsdonor · disease · state · assay
Shared encodercell set and gene modules
Pseudobulk headmean delta · logFC · DEG probability
Distribution headpredicted population · responders · state proportions
AbstentionOOD and uncertainty-aware refusal
No model claim. This architecture is a registered development target. No context-set or generative population model has been trained in this release.
Four leaderboards
Official, generalist, robustness and DMD biology remain separate
DES · PDS · MAE
PARTIAL_AGGREGATE_ADAPTER_DES_LOCKEDDES · PDS · MAE · delta Pearson · logFC Spearman · DEG AUPRC · effect-size Spearman
PARTIAL_AGGREGATE_ADAPTERG1–G7 · calibration · interval coverage · abstention risk · worst-decile performance · per-pathway performance · donor fairness · compute and memory
REGISTERED_DATA_MISSINGfusion · myotube morphology · membrane integrity · calcium · viability · donor replication · reagent replication · disease-specific interaction
REGISTERED_NO_DMD_OUTCOMESError Atlas
Classify how a model fails
common_response_collapsewrong_perturbation_identitycorrect_direction_wrong_magnitudecorrect_mean_wrong_distributiondonor_failurestate_failuretoxicity_missood_overconfidence
Competition task adapter
Wait for official schema
Input, output, cell scale, gene universe, splits, metric weights and submission format remain null until an official task specification is published.
Evaluation dependency
Cell-Eval target pin 0.8.2
The current site runs an internal formula-aligned aggregate adapter, not the official AnnData suite. Version pinning and metric golden tests are required before a competition result is claimed.
Boundary. Registered tasks and model architecture are not benchmark results. Missing donor, state, disease and cell-distribution truth remains null and locked.