1.3 KiB
1.3 KiB
| 1 | variant | backbone | explanation_method | validation_accuracy | validation_macro_f1 | validation_mae | validation_rmse | validation_pearson | attachment4_cases | comprehensiveness_delete_10pct_mean | comprehensiveness_delete_30pct_mean | sufficiency_abs_gap_retain_10pct_mean | sufficiency_abs_gap_retain_30pct_mean | deletion_auc_0_70_mean_logit_drop | scale_stability_mean_spearman | router_shapley_mean_spearman | router_shapley_top1_agreement_rate |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | E0_EarlyConcat | EarlyConcat + BiGRU | exact Shapley + multiscale occlusion | 0.6236263736263736 | 0.5779072819396367 | 0.6614117622375488 | 0.8730906021125315 | 0.6092112225440192 | 20 | 0.4599139286205173 | 1.1217660129070282 | 0.5246159449219704 | 0.25422920733690263 | 0.9156549779565207 | 0.9047463374768046 | ||
| 3 | E1_MoFE_Router | MoFE-7 + MLP Router | router weights, tested by counterfactual deletion | 0.614010989010989 | 0.5661110562085216 | 0.6426214575767517 | 0.8499163895044349 | 0.6013617546095743 | 20 | 0.21003895588219165 | 0.8701988908462226 | 0.49544571414589883 | 0.24998579360544682 | 0.7925371142836022 | 0.725 | 0.85 | |
| 4 | E2_MoFE_Shapley | MoFE-7 + MLP Router | exact Shapley + multiscale occlusion | 0.614010989010989 | 0.5661110562085216 | 0.6426214575767517 | 0.8499163895044349 | 0.6013617546095743 | 20 | 0.3515274651348591 | 0.9817972692660988 | 0.41155125787481667 | 0.19497831985354425 | 0.8371464796829968 | 0.8822506774459532 | 0.725 | 0.85 |