Complete standalone final deliverable and unaligned Q2 results

This commit is contained in:
2026-09-25 22:22:37 +08:00
parent c6b018e5d0
commit adc9c2064b
267 changed files with 15479 additions and 7976 deletions
+7
View File
@@ -0,0 +1,7 @@
# 题目输出目录
- [q1](q1/):附件一 100 条样本的三模态特征、全量汇总、典型样本对齐查询和完整性审计。
- [q2](q2/):附件二未对齐数据上全部保留模型的验证对比、选定模型测试结果及缺失曲线汇总。数学训练入口也会输出附件三的 30 条预测和审计。
- [q3](q3/):Q3 的验证结果、附件四 20 条预测、输入审计、局部解释和典型解释卡生成位置;完整输出由训练入口写入。
完整训练与复现说明见 [项目 README](../README.md),结果解释见 [REPORTS.md](../REPORTS.md)。附件二原始输入不包含在项目中;需按 README 的数据目录结构单独准备。提交赛题附件前,应按赛题规定检查最终附件体积。
+34
View File
@@ -0,0 +1,34 @@
# Q1 输出包
本目录对应题目 Q1 的 100 条附件 1 视频样本。原生特征、主视图和物理时间证据均保留;不复制原始视频和标签表。
| 内容 | 说明 |
|---|---|
| `features_v2/*.npz` | 100 个样本的文本、音频、视觉原生特征、源区间、质量/观测掩码、对齐视图和查询映射 |
| `features_v2/sample_summary.csv` | 样本 ID、视频组、源时长、有效词数和状态 |
| `features_v2/modality_summary.csv` | 300 行模态汇总,含覆盖率、可用质量和缺失情况 |
| `features_v2/manifest_q1.jsonl` | 逐样本路径、源/特征 SHA-256、配置哈希和状态 |
| `features_v2/feature_manifest.json` | 特征定义、工具/模型信息、处理配置和包体审计 |
| `typical_sample_correspondence.csv`、`typical_sample_frames.jpg` | 典型样本的词、物理区间、音频来源行与视频帧对应示例 |
| `alignment_query_example.png` | 文本词区间到原始音频/视频位置的查询权重图 |
| `package_audit.json` | 包含文件数、状态和 SHA-256 的完整性审计 |
| `model_comparison/`、`model_comparison_v2/` | 已整理的对照表与结果文件(以 `REPORTS.md` 中汇总为准) |
对齐视图是固定 0.1 秒网格。文本采用固定转写 CTC 单调路径和保留的边界区间;音频为 74 维,视觉为 OpenFace 2.2.0 的 35 维。四条样本为部分状态:OpenFace 的置信度/成功门控未通过,视觉特征以缺失掩码保留,没有用零值伪装成有效观测。
## 读取
在项目上级目录运行:
```python
from pathlib import Path
from final.adapter import Q1AlignmentAdapter
sample = Q1AlignmentAdapter().from_q1_sample(
"-iRBcNs9oI8/8",
feature_dir=Path("final/output/q1/features_v2"),
)
features, mask = sample.q2_arrays()
```
完整重建命令、依赖和 OpenFace 准备步骤见 [项目 README](../../README.md)。Q1 当前没有人工词边界真值,因此不报告边界误差或概率校准率。
@@ -0,0 +1,48 @@
{
"sample_id": "-iRBcNs9oI8/8",
"selection": "manually selected example with valid audio and vision query maps",
"duration_s": 8.093000411987305,
"word_count": 21,
"words": [
"I've",
"drawn",
"this",
"man",
"here,",
"and",
"if",
"you",
"can",
"tell,",
"he",
"has",
"a",
"lot",
"of",
"big",
"muscles,",
"he",
"looks",
"very",
"strong"
],
"audio_query_shape": [
21,
803
],
"audio_query_nnz": 495,
"audio_query_mapped_words": 21,
"vision_query_shape": [
21,
241
],
"vision_query_nnz": 160,
"vision_query_mapped_words": 21,
"audio_query_feature_validity_channel": "log_energy (audio feature dimension 66)",
"vision_query_feature_validity_channel": "OpenFace AU12 intensity (vision feature dimension 10)",
"alignment_semantics": "per-word normalized overlap between stored CTC word intervals and native source intervals; no learned content similarity",
"coordinate_axes_shown": false,
"color_scale": "shared square-root intensity transform for visibility; original overlap weights retained",
"word_label_positions": "actual transcript labels placed at their CTC word-interval centers on the source-time axis",
"image": "alignment_query_example.png"
}
Binary file not shown.

After

Width:  |  Height:  |  Size: 251 KiB

Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.

Some files were not shown because too many files have changed in this diff Show More