101 lines
112 KiB
JSON
101 lines
112 KiB
JSON
{"sample_id": "-3g5yACwYnA/13", "video_id": "-3g5yACwYnA", "clip_id": "13", "text": "They've been able to find solutions or at least bring some answers to the table.", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-3g5yACwYnA/13.mp4", "duration_s": 5.513997, "ctc_inference_succeeded": true, "word_count": 15, "word_alignment_valid_count": 15, "audio_raw_length": 535, "audio_valid_length": 535, "audio_feature_dim": 25, "vision_raw_length": 28, "vision_valid_length": 28, "vision_feature_dim": 192, "face_blendshape_valid_length": 28, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 163, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.972, "feature_file": "outputs/q1_features/features/-3g5yACwYnA__13.npz", "feature_file_bytes": 70429, "feature_file_sha256": "09e5e19910ce263a86e632a3bfa604775524434a4244072d28a0b7db2510a433"}
|
||
{"sample_id": "-3g5yACwYnA/3", "video_id": "-3g5yACwYnA", "clip_id": "3", "text": "We're a huge user of adhesives for our operation, called flocking, and we don't have the technical inside compounding or the technical expertise to do these types of things.", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-3g5yACwYnA/3.mp4", "duration_s": 14.388997, "ctc_inference_succeeded": true, "word_count": 29, "word_alignment_valid_count": 29, "audio_raw_length": 1428, "audio_valid_length": 1428, "audio_feature_dim": 25, "vision_raw_length": 72, "vision_valid_length": 72, "vision_feature_dim": 192, "face_blendshape_valid_length": 72, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 431, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.546, "feature_file": "outputs/q1_features/features/-3g5yACwYnA__3.npz", "feature_file_bytes": 153606, "feature_file_sha256": "3f7949f71a3c93295c6d5bb75177da024923d22abc18bc59b2799b50e9258104"}
|
||
{"sample_id": "-3g5yACwYnA/2", "video_id": "-3g5yACwYnA", "clip_id": "2", "text": "Key Polymer brings a technical aspect to our operation that we don't have internally.", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-3g5yACwYnA/2.mp4", "duration_s": 9.39401, "ctc_inference_succeeded": true, "word_count": 14, "word_alignment_valid_count": 14, "audio_raw_length": 919, "audio_valid_length": 919, "audio_feature_dim": 25, "vision_raw_length": 47, "vision_valid_length": 47, "vision_feature_dim": 192, "face_blendshape_valid_length": 47, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 278, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.209, "feature_file": "outputs/q1_features/features/-3g5yACwYnA__2.npz", "feature_file_bytes": 93925, "feature_file_sha256": "e94777084a053c5fe7eaaec3d9fb1ac5c9a14712030ed773a00fc168e3ea8236"}
|
||
{"sample_id": "-3g5yACwYnA/9", "video_id": "-3g5yACwYnA", "clip_id": "9", "text": "We have many new opportunities through the way things have changed through the years, looking for new niche high-end, value-added products.", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-3g5yACwYnA/9.mp4", "duration_s": 8.816992, "ctc_inference_succeeded": true, "word_count": 21, "word_alignment_valid_count": 21, "audio_raw_length": 865, "audio_valid_length": 865, "audio_feature_dim": 25, "vision_raw_length": 44, "vision_valid_length": 44, "vision_feature_dim": 192, "face_blendshape_valid_length": 44, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 263, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.181, "feature_file": "outputs/q1_features/features/-3g5yACwYnA__9.npz", "feature_file_bytes": 104222, "feature_file_sha256": "828ad04290ecb09981a500171d5ff9d34dc080951b32cdd41ef525aa50e79ab6"}
|
||
{"sample_id": "-3nNcZdcdvU/5", "video_id": "-3nNcZdcdvU", "clip_id": "5", "text": "Noncompliance can result in legal liability to you and to the school district in which you are employed.", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-3nNcZdcdvU/5.mp4", "duration_s": 7.867969, "ctc_inference_succeeded": true, "word_count": 18, "word_alignment_valid_count": 18, "audio_raw_length": 774, "audio_valid_length": 774, "audio_feature_dim": 25, "vision_raw_length": 40, "vision_valid_length": 40, "vision_feature_dim": 192, "face_blendshape_valid_length": 40, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 236, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.966, "feature_file": "outputs/q1_features/features/-3nNcZdcdvU__5.npz", "feature_file_bytes": 92502, "feature_file_sha256": "4c00de5bef73b6668cea6999aea1a3dac6da5414a03dfc101d29256d05ad147e"}
|
||
{"sample_id": "-HwX2H8Z4hY/2", "video_id": "-HwX2H8Z4hY", "clip_id": "2", "text": "” [President Ronald Reagan:] \"Look at the record", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-HwX2H8Z4hY/2.mp4", "duration_s": 3.982031, "ctc_inference_succeeded": true, "word_count": 8, "word_alignment_valid_count": 7, "audio_raw_length": 387, "audio_valid_length": 387, "audio_feature_dim": 25, "vision_raw_length": 20, "vision_valid_length": 20, "vision_feature_dim": 192, "face_blendshape_valid_length": 4, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 119, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["ctc_words_fallback:1"], "processing_seconds": 0.986, "feature_file": "outputs/q1_features/features/-HwX2H8Z4hY__2.npz", "feature_file_bytes": 44625, "feature_file_sha256": "51f8ecd331cf67b2e813396c4dcc83253226a4641e9a90ce9efc530d3b63e011"}
|
||
{"sample_id": "-HwX2H8Z4hY/5", "video_id": "-HwX2H8Z4hY", "clip_id": "5", "text": "\" President Ronald Reagan blamed the professional bureaucracy of education", "label": -1.0, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-HwX2H8Z4hY/5.mp4", "duration_s": 5.652995, "ctc_inference_succeeded": true, "word_count": 10, "word_alignment_valid_count": 9, "audio_raw_length": 550, "audio_valid_length": 550, "audio_feature_dim": 25, "vision_raw_length": 28, "vision_valid_length": 28, "vision_feature_dim": 192, "face_blendshape_valid_length": 7, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 168, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["ctc_words_fallback:1"], "processing_seconds": 0.977, "feature_file": "outputs/q1_features/features/-HwX2H8Z4hY__5.npz", "feature_file_bytes": 60515, "feature_file_sha256": "318a511a7ab864754fa58f1478d089e8e2656b744632df535052d9fe236f4cf6"}
|
||
{"sample_id": "-HwX2H8Z4hY/6", "video_id": "-HwX2H8Z4hY", "clip_id": "6", "text": "And in part, Al Shanker did too", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-HwX2H8Z4hY/6.mp4", "duration_s": 3.358008, "ctc_inference_succeeded": true, "word_count": 7, "word_alignment_valid_count": 7, "audio_raw_length": 321, "audio_valid_length": 321, "audio_feature_dim": 25, "vision_raw_length": 17, "vision_valid_length": 17, "vision_feature_dim": 192, "face_blendshape_valid_length": 8, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 99, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.986, "feature_file": "outputs/q1_features/features/-HwX2H8Z4hY__6.npz", "feature_file_bytes": 40308, "feature_file_sha256": "e93f3b906d441fb9f46c1282d9d1317b2359dcce773ace2a9d1918e57d53aac0"}
|
||
{"sample_id": "-HwX2H8Z4hY/9", "video_id": "-HwX2H8Z4hY", "clip_id": "9", "text": "It is a word which the administrator uses when he turns around anything which he doesn't like that the teacher is doing", "label": -0.3333333432674408, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-HwX2H8Z4hY/9.mp4", "duration_s": 7.733984, "ctc_inference_succeeded": true, "word_count": 22, "word_alignment_valid_count": 22, "audio_raw_length": 759, "audio_valid_length": 759, "audio_feature_dim": 25, "vision_raw_length": 39, "vision_valid_length": 39, "vision_feature_dim": 192, "face_blendshape_valid_length": 0, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 232, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["no_face_blendshapes_detected"], "processing_seconds": 1.036, "feature_file": "outputs/q1_features/features/-HwX2H8Z4hY__9.npz", "feature_file_bytes": 94012, "feature_file_sha256": "bc986a6a973cf20054c4f9c32f150f91904b1e867b8edb62c43dfd692e70d52d"}
|
||
{"sample_id": "-NFrJFQijFE/1", "video_id": "-NFrJFQijFE", "clip_id": "1", "text": "Structural mounts inside have to be properly stress analyzed so we make sure all that happens", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-NFrJFQijFE/1.mp4", "duration_s": 5.746, "ctc_inference_succeeded": true, "word_count": 16, "word_alignment_valid_count": 16, "audio_raw_length": 561, "audio_valid_length": 561, "audio_feature_dim": 25, "vision_raw_length": 29, "vision_valid_length": 29, "vision_feature_dim": 192, "face_blendshape_valid_length": 0, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 142, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["no_face_blendshapes_detected"], "processing_seconds": 0.972, "feature_file": "outputs/q1_features/features/-NFrJFQijFE__1.npz", "feature_file_bytes": 65573, "feature_file_sha256": "c7c5851bb9f0ea3ff77762b19f59c63dc3835b16bf97151cdba94b58d4f37152"}
|
||
{"sample_id": "-NFrJFQijFE/2", "video_id": "-NFrJFQijFE", "clip_id": "2", "text": "So we coordinate with all the proper technical fields to get ready for the instrument to arrive here", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-NFrJFQijFE/2.mp4", "duration_s": 6.856, "ctc_inference_succeeded": true, "word_count": 18, "word_alignment_valid_count": 18, "audio_raw_length": 665, "audio_valid_length": 665, "audio_feature_dim": 25, "vision_raw_length": 34, "vision_valid_length": 34, "vision_feature_dim": 192, "face_blendshape_valid_length": 0, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 169, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["no_face_blendshapes_detected"], "processing_seconds": 0.902, "feature_file": "outputs/q1_features/features/-NFrJFQijFE__2.npz", "feature_file_bytes": 74682, "feature_file_sha256": "24580a879c451f3b493bb2862b702bc11876bd7e92f6ce5cdeaa63d7f3553562"}
|
||
{"sample_id": "-THoVjtIkeU/12", "video_id": "-THoVjtIkeU", "clip_id": "12", "text": "What ever we turn our attention to is what grows and so if we believe that anything is possible, if we believe that social justice can be achieved and if we believe in youth, they will believe in themselves.", "label": 2.0, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-THoVjtIkeU/12.mp4", "duration_s": 14.896029, "ctc_inference_succeeded": true, "word_count": 39, "word_alignment_valid_count": 39, "audio_raw_length": 1476, "audio_valid_length": 1476, "audio_feature_dim": 25, "vision_raw_length": 75, "vision_valid_length": 75, "vision_feature_dim": 192, "face_blendshape_valid_length": 75, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 445, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.364, "feature_file": "outputs/q1_features/features/-THoVjtIkeU__12.npz", "feature_file_bytes": 175729, "feature_file_sha256": "c6d02ee1da7b846eb2d0e99396488c56156e4da84ede81b9cd5001e032111ac1"}
|
||
{"sample_id": "-THoVjtIkeU/2", "video_id": "-THoVjtIkeU", "clip_id": "2", "text": "I think social justice is extremely important for young people.", "label": 1.3333333730697632, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-THoVjtIkeU/2.mp4", "duration_s": 4.291992, "ctc_inference_succeeded": true, "word_count": 10, "word_alignment_valid_count": 10, "audio_raw_length": 419, "audio_valid_length": 419, "audio_feature_dim": 25, "vision_raw_length": 22, "vision_valid_length": 22, "vision_feature_dim": 192, "face_blendshape_valid_length": 22, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 128, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.797, "feature_file": "outputs/q1_features/features/-THoVjtIkeU__2.npz", "feature_file_bytes": 54279, "feature_file_sha256": "89a34b5dc46d15f3e7e46c1e139cf700945bd87dce4842c52ffd3807f237e1c4"}
|
||
{"sample_id": "-THoVjtIkeU/6", "video_id": "-THoVjtIkeU", "clip_id": "6", "text": "You know that I think listening to young people, taking in what they have to say because what we have seen all around the world is the power of youth.", "label": 2.6666667461395264, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-THoVjtIkeU/6.mp4", "duration_s": 8.097005, "ctc_inference_succeeded": true, "word_count": 30, "word_alignment_valid_count": 30, "audio_raw_length": 794, "audio_valid_length": 794, "audio_feature_dim": 25, "vision_raw_length": 41, "vision_valid_length": 41, "vision_feature_dim": 192, "face_blendshape_valid_length": 41, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 241, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.999, "feature_file": "outputs/q1_features/features/-THoVjtIkeU__6.npz", "feature_file_bytes": 116720, "feature_file_sha256": "fea5cbe0e2f40b280bd1ae100283ab60b0fe89bec42c26af3fafca30ed1751b5"}
|
||
{"sample_id": "-UuX1xuaiiE/1", "video_id": "-UuX1xuaiiE", "clip_id": "1", "text": "^And all of them are really being able to explore ^these different areas in depth ^in a way that really wasn't available ^before the center was here", "label": 1.6666666269302368, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-UuX1xuaiiE/1.mp4", "duration_s": 10.35, "ctc_inference_succeeded": true, "word_count": 27, "word_alignment_valid_count": 27, "audio_raw_length": 1022, "audio_valid_length": 1022, "audio_feature_dim": 25, "vision_raw_length": 52, "vision_valid_length": 52, "vision_feature_dim": 192, "face_blendshape_valid_length": 2, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 309, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.194, "feature_file": "outputs/q1_features/features/-UuX1xuaiiE__1.npz", "feature_file_bytes": 117161, "feature_file_sha256": "abcdcad3220fa8496b4dc85068ad7dd20a67a3bf65af69e9ab701f268138b656"}
|
||
{"sample_id": "-UuX1xuaiiE/0", "video_id": "-UuX1xuaiiE", "clip_id": "0", "text": "^it's amazing to see their enthusiasm and their passion", "label": 2.6666667461395264, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-UuX1xuaiiE/0.mp4", "duration_s": 3.633333, "ctc_inference_succeeded": true, "word_count": 9, "word_alignment_valid_count": 9, "audio_raw_length": 353, "audio_valid_length": 353, "audio_feature_dim": 25, "vision_raw_length": 19, "vision_valid_length": 19, "vision_feature_dim": 192, "face_blendshape_valid_length": 9, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 109, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.909, "feature_file": "outputs/q1_features/features/-UuX1xuaiiE__0.npz", "feature_file_bytes": 47230, "feature_file_sha256": "2927edadb14c25a8eff9afaba1709d2200051fe93acb43c6e0a64b10d7591db6"}
|
||
{"sample_id": "-UuX1xuaiiE/3", "video_id": "-UuX1xuaiiE", "clip_id": "3", "text": "My goal is to become a human rights lawyer", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-UuX1xuaiiE/3.mp4", "duration_s": 4.130013, "ctc_inference_succeeded": true, "word_count": 9, "word_alignment_valid_count": 9, "audio_raw_length": 399, "audio_valid_length": 399, "audio_feature_dim": 25, "vision_raw_length": 21, "vision_valid_length": 21, "vision_feature_dim": 192, "face_blendshape_valid_length": 20, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 123, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.975, "feature_file": "outputs/q1_features/features/-UuX1xuaiiE__3.npz", "feature_file_bytes": 51645, "feature_file_sha256": "50d511960c85926f0d19870832b54c12458d3776c2b4dc1a3821dc95868fd51d"}
|
||
{"sample_id": "-UuX1xuaiiE/6", "video_id": "-UuX1xuaiiE", "clip_id": "6", "text": "I ended up going to work for the US government as an intelligence analyst, specializing in war crimes and human rights issues", "label": -0.3333333432674408, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-UuX1xuaiiE/6.mp4", "duration_s": 8.113997, "ctc_inference_succeeded": true, "word_count": 22, "word_alignment_valid_count": 22, "audio_raw_length": 790, "audio_valid_length": 790, "audio_feature_dim": 25, "vision_raw_length": 40, "vision_valid_length": 40, "vision_feature_dim": 192, "face_blendshape_valid_length": 39, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 240, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.236, "feature_file": "outputs/q1_features/features/-UuX1xuaiiE__6.npz", "feature_file_bytes": 100158, "feature_file_sha256": "286ee70f12631b89b435a7883f2043c0cae0b8378d6d46f9db258fd5af391b19"}
|
||
{"sample_id": "-a55Q6RWvTA/3", "video_id": "-a55Q6RWvTA", "clip_id": "3", "text": "And if you clip coupons, if you don't go out for dinner and movies and things of that nature and try to take up things in life that, well, they always say, \"the best things in life are free\". Reading a book, going for a nice walk, and, of course, combining exercise and various things of that nature where you're not spending money per se.", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-a55Q6RWvTA/3.mp4", "duration_s": 22.153971, "ctc_inference_succeeded": true, "word_count": 65, "word_alignment_valid_count": 65, "audio_raw_length": 2204, "audio_valid_length": 2204, "audio_feature_dim": 25, "vision_raw_length": 111, "vision_valid_length": 111, "vision_feature_dim": 192, "face_blendshape_valid_length": 111, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 664, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.709, "feature_file": "outputs/q1_features/features/-a55Q6RWvTA__3.npz", "feature_file_bytes": 275958, "feature_file_sha256": "2e9c79f654bf8363c47269b3a515a95a87e5f6349c6dc9301e577ea8677d009e"}
|
||
{"sample_id": "-aNfi7CP8vM/7", "video_id": "-aNfi7CP8vM", "clip_id": "7", "text": "Maybe they have no political party affiliation, they're not interested in politics, they could care less about politics.", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-aNfi7CP8vM/7.mp4", "duration_s": 8.694987, "ctc_inference_succeeded": true, "word_count": 18, "word_alignment_valid_count": 18, "audio_raw_length": 849, "audio_valid_length": 849, "audio_feature_dim": 25, "vision_raw_length": 43, "vision_valid_length": 43, "vision_feature_dim": 192, "face_blendshape_valid_length": 43, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 257, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.001, "feature_file": "outputs/q1_features/features/-aNfi7CP8vM__7.npz", "feature_file_bytes": 98603, "feature_file_sha256": "3bab90196a7f22dbdb6d5bb374839b2447eb416eec30377b2604af65f5facddd"}
|
||
{"sample_id": "-aqamKhZ1Ec/0", "video_id": "-aqamKhZ1Ec", "clip_id": "0", "text": "In 2008, there were very serious tribal warfare in Kenya following a disputed election.", "label": -2.0, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-aqamKhZ1Ec/0.mp4", "duration_s": 10.966667, "ctc_inference_succeeded": true, "word_count": 14, "word_alignment_valid_count": 13, "audio_raw_length": 1085, "audio_valid_length": 1085, "audio_feature_dim": 25, "vision_raw_length": 55, "vision_valid_length": 55, "vision_feature_dim": 192, "face_blendshape_valid_length": 55, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 329, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["ctc_words_fallback:1"], "processing_seconds": 1.354, "feature_file": "outputs/q1_features/features/-aqamKhZ1Ec__0.npz", "feature_file_bytes": 101705, "feature_file_sha256": "eb71cd9c477f012f3b16574c1be5283fa0870dcb5d9ebc831bd6eefc2a520647"}
|
||
{"sample_id": "-dxfTGcXJoc/1", "video_id": "-dxfTGcXJoc", "clip_id": "1", "text": "For the 10th straight year, some of Kentucky’s best and most innovative biotech companies and technologies were on display at the annual BIO International Convention, which I and other state officials attended this week in Chicago.", "label": 1.6666666269302368, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-dxfTGcXJoc/1.mp4", "duration_s": 16.161003, "ctc_inference_succeeded": true, "word_count": 36, "word_alignment_valid_count": 36, "audio_raw_length": 1597, "audio_valid_length": 1597, "audio_feature_dim": 25, "vision_raw_length": 81, "vision_valid_length": 81, "vision_feature_dim": 192, "face_blendshape_valid_length": 81, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 482, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.331, "feature_file": "outputs/q1_features/features/-dxfTGcXJoc__1.npz", "feature_file_bytes": 180363, "feature_file_sha256": "16baaa788568929e7acfcc0fc153f1fa91110e51b64263284337b87dba696dd2"}
|
||
{"sample_id": "-dxfTGcXJoc/0", "video_id": "-dxfTGcXJoc", "clip_id": "0", "text": "This is Governor Steve Beshear ... About Kentucky Our state is home to more than 1,500 bioscience and lifescience companies and more than 100,000 people who work for these firms, in areas from nutrigenomics and pharmaceuticals to nanotechnology and medical devices.", "label": 1.0, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-dxfTGcXJoc/0.mp4", "duration_s": 20.5, "ctc_inference_succeeded": true, "word_count": 41, "word_alignment_valid_count": 38, "audio_raw_length": 2037, "audio_valid_length": 2037, "audio_feature_dim": 25, "vision_raw_length": 103, "vision_valid_length": 103, "vision_feature_dim": 192, "face_blendshape_valid_length": 80, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 615, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["ctc_words_fallback:3"], "processing_seconds": 1.464, "feature_file": "outputs/q1_features/features/-dxfTGcXJoc__0.npz", "feature_file_bytes": 202759, "feature_file_sha256": "ec0dda97730b66a051b03048c06c5e5d38526547f272306d94f2bbc9e5d9e90e"}
|
||
{"sample_id": "-dxfTGcXJoc/2", "video_id": "-dxfTGcXJoc", "clip_id": "2", "text": "An estimated 20,000 biotech scientists, executives and industry experts from more than 50 nations were at the BIO conference to learn about the latest scientific advances, and to exchange ideas and establish business relationships.", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-dxfTGcXJoc/2.mp4", "duration_s": 16.697982, "ctc_inference_succeeded": true, "word_count": 34, "word_alignment_valid_count": 32, "audio_raw_length": 1659, "audio_valid_length": 1659, "audio_feature_dim": 25, "vision_raw_length": 84, "vision_valid_length": 84, "vision_feature_dim": 192, "face_blendshape_valid_length": 84, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 500, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["ctc_words_fallback:2"], "processing_seconds": 1.367, "feature_file": "outputs/q1_features/features/-dxfTGcXJoc__2.npz", "feature_file_bytes": 180106, "feature_file_sha256": "22e90ee76842480d82da653934ed53c917b14c3131b9400b0098544f2867ac14"}
|
||
{"sample_id": "-dxfTGcXJoc/6", "video_id": "-dxfTGcXJoc", "clip_id": "6", "text": "Kentucky’s participation at the annual BIO International Convention is the primary means by which our high-tech companies and institutions can reach out to the global scientific community.", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-dxfTGcXJoc/6.mp4", "duration_s": 12.735026, "ctc_inference_succeeded": true, "word_count": 27, "word_alignment_valid_count": 27, "audio_raw_length": 1258, "audio_valid_length": 1258, "audio_feature_dim": 25, "vision_raw_length": 64, "vision_valid_length": 64, "vision_feature_dim": 192, "face_blendshape_valid_length": 63, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 381, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.167, "feature_file": "outputs/q1_features/features/-dxfTGcXJoc__6.npz", "feature_file_bytes": 140160, "feature_file_sha256": "a9457477432872f265c5efd013c19ea478198eef22302f3d9e0d96aeab7986c1"}
|
||
{"sample_id": "-egA8-b7-3M/26", "video_id": "-egA8-b7-3M", "clip_id": "26", "text": "We're updating it all the time and looking forward to your comments on our videos.", "label": 1.6666666269302368, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-egA8-b7-3M/26.mp4", "duration_s": 6.03099, "ctc_inference_succeeded": true, "word_count": 15, "word_alignment_valid_count": 15, "audio_raw_length": 588, "audio_valid_length": 588, "audio_feature_dim": 25, "vision_raw_length": 30, "vision_valid_length": 30, "vision_feature_dim": 192, "face_blendshape_valid_length": 30, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 179, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.937, "feature_file": "outputs/q1_features/features/-egA8-b7-3M__26.npz", "feature_file_bytes": 75011, "feature_file_sha256": "bf014b51b21ea87994ee21f03db87ceb5b9928eed1d2d55784790b1040af9337"}
|
||
{"sample_id": "-egA8-b7-3M/17", "video_id": "-egA8-b7-3M", "clip_id": "17", "text": "As you have more experience, you have more times exhibiting, you get to know more people.", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-egA8-b7-3M/17.mp4", "duration_s": 7.271029, "ctc_inference_succeeded": true, "word_count": 16, "word_alignment_valid_count": 16, "audio_raw_length": 705, "audio_valid_length": 705, "audio_feature_dim": 25, "vision_raw_length": 36, "vision_valid_length": 36, "vision_feature_dim": 192, "face_blendshape_valid_length": 36, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 215, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.971, "feature_file": "outputs/q1_features/features/-egA8-b7-3M__17.npz", "feature_file_bytes": 84195, "feature_file_sha256": "e9c10667126703b2502a15198913c10e2cca2b6165dd4eeb4a8d99133a07e61f"}
|
||
{"sample_id": "-egA8-b7-3M/18", "video_id": "-egA8-b7-3M", "clip_id": "18", "text": "It becomes easier at each one of these conferences to connect with people that you've met or that you're doing business with.", "label": 1.0, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-egA8-b7-3M/18.mp4", "duration_s": 8.386003, "ctc_inference_succeeded": true, "word_count": 22, "word_alignment_valid_count": 22, "audio_raw_length": 822, "audio_valid_length": 822, "audio_feature_dim": 25, "vision_raw_length": 42, "vision_valid_length": 42, "vision_feature_dim": 192, "face_blendshape_valid_length": 42, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 250, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.02, "feature_file": "outputs/q1_features/features/-egA8-b7-3M__18.npz", "feature_file_bytes": 103490, "feature_file_sha256": "ab6ced6fc989adcc5af794eeb33d3d9320dd3399ab87630c7a108449caf64892"}
|
||
{"sample_id": "-egA8-b7-3M/16", "video_id": "-egA8-b7-3M", "clip_id": "16", "text": "Third, another big benefit of exhibiting is connecting with existing clients.", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-egA8-b7-3M/16.mp4", "duration_s": 5.538021, "ctc_inference_succeeded": true, "word_count": 11, "word_alignment_valid_count": 11, "audio_raw_length": 544, "audio_valid_length": 544, "audio_feature_dim": 25, "vision_raw_length": 28, "vision_valid_length": 28, "vision_feature_dim": 192, "face_blendshape_valid_length": 28, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 166, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.889, "feature_file": "outputs/q1_features/features/-egA8-b7-3M__16.npz", "feature_file_bytes": 64870, "feature_file_sha256": "5d039a566cc9534f923e685e5577b09d0f8ac85b5c3c141df8831911c7744ef8"}
|
||
{"sample_id": "-egA8-b7-3M/13", "video_id": "-egA8-b7-3M", "clip_id": "13", "text": "What are you doing that's different?\" They always want an answer.", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-egA8-b7-3M/13.mp4", "duration_s": 4.183984, "ctc_inference_succeeded": true, "word_count": 11, "word_alignment_valid_count": 11, "audio_raw_length": 398, "audio_valid_length": 398, "audio_feature_dim": 25, "vision_raw_length": 21, "vision_valid_length": 21, "vision_feature_dim": 192, "face_blendshape_valid_length": 21, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 123, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.84, "feature_file": "outputs/q1_features/features/-egA8-b7-3M__13.npz", "feature_file_bytes": 55221, "feature_file_sha256": "61e3a28eeb71434c2beb25c37bee7edace80c8cad9939c873a137d574cd9d8a0"}
|
||
{"sample_id": "-egA8-b7-3M/1", "video_id": "-egA8-b7-3M", "clip_id": "1", "text": "I started a successful Legal Nurse Consulting Business in 1989. I mentor nurses who want to become Legal Nurse Consultants.", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-egA8-b7-3M/1.mp4", "duration_s": 10.266016, "ctc_inference_succeeded": true, "word_count": 20, "word_alignment_valid_count": 19, "audio_raw_length": 1011, "audio_valid_length": 1011, "audio_feature_dim": 25, "vision_raw_length": 51, "vision_valid_length": 51, "vision_feature_dim": 192, "face_blendshape_valid_length": 51, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 306, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["ctc_words_fallback:1"], "processing_seconds": 1.115, "feature_file": "outputs/q1_features/features/-egA8-b7-3M__1.npz", "feature_file_bytes": 112851, "feature_file_sha256": "f9f9240885fdb8109abbd3fae1e1628a0881744eb12fa019b2586ee68835898e"}
|
||
{"sample_id": "-egA8-b7-3M/6", "video_id": "-egA8-b7-3M", "clip_id": "6", "text": "First exhibiting is a wonderful opportunity to network with other legal vendors.", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-egA8-b7-3M/6.mp4", "duration_s": 6.264974, "ctc_inference_succeeded": true, "word_count": 12, "word_alignment_valid_count": 12, "audio_raw_length": 614, "audio_valid_length": 614, "audio_feature_dim": 25, "vision_raw_length": 32, "vision_valid_length": 32, "vision_feature_dim": 192, "face_blendshape_valid_length": 32, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 187, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.9, "feature_file": "outputs/q1_features/features/-egA8-b7-3M__6.npz", "feature_file_bytes": 71552, "feature_file_sha256": "63ed3ef14c5d6bcaf97b9d5e69d5614d7e880b90f3ee7cf13245f546d15a7828"}
|
||
{"sample_id": "-egA8-b7-3M/9", "video_id": "-egA8-b7-3M", "clip_id": "9", "text": "Secondly, another goal of exhibiting is building your company image.", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-egA8-b7-3M/9.mp4", "duration_s": 5.089974, "ctc_inference_succeeded": true, "word_count": 10, "word_alignment_valid_count": 10, "audio_raw_length": 489, "audio_valid_length": 489, "audio_feature_dim": 25, "vision_raw_length": 25, "vision_valid_length": 25, "vision_feature_dim": 192, "face_blendshape_valid_length": 25, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 150, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.868, "feature_file": "outputs/q1_features/features/-egA8-b7-3M__9.npz", "feature_file_bytes": 59194, "feature_file_sha256": "f20f151fe4322b86d3c9f6140972ac67c73aa32922b9eb4dbe0fbdf636065337"}
|
||
{"sample_id": "-egA8-b7-3M/20", "video_id": "-egA8-b7-3M", "clip_id": "20", "text": "Now you've got a face that you can connect with a voice, and that makes you closer to that client.", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-egA8-b7-3M/20.mp4", "duration_s": 6.644987, "ctc_inference_succeeded": true, "word_count": 20, "word_alignment_valid_count": 20, "audio_raw_length": 643, "audio_valid_length": 643, "audio_feature_dim": 25, "vision_raw_length": 33, "vision_valid_length": 33, "vision_feature_dim": 192, "face_blendshape_valid_length": 33, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 196, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.95, "feature_file": "outputs/q1_features/features/-egA8-b7-3M__20.npz", "feature_file_bytes": 87987, "feature_file_sha256": "f8d76619a0fc76832079ca699a9c5de1fe9cfc91ee4a2cafdbf366fa5ffeec8a"}
|
||
{"sample_id": "-iRBcNs9oI8/3", "video_id": "-iRBcNs9oI8", "clip_id": "3", "text": "Well, it is the secret of power pose", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-iRBcNs9oI8/3.mp4", "duration_s": 5.621, "ctc_inference_succeeded": true, "word_count": 8, "word_alignment_valid_count": 8, "audio_raw_length": 549, "audio_valid_length": 549, "audio_feature_dim": 25, "vision_raw_length": 28, "vision_valid_length": 28, "vision_feature_dim": 192, "face_blendshape_valid_length": 0, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 167, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["no_face_blendshapes_detected"], "processing_seconds": 0.918, "feature_file": "outputs/q1_features/features/-iRBcNs9oI8__3.npz", "feature_file_bytes": 55728, "feature_file_sha256": "68078a6892f9de5182b9d3ddc812137b46bae3bd1087336dcae6b764fe44881c"}
|
||
{"sample_id": "-iRBcNs9oI8/7", "video_id": "-iRBcNs9oI8", "clip_id": "7", "text": "Well, for starters, let's look at the word \"power\"", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-iRBcNs9oI8/7.mp4", "duration_s": 4.104, "ctc_inference_succeeded": true, "word_count": 9, "word_alignment_valid_count": 9, "audio_raw_length": 396, "audio_valid_length": 396, "audio_feature_dim": 25, "vision_raw_length": 20, "vision_valid_length": 20, "vision_feature_dim": 192, "face_blendshape_valid_length": 0, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 120, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["no_face_blendshapes_detected"], "processing_seconds": 0.811, "feature_file": "outputs/q1_features/features/-iRBcNs9oI8__7.npz", "feature_file_bytes": 48402, "feature_file_sha256": "4041ad453cb24121d0fafda45cfff9dbbce57bdec40a825354376d5aecbc061c"}
|
||
{"sample_id": "-iRBcNs9oI8/6", "video_id": "-iRBcNs9oI8", "clip_id": "6", "text": "What is a power pose", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-iRBcNs9oI8/6.mp4", "duration_s": 2.903, "ctc_inference_succeeded": true, "word_count": 5, "word_alignment_valid_count": 5, "audio_raw_length": 278, "audio_valid_length": 278, "audio_feature_dim": 25, "vision_raw_length": 15, "vision_valid_length": 15, "vision_feature_dim": 192, "face_blendshape_valid_length": 0, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 85, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["no_face_blendshapes_detected"], "processing_seconds": 0.767, "feature_file": "outputs/q1_features/features/-iRBcNs9oI8__6.npz", "feature_file_bytes": 34247, "feature_file_sha256": "33660b05c1f8be7f1f7b89b2400341df488b77a7695990462113cc919a703e0b"}
|
||
{"sample_id": "-iRBcNs9oI8/9", "video_id": "-iRBcNs9oI8", "clip_id": "9", "text": "Power is similar to strength", "label": 1.3333333730697632, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-iRBcNs9oI8/9.mp4", "duration_s": 3.416, "ctc_inference_succeeded": true, "word_count": 5, "word_alignment_valid_count": 5, "audio_raw_length": 333, "audio_valid_length": 333, "audio_feature_dim": 25, "vision_raw_length": 17, "vision_valid_length": 17, "vision_feature_dim": 192, "face_blendshape_valid_length": 0, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 102, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["no_face_blendshapes_detected"], "processing_seconds": 0.816, "feature_file": "outputs/q1_features/features/-iRBcNs9oI8__9.npz", "feature_file_bytes": 36025, "feature_file_sha256": "5c234d0aae9de546fe807ff1f2f0c3e230d6786adbfc62571fcab8232dd4984e"}
|
||
{"sample_id": "-iRBcNs9oI8/8", "video_id": "-iRBcNs9oI8", "clip_id": "8", "text": "I've drawn this man here, and if you can tell, he has a lot of big muscles, he looks very strong", "label": 1.0, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-iRBcNs9oI8/8.mp4", "duration_s": 8.093, "ctc_inference_succeeded": true, "word_count": 21, "word_alignment_valid_count": 21, "audio_raw_length": 798, "audio_valid_length": 798, "audio_feature_dim": 25, "vision_raw_length": 41, "vision_valid_length": 41, "vision_feature_dim": 192, "face_blendshape_valid_length": 0, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 241, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["no_face_blendshapes_detected"], "processing_seconds": 0.996, "feature_file": "outputs/q1_features/features/-iRBcNs9oI8__8.npz", "feature_file_bytes": 94217, "feature_file_sha256": "b11ac96118bcabbbc4c65f82a7d3c0cf44e8750ab856da822c865b9d8561caa0"}
|
||
{"sample_id": "-lzEya4AM_4/5", "video_id": "-lzEya4AM_4", "clip_id": "5", "text": "If it falls into oh any of those three categories, inducing nausea and vomiting would be your next step.", "label": -0.6666666865348816, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-lzEya4AM_4/5.mp4", "duration_s": 7.675, "ctc_inference_succeeded": true, "word_count": 19, "word_alignment_valid_count": 19, "audio_raw_length": 752, "audio_valid_length": 752, "audio_feature_dim": 25, "vision_raw_length": 39, "vision_valid_length": 39, "vision_feature_dim": 192, "face_blendshape_valid_length": 39, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 229, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.054, "feature_file": "outputs/q1_features/features/-lzEya4AM_4__5.npz", "feature_file_bytes": 92703, "feature_file_sha256": "17c139126d6862765aecdc4b5c8fa8a3b9cce667ea9f1b450004aefb14c8c4a5"}
|
||
{"sample_id": "-lzEya4AM_4/6", "video_id": "-lzEya4AM_4", "clip_id": "6", "text": "If the product or poison is some type of petroleum product or corrosive product, you would not attempt to induce vomiting and nausea, as as the product burned on the way down it could cause damage and burning on the way back up.", "label": -0.3333333432674408, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-lzEya4AM_4/6.mp4", "duration_s": 14.791992, "ctc_inference_succeeded": true, "word_count": 43, "word_alignment_valid_count": 43, "audio_raw_length": 1470, "audio_valid_length": 1470, "audio_feature_dim": 25, "vision_raw_length": 74, "vision_valid_length": 74, "vision_feature_dim": 192, "face_blendshape_valid_length": 74, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 443, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.401, "feature_file": "outputs/q1_features/features/-lzEya4AM_4__6.npz", "feature_file_bytes": 184072, "feature_file_sha256": "ea3d7a1cf953b467441a8c8f69585457ca0d64ae2ac642aaa8ef5638d575ea3a"}
|
||
{"sample_id": "-mJ2ud6oKI8/1", "video_id": "-mJ2ud6oKI8", "clip_id": "1", "text": "There are a dozen or more hands on techniques that we can do", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-mJ2ud6oKI8/1.mp4", "duration_s": 6.103, "ctc_inference_succeeded": true, "word_count": 13, "word_alignment_valid_count": 13, "audio_raw_length": 601, "audio_valid_length": 601, "audio_feature_dim": 25, "vision_raw_length": 31, "vision_valid_length": 31, "vision_feature_dim": 192, "face_blendshape_valid_length": 0, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 182, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["no_face_blendshapes_detected"], "processing_seconds": 0.909, "feature_file": "outputs/q1_features/features/-mJ2ud6oKI8__1.npz", "feature_file_bytes": 42496, "feature_file_sha256": "cef94a67ec6c902c28ada0176e70c3c9dda548237dfc89adfbb1a49e58d63448"}
|
||
{"sample_id": "-mJ2ud6oKI8/2", "video_id": "-mJ2ud6oKI8", "clip_id": "2", "text": "So physical therapists and chiropractors will do joint manipulations and mobilizations", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-mJ2ud6oKI8/2.mp4", "duration_s": 5.731, "ctc_inference_succeeded": true, "word_count": 11, "word_alignment_valid_count": 11, "audio_raw_length": 566, "audio_valid_length": 566, "audio_feature_dim": 25, "vision_raw_length": 29, "vision_valid_length": 29, "vision_feature_dim": 192, "face_blendshape_valid_length": 0, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 171, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["no_face_blendshapes_detected"], "processing_seconds": 0.879, "feature_file": "outputs/q1_features/features/-mJ2ud6oKI8__2.npz", "feature_file_bytes": 38780, "feature_file_sha256": "7a75079ee9256bde17ba18fb45213ebdbfc73db7360cc228624f6acc55b3d12f"}
|
||
{"sample_id": "-mJ2ud6oKI8/6", "video_id": "-mJ2ud6oKI8", "clip_id": "6", "text": "They are all very safe", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-mJ2ud6oKI8/6.mp4", "duration_s": 2.257, "ctc_inference_succeeded": true, "word_count": 5, "word_alignment_valid_count": 5, "audio_raw_length": 218, "audio_valid_length": 218, "audio_feature_dim": 25, "vision_raw_length": 12, "vision_valid_length": 12, "vision_feature_dim": 192, "face_blendshape_valid_length": 12, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 67, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.751, "feature_file": "outputs/q1_features/features/-mJ2ud6oKI8__6.npz", "feature_file_bytes": 31649, "feature_file_sha256": "f50ed376f03cd8f4613014f78e16f0a6ec95f4c2657af6880ff0e8a946435cee"}
|
||
{"sample_id": "-mJ2ud6oKI8/9", "video_id": "-mJ2ud6oKI8", "clip_id": "9", "text": "It's safe and the person will feel better later on, but it's sort of like flossing your teeth for the first time", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-mJ2ud6oKI8/9.mp4", "duration_s": 7.033, "ctc_inference_succeeded": true, "word_count": 22, "word_alignment_valid_count": 22, "audio_raw_length": 686, "audio_valid_length": 686, "audio_feature_dim": 25, "vision_raw_length": 35, "vision_valid_length": 35, "vision_feature_dim": 192, "face_blendshape_valid_length": 34, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 208, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.133, "feature_file": "outputs/q1_features/features/-mJ2ud6oKI8__9.npz", "feature_file_bytes": 91413, "feature_file_sha256": "66e7fd67aced87b8cc140c15e29fc3acc4531965aa8347d529e3a13531d9ea61"}
|
||
{"sample_id": "-mJ2ud6oKI8/8", "video_id": "-mJ2ud6oKI8", "clip_id": "8", "text": "Sometimes we have to stretch that joint that is already irritated", "label": -0.3333333432674408, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-mJ2ud6oKI8/8.mp4", "duration_s": 4.192, "ctc_inference_succeeded": true, "word_count": 11, "word_alignment_valid_count": 11, "audio_raw_length": 413, "audio_valid_length": 413, "audio_feature_dim": 25, "vision_raw_length": 21, "vision_valid_length": 21, "vision_feature_dim": 192, "face_blendshape_valid_length": 21, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 125, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.915, "feature_file": "outputs/q1_features/features/-mJ2ud6oKI8__8.npz", "feature_file_bytes": 55199, "feature_file_sha256": "2605a8ef0e9b58c906d4322f462b1b7546c7a862c849c765279e8f5df689f7f3"}
|
||
{"sample_id": "-mqbVkbCndg/0", "video_id": "-mqbVkbCndg", "clip_id": "0", "text": "How, at a particular moment in time—our moment in time—are they limited", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-mqbVkbCndg/0.mp4", "duration_s": 6.466667, "ctc_inference_succeeded": true, "word_count": 12, "word_alignment_valid_count": 12, "audio_raw_length": 634, "audio_valid_length": 634, "audio_feature_dim": 25, "vision_raw_length": 33, "vision_valid_length": 33, "vision_feature_dim": 192, "face_blendshape_valid_length": 33, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 194, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.108, "feature_file": "outputs/q1_features/features/-mqbVkbCndg__0.npz", "feature_file_bytes": 72269, "feature_file_sha256": "b7d742a9161423cb1db8af233308b75552060cdae423464bcec4e288c2e91f2f"}
|
||
{"sample_id": "-t217m2on-s/2", "video_id": "-t217m2on-s", "clip_id": "2", "text": "But a good thing to do is yawning, chewing gum is effective.", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-t217m2on-s/2.mp4", "duration_s": 5.686003, "ctc_inference_succeeded": true, "word_count": 12, "word_alignment_valid_count": 12, "audio_raw_length": 559, "audio_valid_length": 559, "audio_feature_dim": 25, "vision_raw_length": 29, "vision_valid_length": 29, "vision_feature_dim": 192, "face_blendshape_valid_length": 29, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 170, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.873, "feature_file": "outputs/q1_features/features/-t217m2on-s__2.npz", "feature_file_bytes": 67378, "feature_file_sha256": "8bc2165c2e59ba4ad6bc7c754121d6e000ea808902f33894ffc011e8de04184b"}
|
||
{"sample_id": "-t217m2on-s/7", "video_id": "-t217m2on-s", "clip_id": "7", "text": "If you find that your ears consistently do this and you can't pop them often, you'll definitely need to see a physician regarding those things, it could be something more of a nasal infection or a sinus infection that he would need to deal with.", "label": -0.6666666865348816, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-t217m2on-s/7.mp4", "duration_s": 17.183008, "ctc_inference_succeeded": true, "word_count": 45, "word_alignment_valid_count": 45, "audio_raw_length": 1698, "audio_valid_length": 1698, "audio_feature_dim": 25, "vision_raw_length": 86, "vision_valid_length": 86, "vision_feature_dim": 192, "face_blendshape_valid_length": 86, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 512, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.401, "feature_file": "outputs/q1_features/features/-t217m2on-s__7.npz", "feature_file_bytes": 203231, "feature_file_sha256": "2f46e5ccaab773f47dc3c868fb4ebee655be8c1e63417a929e404634497e9145"}
|
||
{"sample_id": "-tANM6ETl_M/3", "video_id": "-tANM6ETl_M", "clip_id": "3", "text": "The first place is either you have a prospect, or a customer who's never done it before, or they've never tried it.", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-tANM6ETl_M/3.mp4", "duration_s": 6.758008, "ctc_inference_succeeded": true, "word_count": 22, "word_alignment_valid_count": 22, "audio_raw_length": 656, "audio_valid_length": 656, "audio_feature_dim": 25, "vision_raw_length": 34, "vision_valid_length": 34, "vision_feature_dim": 192, "face_blendshape_valid_length": 34, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 200, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.372, "feature_file": "outputs/q1_features/features/-tANM6ETl_M__3.npz", "feature_file_bytes": 93347, "feature_file_sha256": "f02e592e9523d42da4cb803c1b88b36aae284afd0a69a24e1b9e687888142b37"}
|
||
{"sample_id": "-tPCytz4rww/11", "video_id": "-tPCytz4rww", "clip_id": "11", "text": "Make sure that your using comps that are not larger, no larger than twelve hundred square feet.", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-tPCytz4rww/11.mp4", "duration_s": 5.466992, "ctc_inference_succeeded": true, "word_count": 17, "word_alignment_valid_count": 17, "audio_raw_length": 533, "audio_valid_length": 533, "audio_feature_dim": 25, "vision_raw_length": 28, "vision_valid_length": 28, "vision_feature_dim": 192, "face_blendshape_valid_length": 28, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 164, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.852, "feature_file": "outputs/q1_features/features/-tPCytz4rww__11.npz", "feature_file_bytes": 76420, "feature_file_sha256": "5bcbfe9dd695b89b7da60668a4cc5ce80373e327c87b45a1651259db54661224"}
|
||
{"sample_id": "-tPCytz4rww/10", "video_id": "-tPCytz4rww", "clip_id": "10", "text": "Say twenty percent so if you've got a thousand square foot condo.", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-tPCytz4rww/10.mp4", "duration_s": 4.788997, "ctc_inference_succeeded": true, "word_count": 12, "word_alignment_valid_count": 12, "audio_raw_length": 463, "audio_valid_length": 463, "audio_feature_dim": 25, "vision_raw_length": 24, "vision_valid_length": 24, "vision_feature_dim": 192, "face_blendshape_valid_length": 24, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 142, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.875, "feature_file": "outputs/q1_features/features/-tPCytz4rww__10.npz", "feature_file_bytes": 60662, "feature_file_sha256": "d2934c2150ce2e1e0062bf3044d9d7af3786db03cbf35a7c823d7d8354de6365"}
|
||
{"sample_id": "-tPCytz4rww/12", "video_id": "-tPCytz4rww", "clip_id": "12", "text": "No less than eight hundred squire feet and going to similar in, similar with bedrooms and bathrooms as well and hopefully the complexes have similar amenities.", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-tPCytz4rww/12.mp4", "duration_s": 11.863997, "ctc_inference_succeeded": true, "word_count": 26, "word_alignment_valid_count": 26, "audio_raw_length": 1169, "audio_valid_length": 1169, "audio_feature_dim": 25, "vision_raw_length": 59, "vision_valid_length": 59, "vision_feature_dim": 192, "face_blendshape_valid_length": 59, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 353, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.156, "feature_file": "outputs/q1_features/features/-tPCytz4rww__12.npz", "feature_file_bytes": 133451, "feature_file_sha256": "a6ff71df17d7bc392bfc52445b482401e0a995fe230868730823dea3a044f073"}
|
||
{"sample_id": "-tPCytz4rww/16", "video_id": "-tPCytz4rww", "clip_id": "16", "text": "So make sure to get a through or to do a through cleaning of the property.", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-tPCytz4rww/16.mp4", "duration_s": 7.20599, "ctc_inference_succeeded": true, "word_count": 16, "word_alignment_valid_count": 16, "audio_raw_length": 709, "audio_valid_length": 709, "audio_feature_dim": 25, "vision_raw_length": 36, "vision_valid_length": 36, "vision_feature_dim": 192, "face_blendshape_valid_length": 36, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 216, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.933, "feature_file": "outputs/q1_features/features/-tPCytz4rww__16.npz", "feature_file_bytes": 83725, "feature_file_sha256": "6934aa9c66e7aa464a0a281e47e1220e87d5beadd74e00f287f8f088946bc21c"}
|
||
{"sample_id": "-tPCytz4rww/18", "video_id": "-tPCytz4rww", "clip_id": "18", "text": "Do so and as well you'll also want to remove any clutter from that you've accumulated.", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-tPCytz4rww/18.mp4", "duration_s": 6.644987, "ctc_inference_succeeded": true, "word_count": 16, "word_alignment_valid_count": 16, "audio_raw_length": 652, "audio_valid_length": 652, "audio_feature_dim": 25, "vision_raw_length": 34, "vision_valid_length": 34, "vision_feature_dim": 192, "face_blendshape_valid_length": 34, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 199, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.92, "feature_file": "outputs/q1_features/features/-tPCytz4rww__18.npz", "feature_file_bytes": 81628, "feature_file_sha256": "9df4418cac050f4385f8decdb1d71025504d9c8d01ccd62c177c8400651de10d"}
|
||
{"sample_id": "-vxjVxOeScU/4", "video_id": "-vxjVxOeScU", "clip_id": "4", "text": "You're going to talk about their life, their marriage and usually how amazing it is that they've stayed together this long.", "label": 1.0, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-vxjVxOeScU/4.mp4", "duration_s": 9.127018, "ctc_inference_succeeded": true, "word_count": 21, "word_alignment_valid_count": 21, "audio_raw_length": 899, "audio_valid_length": 899, "audio_feature_dim": 25, "vision_raw_length": 46, "vision_valid_length": 46, "vision_feature_dim": 192, "face_blendshape_valid_length": 46, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 272, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.022, "feature_file": "outputs/q1_features/features/-vxjVxOeScU__4.npz", "feature_file_bytes": 109211, "feature_file_sha256": "f3d2da4c79b194cb5d88c9a25e5798718b0a54a4ebaa03859d1dfe8cf44c0e3e"}
|
||
{"sample_id": "-wMB_hJL-3o/7", "video_id": "-wMB_hJL-3o", "clip_id": "7", "text": "So if you have a loved one who is depressed those are some of the things that you should think about doing.", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-wMB_hJL-3o/7.mp4", "duration_s": 6.04401, "ctc_inference_succeeded": true, "word_count": 22, "word_alignment_valid_count": 22, "audio_raw_length": 593, "audio_valid_length": 593, "audio_feature_dim": 25, "vision_raw_length": 31, "vision_valid_length": 31, "vision_feature_dim": 192, "face_blendshape_valid_length": 31, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 181, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.862, "feature_file": "outputs/q1_features/features/-wMB_hJL-3o__7.npz", "feature_file_bytes": 87786, "feature_file_sha256": "abc6004b9c9b862a710ef51a7add4b0e15e9decd398568ba5c5c78097b9601e5"}
|
||
{"sample_id": "-wny0OAz3g8/1", "video_id": "-wny0OAz3g8", "clip_id": "1", "text": "And because they couldn’t join unions, many Black workers couldn’t get manufacturing or trade work – which paid much better than service work", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-wny0OAz3g8/1.mp4", "duration_s": 6.84401, "ctc_inference_succeeded": true, "word_count": 23, "word_alignment_valid_count": 22, "audio_raw_length": 673, "audio_valid_length": 673, "audio_feature_dim": 25, "vision_raw_length": 35, "vision_valid_length": 35, "vision_feature_dim": 192, "face_blendshape_valid_length": 14, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 205, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["ctc_words_fallback:1"], "processing_seconds": 1.079, "feature_file": "outputs/q1_features/features/-wny0OAz3g8__1.npz", "feature_file_bytes": 94004, "feature_file_sha256": "362a4d42cba56aa7e531eef1357a32499f8c65e21145586d32ed7947d1acda76"}
|
||
{"sample_id": "-wny0OAz3g8/0", "video_id": "-wny0OAz3g8", "clip_id": "0", "text": "trade labor unions didn’t allow Black workers to join", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-wny0OAz3g8/0.mp4", "duration_s": 3.333333, "ctc_inference_succeeded": true, "word_count": 9, "word_alignment_valid_count": 9, "audio_raw_length": 323, "audio_valid_length": 323, "audio_feature_dim": 25, "vision_raw_length": 17, "vision_valid_length": 17, "vision_feature_dim": 192, "face_blendshape_valid_length": 14, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 100, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.855, "feature_file": "outputs/q1_features/features/-wny0OAz3g8__0.npz", "feature_file_bytes": 46886, "feature_file_sha256": "fe0f40f6343ea3cff917f5145e9f0fe9dee535578478742de40028d28050d7b7"}
|
||
{"sample_id": "-wny0OAz3g8/3", "video_id": "-wny0OAz3g8", "clip_id": "3", "text": "Which then allowed the white workers and unions to justify their decision to not allow black workers into their union", "label": -1.3333333730697632, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-wny0OAz3g8/3.mp4", "duration_s": 6.146029, "ctc_inference_succeeded": true, "word_count": 20, "word_alignment_valid_count": 20, "audio_raw_length": 605, "audio_valid_length": 605, "audio_feature_dim": 25, "vision_raw_length": 31, "vision_valid_length": 31, "vision_feature_dim": 192, "face_blendshape_valid_length": 8, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 184, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.039, "feature_file": "outputs/q1_features/features/-wny0OAz3g8__3.npz", "feature_file_bytes": 84176, "feature_file_sha256": "cda92d90e4e5444e961776b9f99f24af0e2155fa91717f2c7abb4c00f2971364"}
|
||
{"sample_id": "-wny0OAz3g8/2", "video_id": "-wny0OAz3g8", "clip_id": "2", "text": "And because they couldn’t get these jobs, Black communities had more men out of work, higher rates of poverty, and more criminal behavior", "label": -0.3333333432674408, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-wny0OAz3g8/2.mp4", "duration_s": 6.686979, "ctc_inference_succeeded": true, "word_count": 23, "word_alignment_valid_count": 23, "audio_raw_length": 648, "audio_valid_length": 648, "audio_feature_dim": 25, "vision_raw_length": 33, "vision_valid_length": 33, "vision_feature_dim": 192, "face_blendshape_valid_length": 27, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 197, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.066, "feature_file": "outputs/q1_features/features/-wny0OAz3g8__2.npz", "feature_file_bytes": 89372, "feature_file_sha256": "6e4783cfaf56697e1dab151f62b937b00c7ae88edbab3686766ab35f615a765d"}
|
||
{"sample_id": "-wny0OAz3g8/5", "video_id": "-wny0OAz3g8", "clip_id": "5", "text": "This is what’s now known as racial formation theory, a theory formalized by modern sociologists Michael Omi and Howard Winant", "label": 1.0, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-wny0OAz3g8/5.mp4", "duration_s": 6.911979, "ctc_inference_succeeded": true, "word_count": 20, "word_alignment_valid_count": 20, "audio_raw_length": 670, "audio_valid_length": 670, "audio_feature_dim": 25, "vision_raw_length": 34, "vision_valid_length": 34, "vision_feature_dim": 192, "face_blendshape_valid_length": 6, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 204, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.996, "feature_file": "outputs/q1_features/features/-wny0OAz3g8__5.npz", "feature_file_bytes": 86434, "feature_file_sha256": "d8b108c0c2a9e614329ac44f31bf77ecdeb69490c601851f298c0c9622aa2e8f"}
|
||
{"sample_id": "-wny0OAz3g8/7", "video_id": "-wny0OAz3g8", "clip_id": "7", "text": "Omi and Winant argue that the concept of race came about as a tool to justify and maintain the economic and political power held by those of European descent", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-wny0OAz3g8/7.mp4", "duration_s": 8.067969, "ctc_inference_succeeded": true, "word_count": 29, "word_alignment_valid_count": 29, "audio_raw_length": 787, "audio_valid_length": 787, "audio_feature_dim": 25, "vision_raw_length": 40, "vision_valid_length": 40, "vision_feature_dim": 192, "face_blendshape_valid_length": 35, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 240, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.123, "feature_file": "outputs/q1_features/features/-wny0OAz3g8__7.npz", "feature_file_bytes": 115720, "feature_file_sha256": "82baf4e55ebd2068717dd4a15fecd24a1f34843aa5c7f888a5405666570e6a9d"}
|
||
{"sample_id": "-wny0OAz3g8/9", "video_id": "-wny0OAz3g8", "clip_id": "9", "text": "He explores why Black and White Americans tend to have such different outcomes in terms of income, education, and more", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-wny0OAz3g8/9.mp4", "duration_s": 6.213021, "ctc_inference_succeeded": true, "word_count": 20, "word_alignment_valid_count": 20, "audio_raw_length": 600, "audio_valid_length": 600, "audio_feature_dim": 25, "vision_raw_length": 31, "vision_valid_length": 31, "vision_feature_dim": 192, "face_blendshape_valid_length": 29, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 183, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.023, "feature_file": "outputs/q1_features/features/-wny0OAz3g8__9.npz", "feature_file_bytes": 86748, "feature_file_sha256": "a5e965ff931d5a3d9872095ddb7bb48c65e2596de9a73b345d5e493e4b5aa449"}
|
||
{"sample_id": "-571d8cVauQ/0", "video_id": "-571d8cVauQ", "clip_id": "0", "text": "This is Rhett Reiger, White Caspian Studios on behalf of Expert Village.", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-571d8cVauQ/0.mp4", "duration_s": 5.066667, "ctc_inference_succeeded": true, "word_count": 12, "word_alignment_valid_count": 12, "audio_raw_length": 495, "audio_valid_length": 495, "audio_feature_dim": 25, "vision_raw_length": 26, "vision_valid_length": 26, "vision_feature_dim": 192, "face_blendshape_valid_length": 25, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 152, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.815, "feature_file": "outputs/q1_features/features/-571d8cVauQ__0.npz", "feature_file_bytes": 58874, "feature_file_sha256": "f7619fd9f48c31307f3ea25e78bf820a505057521f2f155d75f80b9933dce7ea"}
|
||
{"sample_id": "-571d8cVauQ/5", "video_id": "-571d8cVauQ", "clip_id": "5", "text": "So very important to go out to the locations, walk around, talk with the owners if you can, tell them what you're doing, build a little excitement, put a little glitz on there and let everybody knows this is a very valuable spot.", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-571d8cVauQ/5.mp4", "duration_s": 15.272982, "ctc_inference_succeeded": true, "word_count": 43, "word_alignment_valid_count": 43, "audio_raw_length": 1507, "audio_valid_length": 1507, "audio_feature_dim": 25, "vision_raw_length": 76, "vision_valid_length": 76, "vision_feature_dim": 192, "face_blendshape_valid_length": 76, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 455, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.308, "feature_file": "outputs/q1_features/features/-571d8cVauQ__5.npz", "feature_file_bytes": 186922, "feature_file_sha256": "268d96a63185239a759a6ea3a1807abd37d138b95400ef4cb970125cba68e259"}
|
||
{"sample_id": "-I_e4mIh0yE/1", "video_id": "-I_e4mIh0yE", "clip_id": "1", "text": "In the United States we don't punish failure to the degree to which failure is punished in Europe.", "label": -0.6666666865348816, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-I_e4mIh0yE/1.mp4", "duration_s": 7.622005, "ctc_inference_succeeded": true, "word_count": 18, "word_alignment_valid_count": 18, "audio_raw_length": 740, "audio_valid_length": 740, "audio_feature_dim": 25, "vision_raw_length": 38, "vision_valid_length": 38, "vision_feature_dim": 192, "face_blendshape_valid_length": 38, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 225, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.933, "feature_file": "outputs/q1_features/features/-I_e4mIh0yE__1.npz", "feature_file_bytes": 89671, "feature_file_sha256": "fd45f8d3be6a030b902719e09b8d0e39b198a3897e06a952a7ac73bd596d0102"}
|
||
{"sample_id": "-I_e4mIh0yE/3", "video_id": "-I_e4mIh0yE", "clip_id": "3", "text": "It's perceived that you have actually learned something, over the course of your carreer, and that you won't make the mistake twice.", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-I_e4mIh0yE/3.mp4", "duration_s": 9.163021, "ctc_inference_succeeded": true, "word_count": 22, "word_alignment_valid_count": 22, "audio_raw_length": 895, "audio_valid_length": 895, "audio_feature_dim": 25, "vision_raw_length": 46, "vision_valid_length": 46, "vision_feature_dim": 192, "face_blendshape_valid_length": 46, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 271, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.06, "feature_file": "outputs/q1_features/features/-I_e4mIh0yE__3.npz", "feature_file_bytes": 106161, "feature_file_sha256": "5bc0a18e3a0f0bca0dc14f2a2ce3293c3ce6fa996e51c7a1aaed69c3c4b78dc1"}
|
||
{"sample_id": "-UacrmKiTn4/10", "video_id": "-UacrmKiTn4", "clip_id": "10", "text": "Because, if they are not in any way held accountable for reading the material they won't do it.", "label": -0.6666666865348816, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-UacrmKiTn4/10.mp4", "duration_s": 7.361979, "ctc_inference_succeeded": true, "word_count": 18, "word_alignment_valid_count": 18, "audio_raw_length": 720, "audio_valid_length": 720, "audio_feature_dim": 25, "vision_raw_length": 37, "vision_valid_length": 37, "vision_feature_dim": 192, "face_blendshape_valid_length": 37, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 218, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.936, "feature_file": "outputs/q1_features/features/-UacrmKiTn4__10.npz", "feature_file_bytes": 90141, "feature_file_sha256": "d83feb6007b70660e1a8bd9d92f144ee2ff1226d9dd7cacebf723fd2010474f5"}
|
||
{"sample_id": "-UacrmKiTn4/4", "video_id": "-UacrmKiTn4", "clip_id": "4", "text": "Just given to their own devices they are not going to read the textbook.", "label": -1.3333333730697632, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-UacrmKiTn4/4.mp4", "duration_s": 4.741016, "ctc_inference_succeeded": true, "word_count": 14, "word_alignment_valid_count": 14, "audio_raw_length": 464, "audio_valid_length": 464, "audio_feature_dim": 25, "vision_raw_length": 24, "vision_valid_length": 24, "vision_feature_dim": 192, "face_blendshape_valid_length": 24, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 142, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.798, "feature_file": "outputs/q1_features/features/-UacrmKiTn4__4.npz", "feature_file_bytes": 64832, "feature_file_sha256": "0ad3024c7377b55b9477f09cf8e74b30f627abf1a2b6ef0a4b1fc418e5fb07ff"}
|
||
{"sample_id": "-hnBHBN8p5A/7", "video_id": "-hnBHBN8p5A", "clip_id": "7", "text": "Picture this, before we actually start hacking, we’re in a room formal setting", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-hnBHBN8p5A/7.mp4", "duration_s": 7.372, "ctc_inference_succeeded": true, "word_count": 13, "word_alignment_valid_count": 13, "audio_raw_length": 726, "audio_valid_length": 726, "audio_feature_dim": 25, "vision_raw_length": 36, "vision_valid_length": 36, "vision_feature_dim": 192, "face_blendshape_valid_length": 0, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 176, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["no_face_blendshapes_detected"], "processing_seconds": 0.971, "feature_file": "outputs/q1_features/features/-hnBHBN8p5A__7.npz", "feature_file_bytes": 72066, "feature_file_sha256": "727738b5db20f39e7202422ae7b6aae13a7beaed73032dd4bf9d1b4f31a3b6cd"}
|
||
{"sample_id": "-hnBHBN8p5A/6", "video_id": "-hnBHBN8p5A", "clip_id": "6", "text": "Discussion, how to discuss ideas and opinions more effectively than a native speaker", "label": 1.0, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-hnBHBN8p5A/6.mp4", "duration_s": 6.401, "ctc_inference_succeeded": true, "word_count": 13, "word_alignment_valid_count": 13, "audio_raw_length": 629, "audio_valid_length": 629, "audio_feature_dim": 25, "vision_raw_length": 31, "vision_valid_length": 31, "vision_feature_dim": 192, "face_blendshape_valid_length": 0, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 153, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["no_face_blendshapes_detected"], "processing_seconds": 0.95, "feature_file": "outputs/q1_features/features/-hnBHBN8p5A__6.npz", "feature_file_bytes": 65954, "feature_file_sha256": "62feca3ba0ca057a7b7b1b4b8c760b577480a55c3d1307a5e32d491d794fda36"}
|
||
{"sample_id": "-qDkUB0GgYY/6", "video_id": "-qDkUB0GgYY", "clip_id": "6", "text": "We always love to hear what you say, and like and share this video as well.", "label": 1.3333333730697632, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-qDkUB0GgYY/6.mp4", "duration_s": 4.677995, "ctc_inference_succeeded": true, "word_count": 16, "word_alignment_valid_count": 16, "audio_raw_length": 457, "audio_valid_length": 457, "audio_feature_dim": 25, "vision_raw_length": 24, "vision_valid_length": 24, "vision_feature_dim": 192, "face_blendshape_valid_length": 24, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 140, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.816, "feature_file": "outputs/q1_features/features/-qDkUB0GgYY__6.npz", "feature_file_bytes": 69147, "feature_file_sha256": "7a23449abba588d30c3ba564016c2b28c80245bc918bc5325851be1c125fdf7e"}
|
||
{"sample_id": "-uywlfIYOS8/4", "video_id": "-uywlfIYOS8", "clip_id": "4", "text": "And then from a brand point of view, we need to make sure we're driving the relevant insight.", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-uywlfIYOS8/4.mp4", "duration_s": 6.044987, "ctc_inference_succeeded": true, "word_count": 18, "word_alignment_valid_count": 18, "audio_raw_length": 584, "audio_valid_length": 584, "audio_feature_dim": 25, "vision_raw_length": 30, "vision_valid_length": 30, "vision_feature_dim": 192, "face_blendshape_valid_length": 30, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 179, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.873, "feature_file": "outputs/q1_features/features/-uywlfIYOS8__4.npz", "feature_file_bytes": 80911, "feature_file_sha256": "3d9ca40b5bf8a398539117a43a682eb077d3230c6adeba5bb70d605d47af3507"}
|
||
{"sample_id": "-6rXp3zJ3kc/8", "video_id": "-6rXp3zJ3kc", "clip_id": "8", "text": "Many people are not until they get to be a older age and they realize that gosh they wasted a lot of time and money in placing bets on stock that's ultimately lost value.", "label": -1.0, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-6rXp3zJ3kc/8.mp4", "duration_s": 12.805013, "ctc_inference_succeeded": true, "word_count": 34, "word_alignment_valid_count": 34, "audio_raw_length": 1269, "audio_valid_length": 1269, "audio_feature_dim": 25, "vision_raw_length": 64, "vision_valid_length": 64, "vision_feature_dim": 192, "face_blendshape_valid_length": 64, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 384, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.243, "feature_file": "outputs/q1_features/features/-6rXp3zJ3kc__8.npz", "feature_file_bytes": 155936, "feature_file_sha256": "9154d8ce74a2c17c50738db3c0d947d2e71e68667935e7d95d3ae391d133531b"}
|
||
{"sample_id": "-9y-fZ3swSY/0", "video_id": "-9y-fZ3swSY", "clip_id": "0", "text": "is, you can say, hey I really like baby skin, they are so soft, they don’t have any hair on their face", "label": 1.0, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-9y-fZ3swSY/0.mp4", "duration_s": 6.833333, "ctc_inference_succeeded": true, "word_count": 22, "word_alignment_valid_count": 22, "audio_raw_length": 671, "audio_valid_length": 671, "audio_feature_dim": 25, "vision_raw_length": 35, "vision_valid_length": 35, "vision_feature_dim": 192, "face_blendshape_valid_length": 35, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 205, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.083, "feature_file": "outputs/q1_features/features/-9y-fZ3swSY__0.npz", "feature_file_bytes": 95005, "feature_file_sha256": "3a2ed2dc4d08a11bcc35cfb68f6b83ac50c801f276c38f50b645ea6c0e9d5e4e"}
|
||
{"sample_id": "-9y-fZ3swSY/4", "video_id": "-9y-fZ3swSY", "clip_id": "4", "text": "I’ve seen this in US or in the US", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-9y-fZ3swSY/4.mp4", "duration_s": 2.821029, "ctc_inference_succeeded": true, "word_count": 9, "word_alignment_valid_count": 9, "audio_raw_length": 262, "audio_valid_length": 262, "audio_feature_dim": 25, "vision_raw_length": 14, "vision_valid_length": 14, "vision_feature_dim": 192, "face_blendshape_valid_length": 13, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 81, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.796, "feature_file": "outputs/q1_features/features/-9y-fZ3swSY__4.npz", "feature_file_bytes": 39524, "feature_file_sha256": "97543a5bf15709d01d29423822918e8a42b0f20d562cf72f4a64d4ea6be88d0b"}
|
||
{"sample_id": "-9y-fZ3swSY/8", "video_id": "-9y-fZ3swSY", "clip_id": "8", "text": "That’s a more decent and more polite way to call a lady", "label": 1.6666666269302368, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-9y-fZ3swSY/8.mp4", "duration_s": 4.988997, "ctc_inference_succeeded": true, "word_count": 12, "word_alignment_valid_count": 12, "audio_raw_length": 487, "audio_valid_length": 487, "audio_feature_dim": 25, "vision_raw_length": 25, "vision_valid_length": 25, "vision_feature_dim": 192, "face_blendshape_valid_length": 18, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 149, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.013, "feature_file": "outputs/q1_features/features/-9y-fZ3swSY__8.npz", "feature_file_bytes": 61536, "feature_file_sha256": "e3252b6b0b965fbd84d9435ed763b7b8c8c82557b6a82c93a06feb2a2e75c502"}
|
||
{"sample_id": "-AUZQgSxyPQ/2", "video_id": "-AUZQgSxyPQ", "clip_id": "2", "text": "The perfect soul mate to the Clarisonic Spot Therapy Brush, this gentle, Ph balanced and hydrating exfoliant containing jojoba and acai fruit oils and bamboo and prickly bear extracts deliver intense healing, while smooth granules buff away dead, dry skin cells.", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-AUZQgSxyPQ/2.mp4", "duration_s": 22.511003, "ctc_inference_succeeded": true, "word_count": 41, "word_alignment_valid_count": 41, "audio_raw_length": 2236, "audio_valid_length": 2236, "audio_feature_dim": 25, "vision_raw_length": 113, "vision_valid_length": 113, "vision_feature_dim": 192, "face_blendshape_valid_length": 113, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 674, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 2.075, "feature_file": "outputs/q1_features/features/-AUZQgSxyPQ__2.npz", "feature_file_bytes": 221014, "feature_file_sha256": "5d5302d19af9b0ca3cb9c85523bce5d3010dbaa8029b4f13064998f720952f3e"}
|
||
{"sample_id": "-HeZS2-Prhc/2", "video_id": "-HeZS2-Prhc", "clip_id": "2", "text": "The August jobs report is out and it was seen overall as solid but not great.", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-HeZS2-Prhc/2.mp4", "duration_s": 8.261979, "ctc_inference_succeeded": true, "word_count": 16, "word_alignment_valid_count": 16, "audio_raw_length": 811, "audio_valid_length": 811, "audio_feature_dim": 25, "vision_raw_length": 41, "vision_valid_length": 41, "vision_feature_dim": 192, "face_blendshape_valid_length": 41, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 246, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.003, "feature_file": "outputs/q1_features/features/-HeZS2-Prhc__2.npz", "feature_file_bytes": 91019, "feature_file_sha256": "447eabf4ef50af858c6d189b5145a4c1f109157d0c5afa2f505201ca8d2c3f59"}
|
||
{"sample_id": "-MeTTeMJBNc/0", "video_id": "-MeTTeMJBNc", "clip_id": "0", "text": "Okay, what happens at this point after we've taken this brief walk down memory lane, is the presentation of the gift.", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-MeTTeMJBNc/0.mp4", "duration_s": 9.3, "ctc_inference_succeeded": true, "word_count": 21, "word_alignment_valid_count": 21, "audio_raw_length": 917, "audio_valid_length": 917, "audio_feature_dim": 25, "vision_raw_length": 47, "vision_valid_length": 47, "vision_feature_dim": 192, "face_blendshape_valid_length": 46, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 279, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.048, "feature_file": "outputs/q1_features/features/-MeTTeMJBNc__0.npz", "feature_file_bytes": 100330, "feature_file_sha256": "0fe362d119a5e1efdf6813913b63c513fef14c2fb496022a2a944a21a60cf930"}
|
||
{"sample_id": "-MeTTeMJBNc/13", "video_id": "-MeTTeMJBNc", "clip_id": "13", "text": "It just needs to be a simple statement, and then you present the gift.", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-MeTTeMJBNc/13.mp4", "duration_s": 5.430013, "ctc_inference_succeeded": true, "word_count": 14, "word_alignment_valid_count": 14, "audio_raw_length": 521, "audio_valid_length": 521, "audio_feature_dim": 25, "vision_raw_length": 27, "vision_valid_length": 27, "vision_feature_dim": 192, "face_blendshape_valid_length": 27, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 159, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.888, "feature_file": "outputs/q1_features/features/-MeTTeMJBNc__13.npz", "feature_file_bytes": 66667, "feature_file_sha256": "2707ebca0708b469cbe40988fef1a496dd58412d1fc2e0279abbab33daf11366"}
|
||
{"sample_id": "-MeTTeMJBNc/7", "video_id": "-MeTTeMJBNc", "clip_id": "7", "text": "Maybe you could find a picture of the couple from their wedding or sometime in their life, or maybe even a current picture and have it put in a beautiful frame.", "label": 1.3333333730697632, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-MeTTeMJBNc/7.mp4", "duration_s": 10.516992, "ctc_inference_succeeded": true, "word_count": 31, "word_alignment_valid_count": 31, "audio_raw_length": 1037, "audio_valid_length": 1037, "audio_feature_dim": 25, "vision_raw_length": 53, "vision_valid_length": 53, "vision_feature_dim": 192, "face_blendshape_valid_length": 53, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 314, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.184, "feature_file": "outputs/q1_features/features/-MeTTeMJBNc__7.npz", "feature_file_bytes": 134532, "feature_file_sha256": "e8b7083df69bdf89ff2c931f6facab62f6d5a306b7f0b03ff09f8a1bc94e4100"}
|
||
{"sample_id": "-RfYyzHpjk4/11", "video_id": "-RfYyzHpjk4", "clip_id": "11", "text": "So get your friends lined up, get your business colleagues lined up and have a good time.", "label": 2.0, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-RfYyzHpjk4/11.mp4", "duration_s": 5.238997, "ctc_inference_succeeded": true, "word_count": 17, "word_alignment_valid_count": 17, "audio_raw_length": 503, "audio_valid_length": 503, "audio_feature_dim": 25, "vision_raw_length": 26, "vision_valid_length": 26, "vision_feature_dim": 192, "face_blendshape_valid_length": 26, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 154, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.02, "feature_file": "outputs/q1_features/features/-RfYyzHpjk4__11.npz", "feature_file_bytes": 73768, "feature_file_sha256": "fca832f3b8e7ed259b6954939132ff2b2bdcb94259a25600f27a5b842fc1657d"}
|
||
{"sample_id": "-RfYyzHpjk4/8", "video_id": "-RfYyzHpjk4", "clip_id": "8", "text": "It's pretty, pretty easy to do but you got to set up those numbers ahead of time.", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-RfYyzHpjk4/8.mp4", "duration_s": 4.588997, "ctc_inference_succeeded": true, "word_count": 17, "word_alignment_valid_count": 17, "audio_raw_length": 449, "audio_valid_length": 449, "audio_feature_dim": 25, "vision_raw_length": 23, "vision_valid_length": 23, "vision_feature_dim": 192, "face_blendshape_valid_length": 23, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 137, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.994, "feature_file": "outputs/q1_features/features/-RfYyzHpjk4__8.npz", "feature_file_bytes": 69862, "feature_file_sha256": "ec1d60f3e703564535e1da5f3ecb56f4ad96de90ef791e36a1c1555eb80fdcb8"}
|
||
{"sample_id": "-RfYyzHpjk4/2", "video_id": "-RfYyzHpjk4", "clip_id": "2", "text": "You can make a conference call but it takes quite a bit of planning, well not a lot of planning it's pretty easy to do.", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-RfYyzHpjk4/2.mp4", "duration_s": 5.516016, "ctc_inference_succeeded": true, "word_count": 25, "word_alignment_valid_count": 25, "audio_raw_length": 535, "audio_valid_length": 535, "audio_feature_dim": 25, "vision_raw_length": 28, "vision_valid_length": 28, "vision_feature_dim": 192, "face_blendshape_valid_length": 27, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 164, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.959, "feature_file": "outputs/q1_features/features/-RfYyzHpjk4__2.npz", "feature_file_bytes": 84993, "feature_file_sha256": "6b7191f85e0c3f7aabded124641d79a67eaf2ed1a784b2a4d13803900877654f"}
|
||
{"sample_id": "-UUCSKoHeMA/0", "video_id": "-UUCSKoHeMA", "clip_id": "0", "text": "I mentioned a word in the last clip called 'monotone', and I want to talk about that briefly.", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-UUCSKoHeMA/0.mp4", "duration_s": 7.8, "ctc_inference_succeeded": true, "word_count": 18, "word_alignment_valid_count": 18, "audio_raw_length": 769, "audio_valid_length": 769, "audio_feature_dim": 25, "vision_raw_length": 39, "vision_valid_length": 39, "vision_feature_dim": 192, "face_blendshape_valid_length": 38, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 234, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.975, "feature_file": "outputs/q1_features/features/-UUCSKoHeMA__0.npz", "feature_file_bytes": 86051, "feature_file_sha256": "6911fe030eef9b18344a66f661f78d8a4af466bab0c0182e44b0d7c86a1ddabc"}
|
||
{"sample_id": "-ri04Z7vwnc/0", "video_id": "-ri04Z7vwnc", "clip_id": "0", "text": "going to get married or are already married", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-ri04Z7vwnc/0.mp4", "duration_s": 2.807, "ctc_inference_succeeded": true, "word_count": 8, "word_alignment_valid_count": 8, "audio_raw_length": 272, "audio_valid_length": 272, "audio_feature_dim": 25, "vision_raw_length": 14, "vision_valid_length": 14, "vision_feature_dim": 192, "face_blendshape_valid_length": 0, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 67, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["no_face_blendshapes_detected"], "processing_seconds": 0.745, "feature_file": "outputs/q1_features/features/-ri04Z7vwnc__0.npz", "feature_file_bytes": 39930, "feature_file_sha256": "5a29a9981d8fdee10e0de96b5389c9b8a4b81ee4536bac52f1410779498336b1"}
|
||
{"sample_id": "-ri04Z7vwnc/2", "video_id": "-ri04Z7vwnc", "clip_id": "2", "text": "most people think it'll sort itself out, \"we'll discuss it later,\" it's not something too important", "label": -0.3333333432674408, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-ri04Z7vwnc/2.mp4", "duration_s": 6.027, "ctc_inference_succeeded": true, "word_count": 16, "word_alignment_valid_count": 16, "audio_raw_length": 587, "audio_valid_length": 587, "audio_feature_dim": 25, "vision_raw_length": 29, "vision_valid_length": 29, "vision_feature_dim": 192, "face_blendshape_valid_length": 10, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 143, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.895, "feature_file": "outputs/q1_features/features/-ri04Z7vwnc__2.npz", "feature_file_bytes": 73850, "feature_file_sha256": "0994751df868803b7b6afbeed4dec9e66560e1ec140737613b4d9c92b2e34651"}
|
||
{"sample_id": "-ri04Z7vwnc/5", "video_id": "-ri04Z7vwnc", "clip_id": "5", "text": "\" So I think it's important to discuss finances", "label": 0.3333333432674408, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-ri04Z7vwnc/5.mp4", "duration_s": 3.545, "ctc_inference_succeeded": true, "word_count": 9, "word_alignment_valid_count": 8, "audio_raw_length": 339, "audio_valid_length": 339, "audio_feature_dim": 25, "vision_raw_length": 17, "vision_valid_length": 17, "vision_feature_dim": 192, "face_blendshape_valid_length": 17, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 83, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["ctc_words_fallback:1"], "processing_seconds": 0.854, "feature_file": "outputs/q1_features/features/-ri04Z7vwnc__5.npz", "feature_file_bytes": 47804, "feature_file_sha256": "219e356124bc7ae293351c0410bf4415ce920daa7e773281273649044e2a83b5"}
|
||
{"sample_id": "-s9qJ7ATP7w/1", "video_id": "-s9qJ7ATP7w", "clip_id": "1", "text": "But the hardest thing in life to learn, is to lose", "label": 0.6666666865348816, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-s9qJ7ATP7w/1.mp4", "duration_s": 4.791992, "ctc_inference_succeeded": true, "word_count": 11, "word_alignment_valid_count": 11, "audio_raw_length": 460, "audio_valid_length": 460, "audio_feature_dim": 25, "vision_raw_length": 24, "vision_valid_length": 24, "vision_feature_dim": 192, "face_blendshape_valid_length": 24, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 140, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.942, "feature_file": "outputs/q1_features/features/-s9qJ7ATP7w__1.npz", "feature_file_bytes": 58350, "feature_file_sha256": "cc94c7c592ee6d42ad799825eedbcdfcc0341834c4d79ffb246dfbaafe9c87fd"}
|
||
{"sample_id": "-s9qJ7ATP7w/0", "video_id": "-s9qJ7ATP7w", "clip_id": "0", "text": "they have doubt, they have fear, they lose in a Ferrari race, or they lose in a race, and then they just give up", "label": -0.3333333432674408, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-s9qJ7ATP7w/0.mp4", "duration_s": 6.8, "ctc_inference_succeeded": true, "word_count": 24, "word_alignment_valid_count": 24, "audio_raw_length": 667, "audio_valid_length": 667, "audio_feature_dim": 25, "vision_raw_length": 34, "vision_valid_length": 34, "vision_feature_dim": 192, "face_blendshape_valid_length": 31, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 204, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 2.142, "feature_file": "outputs/q1_features/features/-s9qJ7ATP7w__0.npz", "feature_file_bytes": 96329, "feature_file_sha256": "b0fb54a85e566807cb47c6bdecfe451186e44c63710261c8bb04c9f01b7733d0"}
|
||
{"sample_id": "-s9qJ7ATP7w/5", "video_id": "-s9qJ7ATP7w", "clip_id": "5", "text": "I have been beat up and put down and everything that can go wrong, has gone wrong for me", "label": -2.0, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-s9qJ7ATP7w/5.mp4", "duration_s": 8.561003, "ctc_inference_succeeded": true, "word_count": 19, "word_alignment_valid_count": 19, "audio_raw_length": 835, "audio_valid_length": 835, "audio_feature_dim": 25, "vision_raw_length": 43, "vision_valid_length": 43, "vision_feature_dim": 192, "face_blendshape_valid_length": 43, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 253, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.277, "feature_file": "outputs/q1_features/features/-s9qJ7ATP7w__5.npz", "feature_file_bytes": 99292, "feature_file_sha256": "6ecf85da4fcacecc15338678cf8cc5c6a5f3af0128a88b8d9298286b0a4afb26"}
|
||
{"sample_id": "-s9qJ7ATP7w/4", "video_id": "-s9qJ7ATP7w", "clip_id": "4", "text": "I have lost at everything you can imagine, seriously", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-s9qJ7ATP7w/4.mp4", "duration_s": 4.427018, "ctc_inference_succeeded": true, "word_count": 9, "word_alignment_valid_count": 9, "audio_raw_length": 420, "audio_valid_length": 420, "audio_feature_dim": 25, "vision_raw_length": 22, "vision_valid_length": 22, "vision_feature_dim": 192, "face_blendshape_valid_length": 15, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 129, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.911, "feature_file": "outputs/q1_features/features/-s9qJ7ATP7w__4.npz", "feature_file_bytes": 51817, "feature_file_sha256": "002ce0a58ed37703e00cf3458ab59cc049db47bd7c979615cad3682cdbaf0838"}
|
||
{"sample_id": "-s9qJ7ATP7w/7", "video_id": "-s9qJ7ATP7w", "clip_id": "7", "text": "I used to work for Warren Avis, the guy who started Avis Rent a Car, and he said to me one day, \"Robert, \"what's the purpose of business", "label": 1.0, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-s9qJ7ATP7w/7.mp4", "duration_s": 6.966016, "ctc_inference_succeeded": true, "word_count": 28, "word_alignment_valid_count": 28, "audio_raw_length": 679, "audio_valid_length": 679, "audio_feature_dim": 25, "vision_raw_length": 35, "vision_valid_length": 35, "vision_feature_dim": 192, "face_blendshape_valid_length": 20, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 207, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.075, "feature_file": "outputs/q1_features/features/-s9qJ7ATP7w__7.npz", "feature_file_bytes": 101098, "feature_file_sha256": "85a1bcab56ec084155d7d8bc35f288bf9480ce26e75caaf14e35fc2f1e8b48ba"}
|
||
{"sample_id": "-s9qJ7ATP7w/6", "video_id": "-s9qJ7ATP7w", "clip_id": "6", "text": "But I just kept going", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-s9qJ7ATP7w/6.mp4", "duration_s": 2.475, "ctc_inference_succeeded": true, "word_count": 5, "word_alignment_valid_count": 5, "audio_raw_length": 227, "audio_valid_length": 227, "audio_feature_dim": 25, "vision_raw_length": 12, "vision_valid_length": 12, "vision_feature_dim": 192, "face_blendshape_valid_length": 10, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 71, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 0.804, "feature_file": "outputs/q1_features/features/-s9qJ7ATP7w__6.npz", "feature_file_bytes": 30573, "feature_file_sha256": "68001547dea974adef9554ce2a88d10e746552ec61a8f69c26250d18300fa1b6"}
|
||
{"sample_id": "-s9qJ7ATP7w/8", "video_id": "-s9qJ7ATP7w", "clip_id": "8", "text": "\" And I said, \"Oh, make a profit, and all these other things", "label": 1.3333333730697632, "annotation": "Positive", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-s9qJ7ATP7w/8.mp4", "duration_s": 3.294987, "ctc_inference_succeeded": true, "word_count": 13, "word_alignment_valid_count": 12, "audio_raw_length": 314, "audio_valid_length": 314, "audio_feature_dim": 25, "vision_raw_length": 17, "vision_valid_length": 17, "vision_feature_dim": 192, "face_blendshape_valid_length": 15, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 97, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": ["ctc_words_fallback:1"], "processing_seconds": 0.863, "feature_file": "outputs/q1_features/features/-s9qJ7ATP7w__8.npz", "feature_file_bytes": 52875, "feature_file_sha256": "0e7a2e709dd34a73485db259ac88f7a8fef9cd065910530d361579766cc95b6f"}
|
||
{"sample_id": "-yRb-Jum7EQ/1", "video_id": "-yRb-Jum7EQ", "clip_id": "1", "text": "it comes with the assistance and agitation of states and regimes, Yesterday Iran announced that it will finance the families of the terrorists and murderers this shows that Iran, even after the nuclear agreement, is continuing to aid terrorism, including Palestinian terrorism, Hezbollah terrorism and its assistance to Hamas.", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-yRb-Jum7EQ/1.mp4", "duration_s": 29.288021, "ctc_inference_succeeded": true, "word_count": 49, "word_alignment_valid_count": 49, "audio_raw_length": 2906, "audio_valid_length": 2906, "audio_feature_dim": 25, "vision_raw_length": 146, "vision_valid_length": 146, "vision_feature_dim": 192, "face_blendshape_valid_length": 136, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 875, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 2.523, "feature_file": "outputs/q1_features/features/-yRb-Jum7EQ__1.npz", "feature_file_bytes": 263653, "feature_file_sha256": "a4ad7e2f132c3aa0b5e13048eab783e39398a20158fc1246f925bbb99acc0864"}
|
||
{"sample_id": "-yRb-Jum7EQ/5", "video_id": "-yRb-Jum7EQ", "clip_id": "5", "text": "Yesterday Eliav Gelman lost his life in another terrorist attack, not by the students of terrorism, but by those who teach terrorism, a Palestinian teacher.", "label": -0.6666666865348816, "annotation": "Negative", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-yRb-Jum7EQ/5.mp4", "duration_s": 13.16901, "ctc_inference_succeeded": true, "word_count": 25, "word_alignment_valid_count": 25, "audio_raw_length": 1300, "audio_valid_length": 1300, "audio_feature_dim": 25, "vision_raw_length": 66, "vision_valid_length": 66, "vision_feature_dim": 192, "face_blendshape_valid_length": 66, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 394, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.409, "feature_file": "outputs/q1_features/features/-yRb-Jum7EQ__5.npz", "feature_file_bytes": 139890, "feature_file_sha256": "7f4a3740c7713dd89634f895dce748759b2d17fc1ea10387310234a966a92176"}
|
||
{"sample_id": "-yRb-Jum7EQ/6", "video_id": "-yRb-Jum7EQ", "clip_id": "6", "text": "Therefore, the world needs to stand with Israel against this incitement, which is the number one cause of terrorism.", "label": 0.0, "annotation": "Neutral", "video_path": "/home/gloamxun/modeling_zhaocui/E题数据/附件1-数据集原始多模态样本/MOSEI数据集部分原始视频-100条/-yRb-Jum7EQ/6.mp4", "duration_s": 11.241995, "ctc_inference_succeeded": true, "word_count": 19, "word_alignment_valid_count": 19, "audio_raw_length": 1120, "audio_valid_length": 1120, "audio_feature_dim": 25, "vision_raw_length": 56, "vision_valid_length": 56, "vision_feature_dim": 192, "face_blendshape_valid_length": 56, "face_blendshape_feature_dim": 52, "vision_decoded_source_frames": 336, "text_feature_dim": 768, "alignment_granularity": "transcript word; Audio/Vision pooled over forced CTC word interval", "errors": {}, "warnings": [], "processing_seconds": 1.437, "feature_file": "outputs/q1_features/features/-yRb-Jum7EQ__6.npz", "feature_file_bytes": 112532, "feature_file_sha256": "5e45984ca8eb914de964d3febc9f4d2499600ba8679af2038fa92f3cf1df7a29"}
|