[错误报告]下载番剧完成后，出现parse失败，直接删除torrent和文件

chunner commented 2 weeks ago

确认

[X] 我已经查阅了已知问题，并确认我的问题不在其中。
[X] 我的版本是最新版本，我的版本号与 version 相同。
[X] 我已经 issue 中搜索过，确认我的问题没有被提出过。
[x] 我已经修改标题，将标题中的描述替换为我遇到的问题。

当前程序版本

3.1.14

问题类型

程序运行问题

问题描述

订阅了mikan中的番剧后，等下载完成后，报parse失败，直接删除torrent和视频文件。之前订阅其他番剧时都是正常的。

发生问题时系统日志

[2024-07-05 23:09:52] DEBUG:    Using selector: EpollSelector
[2024-07-05 23:09:52] INFO:     Started server process [7]
[2024-07-05 23:09:52] INFO:     Waiting for application startup.
[2024-07-05 23:09:52] INFO:     
[2024-07-05 23:09:52] INFO:                     _        ____                                    _
[2024-07-05 23:09:52] INFO:          /\        | |      |  _ \                                  (_)
[2024-07-05 23:09:52] INFO:         /  \  _   _| |_ ___ | |_) | __ _ _ __   __ _ _   _ _ __ ___  _
[2024-07-05 23:09:52] INFO:        / /\ \| | | | __/ _ \|  _ < / _` | '_ \ / _` | | | | '_ ` _ \| |
[2024-07-05 23:09:52] INFO:       / ____ \ |_| | || (_) | |_) | (_| | | | | (_| | |_| | | | | | | |
[2024-07-05 23:09:52] INFO:      /_/    \_\__,_|\__\___/|____/ \__,_|_| |_|\__, |\__,_|_| |_| |_|_|
[2024-07-05 23:09:52] INFO:                                                 __/ |
[2024-07-05 23:09:52] INFO:                                                |___/
[2024-07-05 23:09:52] INFO:     Version 3.1.14  Author: EstrellaXD Twitter: https://twitter.com/Estrella_Pan
[2024-07-05 23:09:52] INFO:     GitHub: https://github.com/EstrellaXD/Auto_Bangumi/
[2024-07-05 23:09:52] INFO:     Starting AutoBangumi...
[2024-07-05 23:09:52] INFO:     Config loaded
[2024-07-05 23:09:52] DEBUG:    Starting new HTTP connection (1): 
[2024-07-05 23:09:52] DEBUG:    "GET / HTTP/1.1" 200 649
[2024-07-05 23:09:52] DEBUG:    Re-initializing context...
[2024-07-05 23:09:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:09:52] INFO:     Program running.
[2024-07-05 23:09:52] INFO:     Application startup complete.
[2024-07-05 23:09:52] INFO:     Uvicorn running on http://0.0.0.0:7892 (Press CTRL+C to quit)
[2024-07-05 23:09:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:09:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:09:52] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:09:52] DEBUG:    [Engine] Get 3 RSS items
[2024-07-05 23:09:52] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:09:52] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3240&subgroupid=370. Status: 200
[2024-07-05 23:09:52] DEBUG:    Insert 0 torrents in database.
[2024-07-05 23:09:53] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3407&subgroupid=583. Status: 200
[2024-07-05 23:09:53] DEBUG:    Insert 0 torrents in database.
[2024-07-05 23:09:54] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=611. Status: 200
[2024-07-05 23:09:54] DEBUG:    Insert 0 torrents in database.
[2024-07-05 23:10:24] DEBUG:    Calling on_field_start with no data
[2024-07-05 23:10:24] DEBUG:    Calling on_field_name with data[0:8]
[2024-07-05 23:10:24] DEBUG:    Calling on_field_data with data[9:14]
[2024-07-05 23:10:24] DEBUG:    Calling on_field_end with no data
[2024-07-05 23:10:24] DEBUG:    Calling on_field_start with no data
[2024-07-05 23:10:24] DEBUG:    Calling on_field_name with data[15:23]
[2024-07-05 23:10:24] DEBUG:    Calling on_field_data with data[24:34]
[2024-07-05 23:10:24] DEBUG:    Calling on_field_end with no data
[2024-07-05 23:10:24] DEBUG:    Calling on_end with no data
[2024-07-05 23:10:24] DEBUG:    detected 'bcrypt' backend, version '4.0.1'
[2024-07-05 23:10:24] DEBUG:    'bcrypt' backend lacks $2$ support, enabling workaround
[2024-07-05 23:10:35] DEBUG:    [Database] Find bangumi id: 17.
[2024-07-05 23:10:35] DEBUG:    [Downloader] Authed.
[2024-07-05 23:10:35] DEBUG:    [Database] Delete bangumi id: 17.
[2024-07-05 23:10:35] DEBUG:    [Downloader] Authed.
[2024-07-05 23:10:35] INFO:     [Manager] Delete rule for 鹿乃子乃子乃子虎视眈眈
[2024-07-05 23:10:48] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=611. Status: 200
[2024-07-05 23:10:48] DEBUG:    RAW:[北宇治字幕组] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan [01][先行版][WebRip][HEVC_AAC][繁日内嵌] >> Shikanoko Nokonoko Koshitantan
[2024-07-05 23:10:49] DEBUG:    [Network] Successfully connected to https://mikan.org/Home/Episode/71a2d5e1ab043d6dbb490d089329f222f610181c. Status: 200
[2024-07-05 23:10:49] DEBUG:    [Network] Successfully connected to https://mikan.org/images/Bangumi/202407/2cf8a6e9.jpg. Status: 200
[2024-07-05 23:10:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:10:52] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:10:52] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:11:46] DEBUG:    Calling on_field_start with no data
[2024-07-05 23:11:46] DEBUG:    Calling on_field_name with data[0:8]
[2024-07-05 23:11:46] DEBUG:    Calling on_field_data with data[9:14]
[2024-07-05 23:11:46] DEBUG:    Calling on_field_end with no data
[2024-07-05 23:11:46] DEBUG:    Calling on_field_start with no data
[2024-07-05 23:11:46] DEBUG:    Calling on_field_name with data[15:23]
[2024-07-05 23:11:46] DEBUG:    Calling on_field_data with data[24:34]
[2024-07-05 23:11:46] DEBUG:    Calling on_field_end with no data
[2024-07-05 23:11:46] DEBUG:    Calling on_end with no data
[2024-07-05 23:11:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:11:52] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:11:52] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:12:23] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=611. Status: 200
[2024-07-05 23:12:23] DEBUG:    RAW:[北宇治字幕组] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan [01][先行版][WebRip][HEVC_AAC][繁日内嵌] >> Shikanoko Nokonoko Koshitantan
[2024-07-05 23:12:24] DEBUG:    [Network] Successfully connected to https://mikan.org/Home/Episode/71a2d5e1ab043d6dbb490d089329f222f610181c. Status: 200
[2024-07-05 23:12:24] DEBUG:    [Network] Successfully connected to https://mikan.org/images/Bangumi/202407/2cf8a6e9.jpg. Status: 200
[2024-07-05 23:12:33] DEBUG:    [Downloader] Authed.
[2024-07-05 23:12:33] DEBUG:    RSS Item https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=611 not exists, adding...
[2024-07-05 23:12:33] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=611. Status: 200
[2024-07-05 23:12:33] DEBUG:    [Downloader] Authed.
[2024-07-05 23:12:34] DEBUG:    [Network] Successfully connected to https://mikan.org/Download/20240705/71a2d5e1ab043d6dbb490d089329f222f610181c.torrent. Status: 200
[2024-07-05 23:12:34] DEBUG:    [Network] Successfully connected to https://mikan.org/Download/20240705/50435c2c43d586ddd6500521ce951d4b4cc15d8a.torrent. Status: 200
[2024-07-05 23:12:34] DEBUG:    [Downloader] Add torrent: 鹿乃子乃子乃子虎视眈眈
[2024-07-05 23:12:34] DEBUG:    Insert 2 torrents in database.
[2024-07-05 23:12:34] DEBUG:    [Database] Insert 鹿乃子乃子乃子虎视眈眈 into database.
[2024-07-05 23:12:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:12:52] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:12:52] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:13:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:13:52] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:13:52] WARNING:  [Renamer] [KitaujiSub] Shikanoko Nokonoko Koshitantan [01Pre][WebRip][HEVC_AAC][CHS_JP].mp4 parse failed
[2024-07-05 23:13:52] INFO:     [Downloader] Remove torrents.
[2024-07-05 23:13:52] WARNING:  [Renamer] [KitaujiSub] Shikanoko Nokonoko Koshitantan [01Pre][WebRip][HEVC_AAC][CHT_JP].mp4 parse failed
[2024-07-05 23:13:52] INFO:     [Downloader] Remove torrents.
[2024-07-05 23:13:52] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:14:52] DEBUG:    [Downloader] Authed.
[2024-07-05 23:14:52] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:14:52] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:15:53] DEBUG:    [Downloader] Authed.
[2024-07-05 23:15:53] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:15:53] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:16:53] DEBUG:    [Downloader] Authed.
[2024-07-05 23:16:53] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:16:53] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:17:53] DEBUG:    [Downloader] Authed.
[2024-07-05 23:17:53] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:17:53] DEBUG:    [Renamer] Rename process finished.
[2024-07-05 23:18:53] DEBUG:    [Downloader] Authed.
[2024-07-05 23:18:53] DEBUG:    [Renamer] Start rename process.
[2024-07-05 23:18:53] DEBUG:    [Renamer] Rename process finished.

chunner commented 2 weeks ago

订阅另一个字幕组，没有问题

2024-07-06 08:53:52 ab  | [2024-07-06 08:53:52] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=382. Status: 200
2024-07-06 08:53:52 ab  | [2024-07-06 08:53:52] DEBUG:    RAW:【喵萌奶茶屋】★07月新番★[鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan][01][1080p][简体][招募翻译] >> Shikanoko Nokonoko Koshitantan
2024-07-06 08:53:52 ab  | [2024-07-06 08:53:52] DEBUG:    [Network] Successfully connected to https://mikan.org/Home/Episode/a9884ff88155befab373b430ed21931954335275. Status: 200
2024-07-06 08:53:52 ab  | [2024-07-06 08:53:52] DEBUG:    [Network] Successfully connected to https://mikan.org/images/Bangumi/202407/2cf8a6e9.jpg. Status: 200
2024-07-06 08:53:54 ab  | [2024-07-06 08:53:54] DEBUG:    [Downloader] Authed.
2024-07-06 08:53:54 ab  | [2024-07-06 08:53:54] DEBUG:    RSS Item https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=382 not exists, adding...
2024-07-06 08:53:55 ab  | [2024-07-06 08:53:55] DEBUG:    [Network] Successfully connected to https://mikan.org/RSS/Bangumi?bangumiId=3367&subgroupid=382. Status: 200
2024-07-06 08:53:55 ab  | [2024-07-06 08:53:55] DEBUG:    [Downloader] Authed.
2024-07-06 08:53:55 ab  | [2024-07-06 08:53:55] DEBUG:    [Network] Successfully connected to https://mikan.org/Download/20240705/a9884ff88155befab373b430ed21931954335275.torrent. Status: 200
2024-07-06 08:53:55 ab  | [2024-07-06 08:53:55] DEBUG:    [Downloader] Add torrent: 鹿乃子乃子乃子虎视眈眈
2024-07-06 08:53:55 ab  | [2024-07-06 08:53:55] DEBUG:    Insert 1 torrents in database.
2024-07-06 08:54:45 ab  | [2024-07-06 08:54:45] DEBUG:    [Downloader] Authed.
2024-07-06 08:54:45 ab  | [2024-07-06 08:54:45] DEBUG:    [Renamer] Start rename process.
2024-07-06 08:54:45 ab  | [2024-07-06 08:54:45] INFO:     [Nekomoe kissaten][Shikanoko Nokonoko Koshitantan][01][1080p][CHS].mp4 >> 鹿乃子乃子乃子虎视眈眈 S01E01.mp4
2024-07-06 08:54:45 ab  | [2024-07-06 08:54:45] DEBUG:    [Renamer] Rename process finished.
2024-07-06 08:54:47 ab  | [2024-07-06 08:54:47] DEBUG:    Telegram notification: 200
2024-07-06 08:54:47 ab  | [2024-07-06 08:54:47] DEBUG:    Send notification: 鹿乃子乃子乃子虎视眈眈
2024-07-06 08:55:49 ab  | [2024-07-06 08:55:49] DEBUG:    [Downloader] Authed.
2024-07-06 08:55:49 ab  | [2024-07-06 08:55:49] DEBUG:    [Renamer] Start rename process.
2024-07-06 08:55:49 ab  | [2024-07-06 08:55:49] DEBUG:    [Renamer] Rename process finished.

ResidualBlood commented 2 weeks ago

一样的番剧 WARNING [2024-07-07 23:17:22] Cannot parse [喵萌奶茶屋&LoliHouse] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan - 01 [WebRip 1080p HEVC-10bit AAC][简繁内封字幕]. 只不过我是这个错误

yorktownting commented 2 weeks ago

一样的番剧 WARNING [2024-07-07 23:17:22] Cannot parse [喵萌奶茶屋&LoliHouse] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan - 01 [WebRip 1080p HEVC-10bit AAC][简繁内封字幕]. 只不过我是这个错误

同，好像只有这个torrent会出问题。

YipSzeho commented 2 weeks ago

同样问题

yorktownting commented 2 weeks ago

一样的番剧 WARNING [2024-07-07 23:17:22] Cannot parse [喵萌奶茶屋&LoliHouse] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan - 01 [WebRip 1080p HEVC-10bit AAC][简繁内封字幕]. 只不过我是这个错误

同，好像只有这个torrent会出问题。

试了下本地跑这个test用例是能过的……没明白是什么情况

def test_parse_without_openai(self):
    text = "[喵萌奶茶屋&LoliHouse] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan - 01 [WebRip 1080p HEVC-10bit AAC][简繁内封字幕]"
    result = TitleParser.raw_parser(text)

Jeremy-Hibiki commented 1 week ago

debug 看了一下，这条 RSS 解析出来是

[喵萌奶茶屋&LoliHouse] 鹿乃子乃子乃子虎视眈眈 / Shikanoko Nokonoko Koshitantan\n- 01 [WebRip 1080p HEVC-10bit AAC][简繁内封字幕]

当中不是空格，是\n。然后经过

https://github.com/EstrellaXD/Auto_Bangumi/blob/7913061f45121f26325e04e913f9afcc94232cf5/backend/src/module/parser/analyser/raw_parser.py#L134

又把\n给吞掉了

EstrellaXD / Auto_Bangumi