search

ArneBinder / dialam-2024-shared-task

see http://dialam.arg.tech/
0 stars 0 forks source link

evaluation of our preprocessing #22

Open ArneBinder opened 2 months ago

ArneBinder commented 2 months ago

We do some sophisticated preprocessing with several simplifying assumptions. We should estimate how strong this impacts our overall setup by evaluating the prepared data with respect to the original data.

approach:

  1. create prepared data from the gold train data with the prepare_data.py and add_gold_data=true, but also with re_revert_ra_relations=true and re_remove_none_relations=true
  2. evaluate that with our evaluation scripts (from #5 - btw can we merge this?)
ArneBinder commented 2 months ago

Create the prepared data

command:

python src/utils/prepare_data.py \
--input_dir=data/dataset \
--output_dir=data/dataset_prepared_all_for_evaluation \
--add_gold_data \
--re_revert_ra_relations \
--re_remove_none_relations

Notes:

log output ``` /home/arbi01/miniconda3/envs/dialam-2024-shared-task/bin/python /home/arbi01/projects/dialam-2024-shared-task/src/utils/prepare_data.py --input_dir=data/dataset --output_dir=data/dataset_prepared_all_for_evaluation --add_gold_data --re_revert_ra_relations --re_remove_none_relations Processing nodesets: 1%| | 9/1478 [00:00<00:52, 27.91it/s]ERROR:__main__:nodeset=25936: Failed to process: nodeset=25936: could not determine direction of RA-nodes ['1045111', '1045119', '1045131', '1045138', '1045145'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 1%|▏ | 19/1478 [00:00<00:51, 28.40it/s]ERROR:__main__:nodeset=25902: Failed to process: nodeset=25902: could not determine direction of RA-nodes ['1040119', '1040136', '1040144', '1040156'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 2%|▏ | 36/1478 [00:01<00:35, 40.81it/s]ERROR:__main__:nodeset=25904: Failed to process: nodeset=25904: could not determine direction of RA-nodes ['1040243', '1040282', '1040284', '1040306', '1040325', '1040327', '1040334', '1040386'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 4%|▍ | 59/1478 [00:01<00:31, 45.69it/s]WARNING:__main__:nodeset=25441: Could not find anchor node for any argument of the RA-node 1006518! WARNING:__main__:nodeset=25441: Could not find anchor node for any argument of the RA-node 1006692! WARNING:__main__:nodeset=25441: Could not find anchor node for any argument of the RA-node 1006700! WARNING:__main__:nodeset=25441: Could not find anchor node for any argument of the RA-node 1006705! WARNING:__main__:nodeset=25441: Could not find anchor node for any argument of the RA-node 1006708! WARNING:__main__:nodeset=25441: Could not find anchor node for any argument of the RA-node 1006714! WARNING:__main__:nodeset=25441: Could not find anchor node for any argument of the RA-node 1006723! WARNING:__main__:nodeset=25441: Could not find anchor node for any argument of the RA-node 1006753! WARNING:__main__:nodeset=25441: Could not find anchor node for any argument of the RA-node 1006756! WARNING:__main__:nodeset=25441: Could not find anchor node for any argument of the RA-node 1006762! WARNING:__main__:nodeset=25441: Could not find anchor node for any argument of the RA-node 1006773! WARNING:__main__:nodeset=25441: Could not find anchor node for any argument of the RA-node 1006776! ERROR:__main__:nodeset=25441: Failed to process: nodeset=25441: could not determine direction of RA-nodes ['1006518', '1006692', '1006700', '1006705', '1006708', '1006714', '1006723', '1006753', '1006756', '1006762', '1006773', '1006776'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 6%|▌ | 82/1478 [00:05<02:10, 10.67it/s]ERROR:__main__:nodeset=21477: Failed to process: direction of RA-node 720124 is ambiguous! Processing nodesets: 11%|█▏ | 167/1478 [00:07<00:26, 49.56it/s]WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009290! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009302! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009314! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009348! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009367! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009392! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009402! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009425! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009432! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009449! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009526! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009533! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009552! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009587! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009595! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009647! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009653! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009669! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009702! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009719! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009771! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009785! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009792! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009799! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009838! WARNING:__main__:nodeset=25452: Could not find anchor node for any argument of the RA-node 1009848! ERROR:__main__:nodeset=25452: Failed to process: nodeset=25452: could not determine direction of RA-nodes ['1009290', '1009302', '1009314', '1009348', '1009367', '1009392', '1009402', '1009425', '1009432', '1009449', '1009526', '1009533', '1009552', '1009587', '1009595', '1009647', '1009653', '1009669', '1009702', '1009719', '1009771', '1009785', '1009792', '1009799', '1009838', '1009848'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 12%|█▏ | 177/1478 [00:17<08:30, 2.55it/s]ERROR:__main__:nodeset=18459: Failed to process: nodeset=18459: could not determine direction of RA-nodes ['551360'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 12%|█▏ | 182/1478 [00:17<06:14, 3.46it/s]ERROR:__main__:nodeset=25938: Failed to process: nodeset=25938: could not determine direction of RA-nodes ['1045330', '1045339', '1045352'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 20%|██ | 301/1478 [00:21<00:29, 39.26it/s]ERROR:__main__:nodeset=19217: Failed to process: direction of RA-node 598485 is ambiguous! Processing nodesets: 22%|██▏ | 318/1478 [00:21<00:22, 51.92it/s]ERROR:__main__:nodeset=26068: Failed to process: nodeset=26068: could not determine direction of RA-nodes ['1058687', '1058715', '1058759', '1058762'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 24%|██▍ | 353/1478 [00:22<00:27, 40.51it/s]WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955306! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955309! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955312! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955318! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955321! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955324! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955350! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955353! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955362! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955365! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955368! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955383! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955416! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955422! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955425! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955428! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955431! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955437! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955449! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955454! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955462! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955468! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955491! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955526! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955546! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955567! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955570! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955582! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955591! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955612! WARNING:__main__:nodeset=24809: Could not find anchor node for any argument of the RA-node 955615! ERROR:__main__:nodeset=24809: Failed to process: nodeset=24809: could not determine direction of RA-nodes ['955306', '955309', '955312', '955318', '955321', '955324', '955350', '955353', '955362', '955365', '955368', '955383', '955416', '955422', '955425', '955428', '955431', '955437', '955449', '955454', '955462', '955468', '955491', '955526', '955546', '955567', '955570', '955582', '955591', '955612', '955615'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 24%|██▍ | 358/1478 [00:29<07:00, 2.66it/s]WARNING:src.utils.align_i2l_nodes:nodeset=21083: Could not align I-node (dummy-L-node was selected): 695718 Processing nodesets: 25%|██▍ | 365/1478 [00:29<04:36, 4.02it/s]WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014740! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014743! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014791! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014815! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014845! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014851! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014861! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014876! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014918! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014921! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014942! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014955! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014961! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014964! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014973! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014976! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014982! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014985! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014991! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1014994! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1015000! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1015003! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1015012! WARNING:__main__:nodeset=25463: Could not find anchor node for any argument of the RA-node 1015021! ERROR:__main__:nodeset=25463: Failed to process: nodeset=25463: could not determine direction of RA-nodes ['1014740', '1014743', '1014791', '1014815', '1014845', '1014851', '1014861', '1014876', '1014918', '1014921', '1014942', '1014955', '1014961', '1014964', '1014973', '1014976', '1014982', '1014985', '1014991', '1014994', '1015000', '1015003', '1015012', '1015021'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 25%|██▌ | 370/1478 [00:34<07:54, 2.33it/s]WARNING:__main__:nodeset=24905: Could not find anchor node for any argument of the RA-node 967172! WARNING:__main__:nodeset=24905: Could not find anchor node for any argument of the RA-node 967248! WARNING:__main__:nodeset=24905: Could not find anchor node for any argument of the RA-node 967282! WARNING:__main__:nodeset=24905: Could not find anchor node for any argument of the RA-node 967285! ERROR:__main__:nodeset=24905: Failed to process: nodeset=24905: could not determine direction of RA-nodes ['967172', '967248', '967282', '967285'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 25%|██▌ | 374/1478 [00:34<07:01, 2.62it/s]ERROR:__main__:nodeset=25516: Failed to process: nodeset=25516: could not determine direction of RA-nodes ['1020784'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 26%|██▌ | 386/1478 [00:35<03:27, 5.26it/s]ERROR:__main__:nodeset=19146: Failed to process: nodeset=19146: could not determine direction of RA-nodes ['592456'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 27%|██▋ | 405/1478 [00:35<01:10, 15.18it/s]ERROR:__main__:nodeset=21588: Failed to process: direction of RA-node 724367 is ambiguous! Processing nodesets: 28%|██▊ | 414/1478 [00:35<00:48, 21.99it/s]ERROR:__main__:nodeset=25937: Failed to process: nodeset=25937: could not determine direction of RA-nodes ['1045193', '1045199', '1045211', '1045218', '1045225'] because there is no TA relation between any combination of anchoring I-nodes! ERROR:__main__:nodeset=23766: Failed to process: direction of RA-node 864140 is ambiguous! Processing nodesets: 30%|███ | 447/1478 [00:36<00:36, 28.23it/s]ERROR:__main__:nodeset=21681: Failed to process: nodeset=21681: S-node arguments are not unique! missing relations: [{'sources': ['730239'], 'targets': ['730196'], 'relation': '730399'}] Processing nodesets: 31%|███ | 451/1478 [00:36<00:33, 30.32it/s]ERROR:__main__:nodeset=20844: Failed to process: direction of RA-node 682026 is ambiguous! Processing nodesets: 31%|███ | 458/1478 [00:36<00:26, 38.43it/s]ERROR:__main__:nodeset=21449: Failed to process: nodeset=21449: could not determine direction of RA-nodes ['717746'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 32%|███▏ | 468/1478 [00:37<00:27, 37.37it/s]WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981526! WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981580! WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981602! WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981605! WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981608! WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981611! WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981626! WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981642! WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981645! WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981648! WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981673! WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981676! WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981679! WARNING:__main__:nodeset=25045: Could not find anchor node for any argument of the RA-node 981682! ERROR:__main__:nodeset=25045: Failed to process: nodeset=25045: could not determine direction of RA-nodes ['981526', '981580', '981602', '981605', '981608', '981611', '981626', '981642', '981645', '981648', '981673', '981676', '981679', '981682'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 34%|███▎ | 496/1478 [00:40<00:59, 16.43it/s]WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006856! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006862! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006880! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006886! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006892! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006907! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006918! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006933! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006936! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006968! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006974! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006980! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006983! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006986! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1006992! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1007014! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1007017! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1007020! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1007043! WARNING:__main__:nodeset=25442: Could not find anchor node for any argument of the RA-node 1007093! ERROR:__main__:nodeset=25442: Failed to process: nodeset=25442: could not determine direction of RA-nodes ['1006856', '1006862', '1006880', '1006886', '1006892', '1006907', '1006918', '1006933', '1006936', '1006968', '1006974', '1006980', '1006983', '1006986', '1006992', '1007014', '1007017', '1007020', '1007043', '1007093'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 36%|███▋ | 539/1478 [00:44<00:43, 21.65it/s]WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014162! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014165! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014172! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014178! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014185! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014197! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014242! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014245! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014260! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014266! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014269! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014276! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014294! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014321! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014337! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014350! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014353! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014379! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014404! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014413! WARNING:__main__:nodeset=25461: Could not find anchor node for any argument of the RA-node 1014419! ERROR:__main__:nodeset=25461: Failed to process: nodeset=25461: could not determine direction of RA-nodes ['1014162', '1014165', '1014172', '1014178', '1014185', '1014197', '1014242', '1014245', '1014260', '1014266', '1014269', '1014276', '1014294', '1014321', '1014337', '1014350', '1014353', '1014379', '1014404', '1014413', '1014419'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 38%|███▊ | 567/1478 [00:47<00:46, 19.67it/s]WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017099! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017104! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017109! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017115! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017118! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017145! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017148! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017154! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017191! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017209! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017222! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017225! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017228! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017231! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017237! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017243! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017246! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017255! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017258! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017271! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017280! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017286! WARNING:__main__:nodeset=25473: Could not find anchor node for any argument of the RA-node 1017305! ERROR:__main__:nodeset=25473: Failed to process: nodeset=25473: could not determine direction of RA-nodes ['1017099', '1017104', '1017109', '1017115', '1017118', '1017145', '1017148', '1017154', '1017191', '1017209', '1017222', '1017225', '1017228', '1017231', '1017237', '1017243', '1017246', '1017255', '1017258', '1017271', '1017280', '1017286', '1017305'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 41%|████ | 602/1478 [00:54<00:56, 15.57it/s]ERROR:__main__:nodeset=19908: Failed to process: nodeset=19908: could not determine direction of RA-nodes ['642083'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 42%|████▏ | 623/1478 [00:55<00:36, 23.30it/s]WARNING:__main__:nodeset=24903: Could not find anchor node for any argument of the RA-node 966581! WARNING:__main__:nodeset=24903: Could not find anchor node for any argument of the RA-node 966654! WARNING:__main__:nodeset=24903: Could not find anchor node for any argument of the RA-node 966695! WARNING:__main__:nodeset=24903: Could not find anchor node for any argument of the RA-node 966698! WARNING:__main__:nodeset=24903: Could not find anchor node for any argument of the RA-node 966760! WARNING:__main__:nodeset=24903: Could not find anchor node for any argument of the RA-node 966798! WARNING:__main__:nodeset=24903: Could not find anchor node for any argument of the RA-node 966801! WARNING:__main__:nodeset=24903: Could not find anchor node for any argument of the RA-node 966804! WARNING:__main__:nodeset=24903: Could not find anchor node for any argument of the RA-node 966807! WARNING:__main__:nodeset=24903: Could not find anchor node for any argument of the RA-node 966816! ERROR:__main__:nodeset=24903: Failed to process: nodeset=24903: could not determine direction of RA-nodes ['966581', '966654', '966695', '966698', '966760', '966798', '966801', '966804', '966807', '966816'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 42%|████▏ | 627/1478 [00:59<04:28, 3.17it/s]WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007185! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007197! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007231! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007234! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007242! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007245! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007254! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007267! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007273! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007282! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007295! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007332! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007338! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007369! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007375! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007381! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007401! WARNING:__main__:nodeset=25443: Could not find anchor node for any argument of the RA-node 1007404! ERROR:__main__:nodeset=25443: Failed to process: nodeset=25443: could not determine direction of RA-nodes ['1007185', '1007197', '1007231', '1007234', '1007242', '1007245', '1007254', '1007267', '1007273', '1007282', '1007295', '1007332', '1007338', '1007369', '1007375', '1007381', '1007401', '1007404'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 44%|████▍ | 655/1478 [01:02<01:13, 11.18it/s]WARNING:src.utils.align_i2l_nodes:nodeset=18888: Could not align I-node (dummy-L-node was selected): 572747 ERROR:__main__:nodeset=18888: Failed to process: nodeset=18888: S-node arguments are not unique! missing relations: [{'sources': ['572739'], 'targets': ['572712'], 'relation': '572841'}] Processing nodesets: 46%|████▌ | 675/1478 [01:02<00:35, 22.48it/s]ERROR:__main__:nodeset=21342: Failed to process: nodeset=21342: S-node arguments are not unique! missing relations: [{'sources': ['709522'], 'targets': ['709508'], 'relation': '709559'}] ERROR:__main__:nodeset=19149: Failed to process: nodeset=19149: could not determine direction of RA-nodes ['592728', '592776', '592806'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 52%|█████▏ | 771/1478 [01:05<00:23, 30.59it/s]ERROR:__main__:nodeset=23710: Failed to process: nodeset=23710: S-node arguments are not unique! missing relations: [{'sources': ['811355'], 'targets': ['811397'], 'relation': '861291'}] Processing nodesets: 53%|█████▎ | 785/1478 [01:05<00:20, 33.76it/s]ERROR:__main__:nodeset=23891: Failed to process: direction of RA-node 870484 is ambiguous! Processing nodesets: 54%|█████▍ | 801/1478 [01:06<00:16, 40.65it/s]WARNING:__main__:nodeset=25474: Could not find anchor node for any argument of the RA-node 1017547! WARNING:__main__:nodeset=25474: Could not find anchor node for any argument of the RA-node 1017588! WARNING:__main__:nodeset=25474: Could not find anchor node for any argument of the RA-node 1017600! WARNING:__main__:nodeset=25474: Could not find anchor node for any argument of the RA-node 1017610! WARNING:__main__:nodeset=25474: Could not find anchor node for any argument of the RA-node 1017631! WARNING:__main__:nodeset=25474: Could not find anchor node for any argument of the RA-node 1017634! WARNING:__main__:nodeset=25474: Could not find anchor node for any argument of the RA-node 1017654! WARNING:__main__:nodeset=25474: Could not find anchor node for any argument of the RA-node 1017678! WARNING:__main__:nodeset=25474: Could not find anchor node for any argument of the RA-node 1017690! WARNING:__main__:nodeset=25474: Could not find anchor node for any argument of the RA-node 1017693! WARNING:__main__:nodeset=25474: Could not find anchor node for any argument of the RA-node 1017696! ERROR:__main__:nodeset=25474: Failed to process: nodeset=25474: could not determine direction of RA-nodes ['1017547', '1017588', '1017600', '1017610', '1017631', '1017634', '1017654', '1017678', '1017690', '1017693', '1017696'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 55%|█████▌ | 820/1478 [01:08<00:34, 18.86it/s]ERROR:__main__:nodeset=25940: Failed to process: nodeset=25940: could not determine direction of RA-nodes ['1045512', '1045520'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 56%|█████▌ | 825/1478 [01:08<00:33, 19.30it/s]ERROR:__main__:nodeset=26067: Failed to process: nodeset=26067: could not determine direction of RA-nodes ['1058555', '1058563', '1058605', '1058624', '1058630', '1058642', '1058660', '1058662'] because there is no TA relation between any combination of anchoring I-nodes! ERROR:__main__:nodeset=25411: Failed to process: nodeset=25411: could not determine direction of RA-nodes ['1003826'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 58%|█████▊ | 853/1478 [01:08<00:16, 37.08it/s]ERROR:__main__:nodeset=26087: Failed to process: nodeset=26087: could not determine direction of RA-nodes ['1060873', '1060896', '1060906', '1060928', '1060930', '1060952'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 59%|█████▊ | 866/1478 [01:09<00:13, 44.98it/s]ERROR:__main__:nodeset=19757: Failed to process: nodeset=19757: could not determine direction of RA-nodes ['632412'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 60%|█████▉ | 880/1478 [01:09<00:13, 45.55it/s]ERROR:__main__:nodeset=25510: Failed to process: nodeset=25510: could not determine direction of RA-nodes ['1020342'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 60%|██████ | 892/1478 [01:09<00:13, 44.26it/s]ERROR:__main__:nodeset=25400: Failed to process: nodeset=25400: S-node arguments are not unique! missing relations: [{'sources': ['717266'], 'targets': ['717211'], 'relation': '1003490'}] Processing nodesets: 62%|██████▏ | 910/1478 [01:10<00:17, 32.27it/s]WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008593! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008624! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008629! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008632! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008635! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008669! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008672! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008684! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008723! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008726! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008735! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008738! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008747! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008762! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008765! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008805! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008852! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008880! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008891! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008897! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008909! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008912! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008931! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008937! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008940! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008952! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008955! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008961! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008969! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1008984! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1009011! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1009017! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1009096! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1009099! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1009119! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1009165! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1009180! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1009207! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1009210! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1009213! WARNING:__main__:nodeset=25445: Could not find anchor node for any argument of the RA-node 1009219! ERROR:__main__:nodeset=25445: Failed to process: nodeset=25445: could not determine direction of RA-nodes ['1008593', '1008624', '1008629', '1008632', '1008635', '1008669', '1008672', '1008684', '1008723', '1008726', '1008735', '1008738', '1008747', '1008762', '1008765', '1008805', '1008852', '1008880', '1008891', '1008897', '1008909', '1008912', '1008931', '1008937', '1008940', '1008952', '1008955', '1008961', '1008969', '1008984', '1009011', '1009017', '1009096', '1009099', '1009119', '1009165', '1009180', '1009207', '1009210', '1009213', '1009219'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 63%|██████▎ | 925/1478 [01:27<04:13, 2.18it/s]ERROR:__main__:nodeset=19911: Failed to process: nodeset=19911: I-node texts are not unique! Processing nodesets: 64%|██████▍ | 945/1478 [01:27<01:26, 6.15it/s]ERROR:__main__:nodeset=19761: Failed to process: nodeset=19761: could not determine direction of RA-nodes ['632792'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 64%|██████▍ | 951/1478 [01:27<01:03, 8.36it/s]ERROR:__main__:nodeset=20510: Failed to process: direction of RA-node 666105 is ambiguous! Processing nodesets: 66%|██████▋ | 980/1478 [01:28<00:20, 24.67it/s]WARNING:__main__:nodeset=24808: Could not find anchor node for any argument of the RA-node 955075! WARNING:__main__:nodeset=24808: Could not find anchor node for any argument of the RA-node 955148! WARNING:__main__:nodeset=24808: Could not find anchor node for any argument of the RA-node 955154! WARNING:__main__:nodeset=24808: Could not find anchor node for any argument of the RA-node 955170! WARNING:__main__:nodeset=24808: Could not find anchor node for any argument of the RA-node 955183! WARNING:__main__:nodeset=24808: Could not find anchor node for any argument of the RA-node 955194! WARNING:__main__:nodeset=24808: Could not find anchor node for any argument of the RA-node 955200! ERROR:__main__:nodeset=24808: Failed to process: nodeset=24808: could not determine direction of RA-nodes ['955075', '955148', '955154', '955170', '955183', '955194', '955200'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 68%|██████▊ | 1011/1478 [01:35<00:40, 11.60it/s]ERROR:__main__:nodeset=25901: Failed to process: nodeset=25901: could not determine direction of RA-nodes ['1040059', '1040106'] because there is no TA relation between any combination of anchoring I-nodes! WARNING:__main__:nodeset=25468: Could not find anchor node for any argument of the RA-node 1016153! WARNING:__main__:nodeset=25468: Could not find anchor node for any argument of the RA-node 1016156! WARNING:__main__:nodeset=25468: Could not find anchor node for any argument of the RA-node 1016162! WARNING:__main__:nodeset=25468: Could not find anchor node for any argument of the RA-node 1016170! WARNING:__main__:nodeset=25468: Could not find anchor node for any argument of the RA-node 1016173! WARNING:__main__:nodeset=25468: Could not find anchor node for any argument of the RA-node 1016280! WARNING:__main__:nodeset=25468: Could not find anchor node for any argument of the RA-node 1016295! WARNING:__main__:nodeset=25468: Could not find anchor node for any argument of the RA-node 1016301! ERROR:__main__:nodeset=25468: Failed to process: nodeset=25468: could not determine direction of RA-nodes ['1016153', '1016156', '1016162', '1016170', '1016173', '1016280', '1016295', '1016301'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 69%|██████▊ | 1016/1478 [01:39<02:24, 3.21it/s]WARNING:src.utils.align_i2l_nodes:nodeset=17938: Could not align I-node (dummy-L-node was selected): 512730 Processing nodesets: 69%|██████▉ | 1021/1478 [01:40<01:45, 4.34it/s]WARNING:__main__:nodeset=24807: Could not find anchor node for any argument of the RA-node 954850! WARNING:__main__:nodeset=24807: Could not find anchor node for any argument of the RA-node 954879! WARNING:__main__:nodeset=24807: Could not find anchor node for any argument of the RA-node 954894! WARNING:__main__:nodeset=24807: Could not find anchor node for any argument of the RA-node 954921! WARNING:__main__:nodeset=24807: Could not find anchor node for any argument of the RA-node 954945! WARNING:__main__:nodeset=24807: Could not find anchor node for any argument of the RA-node 954951! WARNING:__main__:nodeset=24807: Could not find anchor node for any argument of the RA-node 954960! WARNING:__main__:nodeset=24807: Could not find anchor node for any argument of the RA-node 954963! ERROR:__main__:nodeset=24807: Failed to process: nodeset=24807: could not determine direction of RA-nodes ['954850', '954879', '954894', '954921', '954945', '954951', '954960', '954963'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 69%|██████▉ | 1025/1478 [01:43<02:50, 2.65it/s]WARNING:src.utils.align_i2l_nodes:nodeset=23701: Could not align I-node (dummy-L-node was selected): 810466 Processing nodesets: 71%|███████ | 1047/1478 [01:43<00:42, 10.04it/s]ERROR:__main__:nodeset=20992: Failed to process: direction of RA-node 689965 is ambiguous! Processing nodesets: 72%|███████▏ | 1060/1478 [01:44<00:22, 18.23it/s]ERROR:__main__:nodeset=25906: Failed to process: nodeset=25906: could not determine direction of RA-nodes ['1040470', '1040528'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 72%|███████▏ | 1065/1478 [01:44<00:24, 16.71it/s]ERROR:__main__:nodeset=26066: Failed to process: nodeset=26066: could not determine direction of RA-nodes ['1058494', '1058509'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 72%|███████▏ | 1069/1478 [01:44<00:21, 18.86it/s]ERROR:__main__:nodeset=22969: Failed to process: nodeset=22969: S-node arguments are not unique! missing relations: [{'sources': ['641748'], 'targets': ['641718'], 'relation': '806997'}] Processing nodesets: 76%|███████▌ | 1121/1478 [01:46<00:16, 22.01it/s]ERROR:__main__:nodeset=17964: Failed to process: nodeset=17964: could not determine direction of RA-nodes ['514854'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 77%|███████▋ | 1136/1478 [01:46<00:11, 30.80it/s]ERROR:__main__:nodeset=19059: Failed to process: direction of RA-node 587841 is ambiguous! ERROR:__main__:nodeset=21401: Failed to process: direction of RA-node 714397 is ambiguous! Processing nodesets: 81%|████████ | 1190/1478 [01:48<00:06, 44.05it/s]WARNING:__main__:nodeset=25475: Could not find anchor node for any argument of the RA-node 1017353! WARNING:__main__:nodeset=25475: Could not find anchor node for any argument of the RA-node 1017366! WARNING:__main__:nodeset=25475: Could not find anchor node for any argument of the RA-node 1017415! WARNING:__main__:nodeset=25475: Could not find anchor node for any argument of the RA-node 1017418! WARNING:__main__:nodeset=25475: Could not find anchor node for any argument of the RA-node 1017439! WARNING:__main__:nodeset=25475: Could not find anchor node for any argument of the RA-node 1017442! WARNING:__main__:nodeset=25475: Could not find anchor node for any argument of the RA-node 1017445! WARNING:__main__:nodeset=25475: Could not find anchor node for any argument of the RA-node 1017451! WARNING:__main__:nodeset=25475: Could not find anchor node for any argument of the RA-node 1017463! WARNING:__main__:nodeset=25475: Could not find anchor node for any argument of the RA-node 1017490! WARNING:__main__:nodeset=25475: Could not find anchor node for any argument of the RA-node 1017499! ERROR:__main__:nodeset=25475: Failed to process: nodeset=25475: could not determine direction of RA-nodes ['1017353', '1017366', '1017415', '1017418', '1017439', '1017442', '1017445', '1017451', '1017463', '1017490', '1017499'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 82%|████████▏ | 1209/1478 [01:49<00:11, 23.41it/s]WARNING:__main__:nodeset=18484: Could not find anchor node for any argument of the RA-node 553464! ERROR:__main__:nodeset=18484: Failed to process: nodeset=18484: could not determine direction of RA-nodes ['553464'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 82%|████████▏ | 1216/1478 [01:49<00:08, 29.68it/s]ERROR:__main__:nodeset=25552: Failed to process: nodeset=25552: S-node arguments are not unique! missing relations: [{'sources': ['572305'], 'targets': ['572285'], 'relation': '1022478'}] Processing nodesets: 83%|████████▎ | 1222/1478 [01:49<00:07, 33.60it/s]ERROR:__main__:nodeset=23749: Failed to process: nodeset=23749: could not determine direction of RA-nodes ['863294'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 84%|████████▍ | 1242/1478 [01:50<00:06, 38.34it/s]WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007463! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007468! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007471! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007491! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007503! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007528! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007562! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007579! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007599! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007602! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007645! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007649! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007658! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007670! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007673! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007686! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007766! WARNING:__main__:nodeset=25444: Could not find anchor node for any argument of the RA-node 1007785! ERROR:__main__:nodeset=25444: Failed to process: nodeset=25444: could not determine direction of RA-nodes ['1007463', '1007468', '1007471', '1007491', '1007503', '1007528', '1007562', '1007579', '1007599', '1007602', '1007645', '1007649', '1007658', '1007670', '1007673', '1007686', '1007766', '1007785'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 85%|████████▍ | 1252/1478 [01:55<00:43, 5.19it/s]ERROR:__main__:nodeset=25907: Failed to process: nodeset=25907: could not determine direction of RA-nodes ['1040578'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 87%|████████▋ | 1280/1478 [01:55<00:10, 18.61it/s]WARNING:__main__:nodeset=24992: Could not find anchor node for any argument of the RA-node 977105! WARNING:__main__:nodeset=24992: Could not find anchor node for any argument of the RA-node 977108! WARNING:__main__:nodeset=24992: Could not find anchor node for any argument of the RA-node 977116! WARNING:__main__:nodeset=24992: Could not find anchor node for any argument of the RA-node 977119! WARNING:__main__:nodeset=24992: Could not find anchor node for any argument of the RA-node 977260! WARNING:__main__:nodeset=24992: Could not find anchor node for any argument of the RA-node 977264! WARNING:__main__:nodeset=24992: Could not find anchor node for any argument of the RA-node 977267! WARNING:__main__:nodeset=24992: Could not find anchor node for any argument of the RA-node 977282! WARNING:__main__:nodeset=24992: Could not find anchor node for any argument of the RA-node 977310! ERROR:__main__:nodeset=24992: Failed to process: nodeset=24992: could not determine direction of RA-nodes ['977105', '977108', '977116', '977119', '977260', '977264', '977267', '977282', '977310'] because there is no TA relation between any combination of anchoring I-nodes! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014490! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014502! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014505! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014536! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014566! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014578! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014581! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014588! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014592! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014595! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014615! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014621! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014632! WARNING:__main__:nodeset=25462: Could not find anchor node for any argument of the RA-node 1014644! ERROR:__main__:nodeset=25462: Failed to process: nodeset=25462: could not determine direction of RA-nodes ['1014490', '1014502', '1014505', '1014536', '1014566', '1014578', '1014581', '1014588', '1014592', '1014595', '1014615', '1014621', '1014632', '1014644'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 88%|████████▊ | 1300/1478 [02:00<00:23, 7.61it/s]ERROR:__main__:nodeset=19091: Failed to process: nodeset=19091: could not determine direction of RA-nodes ['590210'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 90%|█████████ | 1331/1478 [02:01<00:08, 18.00it/s]ERROR:__main__:nodeset=23114: Failed to process: direction of RA-node 820629 is ambiguous! Processing nodesets: 91%|█████████ | 1346/1478 [02:02<00:04, 27.45it/s]ERROR:__main__:nodeset=20888: Failed to process: direction of RA-node 684790 is ambiguous! ERROR:__main__:nodeset=19878: Failed to process: direction of RA-node 639622 is ambiguous! Processing nodesets: 92%|█████████▏| 1354/1478 [02:02<00:03, 33.77it/s]WARNING:src.utils.align_i2l_nodes:nodeset=19319: Could not align I-node (dummy-L-node was selected): 604830 Processing nodesets: 96%|█████████▌| 1418/1478 [02:03<00:01, 30.00it/s]ERROR:__main__:nodeset=20479: Failed to process: direction of RA-node 663443 is ambiguous! Processing nodesets: 98%|█████████▊| 1442/1478 [02:04<00:00, 42.07it/s]ERROR:__main__:nodeset=20507: Failed to process: direction of RA-node 665828 is ambiguous! Processing nodesets: 99%|█████████▊| 1456/1478 [02:04<00:00, 38.41it/s]ERROR:__main__:nodeset=20766: Failed to process: direction of RA-node 677366 is ambiguous! Processing nodesets: 100%|█████████▉| 1473/1478 [02:05<00:00, 42.70it/s]WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015072! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015084! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015087! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015096! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015105! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015120! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015129! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015135! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015141! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015150! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015153! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015165! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015177! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015184! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015193! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015202! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015205! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015208! WARNING:__main__:nodeset=25465: Could not find anchor node for any argument of the RA-node 1015211! ERROR:__main__:nodeset=25465: Failed to process: nodeset=25465: could not determine direction of RA-nodes ['1015072', '1015084', '1015087', '1015096', '1015105', '1015120', '1015129', '1015135', '1015141', '1015150', '1015153', '1015165', '1015177', '1015184', '1015193', '1015202', '1015205', '1015208', '1015211'] because there is no TA relation between any combination of anchoring I-nodes! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016810! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016818! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016836! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016855! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016858! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016901! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016913! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016921! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016933! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016936! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016945! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016948! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016960! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016969! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016972! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1016984! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1017044! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1017047! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1017059! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1017062! WARNING:__main__:nodeset=25472: Could not find anchor node for any argument of the RA-node 1017065! ERROR:__main__:nodeset=25472: Failed to process: nodeset=25472: could not determine direction of RA-nodes ['1016810', '1016818', '1016836', '1016855', '1016858', '1016901', '1016913', '1016921', '1016933', '1016936', '1016945', '1016948', '1016960', '1016969', '1016972', '1016984', '1017044', '1017047', '1017059', '1017062', '1017065'] because there is no TA relation between any combination of anchoring I-nodes! Processing nodesets: 100%|██████████| 1478/1478 [02:10<00:00, 11.33it/s] INFO:src.utils.nodeset_utils:Successfully processed 1405 nodesets (0 blacklisted). Failed to process the following nodesets (73): [('25936', ValueError("nodeset=25936: could not determine direction of RA-nodes ['1045111', '1045119', '1045131', '1045138', '1045145'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25902', ValueError("nodeset=25902: could not determine direction of RA-nodes ['1040119', '1040136', '1040144', '1040156'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25904', ValueError("nodeset=25904: could not determine direction of RA-nodes ['1040243', '1040282', '1040284', '1040306', '1040325', '1040327', '1040334', '1040386'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25441', ValueError("nodeset=25441: could not determine direction of RA-nodes ['1006518', '1006692', '1006700', '1006705', '1006708', '1006714', '1006723', '1006753', '1006756', '1006762', '1006773', '1006776'] because there is no TA relation between any combination of anchoring I-nodes!")), ('21477', ValueError('direction of RA-node 720124 is ambiguous!')), ('25452', ValueError("nodeset=25452: could not determine direction of RA-nodes ['1009290', '1009302', '1009314', '1009348', '1009367', '1009392', '1009402', '1009425', '1009432', '1009449', '1009526', '1009533', '1009552', '1009587', '1009595', '1009647', '1009653', '1009669', '1009702', '1009719', '1009771', '1009785', '1009792', '1009799', '1009838', '1009848'] because there is no TA relation between any combination of anchoring I-nodes!")), ('18459', ValueError("nodeset=18459: could not determine direction of RA-nodes ['551360'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25938', ValueError("nodeset=25938: could not determine direction of RA-nodes ['1045330', '1045339', '1045352'] because there is no TA relation between any combination of anchoring I-nodes!")), ('19217', ValueError('direction of RA-node 598485 is ambiguous!')), ('26068', ValueError("nodeset=26068: could not determine direction of RA-nodes ['1058687', '1058715', '1058759', '1058762'] because there is no TA relation between any combination of anchoring I-nodes!")), ('24809', ValueError("nodeset=24809: could not determine direction of RA-nodes ['955306', '955309', '955312', '955318', '955321', '955324', '955350', '955353', '955362', '955365', '955368', '955383', '955416', '955422', '955425', '955428', '955431', '955437', '955449', '955454', '955462', '955468', '955491', '955526', '955546', '955567', '955570', '955582', '955591', '955612', '955615'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25463', ValueError("nodeset=25463: could not determine direction of RA-nodes ['1014740', '1014743', '1014791', '1014815', '1014845', '1014851', '1014861', '1014876', '1014918', '1014921', '1014942', '1014955', '1014961', '1014964', '1014973', '1014976', '1014982', '1014985', '1014991', '1014994', '1015000', '1015003', '1015012', '1015021'] because there is no TA relation between any combination of anchoring I-nodes!")), ('24905', ValueError("nodeset=24905: could not determine direction of RA-nodes ['967172', '967248', '967282', '967285'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25516', ValueError("nodeset=25516: could not determine direction of RA-nodes ['1020784'] because there is no TA relation between any combination of anchoring I-nodes!")), ('19146', ValueError("nodeset=19146: could not determine direction of RA-nodes ['592456'] because there is no TA relation between any combination of anchoring I-nodes!")), ('21588', ValueError('direction of RA-node 724367 is ambiguous!')), ('25937', ValueError("nodeset=25937: could not determine direction of RA-nodes ['1045193', '1045199', '1045211', '1045218', '1045225'] because there is no TA relation between any combination of anchoring I-nodes!")), ('23766', ValueError('direction of RA-node 864140 is ambiguous!')), ('21681', ValueError("nodeset=21681: S-node arguments are not unique! missing relations: [{'sources': ['730239'], 'targets': ['730196'], 'relation': '730399'}]")), ('20844', ValueError('direction of RA-node 682026 is ambiguous!')), ('21449', ValueError("nodeset=21449: could not determine direction of RA-nodes ['717746'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25045', ValueError("nodeset=25045: could not determine direction of RA-nodes ['981526', '981580', '981602', '981605', '981608', '981611', '981626', '981642', '981645', '981648', '981673', '981676', '981679', '981682'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25442', ValueError("nodeset=25442: could not determine direction of RA-nodes ['1006856', '1006862', '1006880', '1006886', '1006892', '1006907', '1006918', '1006933', '1006936', '1006968', '1006974', '1006980', '1006983', '1006986', '1006992', '1007014', '1007017', '1007020', '1007043', '1007093'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25461', ValueError("nodeset=25461: could not determine direction of RA-nodes ['1014162', '1014165', '1014172', '1014178', '1014185', '1014197', '1014242', '1014245', '1014260', '1014266', '1014269', '1014276', '1014294', '1014321', '1014337', '1014350', '1014353', '1014379', '1014404', '1014413', '1014419'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25473', ValueError("nodeset=25473: could not determine direction of RA-nodes ['1017099', '1017104', '1017109', '1017115', '1017118', '1017145', '1017148', '1017154', '1017191', '1017209', '1017222', '1017225', '1017228', '1017231', '1017237', '1017243', '1017246', '1017255', '1017258', '1017271', '1017280', '1017286', '1017305'] because there is no TA relation between any combination of anchoring I-nodes!")), ('19908', ValueError("nodeset=19908: could not determine direction of RA-nodes ['642083'] because there is no TA relation between any combination of anchoring I-nodes!")), ('24903', ValueError("nodeset=24903: could not determine direction of RA-nodes ['966581', '966654', '966695', '966698', '966760', '966798', '966801', '966804', '966807', '966816'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25443', ValueError("nodeset=25443: could not determine direction of RA-nodes ['1007185', '1007197', '1007231', '1007234', '1007242', '1007245', '1007254', '1007267', '1007273', '1007282', '1007295', '1007332', '1007338', '1007369', '1007375', '1007381', '1007401', '1007404'] because there is no TA relation between any combination of anchoring I-nodes!")), ('18888', ValueError("nodeset=18888: S-node arguments are not unique! missing relations: [{'sources': ['572739'], 'targets': ['572712'], 'relation': '572841'}]")), ('21342', ValueError("nodeset=21342: S-node arguments are not unique! missing relations: [{'sources': ['709522'], 'targets': ['709508'], 'relation': '709559'}]")), ('19149', ValueError("nodeset=19149: could not determine direction of RA-nodes ['592728', '592776', '592806'] because there is no TA relation between any combination of anchoring I-nodes!")), ('23710', ValueError("nodeset=23710: S-node arguments are not unique! missing relations: [{'sources': ['811355'], 'targets': ['811397'], 'relation': '861291'}]")), ('23891', ValueError('direction of RA-node 870484 is ambiguous!')), ('25474', ValueError("nodeset=25474: could not determine direction of RA-nodes ['1017547', '1017588', '1017600', '1017610', '1017631', '1017634', '1017654', '1017678', '1017690', '1017693', '1017696'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25940', ValueError("nodeset=25940: could not determine direction of RA-nodes ['1045512', '1045520'] because there is no TA relation between any combination of anchoring I-nodes!")), ('26067', ValueError("nodeset=26067: could not determine direction of RA-nodes ['1058555', '1058563', '1058605', '1058624', '1058630', '1058642', '1058660', '1058662'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25411', ValueError("nodeset=25411: could not determine direction of RA-nodes ['1003826'] because there is no TA relation between any combination of anchoring I-nodes!")), ('26087', ValueError("nodeset=26087: could not determine direction of RA-nodes ['1060873', '1060896', '1060906', '1060928', '1060930', '1060952'] because there is no TA relation between any combination of anchoring I-nodes!")), ('19757', ValueError("nodeset=19757: could not determine direction of RA-nodes ['632412'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25510', ValueError("nodeset=25510: could not determine direction of RA-nodes ['1020342'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25400', ValueError("nodeset=25400: S-node arguments are not unique! missing relations: [{'sources': ['717266'], 'targets': ['717211'], 'relation': '1003490'}]")), ('25445', ValueError("nodeset=25445: could not determine direction of RA-nodes ['1008593', '1008624', '1008629', '1008632', '1008635', '1008669', '1008672', '1008684', '1008723', '1008726', '1008735', '1008738', '1008747', '1008762', '1008765', '1008805', '1008852', '1008880', '1008891', '1008897', '1008909', '1008912', '1008931', '1008937', '1008940', '1008952', '1008955', '1008961', '1008969', '1008984', '1009011', '1009017', '1009096', '1009099', '1009119', '1009165', '1009180', '1009207', '1009210', '1009213', '1009219'] because there is no TA relation between any combination of anchoring I-nodes!")), ('19911', ValueError('nodeset=19911: I-node texts are not unique!')), ('19761', ValueError("nodeset=19761: could not determine direction of RA-nodes ['632792'] because there is no TA relation between any combination of anchoring I-nodes!")), ('20510', ValueError('direction of RA-node 666105 is ambiguous!')), ('24808', ValueError("nodeset=24808: could not determine direction of RA-nodes ['955075', '955148', '955154', '955170', '955183', '955194', '955200'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25901', ValueError("nodeset=25901: could not determine direction of RA-nodes ['1040059', '1040106'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25468', ValueError("nodeset=25468: could not determine direction of RA-nodes ['1016153', '1016156', '1016162', '1016170', '1016173', '1016280', '1016295', '1016301'] because there is no TA relation between any combination of anchoring I-nodes!")), ('24807', ValueError("nodeset=24807: could not determine direction of RA-nodes ['954850', '954879', '954894', '954921', '954945', '954951', '954960', '954963'] because there is no TA relation between any combination of anchoring I-nodes!")), ('20992', ValueError('direction of RA-node 689965 is ambiguous!')), ('25906', ValueError("nodeset=25906: could not determine direction of RA-nodes ['1040470', '1040528'] because there is no TA relation between any combination of anchoring I-nodes!")), ('26066', ValueError("nodeset=26066: could not determine direction of RA-nodes ['1058494', '1058509'] because there is no TA relation between any combination of anchoring I-nodes!")), ('22969', ValueError("nodeset=22969: S-node arguments are not unique! missing relations: [{'sources': ['641748'], 'targets': ['641718'], 'relation': '806997'}]")), ('17964', ValueError("nodeset=17964: could not determine direction of RA-nodes ['514854'] because there is no TA relation between any combination of anchoring I-nodes!")), ('19059', ValueError('direction of RA-node 587841 is ambiguous!')), ('21401', ValueError('direction of RA-node 714397 is ambiguous!')), ('25475', ValueError("nodeset=25475: could not determine direction of RA-nodes ['1017353', '1017366', '1017415', '1017418', '1017439', '1017442', '1017445', '1017451', '1017463', '1017490', '1017499'] because there is no TA relation between any combination of anchoring I-nodes!")), ('18484', ValueError("nodeset=18484: could not determine direction of RA-nodes ['553464'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25552', ValueError("nodeset=25552: S-node arguments are not unique! missing relations: [{'sources': ['572305'], 'targets': ['572285'], 'relation': '1022478'}]")), ('23749', ValueError("nodeset=23749: could not determine direction of RA-nodes ['863294'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25444', ValueError("nodeset=25444: could not determine direction of RA-nodes ['1007463', '1007468', '1007471', '1007491', '1007503', '1007528', '1007562', '1007579', '1007599', '1007602', '1007645', '1007649', '1007658', '1007670', '1007673', '1007686', '1007766', '1007785'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25907', ValueError("nodeset=25907: could not determine direction of RA-nodes ['1040578'] because there is no TA relation between any combination of anchoring I-nodes!")), ('24992', ValueError("nodeset=24992: could not determine direction of RA-nodes ['977105', '977108', '977116', '977119', '977260', '977264', '977267', '977282', '977310'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25462', ValueError("nodeset=25462: could not determine direction of RA-nodes ['1014490', '1014502', '1014505', '1014536', '1014566', '1014578', '1014581', '1014588', '1014592', '1014595', '1014615', '1014621', '1014632', '1014644'] because there is no TA relation between any combination of anchoring I-nodes!")), ('19091', ValueError("nodeset=19091: could not determine direction of RA-nodes ['590210'] because there is no TA relation between any combination of anchoring I-nodes!")), ('23114', ValueError('direction of RA-node 820629 is ambiguous!')), ('20888', ValueError('direction of RA-node 684790 is ambiguous!')), ('19878', ValueError('direction of RA-node 639622 is ambiguous!')), ('20479', ValueError('direction of RA-node 663443 is ambiguous!')), ('20507', ValueError('direction of RA-node 665828 is ambiguous!')), ('20766', ValueError('direction of RA-node 677366 is ambiguous!')), ('25465', ValueError("nodeset=25465: could not determine direction of RA-nodes ['1015072', '1015084', '1015087', '1015096', '1015105', '1015120', '1015129', '1015135', '1015141', '1015150', '1015153', '1015165', '1015177', '1015184', '1015193', '1015202', '1015205', '1015208', '1015211'] because there is no TA relation between any combination of anchoring I-nodes!")), ('25472', ValueError("nodeset=25472: could not determine direction of RA-nodes ['1016810', '1016818', '1016836', '1016855', '1016858', '1016901', '1016913', '1016921', '1016933', '1016936', '1016945', '1016948', '1016960', '1016969', '1016972', '1016984', '1017044', '1017047', '1017059', '1017062', '1017065'] because there is no TA relation between any combination of anchoring I-nodes!"))] Process finished with exit code 0 ```
ArneBinder commented 2 months ago

Evaluate

This requires #27.

illocutions

command: 

python src/evaluation/eval_official.py \
--mode=illocutions \
--predictions_dir=data/dataset_prepared_all_for_evaluation \
--gold_dir=data/dataset \
--silent

result:

Processing nodesets: 100%|██████████| 1405/1405 [00:04<00:00, 325.11it/s]
general.p: 0.966773671100999
general.r: 0.9501140461143109
general.f1: 0.9570199945849113
focused.p: 0.8514861887815619
focused.r: 0.8342946934622179
focused.f1: 0.8414676836345346
INFO:src.utils.nodeset_utils:Successfully processed 1405 nodesets (0 blacklisted). Failed to process the following nodesets (0): []

arguments

command:

python src/evaluation/eval_official.py \
--mode=arguments \
--predictions_dir=data/dataset_prepared_all_for_evaluation \
--gold_dir=data/dataset \
--silent

result:

Processing nodesets:  34%|███▍      | 478/1405 [00:00<00:01, 555.35it/s]WARNING:__main__:nodeset_id=19737: No focused true relations found
Processing nodesets:  55%|█████▌    | 773/1405 [00:01<00:01, 573.24it/s]WARNING:__main__:nodeset_id=21566: No focused true relations found
Processing nodesets:  96%|█████████▋| 1353/1405 [00:02<00:00, 533.15it/s]WARNING:__main__:nodeset_id=18797: No focused true relations found
Processing nodesets: 100%|██████████| 1405/1405 [00:02<00:00, 550.13it/s]
INFO:src.utils.nodeset_utils:Successfully processed 1405 nodesets (0 blacklisted). Failed to process the following nodesets (0): []
general.p: 0.9668834406785285
general.r: 0.894833091154266
general.f1: 0.9171871425281932
focused.p: 0.8104196386115056
focused.r: 0.7353118115109915
focused.f1: 0.7591900472716043

TODO:

ArneBinder commented 1 month ago

on eval data

requires: #39

Create the prepared data

python src/utils/prepare_data.py \
--input_dir=data/dataset
--output_dir=data/dataset_prepared_val_for_evaluation
--add_gold_data
--re_revert_ra_relations
--re_remove_none_relations
--nodeset_whitelist="18275,20529,23789,25500,19345,21334,19214,17966,19084,20878,23837,18799,18889,19161,23810,21604,18265,23823,23892,20533,23604,23954,21566,21048,21285,18474,23728,23730,23797,23154,20740,18308,23537,19099,18756,23624,20519,23818,20318,23120,21406,21584,19763,23744,23834,19103,18788,23706,21585,23559,23767,21598,25518,22748,20338,23753,23494,17960,21408,21480,23904,18760,23802,20313,20513,21316,23830,19186,23718,19310,25556,19325,19153,18318,20830,21049,25424,21409,23484,23923,23808,21075,21283,23587,23600,21317,21607,18761,21709,23447,23497,19762,23953,20534,25384,19748,23917,21033,23768,23502,23606,21300,19078,19089,21568,19350,21660,18804,17941,21438,19210,23842,23615,21047,25722,21589,20492,20980,23280,21648,20500,25903,19340,25553,23918,20840,23584,21308,20865,23582,23602,19220,23599,21454,23508,21028,21277,23137,18482,21027"

evaluate

--gold_dir=data/train/ \
--predictions_dir=data/dataset_prepared_val_for_evaluation/ \
--mode=arguments

general.p: 0.9712352572157533 general.r: 0.9117948618841476 general.f1: 0.9303856279239436 focused.p: 0.8285371702637893 focused.r: 0.7660763596914678 focused.f1: 0.7861181973697844

python src/evaluation/eval_official.py \
--gold_dir=data/train/ \
--predictions_dir=data/dataset_prepared_val_for_evaluation/ \
--mode=illocutions

general.p: 0.9671865717294916 general.r: 0.9486609426468183 general.f1: 0.9561468513010287 focused.p: 0.8417857142857142 focused.r: 0.8227085616944377 focused.f1: 0.8304712194442135