sil-ai / sil-microsoft-hackathon-2023

SIL-Microsoft Hackathon, September 2023
4 stars 2 forks source link

Magic tokens model output #3

Open ryderwishart opened 1 year ago

ryderwishart commented 1 year ago

@JEdward7777

Using 7 magic tokens, here's some sample output: In: generate_text( "[MAT 1:1_a][MAT 1:1_b]", 100, os.path.join( trained_model_folder, selected_model_dropdown.value ) )

Out:

Sequence ids tensor([[212272, 212273]])
[MAT 1:1_a] [MAT 1:1_b] Kidegen kane na ima se udin bellu litining, kabura na ina yertin ba. Yinnu sa uyenu kiti mine sa ina lai bara iwa shintin ntuc [ZEC 12:12_d] [LUK 12:31_b] [GAL 3:28_d] [LUK 12:31_b] [REV 6:12_c] [HEB 10:29_c] [JHN 7:15_f] Yeneng iwa din dursuzu kiti mine, sa uyenu tibau mine sa ilira kiti mine sa ina nuzu mine, sa

In: generate_text( "[REV 1:1_a][REV 1:1_b][REV 1:1_c][REV 1:1_d][REV 1:1_e][REV 1:1_f][REV 1:1_g]", 100, os.path.join( trained_model_folder, selected_model_dropdown.value ) )

Out:

Sequence ids tensor([[265143, 265144, 265145, 265146, 265147, 265148, 265149]])
[REV 1:1_a] [REV 1:1_b] [REV 1:1_c] [REV 1:1_d] [REV 1:1_e] [REV 1:1_f] [REV 1:1_g] [JOL 2:2_d] [EXO 40:20_e] [PSA 39:1_e] [JHN 9:35_c] [PRO 9:5_c] [JHN 9:35_c] [MAT 17:19_b] [PRO 9:5_c] [PRO 9:5_c] [1KI 8:16_d] [1KI 8:16_d] [1SA 7:5_a] [1KI 11:16_e] [1KI 8:16_d] [EXO 35:14_c] [ROM 3:10_e] [1SA 7:5_a] [LEV 7:29_g] [1KI 8:16_d] [PRO 28:6_b] [LEV 7:29_g] [GEN 33:17_g] [LEV 7:29_g] [PRO 9:5_c] [LEV 7:29_g] [LEV 7:29_g] [PRO 9:5_c] [LEV 7:29_g] [LEV 7:29_g] [LEV 7:29_g] [2KI 8:12_g] [DEU 33:9_c] [1KI 8:16_d] [LEV 7:29_g] [PRO 9:5_c] [LEV 7:29_g] [LEV 7:29_g] [LEV 7:29_g] [2CO 11:24_c] [EXO 40:20_e] [EXO 40:20_e] [LEV 7:29_g] [JOB 23:10_a] [2CO 11:24_c] [JOB 4:11_e] [LEV 7:29_g] [2KI 8:12_g] [EXO 40:20_e] [LEV 7:29_g] [ISA 32:1_c] [ZEC 8:7_g] [MAT 26:58_c] [LEV 7:29_g] [GEN 33:17_g] [LAM 1:14_d] [JHN 9:35_c] [PRO 9:5_c] [PRO 31:6_b] [ZEC 8:7_g] [2KI 3:14_e] [1CO 15:49_e] [2KI 3:14_e] [PRO 9:5_c] [PRO 31:6_b] [EXO 15:9_c] [PRO 9:5_c] [JOB 9:12_e] [EZK 34:30_a] [PSA 83:7_a] [DEU 33:9_c] [MAT 23:33_a] [PSA 82:4_g] [1PE 3:5_b] [DEU 33:9_c] [JOB 30:18_a] [PRO 9:5_c] [DEU 33:9_c] [EZK 7:27_a] [ZEC 8:7_g] [EZK 34:30_a] [DEU 33:9_c] [JOB 23:10_a] [DEU 33:9_c] [PRO 9:5_c] [PSA 82:4_g] [EZK 34:30_a] [EXO 15:9_c] [2KI 3:14_e] [DEU 33:9_c] [EXO 15:9_c] [1PE 3:5_b] [DEU 33:9_c] [JDG 11:38_b]
ryderwishart commented 1 year ago

Update (selecting the trained model, same two inputs as above):

Sequence ids tensor([[212272, 212273]])
[MAT 1:1_a] [MAT 1:1_b] Kubi na awa zazin nkifo nanyan dutu kitin Yesu ku, nwa ti lau kilari nlire kuculu, inan leo iba dak [MAT 10:41_c] [MAT 17:21_c] [1CO 2:1_c] [ACT 21:39_b] [ROM 8:25_c] [1CO 6:9_e] Yene inan ni umong di nin salin lanzun nanite nene sa unuzu bara inung uwa ni wui ba. Meng na nwui ma yitu nin cikil

Using seven magic tokens as input:

Sequence ids tensor([[265143, 265144, 265145, 265146, 265147, 265148, 265149]])
[REV 1:1_a] [REV 1:1_b] [REV 1:1_c] [REV 1:1_d] [REV 1:1_e] [REV 1:1_f] [REV 1:1_g] Nanere wang din sesu umon imonli ulau me wang, na anari wa su kuru nin lisa usuu nin kubi kongo na umon wa punghe ba, na nan nanere ba unan nakara ba, bara na ima kewu ku unan kotu kuwucuwucue, ukuse nani, ukuse na iba

Summary

Ground truth:

Ulelere upunu mbeleng Yesu Kristi na Kutelle wa nighe, a duro achin me imon ncin dak nan nya nayiri baat. A taa iyinno inin nan nyan ntuu ngono kadura me udu nkiti kuchin mye Yohanna.

Prediction:

Nanere wang din sesu umon imonli ulau me wang, na anari wa su kuru nin lisa usuu nin kubi kongo na umon wa punghe ba, na nan nanere ba unan nakara ba, bara na ima kewu ku unan kotu kuwucuwucue, ukuse nani, ukuse na iba