tensorflow / tensor2tensor

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.
Apache License 2.0
15.33k stars 3.47k forks source link

Unable to use custom problem for visualizing attention #1568

Closed chrismostert closed 5 years ago

chrismostert commented 5 years ago

I am trying to run the code in the TransformerVisualization.ipynb notebook to visualize the attention on a user defined problem, however I am unable to do so. When running the following code

usr_dir.import_usr_dir('./transformer')
visualizer = visualization.AttentionVisualizer(hparams_set, model_name, data_dir, problem_name, beam_size=1)

I get the following error

INFO:tensorflow:Importing user module transformer from path /content/Deep-Learning
---------------------------------------------------------------------------
LookupError                               Traceback (most recent call last)
<ipython-input-20-fd5211124aa0> in <module>()
      1 usr_dir.import_usr_dir('./transformer')
----> 2 visualizer = visualization.AttentionVisualizer(hparams_set, model_name, data_dir, problem_name, beam_size=1)

4 frames
/usr/local/lib/python3.6/dist-packages/tensor2tensor/utils/registry.py in problem(name)
    256                   ] + all_problem_names
    257     error_msg = "\n  * ".join(error_lines)
--> 258     raise LookupError(error_msg)
    259   return _PROBLEMS[base_name](was_reversed=was_reversed, was_copy=was_copy)
    260 

LookupError: code_transformer not in the set of supported problems:
  * algorithmic_addition_binary40
  * algorithmic_addition_decimal40
  * algorithmic_cipher_shift200
  * algorithmic_cipher_shift5
  * algorithmic_cipher_vigenere200
  * algorithmic_cipher_vigenere5
  * algorithmic_identity_binary40
  * algorithmic_identity_decimal40
  * algorithmic_multiplication_binary40
  * algorithmic_multiplication_decimal40
  * algorithmic_reverse_binary40
  * algorithmic_reverse_binary40_test
  * algorithmic_reverse_decimal40
  * algorithmic_reverse_nlplike32k
  * algorithmic_reverse_nlplike8k
  * algorithmic_shift_decimal40
  * algorithmic_sort_problem
  * audio_timit_characters_tune
  * audio_timit_tokens8k_test
  * audio_timit_tokens8k_tune
  * babi_qa_concat_all_tasks_10k
  * babi_qa_concat_all_tasks_1k
  * babi_qa_concat_task10_10k
  * babi_qa_concat_task10_1k
  * babi_qa_concat_task11_10k
  * babi_qa_concat_task11_1k
  * babi_qa_concat_task12_10k
  * babi_qa_concat_task12_1k
  * babi_qa_concat_task13_10k
  * babi_qa_concat_task13_1k
  * babi_qa_concat_task14_10k
  * babi_qa_concat_task14_1k
  * babi_qa_concat_task15_10k
  * babi_qa_concat_task15_1k
  * babi_qa_concat_task16_10k
  * babi_qa_concat_task16_1k
  * babi_qa_concat_task17_10k
  * babi_qa_concat_task17_1k
  * babi_qa_concat_task18_10k
  * babi_qa_concat_task18_1k
  * babi_qa_concat_task19_10k
  * babi_qa_concat_task19_1k
  * babi_qa_concat_task1_10k
  * babi_qa_concat_task1_1k
  * babi_qa_concat_task20_10k
  * babi_qa_concat_task20_1k
  * babi_qa_concat_task2_10k
  * babi_qa_concat_task2_1k
  * babi_qa_concat_task3_10k
  * babi_qa_concat_task3_1k
  * babi_qa_concat_task4_10k
  * babi_qa_concat_task4_1k
  * babi_qa_concat_task5_10k
  * babi_qa_concat_task5_1k
  * babi_qa_concat_task6_10k
  * babi_qa_concat_task6_1k
  * babi_qa_concat_task7_10k
  * babi_qa_concat_task7_1k
  * babi_qa_concat_task8_10k
  * babi_qa_concat_task8_1k
  * babi_qa_concat_task9_10k
  * babi_qa_concat_task9_1k
  * cola
  * cola_characters
  * common_voice
  * common_voice_clean
  * common_voice_noisy
  * common_voice_train_full_test_clean
  * genomics_expression_cage10
  * genomics_expression_gm12878
  * genomics_expression_l262k
  * github_function_docstring
  * gym_air_raid-v0_random
  * gym_air_raid-v4_random
  * gym_air_raid_deterministic-v0_random
  * gym_air_raid_deterministic-v4_random
  * gym_air_raid_no_frameskip-v0_random
  * gym_air_raid_no_frameskip-v4_random
  * gym_alien-v0_random
  * gym_alien-v4_random
  * gym_alien_deterministic-v0_random
  * gym_alien_deterministic-v4_random
  * gym_alien_no_frameskip-v0_random
  * gym_alien_no_frameskip-v4_random
  * gym_amidar-v0_random
  * gym_amidar-v4_random
  * gym_amidar_deterministic-v0_random
  * gym_amidar_deterministic-v4_random
  * gym_amidar_no_frameskip-v0_random
  * gym_amidar_no_frameskip-v4_random
  * gym_assault-v0_random
  * gym_assault-v4_random
  * gym_assault_deterministic-v0_random
  * gym_assault_deterministic-v4_random
  * gym_assault_no_frameskip-v0_random
  * gym_assault_no_frameskip-v4_random
  * gym_asterix-v0_random
  * gym_asterix-v4_random
  * gym_asterix_deterministic-v0_random
  * gym_asterix_deterministic-v4_random
  * gym_asterix_no_frameskip-v0_random
  * gym_asterix_no_frameskip-v4_random
  * gym_asteroids-v0_random
  * gym_asteroids-v4_random
  * gym_asteroids_deterministic-v0_random
  * gym_asteroids_deterministic-v4_random
  * gym_asteroids_no_frameskip-v0_random
  * gym_asteroids_no_frameskip-v4_random
  * gym_atlantis-v0_random
  * gym_atlantis-v4_random
  * gym_atlantis_deterministic-v0_random
  * gym_atlantis_deterministic-v4_random
  * gym_atlantis_no_frameskip-v0_random
  * gym_atlantis_no_frameskip-v4_random
  * gym_bank_heist-v0_random
  * gym_bank_heist-v4_random
  * gym_bank_heist_deterministic-v0_random
  * gym_bank_heist_deterministic-v4_random
  * gym_bank_heist_no_frameskip-v0_random
  * gym_bank_heist_no_frameskip-v4_random
  * gym_battle_zone-v0_random
  * gym_battle_zone-v4_random
  * gym_battle_zone_deterministic-v0_random
  * gym_battle_zone_deterministic-v4_random
  * gym_battle_zone_no_frameskip-v0_random
  * gym_battle_zone_no_frameskip-v4_random
  * gym_beam_rider-v0_random
  * gym_beam_rider-v4_random
  * gym_beam_rider_deterministic-v0_random
  * gym_beam_rider_deterministic-v4_random
  * gym_beam_rider_no_frameskip-v0_random
  * gym_beam_rider_no_frameskip-v4_random
  * gym_berzerk-v0_random
  * gym_berzerk-v4_random
  * gym_berzerk_deterministic-v0_random
  * gym_berzerk_deterministic-v4_random
  * gym_berzerk_no_frameskip-v0_random
  * gym_berzerk_no_frameskip-v4_random
  * gym_bowling-v0_random
  * gym_bowling-v4_random
  * gym_bowling_deterministic-v0_random
  * gym_bowling_deterministic-v4_random
  * gym_bowling_no_frameskip-v0_random
  * gym_bowling_no_frameskip-v4_random
  * gym_boxing-v0_random
  * gym_boxing-v4_random
  * gym_boxing_deterministic-v0_random
  * gym_boxing_deterministic-v4_random
  * gym_boxing_no_frameskip-v0_random
  * gym_boxing_no_frameskip-v4_random
  * gym_breakout-v0_random
  * gym_breakout-v4_random
  * gym_breakout_deterministic-v0_random
  * gym_breakout_deterministic-v4_random
  * gym_breakout_no_frameskip-v0_random
  * gym_breakout_no_frameskip-v4_random
  * gym_carnival-v0_random
  * gym_carnival-v4_random
  * gym_carnival_deterministic-v0_random
  * gym_carnival_deterministic-v4_random
  * gym_carnival_no_frameskip-v0_random
  * gym_carnival_no_frameskip-v4_random
  * gym_centipede-v0_random
  * gym_centipede-v4_random
  * gym_centipede_deterministic-v0_random
  * gym_centipede_deterministic-v4_random
  * gym_centipede_no_frameskip-v0_random
  * gym_centipede_no_frameskip-v4_random
  * gym_chopper_command-v0_random
  * gym_chopper_command-v4_random
  * gym_chopper_command_deterministic-v0_random
  * gym_chopper_command_deterministic-v4_random
  * gym_chopper_command_no_frameskip-v0_random
  * gym_chopper_command_no_frameskip-v4_random
  * gym_crazy_climber-v0_random
  * gym_crazy_climber-v4_random
  * gym_crazy_climber_deterministic-v0_random
  * gym_crazy_climber_deterministic-v4_random
  * gym_crazy_climber_no_frameskip-v0_random
  * gym_crazy_climber_no_frameskip-v4_random
  * gym_demon_attack-v0_random
  * gym_demon_attack-v4_random
  * gym_demon_attack_deterministic-v0_random
  * gym_demon_attack_deterministic-v4_random
  * gym_demon_attack_no_frameskip-v0_random
  * gym_demon_attack_no_frameskip-v4_random
  * gym_double_dunk-v0_random
  * gym_double_dunk-v4_random
  * gym_double_dunk_deterministic-v0_random
  * gym_double_dunk_deterministic-v4_random
  * gym_double_dunk_no_frameskip-v0_random
  * gym_double_dunk_no_frameskip-v4_random
  * gym_elevator_action-v0_random
  * gym_elevator_action-v4_random
  * gym_elevator_action_deterministic-v0_random
  * gym_elevator_action_deterministic-v4_random
  * gym_elevator_action_no_frameskip-v0_random
  * gym_elevator_action_no_frameskip-v4_random
  * gym_enduro-v0_random
  * gym_enduro-v4_random
  * gym_enduro_deterministic-v0_random
  * gym_enduro_deterministic-v4_random
  * gym_enduro_no_frameskip-v0_random
  * gym_enduro_no_frameskip-v4_random
  * gym_fishing_derby-v0_random
  * gym_fishing_derby-v4_random
  * gym_fishing_derby_deterministic-v0_random
  * gym_fishing_derby_deterministic-v4_random
  * gym_fishing_derby_no_frameskip-v0_random
  * gym_fishing_derby_no_frameskip-v4_random
  * gym_freeway-v0_random
  * gym_freeway-v4_random
  * gym_freeway_deterministic-v0_random
  * gym_freeway_deterministic-v4_random
  * gym_freeway_no_frameskip-v0_random
  * gym_freeway_no_frameskip-v4_random
  * gym_frostbite-v0_random
  * gym_frostbite-v4_random
  * gym_frostbite_deterministic-v0_random
  * gym_frostbite_deterministic-v4_random
  * gym_frostbite_no_frameskip-v0_random
  * gym_frostbite_no_frameskip-v4_random
  * gym_gopher-v0_random
  * gym_gopher-v4_random
  * gym_gopher_deterministic-v0_random
  * gym_gopher_deterministic-v4_random
  * gym_gopher_no_frameskip-v0_random
  * gym_gopher_no_frameskip-v4_random
  * gym_gravitar-v0_random
  * gym_gravitar-v4_random
  * gym_gravitar_deterministic-v0_random
  * gym_gravitar_deterministic-v4_random
  * gym_gravitar_no_frameskip-v0_random
  * gym_gravitar_no_frameskip-v4_random
  * gym_hero-v0_random
  * gym_hero-v4_random
  * gym_hero_deterministic-v0_random
  * gym_hero_deterministic-v4_random
  * gym_hero_no_frameskip-v0_random
  * gym_hero_no_frameskip-v4_random
  * gym_ice_hockey-v0_random
  * gym_ice_hockey-v4_random
  * gym_ice_hockey_deterministic-v0_random
  * gym_ice_hockey_deterministic-v4_random
  * gym_ice_hockey_no_frameskip-v0_random
  * gym_ice_hockey_no_frameskip-v4_random
  * gym_jamesbond-v0_random
  * gym_jamesbond-v4_random
  * gym_jamesbond_deterministic-v0_random
  * gym_jamesbond_deterministic-v4_random
  * gym_jamesbond_no_frameskip-v0_random
  * gym_jamesbond_no_frameskip-v4_random
  * gym_journey_escape-v0_random
  * gym_journey_escape-v4_random
  * gym_journey_escape_deterministic-v0_random
  * gym_journey_escape_deterministic-v4_random
  * gym_journey_escape_no_frameskip-v0_random
  * gym_journey_escape_no_frameskip-v4_random
  * gym_kangaroo-v0_random
  * gym_kangaroo-v4_random
  * gym_kangaroo_deterministic-v0_random
  * gym_kangaroo_deterministic-v4_random
  * gym_kangaroo_no_frameskip-v0_random
  * gym_kangaroo_no_frameskip-v4_random
  * gym_krull-v0_random
  * gym_krull-v4_random
  * gym_krull_deterministic-v0_random
  * gym_krull_deterministic-v4_random
  * gym_krull_no_frameskip-v0_random
  * gym_krull_no_frameskip-v4_random
  * gym_kung_fu_master-v0_random
  * gym_kung_fu_master-v4_random
  * gym_kung_fu_master_deterministic-v0_random
  * gym_kung_fu_master_deterministic-v4_random
  * gym_kung_fu_master_no_frameskip-v0_random
  * gym_kung_fu_master_no_frameskip-v4_random
  * gym_montezuma_revenge-v0_random
  * gym_montezuma_revenge-v4_random
  * gym_montezuma_revenge_deterministic-v0_random
  * gym_montezuma_revenge_deterministic-v4_random
  * gym_montezuma_revenge_no_frameskip-v0_random
  * gym_montezuma_revenge_no_frameskip-v4_random
  * gym_ms_pacman-v0_random
  * gym_ms_pacman-v4_random
  * gym_ms_pacman_deterministic-v0_random
  * gym_ms_pacman_deterministic-v4_random
  * gym_ms_pacman_no_frameskip-v0_random
  * gym_ms_pacman_no_frameskip-v4_random
  * gym_name_this_game-v0_random
  * gym_name_this_game-v4_random
  * gym_name_this_game_deterministic-v0_random
  * gym_name_this_game_deterministic-v4_random
  * gym_name_this_game_no_frameskip-v0_random
  * gym_name_this_game_no_frameskip-v4_random
  * gym_phoenix-v0_random
  * gym_phoenix-v4_random
  * gym_phoenix_deterministic-v0_random
  * gym_phoenix_deterministic-v4_random
  * gym_phoenix_no_frameskip-v0_random
  * gym_phoenix_no_frameskip-v4_random
  * gym_pitfall-v0_random
  * gym_pitfall-v4_random
  * gym_pitfall_deterministic-v0_random
  * gym_pitfall_deterministic-v4_random
  * gym_pitfall_no_frameskip-v0_random
  * gym_pitfall_no_frameskip-v4_random
  * gym_pong-v0_random
  * gym_pong-v4_random
  * gym_pong_deterministic-v0_random
  * gym_pong_deterministic-v4_random
  * gym_pong_no_frameskip-v0_random
  * gym_pong_no_frameskip-v4_random
  * gym_pooyan-v0_random
  * gym_pooyan-v4_random
  * gym_pooyan_deterministic-v0_random
  * gym_pooyan_deterministic-v4_random
  * gym_pooyan_no_frameskip-v0_random
  * gym_pooyan_no_frameskip-v4_random
  * gym_private_eye-v0_random
  * gym_private_eye-v4_random
  * gym_private_eye_deterministic-v0_random
  * gym_private_eye_deterministic-v4_random
  * gym_private_eye_no_frameskip-v0_random
  * gym_private_eye_no_frameskip-v4_random
  * gym_qbert-v0_random
  * gym_qbert-v4_random
  * gym_qbert_deterministic-v0_random
  * gym_qbert_deterministic-v4_random
  * gym_qbert_no_frameskip-v0_random
  * gym_qbert_no_frameskip-v4_random
  * gym_riverraid-v0_random
  * gym_riverraid-v4_random
  * gym_riverraid_deterministic-v0_random
  * gym_riverraid_deterministic-v4_random
  * gym_riverraid_no_frameskip-v0_random
  * gym_riverraid_no_frameskip-v4_random
  * gym_road_runner-v0_random
  * gym_road_runner-v4_random
  * gym_road_runner_deterministic-v0_random
  * gym_road_runner_deterministic-v4_random
  * gym_road_runner_no_frameskip-v0_random
  * gym_road_runner_no_frameskip-v4_random
  * gym_robotank-v0_random
  * gym_robotank-v4_random
  * gym_robotank_deterministic-v0_random
  * gym_robotank_deterministic-v4_random
  * gym_robotank_no_frameskip-v0_random
  * gym_robotank_no_frameskip-v4_random
  * gym_seaquest-v0_random
  * gym_seaquest-v4_random
  * gym_seaquest_deterministic-v0_random
  * gym_seaquest_deterministic-v4_random
  * gym_seaquest_no_frameskip-v0_random
  * gym_seaquest_no_frameskip-v4_random
  * gym_skiing-v0_random
  * gym_skiing-v4_random
  * gym_skiing_deterministic-v0_random
  * gym_skiing_deterministic-v4_random
  * gym_skiing_no_frameskip-v0_random
  * gym_skiing_no_frameskip-v4_random
  * gym_solaris-v0_random
  * gym_solaris-v4_random
  * gym_solaris_deterministic-v0_random
  * gym_solaris_deterministic-v4_random
  * gym_solaris_no_frameskip-v0_random
  * gym_solaris_no_frameskip-v4_random
  * gym_space_invaders-v0_random
  * gym_space_invaders-v4_random
  * gym_space_invaders_deterministic-v0_random
  * gym_space_invaders_deterministic-v4_random
  * gym_space_invaders_no_frameskip-v0_random
  * gym_space_invaders_no_frameskip-v4_random
  * gym_star_gunner-v0_random
  * gym_star_gunner-v4_random
  * gym_star_gunner_deterministic-v0_random
  * gym_star_gunner_deterministic-v4_random
  * gym_star_gunner_no_frameskip-v0_random
  * gym_star_gunner_no_frameskip-v4_random
  * gym_tennis-v0_random
  * gym_tennis-v4_random
  * gym_tennis_deterministic-v0_random
  * gym_tennis_deterministic-v4_random
  * gym_tennis_no_frameskip-v0_random
  * gym_tennis_no_frameskip-v4_random
  * gym_time_pilot-v0_random
  * gym_time_pilot-v4_random
  * gym_time_pilot_deterministic-v0_random
  * gym_time_pilot_deterministic-v4_random
  * gym_time_pilot_no_frameskip-v0_random
  * gym_time_pilot_no_frameskip-v4_random
  * gym_tutankham-v0_random
  * gym_tutankham-v4_random
  * gym_tutankham_deterministic-v0_random
  * gym_tutankham_deterministic-v4_random
  * gym_tutankham_no_frameskip-v0_random
  * gym_tutankham_no_frameskip-v4_random
  * gym_up_n_down-v0_random
  * gym_up_n_down-v4_random
  * gym_up_n_down_deterministic-v0_random
  * gym_up_n_down_deterministic-v4_random
  * gym_up_n_down_no_frameskip-v0_random
  * gym_up_n_down_no_frameskip-v4_random
  * gym_venture-v0_random
  * gym_venture-v4_random
  * gym_venture_deterministic-v0_random
  * gym_venture_deterministic-v4_random
  * gym_venture_no_frameskip-v0_random
  * gym_venture_no_frameskip-v4_random
  * gym_video_pinball-v0_random
  * gym_video_pinball-v4_random
  * gym_video_pinball_deterministic-v0_random
  * gym_video_pinball_deterministic-v4_random
  * gym_video_pinball_no_frameskip-v0_random
  * gym_video_pinball_no_frameskip-v4_random
  * gym_wizard_of_wor-v0_random
  * gym_wizard_of_wor-v4_random
  * gym_wizard_of_wor_deterministic-v0_random
  * gym_wizard_of_wor_deterministic-v4_random
  * gym_wizard_of_wor_no_frameskip-v0_random
  * gym_wizard_of_wor_no_frameskip-v4_random
  * gym_yars_revenge-v0_random
  * gym_yars_revenge-v4_random
  * gym_yars_revenge_deterministic-v0_random
  * gym_yars_revenge_deterministic-v4_random
  * gym_yars_revenge_no_frameskip-v0_random
  * gym_yars_revenge_no_frameskip-v4_random
  * gym_zaxxon-v0_random
  * gym_zaxxon-v4_random
  * gym_zaxxon_deterministic-v0_random
  * gym_zaxxon_deterministic-v4_random
  * gym_zaxxon_no_frameskip-v0_random
  * gym_zaxxon_no_frameskip-v4_random
  * image_celeba
  * image_celeba32
  * image_celeba64
  * image_celeba_multi_resolution
  * image_celebahq128
  * image_celebahq128_dmol
  * image_celebahq256
  * image_celebahq256_dmol
  * image_cifar10
  * image_cifar100
  * image_cifar100_plain
  * image_cifar100_plain8
  * image_cifar100_plain_gen
  * image_cifar100_tune
  * image_cifar10_plain
  * image_cifar10_plain8
  * image_cifar10_plain_gen
  * image_cifar10_plain_gen_dmol
  * image_cifar10_plain_random_shift
  * image_cifar10_tune
  * image_cifar20
  * image_cifar20_plain
  * image_cifar20_plain8
  * image_cifar20_plain_gen
  * image_cifar20_tune
  * image_fashion_mnist
  * image_fsns
  * image_imagenet
  * image_imagenet224
  * image_imagenet32
  * image_imagenet32_gen
  * image_imagenet32_small
  * image_imagenet64
  * image_imagenet64_gen
  * image_imagenet_multi_resolution_gen
  * image_lsun_bedrooms
  * image_mnist
  * image_mnist_tune
  * image_ms_coco_characters
  * image_ms_coco_tokens32k
  * image_text_ms_coco
  * image_text_ms_coco_multi_resolution
  * image_vqav2_rcnn_feature_tokens10k_labels3k
  * image_vqav2_tokens10k_labels3k
  * img2img_allen_brain
  * img2img_allen_brain_dim16to16_paint1
  * img2img_allen_brain_dim48to64
  * img2img_allen_brain_dim8to32
  * img2img_celeba
  * img2img_celeba64
  * img2img_cifar10
  * img2img_cifar100
  * img2img_imagenet
  * lambada_lm
  * lambada_lm_control
  * lambada_rc
  * lambada_rc_control
  * languagemodel_de_en_fr_ro_wiki64k
  * languagemodel_de_wiki32k
  * languagemodel_de_wiki64k
  * languagemodel_en_wiki32k
  * languagemodel_en_wiki64k
  * languagemodel_en_wiki64k_shorter
  * languagemodel_en_wiki_lm_multi_nli_subwords
  * languagemodel_en_wiki_lm_multi_nli_subwords64k
  * languagemodel_en_wiki_lm_short_multi_nli_subwords64k
  * languagemodel_en_wiki_lm_summarize_cnndm_subwords
  * languagemodel_en_wiki_lm_summarize_cnndm_subwords64k
  * languagemodel_fr_wiki32k
  * languagemodel_fr_wiki64k
  * languagemodel_lm1b32k
  * languagemodel_lm1b32k_packed
  * languagemodel_lm1b8k
  * languagemodel_lm1b8k_packed
  * languagemodel_lm1b_characters
  * languagemodel_lm1b_characters_packed
  * languagemodel_lm1b_multi_nli
  * languagemodel_lm1b_multi_nli_subwords
  * languagemodel_lm1b_sentiment_imdb
  * languagemodel_multi_wiki_translate_fr
  * languagemodel_ptb10k
  * languagemodel_ptb_characters
  * languagemodel_ro_wiki32k
  * languagemodel_ro_wiki64k
  * languagemodel_wiki_noref_v128k_l1k
  * languagemodel_wiki_noref_v32k_l16k
  * languagemodel_wiki_noref_v32k_l1k
  * languagemodel_wiki_noref_v8k_l16k
  * languagemodel_wiki_noref_v8k_l1k
  * languagemodel_wiki_scramble_l128
  * languagemodel_wiki_scramble_l1k
  * languagemodel_wiki_xml_v8k_l1k
  * languagemodel_wiki_xml_v8k_l4k
  * languagemodel_wikitext103
  * languagemodel_wikitext103_characters
  * librispeech
  * librispeech_clean
  * librispeech_clean_small
  * librispeech_noisy
  * librispeech_train_full_test_clean
  * msr_paraphrase_corpus
  * msr_paraphrase_corpus_characters
  * multi_nli
  * multi_nli_characters
  * multi_nli_shared_vocab
  * multi_nli_wiki_lm_shared_vocab
  * multi_nli_wiki_lm_shared_vocab64k
  * ocr_test
  * paraphrase_generation_ms_coco_problem1d
  * paraphrase_generation_ms_coco_problem1d_characters
  * paraphrase_generation_ms_coco_problem2d
  * paraphrase_generation_ms_coco_problem2d_characters
  * parsing_english_ptb16k
  * parsing_english_ptb8k
  * parsing_icelandic16k
  * program_search_algolisp
  * programming_desc2code_cpp
  * programming_desc2code_py
  * question_nli
  * question_nli_characters
  * quora_question_pairs
  * quora_question_pairs_characters
  * rte
  * rte_characters
  * sci_tail
  * sci_tail_characters
  * sci_tail_shared_vocab
  * sentiment_imdb
  * sentiment_imdb_characters
  * sentiment_sst_binary
  * sentiment_sst_binary_characters
  * squad
  * squad_concat
  * squad_concat_positioned
  * stanford_nli
  * stanford_nli_characters
  * stanford_nli_shared_vocab
  * stanford_nli_wiki_lm_shared_vocab
  * stanford_nli_wiki_lm_shared_vocab64k
  * style_transfer_modern_to_shakespeare
  * style_transfer_modern_to_shakespeare_characters
  * style_transfer_shakespeare_to_modern
  * style_transfer_shakespeare_to_modern_characters
  * summarize_cnn_dailymail32k
  * summarize_cnn_dailymail_wiki_lm_shared_vocab
  * summarize_cnn_dailymail_wiki_lm_shared_vocab64k
  * sva_language_modeling
  * sva_number_prediction
  * text2text_copyable_tokens
  * text2text_tmpdir
  * text2text_tmpdir_tokens
  * timeseries_synthetic_data_series10_samples100k
  * timeseries_toy_problem
  * timeseries_toy_problem_no_inputs
  * tiny_algo
  * translate_encs_wmt32k
  * translate_encs_wmt_characters
  * translate_ende_wmt32k
  * translate_ende_wmt32k_packed
  * translate_ende_wmt8k
  * translate_ende_wmt8k_packed
  * translate_ende_wmt_bpe32k
  * translate_ende_wmt_characters
  * translate_enet_wmt32k
  * translate_enet_wmt_characters
  * translate_enfr_wmt32k
  * translate_enfr_wmt32k_packed
  * translate_enfr_wmt32k_with_backtranslate_en
  * translate_enfr_wmt32k_with_backtranslate_fr
  * translate_enfr_wmt8k
  * translate_enfr_wmt_characters
  * translate_enfr_wmt_multi64k
  * translate_enfr_wmt_small32k
  * translate_enfr_wmt_small8k
  * translate_enfr_wmt_small_characters
  * translate_enid_iwslt32k
  * translate_enmk_setimes32k
  * translate_enmk_setimes_characters
  * translate_envi_iwslt32k
  * translate_enzh_wmt32k
  * translate_enzh_wmt8k
  * video_bair_robot_pushing
  * video_bair_robot_pushing_with_actions
  * video_google_robot_pushing
  * video_stochastic_shapes10k
  * video_twentybn
  * wiki_revision
  * wiki_revision_packed1k
  * wiki_revision_packed256
  * wikisum_commoncrawl
  * wikisum_commoncrawl_lead_section
  * wikisum_web
  * wikisum_web_lead_section
  * winograd_nli
  * winograd_nli_characters
  * wsj_parsing

Training the model using the custom problem worked just fine by running t2t-trainer with the t2t_usr_dir flag set to my directory with the custom problem, however I am unable to properly register the problem in the notebook.

Am I doing something wrong? Or is this not supported in the AttentionVIsualizer?

minump commented 5 years ago

Hi Chris,

I am having trouble in registering a custom problem with t2t_usr_dir. My t2t_usr_dir contains a user_translate.py file with problem class with @registry.register_problem. The user defined class extends the translate.TranslateProblem. The t2t_usr_dir also has the init.py file which imports the user_translate.py file. (from . import user_translate). Can you guide me through what I might be missing?