google-research albert issues

google-research / albert

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

Apache License 2.0

3.23k stars 571 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

is it support fine tuning with tf2.x?

#226 ares5221 opened 4 years ago
1
Albert-base-v2 training data

#225 slvcsl opened 4 years ago
0
tensorflow.python.framework.errors_impl.NotFoundError: Restoring from checkpoint failed.

#224 YuHengKit closed 4 years ago
0
ensure str for the case of bytes type.

#223 jnory opened 4 years ago
3
Add the ability to bake threshold into the exported SavedModel.

#222 copybara-service[bot] closed 4 years ago
0
TypeError: '<' not supported between instances of 'int' and 'NoneType' while only predicting, try to fix it, but not sure is it make sense

#221 alznn opened 4 years ago
2
why running run_squad_v2.py in prediction mode with dev-v2.0.json gets zero neg example

#220 urextra opened 4 years ago
1
Add a signature that exposed the SOP log probabilities.

#219 copybara-service[bot] closed 4 years ago
0
Is it possible to load pretrained model's checkpoint and pretrain other corpus with that checkpoint?

#218 sikaleo opened 4 years ago
0
invalid load key, '\x12'

#217 liu-x-p opened 4 years ago
1
How to prepare for the environment/data for fine-tuning?

#216 517030910405 closed 3 years ago
2
Allow run_classifier to export fine-tuned model as a SavedModel.

#215 copybara-service[bot] closed 4 years ago
0
use custom vocab.txt

#214 2696120622 opened 4 years ago
1
is inner_group_num exactly equal to num_hidden_layers/num_hidden_groups?

#213 lsy641 opened 4 years ago
0
how to do inference for SQuAD style QA task using ALBERT?

#212 clrajapaksha opened 4 years ago
2
fine_tune albert with run_classifier.py on GPU but the GPU-util is 0,why and how?

#211 yuanjun1991 opened 4 years ago
2
Where is the function of Factorized Embedding Parameterization?

#210 hntee opened 4 years ago
2
fix the attention mask description error and a cola evaluation calculation error.

#209 copybara-service[bot] closed 4 years ago
0
Description problem of attention_mask.

#208 liushaoweihua opened 4 years ago
0
model isn't learning

#207 raviolli opened 4 years ago
1
different parameter position with api doc

#206 cyjj opened 4 years ago
0
get Matthew_corr = 0 in eval on CoLA

#205 cyjj opened 4 years ago
0
Extremely large RAM consumption by create_pretraining.py

#204 sultanovazamat opened 4 years ago
3
Modify default value of the max_seq_length at the stage of fine-tuning on GLUE

#203 gongel closed 2 years ago
3
Training without SOP Loss

#202 divkakwani opened 4 years ago
0
ValueError: Signature 'serving_default' is missing from meta graph.

#201 preethamgali opened 4 years ago
0
[question] Cross-layer parameter sharing

#200 pglushkov opened 4 years ago
1
ModuleNotFoundError: No module named 'albert'

#199 elliotthwang closed 4 years ago
3
ALBERT-xxlarge V2 training on TPU V3-512 extremely slow

#198 agemagician closed 4 years ago
15
albert large_v2

#197 gogokre opened 4 years ago
2
tokenization.py - WordpieceTokenizer uses "##", but Sentencepiece vocab generates "▁"

#196 abdullaholuk opened 4 years ago
1
Fix instructions on running spm_train.

#195 copybara-service[bot] closed 4 years ago
0
GPU not used when fine-tuning on SQuAD 2.0

#194 Inception95 opened 4 years ago
4
rename the tutorial and add a link to open it from colab.

#193 copybara-service[bot] closed 4 years ago
0
fix an error on the max_seq_length. Here we should set it to 512 instead of 128.

#192 copybara-service[bot] closed 4 years ago
0
ALBERT GLUE fine-tuning colab tutorial.

#191 copybara-service[bot] closed 4 years ago
0
Handle cases where SP can't load the file, but gfile can.

#190 copybara-service[bot] closed 4 years ago
0
run_pretraining.py doesn't read all input files while training on desktop, global step doesn't work like epoch logic

#189 abdullaholuk opened 4 years ago
0
TPU training problem

#188 manueltonneau closed 4 years ago
2
remove an info log from the tokenzier as it flushes the screen

#187 copybara-service[bot] closed 4 years ago
0
Fix error experiments on RACE because of no all.txt

#186 twilightdema closed 4 years ago
0
Fix running experiments on RACE (no all.txt)

#185 twilightdema closed 4 years ago
1
Import from the albert module

#184 copybara-service[bot] closed 4 years ago
0
remove validate_case_matches_checkpoint from the finetuning scripts

#183 copybara-service[bot] closed 4 years ago
0
Allow to read spm model from hub module.

#182 copybara-service[bot] closed 4 years ago
0
How to extract the word embedding

#181 256785 opened 4 years ago
1
Wrong configuration of albert xlarge

#180 zheyuye opened 4 years ago
0
Pretraining iterations_per_loop and batch_size

#179 likith187 opened 4 years ago
0
Getting huge number of training steps

#178 008karan opened 4 years ago
5
Uneven sampling if number of tfrecords > cycle_length

#177 illuminascent opened 4 years ago
0

Previous Next