-
## 🚀 Feature
## Motivation
## Additional context
-
Hi, I am working on STS-B data set and I am executing the following commands in Ubuntu
`export GLUE_DIR=glue_data
export ALBERT_DIR=model_configs/large
export TASK_NAME=STS
export OUTPUT_DIR=s…
-
Hi @kamalkraj Thank you for the previous fix.
I am working on STS-B data set and I am executing the following commands in Ubuntu
```
export GLUE_DIR=glue_data
export ALBERT_DIR=model_configs/l…
-
## 🐛 Bug
Model I am using :ALBERT
Language I am using the model on (English, Chinese....):English
> from transformers import TFAlbertModel
> model2=TFAlbertModel.from_pretrained('alber…
-
will albert for tf2 be released?
-
Hi,
Thanks for your code :) It's very helpful for me to study ALBERT.
As long as I know ALBERT batch size is 4096 on the paper.
Have you ever tried to pretrain from scratch via GPU?
I've seen your…
-
I used albert_base_v2 and tfhub on python3.6 and tensorflow 1.15.0.
I tried to wrap the albert output layer with a pooling layer. And it gives the following erros:
```
-------------------------…
-
Hi,
Can the script do predict? I may miss it, but I didn't see a "do_pred" flag.
-
Hi Kamal,
Is it possible to load Albert Tf1.0 model found here - https://github.com/google-research/google-research/tree/master/albert
for NER training.
-
it appears both xxlarge v1 and v2 files (**tf2_model.h5**) are same size after download: 890.4MB, and same creation date:
---------------------------
v1: https://drive.google.com/file/d/1gl5lOiAHq…