-
Really love your work on open sourcing the whole pipeline and all component!
But when I want to recover the model weight of reward-model-sim, I found this _name_or_path points to a absolute path
![i…
-
貼吧活動:(請查閱 [SARS-CoV-2 Timeline by 2020.02.21](https://github.com/agorahub/_meta/blob/agoran/theagora/sari/Memorandum_2020-02-21_SARS-CoV-2-Timeline_Nathan.pdf?raw=true), by Nathan :cloud: )
- Colla…
-
Is less verbosity the only main benefit of typeclasses over just inputting a set of functions?
Typeclasses can do where `bar` is a member of `Function`:
```
foo(x: A) where Function
bar(x)
…
-
When I use opt-13b to replace opt-1.3b in the step1, step2 use opt-350m.
In the step3_rlhf_finetuning, I get an error message, like this:
>tail -f output/step3-models/13b/training.log
File "/w…
-
**Describe the bug**
When running step 3 with ZERO stage 3 enabled and lora for both the actor and critic models.
An error was reported, it seems to tell me that bloomz does not support zero3+lora.
…
-
Hi,
Thank you for providing and maintaining this repo!
I have a question: After running `metadrive/metadrive/examples/train_generalization_experiment.py`, how to test the trained policy (for exam…
-
# ❓ Questions & Help
Is there any way to do this?
-
-
logits, hidden_layers = transformer_output
# outputs = hidden_layers
if self.output_predict:
# Parallel logits.
# logits_parallel = mpu.copy_to_model_parall…
-
### API 規格
認識理解 API
查找相關資料文件
---
參考資料:
《精通 API 架構》
預計參考網路文章:
- [x] [淺談 API 與 RESTful API](https://israynotarray.com/other/20211125/356203095/)
- [x] [Fetch API 到底是 ESMAScript6 還是 Web A…