-
Comment below with a well-developed question or comment about the reading for this week's workshop.
If you would really like to ask your question in person, please place two exclamation points befo…
-
Hello everyone.
When I trained Mixtral-MOE with QLoRA + Zero3, it occurs error like below.
…
-
Currently, our train-test splitting function mostly serves to show the result of train-test splitting. Though the output datasets can be used directly, it would require a custom workflow e.g. for cros…
-
Post questions here for this week's oritenting readings: Timmermans, Stefan and Iddo Tavory. 2012. “Theory Construction in Qualitative Research: From Grounded Theory to Abductive Analysis.” Sociologic…
-
_The following peer review was solicited as part of the Distill review process._
_**The reviewer chose to keep anonymity.** Distill offers reviewers a choice between anonymous review and offering r…
-
Pose a question about one of the following articles: “[Norman, World’s first psychopath AI (Links to an external site.)](http://norman-ai.mit.edu/)”, 2018. P. Yanardag, M. Cebrian, I. Rahwan; “[Deep n…
-
As in the other examples, the easiest way to approach this is probably to pick a single paper and reproduce its model and results.
Some candidate papers:
- [Mendelian randomization](https://journa…
-
We'll try a slightly different format for our meeting notes this summer, and keep them all in a single thread. This is it!
-
## Improved Proposal
**Proposed System Summary**
Imagine instructing a computer in plain English to solve a complex problem. Our system would not only understand your request but would also …
-
您好,正在尝试微调mixtral 8x7b,但是训练一段时间后loss不再下降,输出也有些问题
使用的config如下:
```python
# Copyright (c) OpenMMLab. All rights reserved.
import torch
from datasets import load_dataset
from mmengine.dataset im…