-
Post your questions here about: “[Text Learning with Sequences (Links to an external site.)](https://docs.google.com/document/d/1vHoYMFH-53UpE528xv_-xhSrkjUELI7ihfXmz3J_As4/edit?usp=sharing)” OR “[Tex…
lkcao updated
2 years ago
-
We are developing a new tool for validating symbolic execution summaries. In the context of this work, we analysed 24 of angr's Simprocedures corresponding to `v9.2.6` and identified 15 bugs in these …
-
"Why is the compression with the language model only chunked? I followed all the steps and trained the model for 1 million steps, obtaining a high loss (2552.305908). I compressed enwik9 (using python…
-
Hi @anas-awadalla
As described in #124, "Our training took place on 32 80GB A100s. We trained on 5M samples from MMC4 and 10M from LAION 2B."
I am interested in the details of loss during trai…
-
This package is great work and the Gen team would love to collaborate and contribute to this. One concern I have is that DistributionsAD brings in some a list of dependencies beyond those of Zygote, T…
-
Plan discussed at meeting
We will use the following environments:
- stage
- ccebikes (large: 86k trips, 108 users)
- smart commute (medium, long-term: 18k trips, 21 users)
- STM community (smal…
-
Hi! when I try to run a python [scripts](https://github.com/pytorch/PiPPy/blob/main/examples/llama/pippy_llama.py) for llm inference in pipeline parallelism on single server with multi GPUs. It turned…
-
I seem to get these errors when using the questions in the cells
: in _fwd_kernel:21
> KeyError:
('2-.-0-.-0--394352f6a8351feaac334fbb8cc63fa4-46c7c5d46afed8316facd72e7e581bec-4da92a6240b2b82…
-
Hi,
we (as part of the [Web of Things working group](https://www.w3.org/WoT/WG/)) look into the issue how to allow typing values when exchanging data. For now we referenced JSON Schema.
For exam…
-
### System Info
```Shell
# Machine Learning and Deep Learning Libraries
torch==2.4.1 --index-url https://download.pytorch.org/whl/cu121 # Deep learning framework
torchvision==0.17.1 # Co…