-
Google has been leveraging Atlas visualizer for embeddings:
https://atlas.nomic.ai/
Look at the possibility of embedding visualization for distributed data sets as a way to explore / search for data.…
-
**Introduction or background of this discussion**:
OSPP project: "Real-Time IoT Perception Systems Based on Edge-Cloud Collaboration with Large Foundation Models"
**Contents of this discussion…
-
# URL
- https://arxiv.org/abs/2404.09385
# Affiliations
- Shu-wen Yang, N/A
- Heng-Jui Chang, N/A
- Zili Huang, N/A
- Andy T. Liu, N/A
- Cheng-I Lai, N/A
- Haibin Wu, N/A
- Jiatong Shi, …
-
Hi,
I am curious if it would be possible to implement Megatron-style sequence parallelism in the repository.
Sequence parallelism is crucial for reducing activation memory, which is otherwise ch…
-
Two teams, currently called Operators and Anarchists.
These are the two concepts I've gotten the chance to make this week.
![hc1_01](https://github.com/Facepunch/sbox-hc1/assets/99647346/247cad3e-b…
-
the default model variant is "7b":
https://github.com/foundation-model-stack/fms-fsdp/blob/65b0ea670fa375bb0f7f6a285e7229bb96ebdd0f/fms_fsdp/config/training.py#L8
but it is not in the supported wh…
-
Sample (modified) but discovered by the V2 specs from the [terraform client](https://github.com/pactflow/terraform-provider-pact)
```
{
"consumer": {
"name": "terraform-client"
},
"int…
-
### Feature request
Host the MedImg dataset (similar to Imagenet but for biomedical images).
### Motivation
There is a clear need for biomedical image foundation models and large scale biome…
-
Which is the weight of MiDas/KBR in google drive?
-
Example of command:
```python benchmark_throughput.py --model gpt2 --input-len 256 --output-len 256```
Output:
```Namespace(backend='vllm', dataset=None, input_len=256, output_len=256, model='gpt…