mosaicml examples issues

mosaicml / examples

Fast and flexible reference benchmarks

Apache License 2.0

424 stars 121 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

MosaicBert: Training stops after first evaluation pass with Flash Attention 2

#453 amishparekh opened 1 week ago
0
Can't install the requirements for mosaicml

#452 vitoriastavis opened 2 weeks ago
0
Matmul error when using output_all_encoded_layers = True, and pooler

#451 MostHumble opened 2 weeks ago
0
How to add a custom key to config file?

#450 pvti opened 3 months ago
0
Fix betas bug

#449 Skylion007 opened 4 months ago
0
pin sd fine-tuning yamls to working commit

#448 A-Jacobson closed 4 months ago
0
Error when training with Mosaic-Bert

#447 naveenkumar2703 opened 4 months ago
0
update mcloud yamls + requirements for sd and sd-dreambooth

#446 A-Jacobson closed 4 months ago
0
MosaicBERT: Convert composer weights to HF

#445 stefan-it opened 5 months ago
1
Fixes #322 (Change bf16 to amp_bf16)

#443 Taytay opened 5 months ago
0
MosaicBERT: pretraining configuration for models > 128 seq. length

#442 stefan-it opened 6 months ago
5
FlashAttention Triton error on the MosaicBERT models other than base

#441 Taytay closed 5 months ago
3
Modernize MosaicBERT

#440 Skylion007 opened 6 months ago
8
Please bring code features from MPT-7b back to MPT-1b for use of MPT-1b with SFTTrainer.

#439 OlegJakushkin opened 7 months ago
0
config class for bert is not consistent

#438 DanielWit opened 7 months ago
2
update foundry version

#437 bojanbabic closed 8 months ago
0
Bump images for llama2 and update compute

#436 margaretqian closed 9 months ago
0
Bump inference image 0.1.40

#435 margaretqian closed 9 months ago
0
pin examples repo

#434 KuuCi closed 10 months ago
0
Llama2 example + better no-code deployment docs

#433 margaretqian closed 10 months ago
0
Fix no code image version

#432 margaretqian closed 10 months ago
0
--concat_tokens flag in BERT pretraining

#431 mscherrmann closed 10 months ago
2
Fix typo in path

#430 dakinggg closed 10 months ago
0
no code examples

#429 RR4787 closed 10 months ago
0
Refine llama2 handler

#428 asfandyarq closed 10 months ago
1
Update BERT yamls for compatibility with main branch

#427 jacobfulano closed 11 months ago
0
fix sp conversion for slow tokenizer

#426 dakinggg closed 10 months ago
0
Llama2 handler

#425 margaretqian closed 9 months ago
0
fix streaming handler

#424 Glabred closed 11 months ago
0
Fix yaml

#423 tianshuc closed 11 months ago
0
Updated inference mpt yaml with new git commit and corrected handler name

#422 tianshuc closed 11 months ago
0
Add gcp commit to yaml

#421 margaretqian closed 11 months ago
0
Finetuning script broken?

#420 mscherrmann closed 11 months ago
4
Add GCP downloader in example

#419 tianshuc closed 11 months ago
0
Finetuning on windows machine

#418 mscherrmann closed 11 months ago
4
Make FT handler download from GCP

#417 ajaysaini725 closed 11 months ago
0
[WIP] Finetuning MVP script

#416 nancyhung closed 10 months ago
1
Update llm-foundry commit for allowing trust_remote_code in tokenizer for conversion script

#415 margaretqian closed 11 months ago
0
Explain composer logs emitted during training + Replicate Benchmark Results

#414 geodra closed 11 months ago
1
Instructor YAMLs: update git commit

#413 sakshigupta93 closed 11 months ago
0
Remove docker workflow

#412 dakinggg closed 12 months ago
0
Prototype outline

#411 ajaysaini725 closed 12 months ago
0
Pin foundry and fix a minor yaml change with latest foundry

#410 dakinggg closed 12 months ago
0
Update instructor yamls

#409 sakshigupta93 closed 12 months ago
0
Confusion regarding conflicting information in model card of "mosaic-bert" on Hugging Face

#408 mscherrmann closed 11 months ago
2
Inquiry about Mosaic-BERT and BERT-Base Sequence Lengths

#407 mscherrmann closed 11 months ago
9
Add masking_rate_scheduling to examples

#406 zankner opened 1 year ago
0
Fix pydantic version

#405 margaretqian closed 1 year ago
0
Specify gpu num in 30b yaml

#404 margaretqian closed 1 year ago
0
Update commit for replit yaml

#403 margaretqian closed 1 year ago
0