issues
search
pytorch
/
torchchat
Run PyTorch LLMs locally on servers, desktop and mobile
BSD 3-Clause "New" or "Revised" License
3.09k
stars
192
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Update gitignore
#1122
Gasoonjia
opened
7 hours ago
1
[distributed] add TrackTime, monitor perf for weight loading per stage
#1121
lessw2020
opened
14 hours ago
1
[distributed] add stage metrics - total params per stage, total size and present it in a nicely formatted manner
#1120
lessw2020
opened
14 hours ago
1
[distributed] add gpu specs, % and absolute peak mem used per stage
#1119
lessw2020
opened
15 hours ago
1
build_native et fails
#1118
sunshinesfbay
opened
18 hours ago
1
install_et and build_native et clone and build executorch twice.
#1117
sunshinesfbay
opened
18 hours ago
0
Fix benchmarking statistics computation when profiler is used in generate.py
#1116
sanchitintel
opened
18 hours ago
2
Bumped up core pytorch version
#1115
Gasoonjia
opened
2 days ago
2
What is the future plan of this torchchat project?
#1114
yanbing-j
closed
1 minute ago
2
[Easy] Improve Print Formatting for generate stats
#1113
Jack-Khuu
closed
2 days ago
2
Add max-autotune option for prefill
#1112
yanbing-j
closed
2 days ago
2
Torchao install from pypi instead of github
#1111
Gasoonjia
opened
3 days ago
1
[distributed] integrate chat tokenizers, and add llama3-8B model option
#1110
lessw2020
closed
3 days ago
1
[Dist] Small fix to set_device
#1109
kwen2501
closed
3 days ago
1
Minor Readme changes
#1108
byjlw
closed
3 days ago
1
ET Runner build fails with buck2 "Failed to stat `executorch/buck-out/v2`" error
#1107
byjlw
opened
4 days ago
2
Can't run ET Install
#1106
byjlw
closed
4 days ago
1
HelloGitHub Badge
#1105
521xueweihan
opened
5 days ago
0
[distributed] ensure precise rope embeddings by creating frequencies in bf16
#1104
lessw2020
closed
4 days ago
1
Cannot install ET
#1103
byjlw
closed
5 days ago
1
Merge model_dist into model
#1102
kwen2501
closed
5 days ago
2
should have the ability to output debug artifacts when exporting to a .pte file
#1101
byjlw
opened
5 days ago
0
Switch gguf-util test to a smaller model to prevent timeout
#1100
Jack-Khuu
closed
5 days ago
1
[Distributed] Enable sequence parallel
#1099
kwen2501
closed
5 days ago
1
[distributed] add verification_utils.py - collection of validation utils for verifying various model aspects
#1098
lessw2020
closed
5 days ago
2
safetensor updates: add attn head permute, update gating layer mapping
#1097
lessw2020
closed
5 days ago
1
[Consolidate] Move parallelization code into a .distribute() method
#1096
kwen2501
closed
6 days ago
2
Vague error when trying to use the browser if API isn't running
#1095
byjlw
opened
1 week ago
0
[easy] Undo Extra Redirection for adb Paths
#1094
Jack-Khuu
closed
1 week ago
1
[easy] README: typo- missing where
#1093
Jack-Khuu
closed
6 days ago
1
[Hackability Refactor] Removing __main__ from export/generate/eval
#1092
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] Restricted Lint
#1091
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] Move scripts under torchchat/utils
#1090
Jack-Khuu
closed
1 week ago
2
[Hackability Refactor] Move export and generate under torchchat/
#1089
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] Update missed direct file callsites to use torchchat.py
#1088
Jack-Khuu
closed
1 week ago
1
[Distributed Inference] running under .inference_mode() = assert Dtensor NotImplementedError: Operator aten.matmul.default does not have a sharding strategy registered.
#1087
lessw2020
closed
1 week ago
1
[Distributed Inference] moving stage.submod to non-fp32 (bf16, fp16) results in dtensor assert "self.mask_buffer.data is not None"
#1086
lessw2020
closed
1 week ago
4
[Hackability Refactor] Easy Moves: eval, gguf_loader, quantize, model_dist
#1085
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] Move build/util into torchchat/utils
#1084
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] Move cli related files under torchchat/cli
#1083
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] Move model_config into torchchat/model_config
#1082
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] Move installation related files into install/
#1081
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] Move select top level docs into folders torchchat/
#1080
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] Move the top level util folder into torchchat/utils
#1079
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] Collapse gguf_util into gguf_loader
#1078
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] Move model.py underneath torchchat/
#1077
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] File structure Re-organization under a torchchat/ folder
#1076
Jack-Khuu
closed
1 week ago
2
[Hackability Refactor] Migrate CLI call sites to explicitly go through torchchat.py
#1075
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] Migrate call sites to explicitly go through torchchat.py
#1074
Jack-Khuu
closed
1 week ago
1
[Hackability Refactor] Move known_model_params under torchchat
#1073
Jack-Khuu
closed
1 week ago
1
Next