issues
search
flexflow
/
FlexFlow
FlexFlow Serve: Low-Latency, High-Performance LLM Serving
https://flexflow.readthedocs.io
Apache License 2.0
1.59k
stars
218
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Improve the variant implementation to enable automatic type conversion
#1330
wmdi
opened
3 months ago
0
Implement a true `operator==` for `ParallelComputationGraph` and resolve the related hash issue
#1329
wmdi
opened
3 months ago
0
Unit tests in compiler using rapidcheck cannot build
#1328
wmdi
opened
3 months ago
0
Improve readability of graph testcases
#1327
wmdi
opened
3 months ago
0
Separate up MCMC search logic in compiler
#1326
wmdi
opened
3 months ago
0
Separate up DP logic in compiler
#1325
wmdi
opened
3 months ago
0
Refactor the results of different levels of search
#1324
wmdi
opened
3 months ago
0
Add primitive for estimating cost of a fully-mapped PCG
#1323
wmdi
opened
3 months ago
1
Fix graph printing workaround in compiler testing code
#1322
lockshaw
opened
3 months ago
0
Remove unnecessary dependencies and allow using external installs
#1321
lockshaw
closed
3 months ago
0
Modify model cache path
#1320
lockshaw
opened
3 months ago
1
Spec infer C++ examples blocked
#1319
reyna-abhyankar
closed
3 months ago
4
Fix NCCL tear down issue, update docker pre-build cuda version list
#1318
goliaro
closed
4 months ago
0
Huggingface Format Convert & Upload PR Issues
#1317
april-yyt
opened
4 months ago
0
Add more sophisticated error handling in kernels
#1316
reyna-abhyankar
opened
4 months ago
2
Improve the design of the `compiler` library
#1315
wmdi
opened
4 months ago
5
use the cuda graph for specinfer and it's blocked
#1314
lambda7xx
opened
4 months ago
2
utilize the cuda graph to optimize the kernel overhead
#1313
lambda7xx
closed
1 month ago
4
Does FlexFlow support P40?
#1312
wozwdaqian
opened
4 months ago
0
Initial draft of operator docs
#1311
abisatish
closed
1 month ago
1
Add high-level new developer docs for repo-refactor operator interface
#1310
lockshaw
opened
4 months ago
0
Update documentations in lib/substitutions
#1309
Bob-Chen222
closed
3 months ago
2
support cuda 12.1 and cuda 12.2
#1308
goliaro
closed
4 months ago
0
update legion version
#1307
jiazhihao
opened
4 months ago
0
Peft python interface
#1306
goliaro
closed
3 months ago
0
Local Execution
#1305
reyna-abhyankar
closed
1 month ago
0
Set -e in `flexflow_python` interpreter
#1304
goliaro
closed
1 month ago
0
Add "set -euo pipefail" in flexflow_python script
#1303
michaelatkin31
closed
4 months ago
2
Using Algorithm 2 in SpecInfer paper, I get wrong outputs.
#1302
dutsc
opened
4 months ago
3
SpecInfer generate '<pad>'
#1301
dutsc
opened
4 months ago
1
HuggingFace Upload Feature
#1300
april-yyt
opened
4 months ago
0
Inference -> BertMLM
#1299
jiazhihao
closed
1 month ago
0
Cuda graph Draft
#1298
lambda7xx
closed
1 month ago
0
Add examples for every layer in the python layer API
#1297
FelixBrakel
closed
1 month ago
1
Hip kernel refactor
#1296
reyna-abhyankar
opened
5 months ago
6
Example code tutorials for `lib/substitutions`
#1295
lockshaw
opened
5 months ago
0
Per-external-function docstrings for `lib/substitutions`
#1294
lockshaw
opened
5 months ago
7
Example Code Tutorial for `util/graph`
#1293
lockshaw
opened
5 months ago
0
`utils/graph` per-(nontrivial) function documentation
#1292
lockshaw
opened
5 months ago
0
Docs Modification for Python Usecases
#1291
april-yyt
closed
5 months ago
0
Peft optimizer
#1290
goliaro
opened
5 months ago
0
BatchNorm operator initialization missing
#1289
FelixBrakel
opened
5 months ago
0
Peft alignment & debugging tools
#1288
goliaro
closed
5 months ago
0
Bug fixes and update Legion version
#1287
goliaro
closed
5 months ago
2
Revert "Bug fixes and update Legion version"
#1286
goliaro
closed
5 months ago
0
Pointer cast for `cow_ptr_t`
#1285
wmdi
opened
5 months ago
0
Improve `get_subgraph` for open graphs
#1284
wmdi
opened
5 months ago
1
Add more inheritance for graphs
#1283
wmdi
opened
5 months ago
2
Add documentation/sequence diagram for backend/task-spec interaction
#1282
lockshaw
opened
5 months ago
0
Add op-attrs unit tests to CI
#1281
lockshaw
opened
5 months ago
0
Previous
Next