issues
search
flexflow
/
FlexFlow
FlexFlow Serve: Low-Latency, High-Performance LLM Serving
https://flexflow.readthedocs.io
Apache License 2.0
1.59k
stars
218
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Hip Refactor for optimizer, partition and pool
#1379
Bob-Chen222
closed
1 month ago
0
FlexFlow should correctly use concurrent tasks
#1378
rohany
opened
2 months ago
2
Performance Issue
#1377
lethean287
opened
2 months ago
0
Flexflow attempts to register duplicate sharding functors
#1376
rohany
opened
2 months ago
2
Graph Documentation Update
#1375
Marsella8
closed
1 week ago
1
Operators support for updated speculative inference design
#1374
chenzhuofu
opened
2 months ago
6
Hip refactor for loss, dropout, flat, and gather
#1373
Bob-Chen222
closed
4 weeks ago
1
doc: fix c++ serving example
#1372
chenzhuofu
closed
2 months ago
0
Docs: typo in C++ serving example
#1371
chenzhuofu
closed
2 months ago
0
Define several request manager states and added new APIs
#1370
zikun-li
closed
1 month ago
2
Hip Refactor for element_binary_kernels, unary kernels, and embedding kernels
#1369
Bob-Chen222
closed
1 month ago
0
Hip Refactor for element_binary_kernels, unary_kernels and embedding kernels
#1368
Bob-Chen222
closed
2 months ago
1
refactor of element_binary_kernels, unary kenerls and embedding_kernels
#1367
Bob-Chen222
closed
2 months ago
0
Kernel build
#1366
reyna-abhyankar
closed
2 months ago
3
Adding cost_estimator implementation considering parallelization
#1365
Marsella8
opened
2 months ago
0
Simplify BatchConfig
#1364
zikun-li
opened
2 months ago
11
Add scripts for evaluation with Microsoft Azure trace
#1363
Flechman
closed
2 months ago
0
FlexFlow Mapper Assertion Failure: Memory Allocation Error
#1362
hygorjardim
closed
2 months ago
1
Update on request manager
#1361
zwang86
opened
2 months ago
4
Changes to support Perlmutter environment
#1360
goliaro
closed
2 months ago
0
Hip Refactor
#1359
Bob-Chen222
closed
1 month ago
1
fix: 'model_configs' AttributeError
#1358
chenzhuofu
closed
3 months ago
0
Implement `update` and non-op task execution locally
#1357
reyna-abhyankar
opened
3 months ago
0
Refactor optimizer and loss functions
#1356
reyna-abhyankar
opened
3 months ago
0
Implement `LegionTaskArgumentAccessor`
#1355
reyna-abhyankar
opened
3 months ago
0
Refactor Utility tasks
#1354
reyna-abhyankar
opened
3 months ago
0
Refactor Initializer Kernels
#1353
reyna-abhyankar
opened
3 months ago
0
Refactor PCG & `ParallelTensorMapping`
#1352
reyna-abhyankar
opened
3 months ago
0
Resurrect substitution-to-dot
#1351
lockshaw
closed
1 month ago
0
Commit proj toml and update proj version
#1350
lockshaw
closed
3 months ago
0
Implement the DP algorithm for memory optimization
#1349
wmdi
opened
3 months ago
1
enable Compiler test
#1348
lambda7xx
opened
3 months ago
0
Add option to use external tl::expected
#1347
lockshaw
closed
3 months ago
0
Re-merge #1229
#1346
lockshaw
closed
3 months ago
0
Split prefilling batch with decoding batch for increamental decoding.
#1345
zwang86
closed
1 month ago
2
Seperate prefilling and decoding for increamental decoding
#1344
zwang86
closed
3 months ago
0
Documentation of internals of un-labelled graphs
#1343
lockshaw
closed
1 week ago
1
Implement new DP algorithms in compiler
#1342
lockshaw
opened
3 months ago
0
proj support for local doxygen rendering
#1341
lockshaw
opened
3 months ago
0
Add coverage metrics for unit tests in CI
#1340
lockshaw
closed
1 month ago
5
Doxygen documentation for `lib/substitutions`
#1339
Bob-Chen222
opened
3 months ago
2
Can we modify the "expansion configuration" parameters, such as "token tree width" and "token tree depth"?
#1338
hky011011
opened
3 months ago
0
Error while importing `import flexflow.serve as ff`
#1337
goelayu
opened
3 months ago
4
Reenable `utils` tests
#1336
lockshaw
opened
3 months ago
0
Add graph library algorithm.h documentation
#1335
hsdfzhsdfz
opened
3 months ago
1
`inputs` not initialized in `UpwardOpenMultiDiSubgraphView`
#1334
lockshaw
opened
3 months ago
1
Modify BeamSearchBatchConfig to Support General Tree Structure.
#1333
zikun-li
opened
3 months ago
9
FFModel 'null' in compile_inference
#1332
april-yyt
opened
3 months ago
0
Request for FlexLLM Artifact
#1331
warpmatrix
closed
3 months ago
2
Improve the variant implementation to enable automatic type conversion
#1330
wmdi
opened
3 months ago
0
Previous
Next