argonne-lcf dlio_benchmark issues

argonne-lcf / dlio_benchmark

An I/O benchmark for deep Learning applications

https://dlio-benchmark.readthedocs.io

Apache License 2.0

62 stars 27 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

New improved modelling for LLM Deepspeed.

#230 hariharan-devarajan opened 1 day ago
0
Bugfix: fix type of number for offset and size

#229 hariharan-devarajan opened 1 week ago
0
Update overview.rst

#228 mannreis opened 1 week ago
0
Improve CI Performance.

#227 hariharan-devarajan closed 1 month ago
0
For sample indexing we fix the uneven sampling

#226 hariharan-devarajan closed 1 week ago
2
IndexError: list index out of range when running custom.yaml file with custom num_files_train parameter

#225 anrahman4 closed 1 week ago
5
Fix PyPI Publish Issue and Improve Project Metadata

#224 izzet closed 1 month ago
0
Fix missing import for chunking.

#223 hariharan-devarajan closed 1 month ago
0
Changing logging levels

#222 zhenghh04 opened 1 month ago
7
Redundant shuffling

#221 zhenghh04 opened 1 month ago
0
Fixed mocking for DFTracer

#220 hariharan-devarajan closed 1 month ago
1
Is computation_time only related to the GPU model?

#219 LLJING-ER opened 1 month ago
3
Adding version fix restricts matching on python 3.9 environment.

#218 hariharan-devarajan closed 1 month ago
0
OOM Fix

#217 zhenghh04 closed 2 months ago
0
Fixed iterator to only store data for that rank.

#216 hariharan-devarajan closed 1 month ago
0
Ignore file indexing for native data loader.

#215 hariharan-devarajan closed 1 month ago
0
Only intialize and finalize on DLIOMPI

#214 hariharan-devarajan closed 1 month ago
0
Bug fix for MPI and HDF5 workloads on LC clusters

#213 hariharan-devarajan closed 2 months ago
1
Fix README CI badge

#212 izzet closed 2 months ago
0
Publish on PyPI

#211 izzet closed 2 months ago
4
Refactor `setup.py` to Enable PyPI Publishing

#210 izzet closed 2 months ago
0
DFTracer CI environment variables fixed.

#209 izzet closed 3 months ago
0
Switch DLIO Profiler to DFTracer.

#208 hariharan-devarajan closed 2 months ago
1
Fixed the MPI initialization issue

#207 zhenghh04 closed 3 months ago
0
Mlperf storage v1.0

#206 zhenghh04 closed 3 months ago
0
sync up

#205 zhenghh04 closed 3 months ago
0
Fix requirements file

#204 johnugeorge closed 3 months ago
0
sync up mlperf_storage_v1.0

#203 zhenghh04 closed 4 months ago
0
Bring v1.0 to the most recent commit

#202 zhenghh04 closed 4 months ago
0
Mlperf requests

#201 zhenghh04 closed 4 months ago
0
Fixed potential insufficient samples due to num_files is not divisible by comm.size

#200 zhenghh04 closed 4 months ago
3
Request changes from MLPerf Storage

#199 zhenghh04 closed 4 months ago
0
Fix # of files not divisible by # of accelerators

#198 LouisDDN closed 4 months ago
6
Shard filenames instead of images (tfreader)

#197 LouisDDN closed 4 months ago
0
Update config.py

#196 zhenghh04 closed 4 months ago
0
Metric updates

#195 zhenghh04 opened 4 months ago
0
Improve tfreader parsing performance (batch)

#194 LouisDDN closed 4 months ago
3
Looks like the benchmark is not calculating client memory sizes correctly in the datasize command for scale out client testing

#193 danlchilton opened 4 months ago
0
reduced tensorflow version

#192 zhenghh04 closed 4 months ago
0
Packaging

#191 zhenghh04 closed 4 months ago
0
Packaging

#190 zhenghh04 closed 4 months ago
0
Added doc for synthetic data loader and data reader

#189 zhenghh04 closed 4 months ago
0
Synthetic data support

#188 zhenghh04 closed 4 months ago
0
Generating a Cosmoflow dataset is very slow

#187 Linzsd opened 5 months ago
0
Merge from main

#186 zhenghh04 closed 5 months ago
0
Fixed Performance issue in TF Data loader

#185 zhenghh04 closed 5 months ago
0
Fixing action failure issue

#184 zhenghh04 closed 5 months ago
0
Changed from PyTorch to Tensorflow for ResNet50 and CosmoFlow

#183 zhenghh04 closed 5 months ago
0
generating indexed_binary files causes kernel OOM to kill process (#181)

#182 krehm closed 4 months ago
1
generating indexed_binary files causes kernel OOM to kill process

#181 krehm opened 6 months ago
0