DataBiosphere getm issues

DataBiosphere / getm

Concurrent reads of HTTP URL addressed data

MIT License

6 stars 1 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Catch subprocess errors

#136 xbrianh opened 5 months ago
0
Failure to end process or retry upon connection reset error

#135 abaumann opened 7 months ago
4
Limit Requests Version

#134 THWiseman closed 1 year ago
0
urllib3 method API Change

#133 THWiseman opened 1 year ago
0
Python 3.7 backport for sharedmemory does not compile on Mac OS

#132 aofarrel opened 2 years ago
0
Credits

#131 xbrianh closed 3 years ago
0
Move repository to the DataBiosphere GitHub org

#130 xbrianh closed 3 years ago
0
Document the Python 3.7 backport of sharedmemory

#129 xbrianh closed 3 years ago
0
dev script to resize shm so we don't forget how

#128 xbrianh closed 3 years ago
0
Reduce chunk_size and warn if /dev/shm constrained

#127 xbrianh closed 3 years ago
0
Fix max read size calculation in keep alive reader

#126 xbrianh closed 3 years ago
0
Fix progress increments

#125 xbrianh closed 3 years ago
0
Fix type hint

#124 xbrianh closed 3 years ago
0
Add test: ConcurrentHeap with constant priority submissions

#123 xbrianh opened 3 years ago
0
bump mypy

#122 xbrianh closed 3 years ago
0
Fix collision bug in ConcurrentHeap

#121 xbrianh closed 3 years ago
0
Document manifest CLI feature in readme

#120 xbrianh opened 3 years ago
0
Update progress bar more frequently.

#119 xbrianh closed 3 years ago
0
Limit progress bar name to 40 characters

#118 xbrianh closed 3 years ago
0
Create subdirectores as needed for download target

#117 xbrianh closed 3 years ago
0
Fix type hint

#116 xbrianh closed 3 years ago
0
Use ConcurrentHeap to prioritize small downloads

#115 xbrianh closed 3 years ago
0
Introduce concurrent.collections.ConcurrentHeap

#114 xbrianh closed 3 years ago
0
Add _download utility method

#113 xbrianh closed 3 years ago
0
Make CLI exit on error more explicit

#112 xbrianh closed 3 years ago
0
Relax concurrency constraints, default to # of CPUs

#111 xbrianh closed 3 years ago
0
Check for URL accessibility before download

#110 xbrianh closed 3 years ago
0
Xbrianh refactor url gen scripts

#109 xbrianh closed 3 years ago
0
Include response in http.accessable

#108 xbrianh closed 3 years ago
0
CLI defaults to fails fast, argument to fail slow

#107 xbrianh closed 3 years ago
0
Test CLI arguments and config

#106 xbrianh closed 3 years ago
0
Fix CLI concurrency arg types and constraints

#105 xbrianh closed 3 years ago
0
Refactor CLI logging with stateful structure

#104 xbrianh closed 3 years ago
0
Util function to quiet stdout, stderr, and logging

#103 xbrianh closed 3 years ago
0
Import entire cli module into tests

#102 xbrianh closed 3 years ago
0
CLI argument to halt batch downloads eagerly on error

#101 xbrianh closed 3 years ago
0
CLI should return non-zero exit status if any download fails

#100 xbrianh closed 3 years ago
1
Post upgrade message to CLI users when new version is available.

#99 xbrianh opened 3 years ago
0
Update progress bar more often

#98 xbrianh closed 3 years ago
0
Better assignment of progress indicator type

#97 xbrianh closed 3 years ago
0
Ensure streamed http responses are closed

#96 xbrianh closed 3 years ago
0
Ensure multipart buffer is only sized once

#95 xbrianh closed 3 years ago
0
Create subdirectories as needed for local filepath

#94 xbrianh closed 3 years ago
0
Add dev script to generate s3 signed URLs

#93 xbrianh closed 3 years ago
0
Add http function to probe URL accessibility

#92 xbrianh closed 3 years ago
0
Add TTL for http.head cache

#91 xbrianh opened 3 years ago
0
Improve checksum failure reporting for the CLI

#90 xbrianh opened 3 years ago
0
Add verbosity modes to CLI

#89 xbrianh closed 3 years ago
0
Correctly report url for failed downloads

#88 xbrianh closed 3 years ago
0
Dynamically allocate shared memory

#87 xbrianh closed 3 years ago
0