-
Some notes (in no particular order) about speeding up reading many chunks of data from cloud storage.
## General info about cloud storage buckets
In general, cloud storage buckets are highly dis…
-
something similar to the way [jscodeshift](https://github.com/facebook/jscodeshift/) works (create multiple child processes and run transforms in parallel).
this should speed things up drastically wh…
-
There seem to be three principal modes with which people access data in files:
1. Reading (this is pure reading, maybe you want to read some specific byte range or read incrementally)
2. Writing (…
-
In table.smk, the rule vembrane_table calls get_vembrane_config to get the parameters for the vembrane header table. This should add the annotation fields from config.yaml.
Example from config.y…
-
How to import weight matrix generated by other software or manually ,Such as Stata or Excel (weight_matrix.dta of weight_matrix.csv)? or How to generate distance weight matrix from latitude and longit…
-
**Internal/External**
*Internal*
**Describe the feature you'd like**
The deserialization of the ledger snapshot file should fail if what was read from disk differs from what was written to disk (…
-
## Goal
Produce a pipeline to transform model outputs into datasets formatted for public consumption (website, data.cdc.gov, DCIPHER, others?).
## Pipeline structure
- Modeling outputs write …
-
Would it be possible to add support combined LZO files? For example, if I compress two files and then concatenate the compressed versions, it'd be nice to be able to decompress the combined file get t…
joey updated
13 years ago
-
Hi, this is follow-up for https://github.com/micropython/micropython/pull/13786, to not unnecessarily clutter that issue.
So up-front I think I mixed up things in my initial comment, so to clarify …
-
**Submitting author:** @gadomski (Peter Gadomski)
**Repository:** https://github.com/gadomski/antimeridian
**Branch with paper.md** (empty if default branch):
**Version:** v0.3.9
**Editor:** Pending
…