-
Since Presto is upgraded to Parquet 1.12+, we can implement the bloom filter feature.
-
BloomFilter size keeps increasing when serializing and deserializing with kryo ?
Below is the relevant code
```
import com.esotericsoftware.kryo.kryo5.Kryo;
import com.esotericsoftware.kryo.kryo…
-
I want the ability to download a file of bad domain names and be able to block domains if they are in that file
This would require some sort of fast lookup data structure.
- BloomFilter
- P…
-
It's a minor issue, alas, it requires changes to the file format which might be a hassle.
``` python
>> fruit = pybloomfilter.BloomFilter(100000, 0.1, '/tmp/words.bloom')
>> fruit.update(('apple', '…
-
We are facing issues with installing peleton-bloomfilter module .It was showing subprocess error with exit status 1.And python setup.py bdist_wheel did not run successfully.
-
-
```
Current BloomFilter sizing estimate is overly conservative and could result
in excessive memory usage. Consider the case where the MergeScanner returns
the following cells to be considered for ins…
-
I'm unable to create a bloomfilter for a field, when I perform writes with repeating values. The bloomfilter returned is null when I try to read such a parquet file. If there are no repeating values, …
-
```r
library(disk.frame)
a = data.frame(id = sample(1:100, 1000, replace=TRUE), values = runif(1000))
adf = as.disk.frame(a, nchunks = 6)
adf_sharded = adf %>%
mutate(rand_chunk = sample(1:2…
-
- [x] Assess [xor filters](https://lemire.me/blog/2019/12/19/xor-filters-faster-and-smaller-than-bloom-filters/) *Notes:* The paper is quite confusing. It takes much longer to create a filter.
- […