nathanmarz dfs-datastores issues

nathanmarz / dfs-datastores

Dead-simple vertical partitioning, compression, appends, and consolidation of data on a distributed filesystem.

BSD 3-Clause "New" or "Revised" License

215 stars 82 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Can't execute any of what's show on page 68-69 of your book

#57 sb3rg opened 5 years ago
1
EMRFS workaround for creating $folder$ files

#56 jschwellach closed 8 years ago
2
Querying pail data files using Mapreduce

#55 pankug opened 8 years ago
0
Pail migrate

#54 gsriram7 closed 9 years ago
0
Compatibility with Cascading 3.0

#53 cchepelov closed 8 years ago
1
NPE on Windows

#52 gammay opened 9 years ago
1
'lein uberjar' doesn't include compiled classes for dfs-datastore

#51 bhiles opened 9 years ago
0
A VersionedTap overrides mapreduce.input.fileinputformat.inputdir without taking in account the previous values

#50 bqm opened 9 years ago
0
Problem with pail consolidation on HDFS

#49 juliankeppel opened 9 years ago
2
checkValidStructure fails when using yarn

#48 abolibibelot closed 5 years ago
0
Use the CombineFileInputFormat to avoid too many mappers

#47 hansmire opened 10 years ago
3
add parquet support

#46 sorenmacbeth opened 10 years ago
7
Mhansmire revert to hadoop 1.0.3

#45 hansmire closed 10 years ago
5
consolidator enhancements: throw exception on delete failure, add working directory as argument

#44 dkincaid opened 10 years ago
1
Check type of object being written via TypedRecordOutputStream.writeObject(obj); Override Pail.toString() for nicer printing

#43 vmarcinko opened 10 years ago
1
Issue 41. PailTap should use Hadoop configuration provided to it instead...

#42 kyrill007 closed 10 years ago
4
PailTap ignores Hadoop configuration provided to it

#41 kyrill007 closed 10 years ago
1
Comment out flaky tests and make some error messages more helpful.

#40 azymnis closed 11 years ago
1
NPE in VersionedTap.sourceConfInit

#39 mikegagnon opened 11 years ago
6
PailStructure passed to Pail.create is not used in the output stream

#38 kul opened 11 years ago
2
Modify version checker to disregard paths starting with underscores and dangling versions.

#37 azymnis closed 11 years ago
12
Enable dynamic PailStructure

#36 stevensurgnier closed 6 years ago
0
PailRecordWriter should bound number of open files

#35 derrickburns opened 11 years ago
0
Exception in .cleanupTapMetaData

#34 sritchie opened 11 years ago
0
Allow custom file formats (aside from SequenceFileFormat) to pass args

#33 baconz opened 11 years ago
6
Addresses issue #30 - file copy will utilize hadoop.tmp.dir config prope...

#32 dkincaid closed 10 years ago
0
Snapshot doesn't allow injection of a FileSystem to use for the snapshot destination

#31 dkincaid opened 11 years ago
2
Snapshot fails if process can't write to /tmp

#30 dkincaid opened 11 years ago
1
PailTap doesn't create random file names

#29 fkautz opened 11 years ago
0
Allow user to programmatically add compression codecs

#28 fkautz opened 11 years ago
0
override getModifiedTime for Cascading >= 2.1

#27 sorenmacbeth opened 11 years ago
0
Adding support for snappy.

#26 fkautz closed 11 years ago
3
LZO Compression Support

#25 ashwanthkumar closed 9 years ago
0
keep around a configurable number of versions, default 3

#24 boazavital closed 11 years ago
0
forced inclusion of cascading-core and hadoop-core

#23 sorenmacbeth opened 11 years ago
2
ClassFiles for Consolidator

#22 rahulrv1980 opened 11 years ago
0
Absorb after Consolidation doesn't work!

#21 derrickburns opened 11 years ago
0
Changes getSpecAndRoot(..) as per Oscar

#20 krishnanraman closed 11 years ago
0
Implementing shredding of BigData book ch 6.4 pail ok pailtap failing in jcascalog in hadoop under EMR

#19 ljackson closed 11 years ago
4
Use slf4j instead of log4j to support other logging backends

#18 rossabaker closed 11 years ago
1
Added support for parameterized PailStructures

#17 derrickburns closed 5 years ago
10
Added support for parameterized PailStructures

#16 derrickburns closed 11 years ago
5
Added support for parameterized PailStructures

#15 derrickburns closed 11 years ago
2
PailStructure constructor cannot be parameterized

#14 derrickburns closed 11 years ago
1
VersionedTap should take a "cleanup" parameter.

#13 sritchie opened 11 years ago
0
Problems consolidating HDFS pail

#12 derrickburns opened 11 years ago
6
PailRecordWriter using multiple OpenAttributeFiles fails to clean up

#11 derrickburns opened 11 years ago
0
Problems creating pails on s3

#10 whoahbot closed 11 years ago
9
project.clj dependencies

#9 duarten closed 11 years ago
1
JobConf Configuration should inherit from FileSystem's Configuration

#8 bm3780 closed 12 years ago
3