search

oss-tsukuba / gfarm

distributed file system for large-scale cluster computing and wide-area data sharing. provides fine-grained replica location control.
Other
32 stars 12 forks source link

file contents validation by using md5 checksum #749

Closed gfarm-admin closed 4 years ago

gfarm-admin commented 10 years ago

Same ticket on a different branch:

Reported by: n-soda

Original Ticket: gfarm/tickets/749

gfarm-admin commented 10 years ago

implemented by tatebe@-san on the 2.5 branch:

xattr based implemenation: [r8837], [r8838], [r8839], [r8847], [r8848] gfspoolmd5 command: [r8840], [r8841], [r8842], [r8843], [r8844], [r8845], [r8849], [r8850], [r8851], [r8853], [r8854] [r8859]: undo [r8848], [r8839], [r8838] (i.e. undo new xattr protocols, new -I option in the gfxattr command, to specify an inode number) [r8860]: new protocol GFM_PROTO_FHOPEN, and new API: gfs_pio_fhopen(), gfs_pio_fhopendir(), gfs_fgetdirpath [#750] [r8861]: new -I option in the gfxattr command, to specify an inode number [#750] [r8862], [r8865]: gfspoolmd5 - use new API gfs_pio_fhopen() [#750] [r8869], [r8870]: checkopint file .md5.count [r8875], [r8876]: gfspoolmd5 - new option -m to specify only recently changed files [r8881]: md5 functions are moved from gfspoolmd5 to gfutil [r8882], [r8884], [r8927]: "kdigest" directive in gfarm2.conf [r8886]: check checksum when reading entire file [r8889], [r8902]: new protocol GFS_PROTO_CKSUM, new APIs gfs_stat_cksum() and gfs_pio_cksum(), make gfs_pio_close() return checksum mismatch error, new command gfcksum [r8890]: eliminate unused old code [r8914]: make gfarm_foreach() process files first (XXX implementation is not optimal, though) [r8915], [r8918]: make checksum len handling consistent [r8916], [r8917], [r8919]: gfcksum command - new option -v and -c [r8921], [r8922]: gfcksum man page [r8929]: gfs_pio_read() does not return an error, if part of data is already read [r8930], [r8931]: return a checksum error in GFS_PROTO_PREAD, when the entire file is read

[r8920]: let grid ftp server check an error code of gfs_pio_close()

Original comment by: n-soda

gfarm-admin commented 10 years ago

[r8932] made the following changes

Original comment by: n-soda

gfarm-admin commented 10 years ago

some issues in [r8930] and [r8931] are fixed in the following revisions by tatebe@-san on the 2.5 branch: [r8935], [r8944], [r8945], [r8946], [r8947], [r8950]

Original comment by: n-soda

gfarm-admin commented 10 years ago

errors and warnings on Solaris 9 are fixed in [r8962]

Original comment by: n-soda

gfarm-admin commented 10 years ago

Original comment by: otatebe

gfarm-admin commented 10 years ago

on 2.6 branch in [r9188]: make gfarm2fs report EIO instead of EINVAL, when GFARM_ERR_CHECKSUM_ERROR happens.

Original comment by: n-soda

gfarm-admin commented 9 years ago

Diff:


--- old
+++ new
@@ -0,0 +1,5 @@
+* * *
+
+Same ticket on a different branch:
+
+ * main trunk: [#886]

Original comment by: n-soda

gfarm-admin commented 9 years ago

this feature was first released as gfarm-2.5.8.5, some fixes were made until gfarm-2.5.8.10, regression tests were added in gfarm-2.5.8.13

Original comment by: n-soda