search

syndicate-storage / syndicate

Internet-scale software-defined storage system
Apache License 2.0
56 stars 10 forks source link

Handle files of unknown size #20

Closed jcnelson closed 11 years ago

jcnelson commented 11 years ago

Update the UG to open and stream files of unknown size, which can be served by an AG. This will be indicated by a file having a maximum possible size. The UG should request blocks until it gets an incomplete block or runs out of user buffer space, and not rely on the file's size field.

wathsalav commented 11 years ago

Is this feature implemented? I get an EPERM when reading a "file of unknown size" from AG SQL.

jcnelson commented 11 years ago

Not yet. I'm taking care of it this weekend.

----- Original Message ----- From: "Wathsala Vithanage" notifications@github.com To: "jcnelson/syndicate" syndicate@noreply.github.com Cc: "Jude Nelson" jcnelson@CS.Princeton.EDU Sent: Wednesday, July 17, 2013 11:04:09 AM Subject: Re: [syndicate] Handle files of unknown size (#20)

Is this feature implemented? I get an EPERM when reading a "file of unknown size" from AG SQL.

— Reply to this email directly or view it on GitHub .

jcnelson commented 11 years ago

Actually, since we're using off_t to represent size, let's go ahead and define a file of unknown size as having a negative size, not a maximal size. There does not appear to be an easy way to determine the maximum positive value a signed integer type can be (NOTE: (ssize_t)pow(2,32) isn't it).