search

bigdata4u / spymemcached

Automatically exported from code.google.com/p/spymemcached
0 stars 0 forks source link

Client shouldn't assume maximum storable value size #106

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago 
With the latest version of the memcached one can pass -I to
specify the maximum size of a value:

http://code.google.com/p/memcached/wiki/ReleaseNotes142

So the client shouldn't make any assumptions on the size.
This is checked in CachedData.

Original issue reported on code.google.com by blair-ol...@orcaware.com on 24 Nov 2009 at 9:02

GoogleCodeExporter commented 8 years ago 
Another user encontered this as well with membase:

2011-03-01 15:55:56,408 INFO 
com.qf.index.job.DocWritableToMembaseImporterBigOnlyMR: date_published=January 
01, 1983
2011-03-01 15:56:01,620 INFO com.qf.doc.util.store.MembaseDocStore: Waiting for 
server connection to be established...
2011-03-01 15:56:02,709 ERROR 
com.qf.index.job.DocWritableToMembaseImporterBigOnlyMR: Error persisting: 
0002941658902070-0002941658902070.xml
java.lang.IllegalArgumentException: Cannot cache data larger than 1048576 bytes 
(you tried to cache a 1653567 byte object)
    at net.spy.memcached.CachedData.<init>(CachedData.java:30)
    at net.spy.memcached.transcoders.SerializingTranscoder.encode(SerializingTranscoder.java:152)
    at net.spy.memcached.MemcachedClient.asyncStore(MemcachedClient.java:383)
    at net.spy.memcached.MemcachedClient.set(MemcachedClient.java:773)
    at com.qf.doc.util.store.MembaseDocStore.put(MembaseDocStore.java:417)
    at com.qf.index.job.DocWritableToMembaseImporterBigOnlyMR$DocWritableToMembaseMapper.run(DocWritableToMembaseImporterBigOnlyMR.java:112)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:639)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:315)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1063)
    at org.apache.hadoop.mapred.Child.main(Child.java:211)

Original comment by ingen...@gmail.com on 2 Mar 2011 at 12:34

GoogleCodeExporter commented 8 years ago 
Fix is available for review:
http://review.membase.org/#change,5502

Original comment by ingen...@gmail.com on 19 Apr 2011 at 7:47

GoogleCodeExporter commented 8 years ago

Original comment by ingen...@gmail.com on 23 Apr 2011 at 12:41