Hub: Huge feed property raising new error

#
12-18 10:53PM 04.535

Waiting for RPC(urlfetch, Fetch, .., ..)

#
D 12-18 10:53PM 05.063

Retrieved 100 feed entries, 0 of which have been seen before

#
I 12-18 10:53PM 05.109

Saving 100 new/updated entries for content format='atom', 
content_type=u'application/atom+xml; charset=utf-8', header_footer_bytes=1342

#
I 12-18 10:53PM 05.246

wait_for_all_pending_rpcs(): exception in check_rpc_success()
Traceback (most recent call last):
  File "/base/python_runtime/python_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 838, in wait_for_all_pending_rpcs
    self.check_rpc_success(rpc)
  File "/base/python_runtime/python_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 977, in check_rpc_success
    raise _ToDatastoreError(err)
BadRequestError: string property payload is too long.  It cannot exceed 1000000 
characters.

#
E 12-18 10:53PM 05.287

ApplicationError: 1 string property payload is too long.  It cannot exceed 
1000000 characters.
Traceback (most recent call last):
  File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/webapp/__init__.py", line 517, in __call__
    handler.post(*groups)
  File "/base/data/home/apps/pubsubhubbub/anti-dos.347017557013756752/main.py", line 652, in decorated
    return func(myself, *args, **kwargs)
  File "/base/data/home/apps/pubsubhubbub/anti-dos.347017557013756752/main.py", line 2748, in post
    self._handle_fetches(work_list)
  File "/base/data/home/apps/pubsubhubbub/anti-dos.347017557013756752/main.py", line 2728, in _handle_fetches
    async_proxy.wait()
  File "/base/data/home/apps/pubsubhubbub/anti-dos.347017557013756752/async_apiproxy.py", line 131, in wait
    self._run_callbacks()
  File "/base/data/home/apps/pubsubhubbub/anti-dos.347017557013756752/async_apiproxy.py", line 124, in _run_callbacks
    callback()
  File "/base/data/home/apps/pubsubhubbub/anti-dos.347017557013756752/async_apiproxy.py", line 71, in <lambda>
    done_callback = lambda: user_callback(pbresponse, None)
  File "/base/data/home/apps/pubsubhubbub/anti-dos.347017557013756752/urlfetch_async.py", line 93, in completion_callback
    callback(result, user_exception)
  File "/base/data/home/apps/pubsubhubbub/anti-dos.347017557013756752/main.py", line 2449, in wrapper
    exception)
  File "/base/data/home/apps/pubsubhubbub/anti-dos.347017557013756752/main.py", line 2654, in <lambda>
    feed_record, work, fetch_url, attempts, *args)
  File "/base/data/home/apps/pubsubhubbub/anti-dos.347017557013756752/main.py", line 2708, in callback
    if parse_feed(feed_record, headers, content):
  File "/base/data/home/apps/pubsubhubbub/anti-dos.347017557013756752/main.py", line 2599, in parse_feed
    db.run_in_transaction(txn)
  File "/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py", line 1981, in RunInTransaction
    DEFAULT_TRANSACTION_RETRIES, function, *args, **kwargs)
  File "/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py", line 2067, in RunInTransactionCustomRetries
    ok, result = _DoOneTry(new_connection, function, args, kwargs)
  File "/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py", line 2088, in _DoOneTry
    result = function(*args, **kwargs)
  File "/base/data/home/apps/pubsubhubbub/anti-dos.347017557013756752/main.py", line 2584, in txn
    db.put(group)
  File "/base/python_runtime/python_lib/versions/1/google/appengine/ext/db/__init__.py", line 1354, in put
    keys = datastore.Put(entities, config=config)
  File "/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py", line 404, in Put
    return _GetConnection().async_put(config, entities, extra_hook).get_result()
  File "/base/python_runtime/python_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 601, in get_result
    self.check_success()
  File "/base/python_runtime/python_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 572, in check_success
    rpc.check_success()
  File "/base/python_runtime/python_lib/versions/1/google/appengine/api/apiproxy_stub_map.py", line 502, in check_success
    self.__rpc.CheckSuccess()
  File "/base/python_runtime/python_lib/versions/1/google/appengine/api/apiproxy_rpc.py", line 126, in CheckSuccess
    raise self.exception
ApplicationError: ApplicationError: 1 string property payload is too long.  It 
cannot exceed 1000000 characters.
Original issue reported on code.google.com by bslat...@google.com on 19 Dec 2010 at 7:00
Tallefer / pubsubhubbub

Hub: Huge feed property raising new error #128
