[Twisted-Python] hardcoded SIZE_LIMIT
Jp Calderone
exarkun at intarweb.us
Wed Oct 8 08:46:21 MDT 2003
On Wed, Oct 08, 2003 at 10:40:10AM +0200, Christoph Wiedemann wrote:
> Hello,
>
> i'm trying to use PB for remote procedure calls in the context of numeric
> computations. So far things work really well (Twisted is a real cool piece of
> software!), but now i'm trapped by twisted.spread.banana.SIZE_LIMIT. I need to
> send pretty much data over the network (~512 MB) and tried out to set the
> SIZE_LIMIT to 640 MB. Hmm, still getting the "String too long exception", cause
> the 640 kB are hardcoded in cBanana.c. Any chances to make the limit
> configurable ?
>
Check out twisted.spread.util.StringPager -- it uses the Producer/Consumer
pattern to send the string a piece at a time. This will reduce memory usage
and probably increase network performance, since smaller chunks are being
serialized and transmitted only once the network is ready for them.
Jp
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: Digital signature
URL: </pipermail/twisted-python/attachments/20031008/42b0a2ed/attachment.sig>
More information about the Twisted-Python
mailing list