[Twisted-Python] Need words of wisdom regarding PB

Paul G paul-lists at perforge.com
Thu Jun 29 18:18:14 MDT 2006


tzahi,

it saddens me to say that you can't get it. the reason is simple: i can't 
get it either. i'd erroneously thought the code was backed up before i wiped 
a box, but that was not the case :( it is now lost, along with some other 
semi-useful stuff.

with that said, i don't think it would've been useful for what you were 
attempting - i was compressing the data before sending it over pb, while you 
seem to be interested in doing this automagically at the pb or transport 
level.

-p

----- Original Message ----- 
From: "Tzahi Fadida" <Tzahi.ML at gmail.com>
To: "Twisted general discussion" <twisted-python at twistedmatrix.com>
Sent: Wednesday, June 28, 2006 8:39 AM
Subject: Re: [Twisted-Python] Need words of wisdom regarding PB


On Wednesday 28 June 2006 14:50, Paul G wrote:
> i implemented file transfer with an optional intermediate gzip stage using
> pb a long while ago. if you're dealing with fairly low latency, a single 
> pb
> connection is fine; for higher latencies, you'll want to multiplex 
> multiple
> pb connections (this has to do with tcp, not pb). with my quick hack, i 
> was
> able to saturate a fast-e with virtually no significant cpu utilization -
> the disk io and the network were the bottlenecks.

I am also very much interested in compressing the underlying transfers using
PB. Where can we get the hack? :)
I am looking for something that is done after serialization so all features 
of
jelly remains. I.e., just before transfer, compress the data. Preferably 
with
some control, i.e., with each message i send i want to be able to say
if to compress and to what level of compression.

Currently i have to circumvent jelly by pickle and compress but i can only
do that when server sends to client since the client trusts the server.
However the server does not trust the client and thus, cannot allow pickled
objects to be unserialized.

maybe something like callRemoteCompressed...

-- 
Regards,
Tzahi.
--
Tzahi Fadida
Blog: http://tzahi.blogsite.org | Home Site: http://tzahi.webhop.info
WARNING TO SPAMMERS: see at
http://members.lycos.co.uk/my2nis/spamwarning.html

_______________________________________________
Twisted-Python mailing list
Twisted-Python at twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python 





More information about the Twisted-Python mailing list