[Twisted-Python] Backup Agent

[Christopher Armstrong]

Michal Pasternak wrote:
> David A. Leedom [Mon, Feb 16, 2004 at 10:03:37AM -0500]:

>>2.      What would be the best approach using twisted to transmit a file 
>>system catalog across the local wire.  I was playing with some remote 
>>procedure calls over the weekend that seemed to work.  I am thinking I 
>>could create a class that would gather the local file system and send it 
>>over the wire as one lump.
> 
> 
> Remote procedures have limit of 640 KB for their parameters (because "640 KB
> should be enough to anyone"). You should use Pager and Collector.
> 
> >>3.      If I am going to transmit a backup file (<500meg) over the wire to 
>>another local computer what is the best Twisted approach to take?
> 
> 
> See above. Also, please remember, that memory issues matter. If you're
> paging the data (send small chunks), you should save them on the backup
> server, as they are received. If you are transfering a big file, keeping all
> the data received in some buffer is a bad idea. 

PB probably isn't good for massive file transfer like that. I'd either 
use an existing tool like rsync or http or whatever, or roll a trivial 
protocol that just sends length_of_data:data.


-- 
  Twisted | Christopher Armstrong: International Man of Twistery
   Radix  |          Release Manager,  Twisted Project
---------+           http://radix.twistedmatrix.com/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 256 bytes
Desc: OpenPGP digital signature
URL: </pipermail/twisted-python/attachments/20040216/2ccfe6d3/attachment.sig>