Return-Path: X-Original-To: distix@pieni.net Delivered-To: distix@pieni.net Received: from yaffle.pepperfish.net (yaffle.pepperfish.net [88.99.213.221]) by pieni.net (Postfix) with ESMTPS id DE52A4045A for ; Sat, 22 Jul 2017 14:18:12 +0000 (UTC) Received: from platypus.pepperfish.net (unknown [10.112.101.20]) by yaffle.pepperfish.net (Postfix) with ESMTP id 5022F4188C; Sat, 22 Jul 2017 15:18:12 +0100 (BST) Received: from ip6-localhost.nat ([::1] helo=platypus.pepperfish.net) by platypus.pepperfish.net with esmtp (Exim 4.80 #2 (Debian)) id 1dYvES-0007q0-9k; Sat, 22 Jul 2017 15:18:12 +0100 Received: from [10.112.101.21] (helo=mx3.pepperfish.net) by platypus.pepperfish.net with esmtps (Exim 4.80 #2 (Debian)) id 1dYvER-0007pp-JJ for ; Sat, 22 Jul 2017 15:18:11 +0100 Received: from koom.pieni.net ([88.99.190.206] helo=pieni.net) by mx3.pepperfish.net with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from ) id 1dYvEP-0005mu-Ez for obnam-support@obnam.org; Sat, 22 Jul 2017 15:18:11 +0100 Received: from exolobe3.liw.fi (unknown [194.111.46.68]) by pieni.net (Postfix) with ESMTPSA id D35F84045A; Sat, 22 Jul 2017 14:18:01 +0000 (UTC) Received: from liw.fi (localhost [127.0.0.1]) by exolobe3.liw.fi (Postfix) with ESMTPS id 5A2FA1256EF; Sat, 22 Jul 2017 17:17:57 +0300 (EEST) Date: Sat, 22 Jul 2017 17:17:56 +0300 From: Lars Wirzenius To: "Laurence Perkins (OE)" Message-ID: <20170722141756.yzxatuvogrdsh4jv@liw.fi> References: <1500484994.13826.5.camel@openeye.net> <20170719181232.sdqihqdqldsgzmtd@liw.fi> <1500571405.13826.8.camel@openeye.net> MIME-Version: 1.0 In-Reply-To: <1500571405.13826.8.camel@openeye.net> User-Agent: NeoMutt/20170113 (1.7.2) X-Pepperfish-Transaction: 7014-52a6-9220-c276 X-Spam-Score: -3.4 X-Spam-Score-int: -33 X-Spam-Bar: --- X-Scanned-By: pepperfish.net, Sat, 22 Jul 2017 15:18:11 +0100 X-Spam-Report: Content analysis details: (-3.4 points) pts rule name description ---- ---------------------- -------------------------------------------------- -0.5 PPF_USER_AGENT User-Agent: exists -1.0 PPF_USER_AGENT_MUTT User-Agent: contains Mutt (Mutt isn't a spam tool) -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-ACL-Warn: message may be spam X-Scan-Signature: 625f24d4d5a9233cab8b0380f6b09df7 Cc: "obnam-support@obnam.org" Subject: Re: Variable Chunksize X-BeenThere: obnam-support@obnam.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Obnam backup software discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1522547395162646860==" Mime-version: 1.0 Sender: obnam-support-bounces@obnam.org Errors-To: obnam-support-bounces@obnam.org --===============1522547395162646860== Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="rshzt4oa3ptdtden" Content-Disposition: inline --rshzt4oa3ptdtden Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable For more precise deduplication, it's almost certainly necessary to use smaller chunks than the megabyte sized ones Obnam currently uses by default. Smaller chunks mean more chunks. On Thu, Jul 20, 2017 at 05:23:37PM +0000, Laurence Perkins (OE) wrote: > When I get some spare time I'll see if I can hack it into the chunking > algorithm and test what happens with some real data sets. Please do. --=20 I want to build worthwhile things that might last. --joeyh --rshzt4oa3ptdtden Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEETNTnrewG6wEE1EJ3bC+mFux6IDEFAllzXpMACgkQbC+mFux6 IDHu5g//af12fJH8rIKKsLJxcidDgXWAnT92iyTZQWgb6IBR/+vhzcRVF9msvhNy K5DAPQWo/fnxeZvgJo/kbq2XxDPkWGfVF/2KtPZWmQKHv6vpM+IXqUeNbQcehEeL BI5ExYxpSV7rijU9LJcOgisowlWdDFyjrQPT7ShG+i3iYyNcH0BeUOGrGeSgIpgF NmygAkOeIg4b7/1VhQXxu6fy7fC0a5XgD6kFarcuzboeCnSCh1VjBVGfvnljjs+A 9q1HCRsAM9wGeAyYNFsD7WJwcSKP/VmB6eiNXTuA0DA+2X4PqT4jnoUN1lwkCIpP YKT2cbCUxtaK+GJcnrfenQzYR+ynSR5Y6zXfJ+qedOk3Nn4tt0LKiA0VQls8KK8d yUAySo6ayfXPIVOyybXVQfaFH6tOyf+jTOorb9ivW/9+WsyVTnTI8/BRLF1Arsbr VRlki91FZOPZK8vetfSFnOZZKDQ8UFQOcmtlzzEvVGuSqFFkewKjIMpRkwOQqLmz npy+OKxSxepuunnNKgv/PDX4JyBLS8ANaS4kNqnVELdF5o8LWci12ucSUCWqKEb+ JDGgKL/4k/U2GTuQ1rOwC/EKtAMIoSFL/V8n8BHftukMfsaEXtIm9KFT1Vq3qffj l3EB4qWXgPv+sj/8TJc54AxZLeK0bkZpxRmFI6upsCqrYB20gts= =f1CV -----END PGP SIGNATURE----- --rshzt4oa3ptdtden-- --===============1522547395162646860== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ obnam-support mailing list obnam-support@obnam.org http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org --===============1522547395162646860==--