summaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authordistix ticketing system <distix@pieni.net>2017-07-24 17:21:32 +0000
committerdistix ticketing system <distix@pieni.net>2017-07-24 17:21:32 +0000
commit35d4273228ba5221acf44af81e2cd9c323a89860 (patch)
tree9225bcd5491b1c038c5fec57fa9fef01e22c4a70
parentba2d4988cb0c63bc232c32f67ce8cfd91a9ee2c6 (diff)
downloadobnam-support-distix-35d4273228ba5221acf44af81e2cd9c323a89860.tar.gz
imported mails
-rw-r--r--tickets/11c32688f6ae4c039e5fef65b5007a88/Maildir/new/1500916891.M477554P17587Q1.koom137
-rw-r--r--tickets/11c32688f6ae4c039e5fef65b5007a88/Maildir/new/1500916892.M181237P17587Q2.koom140
2 files changed, 277 insertions, 0 deletions
diff --git a/tickets/11c32688f6ae4c039e5fef65b5007a88/Maildir/new/1500916891.M477554P17587Q1.koom b/tickets/11c32688f6ae4c039e5fef65b5007a88/Maildir/new/1500916891.M477554P17587Q1.koom
new file mode 100644
index 0000000..f490991
--- /dev/null
+++ b/tickets/11c32688f6ae4c039e5fef65b5007a88/Maildir/new/1500916891.M477554P17587Q1.koom
@@ -0,0 +1,137 @@
+Return-Path: <obnam-support-bounces@obnam.org>
+X-Original-To: distix@pieni.net
+Delivered-To: distix@pieni.net
+Received: from yaffle.pepperfish.net (yaffle.pepperfish.net [88.99.213.221])
+ by pieni.net (Postfix) with ESMTPS id 5725F4044D
+ for <distix@pieni.net>; Mon, 24 Jul 2017 17:19:55 +0000 (UTC)
+Received: from platypus.pepperfish.net (unknown [10.112.101.20])
+ by yaffle.pepperfish.net (Postfix) with ESMTP id 1F9824189F;
+ Mon, 24 Jul 2017 18:19:55 +0100 (BST)
+Received: from ip6-localhost.nat ([::1] helo=platypus.pepperfish.net)
+ by platypus.pepperfish.net with esmtp (Exim 4.80 #2 (Debian))
+ id 1dZh1P-00079P-30; Mon, 24 Jul 2017 18:19:55 +0100
+Received: from [10.112.101.21] (helo=mx3.pepperfish.net)
+ by platypus.pepperfish.net with esmtps (Exim 4.80 #2 (Debian))
+ id 1dZh1O-00079E-OH
+ for <obnam-support@obnam.org>; Mon, 24 Jul 2017 18:19:54 +0100
+Received: from mail-yw0-f181.google.com ([209.85.161.181])
+ by mx3.pepperfish.net with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)
+ (Exim 4.89) (envelope-from <mathstuf@gmail.com>) id 1dZh1M-0004KK-4g
+ for obnam-support@obnam.org; Mon, 24 Jul 2017 18:19:54 +0100
+Received: by mail-yw0-f181.google.com with SMTP id a12so52984459ywh.3
+ for <obnam-support@obnam.org>; Mon, 24 Jul 2017 10:19:44 -0700 (PDT)
+DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
+ h=date:from:to:cc:subject:message-id:reply-to:references:mime-version
+ :content-disposition:in-reply-to:user-agent;
+ bh=zcZUJOIzO1CXYhMjOw+D95FO1ugfKENbXcSnTexUgQI=;
+ b=aF6S5aoCgBsK5H+xbrnZwyf0eBOJ2KJmsExogm89bMoY79qBOaeE3cJsD0bYItrNJ/
+ dSX3GW0WzVufYu75DwkO4ohgE72HpPsUavqJpey5featSYTqh/9X5dOkXK1PRYjqCwUF
+ EFlHqEVgiaeKpBDdgfRkArfogaTsOT6x5ZPbRUnlzC6JsLtQPs8SW3eVbmn5W80qwXRd
+ W/BeutugqivdUZKbRZ9TXtTVoW0ufjZ47A5cGZyfYz8PCAvzgE5VCrmdkbZMDe2V0k9x
+ xn2zXUqHs705pfR29Od/3hZyK3nFkYeyEkBUYogjOfe7goamwsEOWfd+OYZyTtH+Eb+2
+ 5Lkg==
+X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
+ d=1e100.net; s=20161025;
+ h=x-gm-message-state:date:from:to:cc:subject:message-id:reply-to
+ :references:mime-version:content-disposition:in-reply-to:user-agent;
+ bh=zcZUJOIzO1CXYhMjOw+D95FO1ugfKENbXcSnTexUgQI=;
+ b=tKkObjIhIt2gh0F5TiEa/3PtcpN97WEsB6tCwLJBVAdumeSKuZo+XHeTTlL/H+AGWL
+ 3zU15Zd2rO4kYWyMqugpNCdlx3+4KTNXX8z3cWYdvVDmFkMOmTwCwBxvVcWEnB7F6NHI
+ 2c7N4ox1Lb8Sx4C6jyQomMoTB1c3uNEHkUOXoBtUJK52aNi+PdKMeLBJFMKssMt63L/E
+ 1R8wsSDfAsi8De3dKy4JVNPu8letHqrbuT1JmnxM6h/TfIMYdFTdKVg9URhCsaehpBgO
+ gogDnZG3xIpmK+L6ef6uh0yGiD5XUqXzxuUuMg5sqqrGWUnuB3y3mCOcRB/pJ3tYmWhd
+ IdXQ==
+X-Gm-Message-State: AIVw113jQQJIpq+NGmcAvMvLK17OWjCtmmouIb/c1Qc7+012flgCwkYe
+ v5Ip9UR2+SXyhQ==
+X-Received: by 10.129.75.202 with SMTP id y193mr13621906ywa.419.1500916783367;
+ Mon, 24 Jul 2017 10:19:43 -0700 (PDT)
+Received: from localhost (tripoint.kitware.com. [66.194.253.20])
+ by smtp.gmail.com with ESMTPSA id k186sm1073097ywd.19.2017.07.24.10.19.42
+ (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256);
+ Mon, 24 Jul 2017 10:19:43 -0700 (PDT)
+Date: Mon, 24 Jul 2017 13:19:42 -0400
+From: Ben Boeckel <mathstuf@gmail.com>
+To: "Laurence Perkins (OE)" <lperkins@openeye.net>
+Message-ID: <20170724171942.GA17269@megas.kitware.com>
+References: <1500484994.13826.5.camel@openeye.net>
+ <20170719181232.sdqihqdqldsgzmtd@liw.fi>
+ <1500571405.13826.8.camel@openeye.net>
+ <20170722141756.yzxatuvogrdsh4jv@liw.fi>
+ <1500916329.13826.13.camel@openeye.net>
+MIME-Version: 1.0
+Content-Type: text/plain; charset=utf-8
+Content-Disposition: inline
+In-Reply-To: <1500916329.13826.13.camel@openeye.net>
+User-Agent: Mutt/1.8.3 (2017-05-23)
+X-Pepperfish-Transaction: 9376-3416-98d5-d378
+X-Spam-Score: 0.2
+X-Spam-Score-int: 2
+X-Spam-Bar: /
+X-Scanned-By: pepperfish.net, Mon, 24 Jul 2017 18:19:54 +0100
+X-Spam-Report: Content analysis details: (0.2 points)
+ pts rule name description
+ ---- ---------------------- --------------------------------------------------
+ 1.0 PPF_FROM_CONTAINS_MAIL The From header contains 'mail'
+ -0.5 PPF_USER_AGENT User-Agent: exists
+ -1.0 PPF_USER_AGENT_MUTT User-Agent: contains Mutt (Mutt isn't a spam
+ tool)
+ 1.2 FREEMAIL_FROM Sender email is commonly abused enduser mail provider
+ (mathstuf[at]gmail.com)
+ -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
+ [score: 0.0000]
+ -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature
+ 0.1 DKIM_SIGNED Message has a DKIM or DK signature,
+ not necessarily valid
+ -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from author's
+ domain -0.0 RCVD_IN_MSPIKE_H3 RBL: Good reputation (+3)
+ [209.85.161.181 listed in wl.mailspike.net]
+ -0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at http://www.dnswl.org/, no
+ trust [209.85.161.181 listed in list.dnswl.org]
+ 1.5 RCVD_IN_SORBS_SPAM RBL: SORBS: sender is a spam source
+ [209.85.161.181 listed in dnsbl.sorbs.net]
+ -0.0 RCVD_IN_MSPIKE_WL Mailspike good senders
+X-ACL-Warn: message may be spam
+X-Scan-Signature: 33c28d4dad91734d931da14cc3b51e8a
+Cc: "obnam-support@obnam.org" <obnam-support@obnam.org>,
+ "liw@liw.fi" <liw@liw.fi>
+Subject: Re: Variable Chunksize
+X-BeenThere: obnam-support@obnam.org
+X-Mailman-Version: 2.1.5
+Precedence: list
+Reply-To: mathstuf@gmail.com
+List-Id: Obnam backup software discussion <obnam-support-obnam.org>
+List-Unsubscribe: <http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org>,
+ <mailto:obnam-support-request@obnam.org?subject=unsubscribe>
+List-Archive: <http://listmaster.pepperfish.net/pipermail/obnam-support-obnam.org>
+List-Post: <mailto:obnam-support@obnam.org>
+List-Help: <mailto:obnam-support-request@obnam.org?subject=help>
+List-Subscribe: <http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org>,
+ <mailto:obnam-support-request@obnam.org?subject=subscribe>
+Sender: obnam-support-bounces@obnam.org
+Errors-To: obnam-support-bounces@obnam.org
+
+On Mon, Jul 24, 2017 at 17:12:15 +0000, Laurence Perkins (OE) wrote:
+> Which just made me realise what kind of space savings I could get on
+> one of my archives... I guess this just moved up the priority list a
+> ways... Any suggestions for a hash that's fast enough to crawl over
+> large files without hurting performance too much while still giving
+> reasonable control over the average chunk size?
+
+What about the hashing used by casync in its chunking? From its
+announcement[1]:
+
+ The "chunking" algorithm is based on a the buzhash rolling hash
+ function. SHA256 is used as strong hash function to generate digests
+ of the chunks. xz is used to compress the individual chunks.
+
+It sounds like you use a rolling hash to find the chunks and then store
+them according to their SHA256 hash.
+
+--Ben
+
+[1]http://0pointer.net/blog/casync-a-tool-for-distributing-file-system-images.html
+
+_______________________________________________
+obnam-support mailing list
+obnam-support@obnam.org
+http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org
diff --git a/tickets/11c32688f6ae4c039e5fef65b5007a88/Maildir/new/1500916892.M181237P17587Q2.koom b/tickets/11c32688f6ae4c039e5fef65b5007a88/Maildir/new/1500916892.M181237P17587Q2.koom
new file mode 100644
index 0000000..7d602d8
--- /dev/null
+++ b/tickets/11c32688f6ae4c039e5fef65b5007a88/Maildir/new/1500916892.M181237P17587Q2.koom
@@ -0,0 +1,140 @@
+Return-Path: <obnam-support-bounces@obnam.org>
+X-Original-To: distix@pieni.net
+Delivered-To: distix@pieni.net
+Received: from yaffle.pepperfish.net (yaffle.pepperfish.net [88.99.213.221])
+ by pieni.net (Postfix) with ESMTPS id 5EBA84020D
+ for <distix@pieni.net>; Mon, 24 Jul 2017 17:21:03 +0000 (UTC)
+Received: from platypus.pepperfish.net (unknown [10.112.101.20])
+ by yaffle.pepperfish.net (Postfix) with ESMTP id 4677B4189F;
+ Mon, 24 Jul 2017 18:21:03 +0100 (BST)
+Received: from ip6-localhost.nat ([::1] helo=platypus.pepperfish.net)
+ by platypus.pepperfish.net with esmtp (Exim 4.80 #2 (Debian))
+ id 1dZh2V-0007OV-8e; Mon, 24 Jul 2017 18:21:03 +0100
+Received: from [10.112.101.21] (helo=mx3.pepperfish.net)
+ by platypus.pepperfish.net with esmtps (Exim 4.80 #2 (Debian))
+ id 1dZh2U-0007O4-ID
+ for <obnam-support@obnam.org>; Mon, 24 Jul 2017 18:21:02 +0100
+Received: from koom.pieni.net ([88.99.190.206] helo=pieni.net)
+ by mx3.pepperfish.net with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
+ (Exim 4.89) (envelope-from <liw@liw.fi>) id 1dZh2S-0004PI-U8
+ for obnam-support@obnam.org; Mon, 24 Jul 2017 18:21:02 +0100
+Received: from exolobe3.liw.fi (82-181-57-241.bb.dnainternet.fi
+ [82.181.57.241]) by pieni.net (Postfix) with ESMTPSA id A40C5405A8;
+ Mon, 24 Jul 2017 17:20:50 +0000 (UTC)
+Received: from liw.fi (localhost [127.0.0.1])
+ by exolobe3.liw.fi (Postfix) with ESMTPS id CA4A61200EA;
+ Mon, 24 Jul 2017 20:20:44 +0300 (EEST)
+Date: Mon, 24 Jul 2017 20:20:43 +0300
+From: Lars Wirzenius <liw@liw.fi>
+To: "Laurence Perkins (OE)" <lperkins@openeye.net>
+Message-ID: <20170724172043.s2ykrfwcusyzdcgd@liw.fi>
+References: <1500484994.13826.5.camel@openeye.net>
+ <20170719181232.sdqihqdqldsgzmtd@liw.fi>
+ <1500571405.13826.8.camel@openeye.net>
+ <20170722141756.yzxatuvogrdsh4jv@liw.fi>
+ <1500916329.13826.13.camel@openeye.net>
+MIME-Version: 1.0
+In-Reply-To: <1500916329.13826.13.camel@openeye.net>
+User-Agent: NeoMutt/20170113 (1.7.2)
+X-Pepperfish-Transaction: d932-fcaa-e364-43eb
+X-Spam-Score: -3.4
+X-Spam-Score-int: -33
+X-Spam-Bar: ---
+X-Scanned-By: pepperfish.net, Mon, 24 Jul 2017 18:21:02 +0100
+X-Spam-Report: Content analysis details: (-3.4 points)
+ pts rule name description
+ ---- ---------------------- --------------------------------------------------
+ -0.5 PPF_USER_AGENT User-Agent: exists
+ -1.0 PPF_USER_AGENT_MUTT User-Agent: contains Mutt (Mutt isn't a spam
+ tool)
+ -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
+ [score: 0.0000]
+X-ACL-Warn: message may be spam
+X-Scan-Signature: 8e53bf13cb5fa4952a081d65efed4e37
+Cc: "obnam-support@obnam.org" <obnam-support@obnam.org>
+Subject: Re: Variable Chunksize
+X-BeenThere: obnam-support@obnam.org
+X-Mailman-Version: 2.1.5
+Precedence: list
+List-Id: Obnam backup software discussion <obnam-support-obnam.org>
+List-Unsubscribe: <http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org>,
+ <mailto:obnam-support-request@obnam.org?subject=unsubscribe>
+List-Archive: <http://listmaster.pepperfish.net/pipermail/obnam-support-obnam.org>
+List-Post: <mailto:obnam-support@obnam.org>
+List-Help: <mailto:obnam-support-request@obnam.org?subject=help>
+List-Subscribe: <http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org>,
+ <mailto:obnam-support-request@obnam.org?subject=subscribe>
+Content-Type: multipart/mixed; boundary="===============8879255905254956802=="
+Mime-version: 1.0
+Sender: obnam-support-bounces@obnam.org
+Errors-To: obnam-support-bounces@obnam.org
+
+
+--===============8879255905254956802==
+Content-Type: multipart/signed; micalg=pgp-sha512;
+ protocol="application/pgp-signature"; boundary="jfkiq2sxlnslxmsw"
+Content-Disposition: inline
+
+
+--jfkiq2sxlnslxmsw
+Content-Type: text/plain; charset=us-ascii
+Content-Disposition: inline
+Content-Transfer-Encoding: quoted-printable
+
+On Mon, Jul 24, 2017 at 05:12:15PM +0000, Laurence Perkins (OE) wrote:
+> Smaller chunk size makes deduplication more precise regardless of the
+> type of splitting, but it should generate some pretty big savings on
+> similar data without reducing the chunk size because it will be better
+> at finding identical chunks of data since it's not relying on them
+> being at fixed offsets.
+
+If you have actual measurements of this, please report them. Some
+years ago when this idea first came up in the Obnam context, using
+the proposed type of chunking without reducing chunk size
+significatnly didn't much help in de-duplication. Only when the
+average chunk size became much smaller, did de-deuplication get a lot
+better, but then the number of chunks became a problem.
+
+Guessing isn't helpful here. Even if it were, now is not a good time
+for me to spend any time on this, and I don't want to even consider a
+patch for this until green albatross is in shape.
+
+--=20
+I want to build worthwhile things that might last. --joeyh
+
+--jfkiq2sxlnslxmsw
+Content-Type: application/pgp-signature; name="signature.asc"
+
+-----BEGIN PGP SIGNATURE-----
+
+iQIzBAABCgAdFiEETNTnrewG6wEE1EJ3bC+mFux6IDEFAll2LGoACgkQbC+mFux6
+IDFfGxAAidaVMXQm4i+pWmu/07be3VuWFJmFgS8Yvp8uXvVd835agOQqypsk775l
+jS0KnrXazzVv6lg0PjXOsLQONYRJ9IQQ6wwEBieWc2Q22cSJFyH+VMibIPb3+Tnj
+Gu6OA161CCAK0qpnaq6fo7fJsf9JYWcEMYWUhM9u43YVuULVlYZf3OFlXueJTt0y
+yaXQfHZYYLoJUz84nIhj4bxBCyL9GjMYfY9FowyDb24pz9CkGtcOubAiskt4hs0f
+tL2n05hfnN1fUfv7ukXC1vdbPlGGCLzZmfvBg4grqP8crAqW3P5fYMhci5rQsllh
+6e03f+Mwh/w+oFGsff86mwpBCgCpFhU6a4RmREPB4n2A1apmtlhXTXwAioryZIg2
+gKlMWXe3OcZAlrZyKrM2lZK56B9M96G2JKIOY2bytquTWDzaEdxTxOHZgnPVVLQx
+fPNZvl8tBvFp7XYNtgI0hiyZn/wD5mHR1eC3ji7KiEuKnq3rG9QK9JgI3OfJ95eG
+abJdZ/YqtebSZkJytbSKV18nTFffvazf3k+sDpkWFHXAC7YgaNM8OR7gb4HXiNqY
+V0iNDLV88XMNX3lNv3DJEks+5ejAPo932kbHrYQFiofTlMnRWRx9wVAPcGcD+dv+
+TlrnyhLrZg3uJxxGfSg2mQ7Xq07+FO2ELqlheOSu0tnuq2GNEW4=
+=2hi6
+-----END PGP SIGNATURE-----
+
+--jfkiq2sxlnslxmsw--
+
+
+--===============8879255905254956802==
+Content-Type: text/plain; charset="us-ascii"
+MIME-Version: 1.0
+Content-Transfer-Encoding: 7bit
+Content-Disposition: inline
+
+_______________________________________________
+obnam-support mailing list
+obnam-support@obnam.org
+http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org
+
+--===============8879255905254956802==--
+