From 8c087e41fdda5d9508b9c95ea57fbd079142633d Mon Sep 17 00:00:00 2001 From: Lars Wirzenius Date: Sat, 20 Feb 2016 22:10:13 +0200 Subject: imported mails --- .../cur/.this-dir-not-empty/.empty/empty-file | 0 .../new/.this-dir-not-empty/.empty/empty-file | 0 .../new/1455999009.M394505P17339Q199.exolobe1 | 115 ++++++++++++++++++++ .../new/1455999009.M427716P17339Q200.exolobe1 | 115 ++++++++++++++++++++ .../new/1455999009.M439127P17339Q201.exolobe1 | 116 +++++++++++++++++++++ .../tmp/.this-dir-not-empty/.empty/empty-file | 0 .../8df68737194d4fda872886ac1398485b/ticket.yaml | 4 + 7 files changed, 350 insertions(+) create mode 100644 tickets/8df68737194d4fda872886ac1398485b/Maildir/cur/.this-dir-not-empty/.empty/empty-file create mode 100644 tickets/8df68737194d4fda872886ac1398485b/Maildir/new/.this-dir-not-empty/.empty/empty-file create mode 100644 tickets/8df68737194d4fda872886ac1398485b/Maildir/new/1455999009.M394505P17339Q199.exolobe1 create mode 100644 tickets/8df68737194d4fda872886ac1398485b/Maildir/new/1455999009.M427716P17339Q200.exolobe1 create mode 100644 tickets/8df68737194d4fda872886ac1398485b/Maildir/new/1455999009.M439127P17339Q201.exolobe1 create mode 100644 tickets/8df68737194d4fda872886ac1398485b/Maildir/tmp/.this-dir-not-empty/.empty/empty-file create mode 100644 tickets/8df68737194d4fda872886ac1398485b/ticket.yaml (limited to 'tickets/8df68737194d4fda872886ac1398485b') diff --git a/tickets/8df68737194d4fda872886ac1398485b/Maildir/cur/.this-dir-not-empty/.empty/empty-file b/tickets/8df68737194d4fda872886ac1398485b/Maildir/cur/.this-dir-not-empty/.empty/empty-file new file mode 100644 index 0000000..e69de29 diff --git a/tickets/8df68737194d4fda872886ac1398485b/Maildir/new/.this-dir-not-empty/.empty/empty-file b/tickets/8df68737194d4fda872886ac1398485b/Maildir/new/.this-dir-not-empty/.empty/empty-file new file mode 100644 index 0000000..e69de29 diff --git a/tickets/8df68737194d4fda872886ac1398485b/Maildir/new/1455999009.M394505P17339Q199.exolobe1 b/tickets/8df68737194d4fda872886ac1398485b/Maildir/new/1455999009.M394505P17339Q199.exolobe1 new file mode 100644 index 0000000..1c6ce4d --- /dev/null +++ b/tickets/8df68737194d4fda872886ac1398485b/Maildir/new/1455999009.M394505P17339Q199.exolobe1 @@ -0,0 +1,115 @@ +Return-Path: +X-Original-To: distix@pieni.net +Delivered-To: distix@pieni.net +Received: from bagpuss.pepperfish.net (bagpuss.pepperfish.net [148.251.8.16]) + (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) + (No client certificate requested) + by pieni.net (Postfix) with ESMTPS id 483C52E2E1 + for ; Sat, 17 Oct 2015 19:55:06 +0200 (CEST) +Received: from platypus.pepperfish.net (unknown [10.112.100.20]) + by bagpuss.pepperfish.net (Postfix) with ESMTP id AE4D2BBD; + Sat, 17 Oct 2015 18:55:05 +0100 (BST) +Received: from ip6-localhost ([::1] helo=platypus.pepperfish.net) + by platypus.pepperfish.net with esmtp (Exim 4.80 #2 (Debian)) + id 1ZnVhB-0004Vo-JJ; Sat, 17 Oct 2015 18:55:05 +0100 +Received: from inmail0 ([10.112.100.10] helo=mx0.pepperfish.net) + by platypus.pepperfish.net with esmtp (Exim 4.80 #2 (Debian)) + id 1ZnVhA-0004VM-7u + for ; Sat, 17 Oct 2015 18:55:04 +0100 +Received: from mailout.easymail.ca ([64.68.201.169]) + by mx0.pepperfish.net with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:256) + (Exim 4.80) (envelope-from ) + id 1ZnVh7-0006Ku-1D + for obnam-dev@obnam.org; Sat, 17 Oct 2015 18:55:04 +0100 +Received: from localhost (localhost [127.0.0.1]) + by mailout.easymail.ca (Postfix) with ESMTP id AD899EAF8 + for ; Sat, 17 Oct 2015 13:54:50 -0400 (EDT) +X-Virus-Scanned: Debian amavisd-new at mailout.easymail.ca +X-Spam-Flag: NO +X-Spam-Score: -3.681 +X-Spam-Level: +X-Spam-Status: No, score=-3.681 required=5 tests=[ALL_TRUSTED=-1.8, AWL=0.026, + BAYES_00=-2.599, DNS_FROM_AHBL_RHSBL=0.692] +Received: from mailout.easymail.ca ([127.0.0.1]) + by localhost (easymail-mailout.easydns.vpn [127.0.0.1]) (amavisd-new, + port 10024) with ESMTP id q5i63X3--m9U for ; + Sat, 17 Oct 2015 13:54:50 -0400 (EDT) +Received: from mail-io0-f174.google.com (mail-io0-f174.google.com + [209.85.223.174]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) + (No client certificate requested) + by mailout.easymail.ca (Postfix) with ESMTPSA id 5223BEA8D + for ; Sat, 17 Oct 2015 13:54:50 -0400 (EDT) +Received: by iodv82 with SMTP id v82so153037402iod.0 + for ; Sat, 17 Oct 2015 10:54:50 -0700 (PDT) +MIME-Version: 1.0 +X-Received: by 10.107.18.91 with SMTP id a88mr3405229ioj.91.1445104490055; + Sat, 17 Oct 2015 10:54:50 -0700 (PDT) +Received: by 10.107.142.141 with HTTP; Sat, 17 Oct 2015 10:54:50 -0700 (PDT) +Date: Sat, 17 Oct 2015 20:54:50 +0300 +Message-ID: +From: Henri Sivonen +To: obnam-dev@obnam.org +Content-Type: text/plain; charset=UTF-8 +X-Spam-Score: -2.1 +X-Spam-Score-int: -20 +X-Spam-Bar: -- +X-Scanned-By: pepperfish.net, Sat, 17 Oct 2015 18:55:04 +0100 +X-Spam-Report: Content analysis details: (-2.1 points) + pts rule name description + ---- ---------------------- -------------------------------------------------- + 0.5 PPF_RECEIVED_HTTP Received header mentions http + -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low + trust [64.68.201.169 listed in list.dnswl.org] + -0.0 SPF_PASS SPF: sender matches SPF record + -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% + [score: 0.0000] +X-ACL-Warn: message may be spam +X-Scan-Signature: fc828f4ee22ea391207ca0493f0eb918 +Subject: Enhancement: Avoid storing compressed data when compression would + expand data +X-BeenThere: obnam-dev@obnam.org +X-Mailman-Version: 2.1.5 +Precedence: list +List-Id: Obnam development discussions +List-Unsubscribe: , + +List-Archive: +List-Post: +List-Help: +List-Subscribe: , + +Sender: obnam-dev-bounces@obnam.org +Errors-To: obnam-dev-bounces@obnam.org + +I have made a minor improvement to avoid storing compressed data even +when compression has been enabled in cases where compression (plus +tagging) would end up expanding the data. This avoids space waste upon +transfer and storage and compute waste upon reading. + +The change is available for pulling from the "no-expansion" branch of +the repo https://github.com/hsivonen/obnam.git (the branch contains +nothing else). Web view of the changeset: +https://github.com/hsivonen/obnam/commit/5002965ad28c89a08c370efa880a060cf7835dbd +Patch format: +https://github.com/hsivonen/obnam/commit/5002965ad28c89a08c370efa880a060cf7835dbd.patch + +I have tested the patch manually with a directory containing two files +generated with +$ head -c 1024 /dev/urandom > rand +$ head -c 1024 /dev/zero > zero +(rand doesn't compress and zero compresses very well.) + +However, I'm currently unfamiliar with the workings of yarn, so I +haven't added automated tests. If the patch isn't acceptable without +tests, I'd appreciate advice on how to do the kind of testing that +looks inside the chunk data stored in the repo. + +-- +Henri Sivonen +hsivonen@hsivonen.fi +https://hsivonen.fi/ + +_______________________________________________ +obnam-dev mailing list +obnam-dev@obnam.org +http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-dev-obnam.org diff --git a/tickets/8df68737194d4fda872886ac1398485b/Maildir/new/1455999009.M427716P17339Q200.exolobe1 b/tickets/8df68737194d4fda872886ac1398485b/Maildir/new/1455999009.M427716P17339Q200.exolobe1 new file mode 100644 index 0000000..1c6ce4d --- /dev/null +++ b/tickets/8df68737194d4fda872886ac1398485b/Maildir/new/1455999009.M427716P17339Q200.exolobe1 @@ -0,0 +1,115 @@ +Return-Path: +X-Original-To: distix@pieni.net +Delivered-To: distix@pieni.net +Received: from bagpuss.pepperfish.net (bagpuss.pepperfish.net [148.251.8.16]) + (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) + (No client certificate requested) + by pieni.net (Postfix) with ESMTPS id 483C52E2E1 + for ; Sat, 17 Oct 2015 19:55:06 +0200 (CEST) +Received: from platypus.pepperfish.net (unknown [10.112.100.20]) + by bagpuss.pepperfish.net (Postfix) with ESMTP id AE4D2BBD; + Sat, 17 Oct 2015 18:55:05 +0100 (BST) +Received: from ip6-localhost ([::1] helo=platypus.pepperfish.net) + by platypus.pepperfish.net with esmtp (Exim 4.80 #2 (Debian)) + id 1ZnVhB-0004Vo-JJ; Sat, 17 Oct 2015 18:55:05 +0100 +Received: from inmail0 ([10.112.100.10] helo=mx0.pepperfish.net) + by platypus.pepperfish.net with esmtp (Exim 4.80 #2 (Debian)) + id 1ZnVhA-0004VM-7u + for ; Sat, 17 Oct 2015 18:55:04 +0100 +Received: from mailout.easymail.ca ([64.68.201.169]) + by mx0.pepperfish.net with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:256) + (Exim 4.80) (envelope-from ) + id 1ZnVh7-0006Ku-1D + for obnam-dev@obnam.org; Sat, 17 Oct 2015 18:55:04 +0100 +Received: from localhost (localhost [127.0.0.1]) + by mailout.easymail.ca (Postfix) with ESMTP id AD899EAF8 + for ; Sat, 17 Oct 2015 13:54:50 -0400 (EDT) +X-Virus-Scanned: Debian amavisd-new at mailout.easymail.ca +X-Spam-Flag: NO +X-Spam-Score: -3.681 +X-Spam-Level: +X-Spam-Status: No, score=-3.681 required=5 tests=[ALL_TRUSTED=-1.8, AWL=0.026, + BAYES_00=-2.599, DNS_FROM_AHBL_RHSBL=0.692] +Received: from mailout.easymail.ca ([127.0.0.1]) + by localhost (easymail-mailout.easydns.vpn [127.0.0.1]) (amavisd-new, + port 10024) with ESMTP id q5i63X3--m9U for ; + Sat, 17 Oct 2015 13:54:50 -0400 (EDT) +Received: from mail-io0-f174.google.com (mail-io0-f174.google.com + [209.85.223.174]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) + (No client certificate requested) + by mailout.easymail.ca (Postfix) with ESMTPSA id 5223BEA8D + for ; Sat, 17 Oct 2015 13:54:50 -0400 (EDT) +Received: by iodv82 with SMTP id v82so153037402iod.0 + for ; Sat, 17 Oct 2015 10:54:50 -0700 (PDT) +MIME-Version: 1.0 +X-Received: by 10.107.18.91 with SMTP id a88mr3405229ioj.91.1445104490055; + Sat, 17 Oct 2015 10:54:50 -0700 (PDT) +Received: by 10.107.142.141 with HTTP; Sat, 17 Oct 2015 10:54:50 -0700 (PDT) +Date: Sat, 17 Oct 2015 20:54:50 +0300 +Message-ID: +From: Henri Sivonen +To: obnam-dev@obnam.org +Content-Type: text/plain; charset=UTF-8 +X-Spam-Score: -2.1 +X-Spam-Score-int: -20 +X-Spam-Bar: -- +X-Scanned-By: pepperfish.net, Sat, 17 Oct 2015 18:55:04 +0100 +X-Spam-Report: Content analysis details: (-2.1 points) + pts rule name description + ---- ---------------------- -------------------------------------------------- + 0.5 PPF_RECEIVED_HTTP Received header mentions http + -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low + trust [64.68.201.169 listed in list.dnswl.org] + -0.0 SPF_PASS SPF: sender matches SPF record + -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% + [score: 0.0000] +X-ACL-Warn: message may be spam +X-Scan-Signature: fc828f4ee22ea391207ca0493f0eb918 +Subject: Enhancement: Avoid storing compressed data when compression would + expand data +X-BeenThere: obnam-dev@obnam.org +X-Mailman-Version: 2.1.5 +Precedence: list +List-Id: Obnam development discussions +List-Unsubscribe: , + +List-Archive: +List-Post: +List-Help: +List-Subscribe: , + +Sender: obnam-dev-bounces@obnam.org +Errors-To: obnam-dev-bounces@obnam.org + +I have made a minor improvement to avoid storing compressed data even +when compression has been enabled in cases where compression (plus +tagging) would end up expanding the data. This avoids space waste upon +transfer and storage and compute waste upon reading. + +The change is available for pulling from the "no-expansion" branch of +the repo https://github.com/hsivonen/obnam.git (the branch contains +nothing else). Web view of the changeset: +https://github.com/hsivonen/obnam/commit/5002965ad28c89a08c370efa880a060cf7835dbd +Patch format: +https://github.com/hsivonen/obnam/commit/5002965ad28c89a08c370efa880a060cf7835dbd.patch + +I have tested the patch manually with a directory containing two files +generated with +$ head -c 1024 /dev/urandom > rand +$ head -c 1024 /dev/zero > zero +(rand doesn't compress and zero compresses very well.) + +However, I'm currently unfamiliar with the workings of yarn, so I +haven't added automated tests. If the patch isn't acceptable without +tests, I'd appreciate advice on how to do the kind of testing that +looks inside the chunk data stored in the repo. + +-- +Henri Sivonen +hsivonen@hsivonen.fi +https://hsivonen.fi/ + +_______________________________________________ +obnam-dev mailing list +obnam-dev@obnam.org +http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-dev-obnam.org diff --git a/tickets/8df68737194d4fda872886ac1398485b/Maildir/new/1455999009.M439127P17339Q201.exolobe1 b/tickets/8df68737194d4fda872886ac1398485b/Maildir/new/1455999009.M439127P17339Q201.exolobe1 new file mode 100644 index 0000000..2dabb95 --- /dev/null +++ b/tickets/8df68737194d4fda872886ac1398485b/Maildir/new/1455999009.M439127P17339Q201.exolobe1 @@ -0,0 +1,116 @@ +Return-Path: +X-Original-To: distix@pieni.net +Delivered-To: distix@pieni.net +Received: from bagpuss.pepperfish.net (bagpuss.pepperfish.net [148.251.8.16]) + (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) + (No client certificate requested) + by pieni.net (Postfix) with ESMTPS id CE3712F095 + for ; Mon, 19 Oct 2015 21:20:35 +0200 (CEST) +Received: from platypus.pepperfish.net (unknown [10.112.100.20]) + by bagpuss.pepperfish.net (Postfix) with ESMTP id 2AA28B8A; + Mon, 19 Oct 2015 20:20:35 +0100 (BST) +Received: from ip6-localhost ([::1] helo=platypus.pepperfish.net) + by platypus.pepperfish.net with esmtp (Exim 4.80 #2 (Debian)) + id 1ZoFz0-0002S8-WF; Mon, 19 Oct 2015 20:20:35 +0100 +Received: from inmail0 ([10.112.100.10] helo=mx0.pepperfish.net) + by platypus.pepperfish.net with esmtp (Exim 4.80 #2 (Debian)) + id 1ZoFyz-0002S1-9Q + for ; Mon, 19 Oct 2015 20:20:33 +0100 +Received: from pieni.net ([95.142.166.37] ident=postfix) + by mx0.pepperfish.net with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) + (Exim 4.80) (envelope-from ) id 1ZoFyw-0001QV-QL + for obnam-dev@obnam.org; Mon, 19 Oct 2015 20:20:33 +0100 +Received: from exolobe1.liw.fi (82-181-8-107.bb.dnainternet.fi [82.181.8.107]) + (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) + (No client certificate requested) + by pieni.net (Postfix) with ESMTPSA id D979A2F089; + Mon, 19 Oct 2015 21:20:23 +0200 (CEST) +Received: from exolobe1.liw.fi (localhost [127.0.0.1]) + by exolobe1.liw.fi (Postfix) with ESMTPS id 215924050E; + Mon, 19 Oct 2015 22:20:23 +0300 (EEST) +Date: Mon, 19 Oct 2015 22:20:22 +0300 +From: Lars Wirzenius +To: Henri Sivonen +Message-ID: <20151019192022.GK2563@exolobe1.liw.fi> +References: +MIME-Version: 1.0 +Content-Type: text/plain; charset=iso-8859-1 +Content-Disposition: inline +Content-Transfer-Encoding: 8bit +In-Reply-To: +User-Agent: Mutt/1.5.23 (2014-03-12) +X-Spam-Score: -3.4 +X-Spam-Score-int: -33 +X-Spam-Bar: --- +X-Scanned-By: pepperfish.net, Mon, 19 Oct 2015 20:20:33 +0100 +X-Spam-Report: Content analysis details: (-3.4 points) + pts rule name description + ---- ---------------------- -------------------------------------------------- + -1.0 PPF_USER_AGENT_MUTT User-Agent: contains Mutt (Mutt isn't a spam + tool) -0.5 PPF_USER_AGENT User-Agent: exists + -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% + [score: 0.0000] +X-ACL-Warn: message may be spam +X-Scan-Signature: 625f24d4d5a9233cab8b0380f6b09df7 +Cc: obnam-dev@obnam.org +Subject: Re: Enhancement: Avoid storing compressed data when compression + would expand data +X-BeenThere: obnam-dev@obnam.org +X-Mailman-Version: 2.1.5 +Precedence: list +List-Id: Obnam development discussions +List-Unsubscribe: , + +List-Archive: +List-Post: +List-Help: +List-Subscribe: , + +Sender: obnam-dev-bounces@obnam.org +Errors-To: obnam-dev-bounces@obnam.org + +Applied, thanks. + +On Sat, Oct 17, 2015 at 08:54:50PM +0300, Henri Sivonen wrote: +> I have made a minor improvement to avoid storing compressed data even +> when compression has been enabled in cases where compression (plus +> tagging) would end up expanding the data. This avoids space waste upon +> transfer and storage and compute waste upon reading. +> +> The change is available for pulling from the "no-expansion" branch of +> the repo https://github.com/hsivonen/obnam.git (the branch contains +> nothing else). Web view of the changeset: +> https://github.com/hsivonen/obnam/commit/5002965ad28c89a08c370efa880a060cf7835dbd +> Patch format: +> https://github.com/hsivonen/obnam/commit/5002965ad28c89a08c370efa880a060cf7835dbd.patch +> +> I have tested the patch manually with a directory containing two files +> generated with +> $ head -c 1024 /dev/urandom > rand +> $ head -c 1024 /dev/zero > zero +> (rand doesn't compress and zero compresses very well.) +> +> However, I'm currently unfamiliar with the workings of yarn, so I +> haven't added automated tests. If the patch isn't acceptable without +> tests, I'd appreciate advice on how to do the kind of testing that +> looks inside the chunk data stored in the repo. +> +> -- +> Henri Sivonen +> hsivonen@hsivonen.fi +> https://hsivonen.fi/ +> +> _______________________________________________ +> obnam-dev mailing list +> obnam-dev@obnam.org +> http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-dev-obnam.org +> + +-- +Schrödinger's backup hypothesis: the condition of any backup is +undefined until a restore is attempted. -- andrewsh + +_______________________________________________ +obnam-dev mailing list +obnam-dev@obnam.org +http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-dev-obnam.org diff --git a/tickets/8df68737194d4fda872886ac1398485b/Maildir/tmp/.this-dir-not-empty/.empty/empty-file b/tickets/8df68737194d4fda872886ac1398485b/Maildir/tmp/.this-dir-not-empty/.empty/empty-file new file mode 100644 index 0000000..e69de29 diff --git a/tickets/8df68737194d4fda872886ac1398485b/ticket.yaml b/tickets/8df68737194d4fda872886ac1398485b/ticket.yaml new file mode 100644 index 0000000..bba9a75 --- /dev/null +++ b/tickets/8df68737194d4fda872886ac1398485b/ticket.yaml @@ -0,0 +1,4 @@ +ticket-id: +- 8df68737194d4fda872886ac1398485b +title: +- "Enhancement: Avoid storing compressed data when compression would\n expand data" -- cgit v1.2.1