summaryrefslogtreecommitdiff
path: root/tickets/7bffecb37eb447d1990f2c220b562b0c/Maildir/new/1543221306.M870846P9860Q1.koom
blob: e26bdbe951dc5fdc7a2c5042068815a009c9360c (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
Return-Path: <ick-discuss-bounces@ick.liw.fi>
X-Original-To: distix@pieni.net
Delivered-To: distix@pieni.net
Received: from yaffle.pepperfish.net (yaffle.pepperfish.net [88.99.213.221])
	by pieni.net (Postfix) with ESMTPS id 5A0E042FDC
	for <distix@pieni.net>; Mon, 26 Nov 2018 08:34:57 +0000 (UTC)
Received: from platypus.pepperfish.net (unknown [10.112.101.20])
	by yaffle.pepperfish.net (Postfix) with ESMTP id 3499D41CFB
	for <distix@pieni.net>; Mon, 26 Nov 2018 08:34:57 +0000 (GMT)
Received: from ip6-localhost.nat ([::1] helo=platypus.pepperfish.net)
	by platypus.pepperfish.net with esmtp (Exim 4.80 #2 (Debian))
	id 1gRCM5-0003wB-4u; Mon, 26 Nov 2018 08:34:57 +0000
Received: from koom.pieni.net ([88.99.190.206] helo=pieni.net)
 by platypus.pepperfish.net with esmtpsa (Exim 4.80 #2 (Debian))
 id 1gRCM4-0003vx-Iy; Mon, 26 Nov 2018 08:34:56 +0000
Received: from exolobe1.liw.fi (62-78-212-250.bb.dnainternet.fi
 [62.78.212.250]) by pieni.net (Postfix) with ESMTPSA id 3C8C642FD5;
 Mon, 26 Nov 2018 08:34:56 +0000 (UTC)
Received: from exolobe1.liw.fi (localhost [127.0.0.1])
 by exolobe1.liw.fi (Postfix) with ESMTPS id 997A7124708;
 Mon, 26 Nov 2018 10:34:55 +0200 (EET)
Date: Mon, 26 Nov 2018 10:34:54 +0200
From: Lars Wirzenius <liw@liw.fi>
To: Daniel Silverstone <dsilvers@digital-scurf.org>
Message-ID: <20181126083454.GA2458@exolobe1.liw.fi>
References: <20181123183716.GB5774@exolobe1.liw.fi>
 <20181126082537.avtwyxuu3mghkgwp@somnambulist.local>
MIME-Version: 1.0
In-Reply-To: <20181126082537.avtwyxuu3mghkgwp@somnambulist.local>
User-Agent: Mutt/1.10.1 (2018-07-13)
X-Pepperfish-Transaction: fbe3-31b3-fe4e-c6b6
X-Pepperfish-Transaction-By: platypus
Cc: ick-discuss@ick.liw.fi
Subject: Re: New Ick component: Muck, for JSON storage
X-BeenThere: ick-discuss@ick.liw.fi
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: discussions about the ick CI system <ick-discuss-ick.liw.fi>
List-Unsubscribe: <https://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/ick-discuss-ick.liw.fi>,
 <mailto:ick-discuss-request@ick.liw.fi?subject=unsubscribe>
List-Archive: <http://listmaster.pepperfish.net/pipermail/ick-discuss-ick.liw.fi>
List-Post: <mailto:ick-discuss@ick.liw.fi>
List-Help: <mailto:ick-discuss-request@ick.liw.fi?subject=help>
List-Subscribe: <https://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/ick-discuss-ick.liw.fi>,
 <mailto:ick-discuss-request@ick.liw.fi?subject=subscribe>
Content-Type: multipart/mixed; boundary="===============4622624238269411860=="
Mime-version: 1.0
Sender: ick-discuss-bounces@ick.liw.fi
Errors-To: ick-discuss-bounces@ick.liw.fi


--===============4622624238269411860==
Content-Type: multipart/signed; micalg=pgp-sha512;
 protocol="application/pgp-signature"; boundary="Q68bSM7Ycu6FN28Q"
Content-Disposition: inline


--Q68bSM7Ycu6FN28Q
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Mon, Nov 26, 2018 at 08:25:37AM +0000, Daniel Silverstone wrote:
> On Fri, Nov 23, 2018 at 20:37:16 +0200, Lars Wirzenius wrote:
> > Thoughts?
>=20
> Currently only one jumps out:
>=20
> > Muck stores JSON objects in memory, but persistently: they get written
> > to disk and loaded back into memory if the service is restarted.
>=20
> Does Muck offer any guarantees as to the durability of writes?  If the
> Muck host reboots unexpectedly, how much data will be lost?

At the moment, the prototype opens the changelog file in append mode,
and just write to it. It doesn't try to fsync or otherwise ensure data
is committed to disk: I wanted to keep things simple. (Neither does
the ick controller for its current storage solution.)

For an eventual production version, I'll want to add at least the
fsync calls (data and file and directory metadata). When I/we get
there, I would appreciate help with those details.

--=20
I want to build worthwhile things that might last. --joeyh

--Q68bSM7Ycu6FN28Q
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQIzBAABCgAdFiEETNTnrewG6wEE1EJ3bC+mFux6IDEFAlv7sC0ACgkQbC+mFux6
IDFBHA//eqmskgOc7xq8AOrw02FVv8KFJ3uIq0jhdknzmDe+kZlzw2D3iioQbvuR
sG0K3GNiroIsHxCvySUCFe/kqaJyKbSlLpm0qoG0225lHneGD+cCK9Dl3jWIZgWW
voXNtiKRVW8mYEnsjPcFu+ebWAhAEnjid7X2HzOm5hoA+ddKt1fu60bzsiW+SQ0j
cpDxaDxMGA4A3FqeeY6ph/iCEBDBp3rnTZGUKqHTaW4R5Tj5w2b6Xqad4TwVG5Yk
AkwcD/plozsO7l7KB+X44EGLNoc2FNefX5DSpai/WV08VN91JT94FuueVk4wwuBg
6GYzjEZO5isIVjCBfgj3eqxG/9oxxjZmcD6PZsjQnkJnK6QOY6EqSca0mWyEPbfM
cQOJ7rJTWnOc6r2Ly0JZ7qOrI+qTOtUwDWf8hD+TBOEm8P6deNJWgJyYtSDTIZEr
Jq4IbII2n2z/tx99XubO6KX4f1lU2m8Z6zRdh8MeC4L6oJqslQY3l2uYWCVhFp3Q
ypUS9k8NcvK0rVQVd1lAV8ILrUcofMmqTF/kc42uu1FsTdwiA753sNh00DNUiKXm
GJOOblBAx0VXBkAeK3/koP3MGvOdgN9t9m1j0r24BRyOdSwRL7oQIiyiXKYNkWbd
buNxc+8J7IMFeFZ/xJAp2BExkNjU8sdY43ACgpRrOIlE8uWgwjQ=
=4YU6
-----END PGP SIGNATURE-----

--Q68bSM7Ycu6FN28Q--


--===============4622624238269411860==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
ick-discuss mailing list
ick-discuss@ick.liw.fi
https://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/ick-discuss-ick.liw.fi

--===============4622624238269411860==--