Archive-Opsec

Search

/ to open · ↑↓ to move · Enter to open

Indexes guides, archive entries, news, resources and sources. Nothing is sent to a third party.

Guide categories

Metadata

Metadata Explained

A worked primer on data about data: what leaks even with perfect encryption, and the measures that actually reduce it.

Metadata is data about data. It is what a system knows because you used it, rather than because of what you said. The reason it matters is that the content is often protected and the metadata is not.

A worked example

Consider an end-to-end encrypted message from Alice to Bob. The operator cannot read it. It can still see:

  • Alice’s and Bob’s account identifiers
  • the time, to the second
  • the message size
  • the IP address each device connected from
  • the client software version
  • how long the session lasted, and how many messages followed

None of that is the message. Together, it is a very good description of a relationship and its timing. Add a movement history, and you have a location; add a de-anonymisation result, and you have a name.

The five leaks that recur

Timing. Who talked to whom and when. Often more identifying than content. It is the reason Tor rebuilds circuits and why some protocols pad message sizes.

Volume. How much data, in what pattern. Download patterns identify content; a large transfer at a specific time is a strong signal.

Network location. IP addresses, and the radio-level identifiers devices broadcast. Resolved roughly by anyone with a database.

Device identity. Advertised identifiers, fingerprintable configuration, and hardware serial numbers.

Retention and linkage. The same identifier used across contexts, for years, is what turns many small records into one profile.

What reduces metadata

MeasureReducesCost
Traffic paddingSize and pattern leakageBandwidth, latency
Batched or delayed deliveryTiming leakageDelay
Message batchingTiming and sizeDelay, complexity
Metadata-minimising protocolsServer-side recordsRequires protocol change
Anonymous addressingLinkabilityUsability, a directory may be needed
Relay or mix networksLinkability to the clientLatency, the reason for Tor
Encrypted DNSName lookups on the local networkTrust in the resolver
Short retention periodsEverything, eventuallyOperational work for the holder

Reading a claim about metadata

When someone says a system is private, ask:

  1. Does the service learn who communicated with whom?
  2. Does it learn when, and how often?
  3. Does it learn the sizes?
  4. Is there a mechanism to say no to content collection while the system still works?
  5. What is retained after deletion is requested, and who can be made to produce it?

A system that answers all five is worth trusting more than one that answers only the first, and considerably more than one that answers none of them.

Sources

Sources

  1. Metadata Equals Surveillance Schneier on Security non-profit Posted 23 September 2013, not January 2015. Replaces a 2015-dated URL whose title matched no Schneier post; the old path now redirects to this article. Accessed
  2. Robust De-anonymization of Large Sparse Datasets IEEE Symposium on Security and Privacy academic Narayanan and Shmatikov, 2008 — re-identification from a supposedly de-identified dataset. Accessed
  3. Unique in the Crowd: The privacy bounds of human mobility Scientific Reports academic de Montjoye et al., 2013. Accessed
  4. RFC 8446: TLS 1.3 IETF standard Accessed
  • Guide Introductory

    What Tor Is (Guide)

    How onion routing works, what it guarantees, what it does not, and the misconceptions that cause harm.

  • Guide Intermediate

    DNS Privacy (Guide)

    Why name resolution is the most useful thing your network can see, and what encrypted DNS changes.

  • Guide Introductory

    Encryption Explained (Guide)

    Encryption in transit and at rest, symmetric and asymmetric primitives, and the misconceptions that make people over- or under-trust it.