Metadata
Metadata Explained
A worked primer on data about data: what leaks even with perfect encryption, and the measures that actually reduce it.
Metadata is data about data. It is what a system knows because you used it, rather than because of what you said. The reason it matters is that the content is often protected and the metadata is not.
A worked example
Consider an end-to-end encrypted message from Alice to Bob. The operator cannot read it. It can still see:
- Alice’s and Bob’s account identifiers
- the time, to the second
- the message size
- the IP address each device connected from
- the client software version
- how long the session lasted, and how many messages followed
None of that is the message. Together, it is a very good description of a relationship and its timing. Add a movement history, and you have a location; add a de-anonymisation result, and you have a name.
The five leaks that recur
Timing. Who talked to whom and when. Often more identifying than content. It is the reason Tor rebuilds circuits and why some protocols pad message sizes.
Volume. How much data, in what pattern. Download patterns identify content; a large transfer at a specific time is a strong signal.
Network location. IP addresses, and the radio-level identifiers devices broadcast. Resolved roughly by anyone with a database.
Device identity. Advertised identifiers, fingerprintable configuration, and hardware serial numbers.
Retention and linkage. The same identifier used across contexts, for years, is what turns many small records into one profile.
What reduces metadata
| Measure | Reduces | Cost |
|---|---|---|
| Traffic padding | Size and pattern leakage | Bandwidth, latency |
| Batched or delayed delivery | Timing leakage | Delay |
| Message batching | Timing and size | Delay, complexity |
| Metadata-minimising protocols | Server-side records | Requires protocol change |
| Anonymous addressing | Linkability | Usability, a directory may be needed |
| Relay or mix networks | Linkability to the client | Latency, the reason for Tor |
| Encrypted DNS | Name lookups on the local network | Trust in the resolver |
| Short retention periods | Everything, eventually | Operational work for the holder |
Reading a claim about metadata
When someone says a system is private, ask:
- Does the service learn who communicated with whom?
- Does it learn when, and how often?
- Does it learn the sizes?
- Is there a mechanism to say no to content collection while the system still works?
- What is retained after deletion is requested, and who can be made to produce it?
A system that answers all five is worth trusting more than one that answers only the first, and considerably more than one that answers none of them.
Sources
- Schneier: Metadata Equals Surveillance — a short, quotable argument that collecting metadata is surveillance rather than a lesser form of it, written in 2013. Useful for the framing, not for a technical taxonomy of what metadata reveals.
- Narayanan & Shmatikov — IEEE S&P 2008.
- de Montjoye et al. — Scientific Reports 3, 2013.
Topics
Sources
- Metadata Equals Surveillance Posted 23 September 2013, not January 2015. Replaces a 2015-dated URL whose title matched no Schneier post; the old path now redirects to this article. Accessed
- Robust De-anonymization of Large Sparse Datasets Narayanan and Shmatikov, 2008 — re-identification from a supposedly de-identified dataset. Accessed
- Unique in the Crowd: The privacy bounds of human mobility de Montjoye et al., 2013. Accessed
- RFC 8446: TLS 1.3 Accessed
Related guides
-
Guide Intermediate
End-to-End Encrypted Messaging (Guide)
What the encryption protects, what the provider still sees, and why metadata is usually the real story.
-
Guide Introductory
What Tor Is (Guide)
How onion routing works, what it guarantees, what it does not, and the misconceptions that cause harm.
-
Guide Intermediate
DNS Privacy (Guide)
Why name resolution is the most useful thing your network can see, and what encrypted DNS changes.
-
Guide Introductory
Encryption Explained (Guide)
Encryption in transit and at rest, symmetric and asymmetric primitives, and the misconceptions that make people over- or under-trust it.