thearchivist.fun
Practical guide · Evergreen reference

Measure a collection without claiming to measure the internet

Counts make an archive feel concrete, but they can mislead when the unit or collection method is unclear. Fifty posts, fifty images, and fifty distinct caption variants are different measurements. A useful numerical statement tells the reader exactly what was counted and what the result can represent. 1. Define the unit. Decide whether each row represents a post, account, file, template, event, or source. If several posts reuse the same file, retain the relationship rather than confusing reuse with new creation. Write a counting rule that another person could apply to an ambiguous example. 2. Describe the collection method. Record the platforms, search terms, dates, access conditions, and inclusion rules. A set found through ranked search results is shaped by that retrieval process. Do not call it a random or representative sample unless the actual design justifies that description. 3. State the denominator. A claim that ten examples use a certain caption means little without the total examined and the definition of eligible examples. Keep missing or unclassifiable items visible. Excluding difficult cases can change the apparent pattern, so record those exclusions. 4. Separate activity from people. Views, likes, comments, and shares are platform-defined signals, not interchangeable counts of unique people or agreement. Record the label and capture time of the metric you actually observed. A displayed count may change, and a comparison across platforms may use incompatible definitions. 5. Inspect the coding process. If you classify examples as ironic, political, or supportive, write the criteria and test them on a few difficult cases. A second reader can reveal ambiguities. Keep disputed cases marked rather than forcing every interpretation into a clean category. 6. Report a bounded pattern. Write that a specified share of your collected examples has a feature, and explain the collection limits. Avoid turning a case study into a statement about what everyone believes or how the whole internet behaves. A vivid example illustrates a possibility; a count within a convenience set describes that set. When numbers matter to an argument, include a small table with unit, total, exclusions, collection period, and method. Preserve the underlying records and any calculation steps so someone can reproduce the result. If the data are too thin for a numerical conclusion, use a qualitative comparison instead. Careful measurement adds information; decorative precision can obscure the very uncertainty the archive is meant to preserve.

Context and provenance

Define the unit, denominator, and collection method before interpreting counts.

Sources and evidence

  1. Pew Research Center: What are nonprobability surveys?
  2. Pew Research Center: Writing survey questions
  3. DataONE: Consider dataset compatibility

Editorial review: 2026-09-23. New evidence may change this account.

Report a problem with this record