Columns

Shepardizing citation research

 

by Kaitlin Klemp-Skirvin   |   Michigan Bar Journal

Libraries & Legal Research

FOUNDATIONS OF LEGAL CITATION INDEXING

The story of using citations in legal research begins with a lawyer’s worst nightmare: looking like a fool in court. In 1807, Maine lawyer Simon Greenleaf based an argument on an English decision that had, unbeknownst to him, been overturned. We cannot judge Greenleaf too harshly for this mistake. Legal research in the nineteenth century was daunting due to the lack of published American caselaw. This unfortunate experience led Greenleaf to study “as far as he could, which of the apparently authoritative cases in the Reports had lost their force, and to give the information to the profession.”1 Greenleaf developed a lifelong friendship with Supreme Court Justice Joseph Story, who wrote that Greenleaf’s work was “eminently useful, because it accustoms lawyers to reason upon principle, and to pass beyond the narrow boundary of authority.”2

From 1821 to 1856, Greenleaf’s Overruled Cases presented an alphabetical list of American and English cases that were overturned in American courts. It faced criticism for missing cases, but a perfect index with such a massive scope was unattainable at the time. State indexes, which were easier to maintain, developed throughout the mid-nineteenth century. By the 1870s, enough American reporters had been published to create a comprehensive pool of state and federal caselaw. A new wave of lawyers and legal scholars like Melville Below, George Wendling, and Robert Desty published indexes and digests. Frank Shepard also published an index, but Shepard was neither a lawyer nor a legal scholar.

SHEPARD’S CITATION SERVICE

Frank Shepard (1848-1900) was a lawbook salesman who worked for the company that published Wendling’s index. The publication date of Shepard’s first index, Illinois Citations, is up to debate. The year given by Lexis is 1873,3 but some scholars claim it wasn’t until 1875 — the year the Frank Shepard Company opened.45 Shepard’s legal citation index consisted of stamp-sized annotations printed on perforated sheets of gummed paper that were placed in the margins of case reporters. Its methodology was simple: Upon publication of a new case, citations were analyzed for change in precedent, and annotations were written. While many indexes were published only once and quickly went out of date, Shepard moved ahead of his competitors by implementing a subscription model for updates.

Shepard’s company went through name changes, acquisitions, and technological advancements throughout the twentieth century, including contracting with West and Lexis simultaneously. In 1999, Lexis introduced a citator product named New Shepard’s that eventually became the beloved Shepard’s Citation Service, where we now enjoy online access to ever-updating color-coded icons that demonstrate the nuance of dicta. The goal remains the same: to stay on top of good law.

EUGENE GARFIELD: THE GRANDFATHER OF GOOGLE6

Dr. Eugene Garfield (1925-2017) earned a Bachelor’s in Chemistry (1949) and Master’s in Library Science (1954) from Columbia University. He completed a PhD in Structural Linguistics from the University of Pennsylvania in 1961.7 In 1955, he developed a new method for indexing science scholarship using the “journal impact factor.”8 The “impact” assigned to each article was based on two elements: “the numerator, which is the number of citations in the current year to items published in the previous two years, and the denominator, which is the number of substantive articles and reviews published in the same two years.”9 This research came to life in 1964, when Garfield introduced the Science Citation Index, a tool for researchers “to follow citation links to find the specialized research most germane to their work.”10 Garfield continued to index scholarship of all disciplines throughout his career.11 Clarivate hosts a database of Garfield’s indexes called Web of Science, described as “documenting the most influential research in any given field as directly judged by researchers themselves, provid[ing] the basis for assessing and benchmarking the research performance of individuals, institutions, nations, and regions.”12

Garfield received many letters in response to his indexing projects. One of these was from William Adair, former vice president of Shepard’s, who encouraged Garfield to familiarize himself with Shepard’s methodology. Intrigued, Garfield went to his local library and “screamed out ‘Eureka!’” upon discovering Shepard’s.13 At the time, he was struggling to construct a method for indexing reviews. Shepard’s shifted Garfield’s perspective on citation indexing: Instead of having the impact factor be the researcher’s focus, the primary document had to be the focus. After all, one of the purposes of citation research is to use a primary resource to find information on other resources.

INDEXING IN THE INFORMATION AGE

Coders in the 1990s were also inspired by the work of Garfield and his contemporaries. A new perspective was required, once again. In comparison to caselaw or journal articles, websites “frequently do not acknowledge one another’s existence.”14 Research on the World Wide Web required analysis of text. Early search engines used basic metrics — for example, the frequency of a keyword. As the number of websites grew and coding became more complex, it was clear that an even more advanced algorithm was required to organize the online world.

IBM’s CLEVER Project (1996) analyzed website text with an algorithm that categorized websites as either “hubs” or “authorities.”15 This algorithm is similar to Garfield’s journal impact factor: Some websites are standalone authorities, while others are a hub of other websites. “Authorities” have a higher impact and therefore should be higher on a search result list than a “hub.” Google’s founders were also inspired by Garfield and his contemporaries. When Google discovers new websites, its algorithm tool, PageRank, identifies and indexes text using a variety of metrics.16 When we conduct a search on Google, we are not searching the World Wide Web. Rather, we are searching Google’s index of websites.

FINAL THOUGHTS

The evolution of citation indexing reflects the ever-present need for accurate and organized authoritative information. From sticking annotations in a reporter margin to digital indexing of websites, each step in the development of indexing has been driven by the goal to ensure the most relevant, reliable sources rise to the top.


The views expressed in “Libraries & Legal Research,” as well as other expressions of opinions published in the Bar Journal from time to time, do not necessarily state or reflect the official position of the State Bar of Michigan, nor does their publication constitute an endorsement of the views expressed. They are the opinions of the authors and are intended not to end discussion, but to stimulate thought about significant issues affecting the legal profession, the making of laws, and the adjudication of disputes.


ENDNOTES

1. Parsons, Commemorative Address at Cambridge, Mass. (Oct 20, 1853), excerpted in 16 Monthly L Rep 413, 414 (1853).

2. William Story, ed, Life and Letters of Joseph Story (Boston: Little, Brown, 1851) pp 328-29.

3. Shepard’s Citation Guide Part 1: The History, LexisNexis https://www.lexisnexis.com/community/insights/legal/b/product-features/posts/shepards-citation-guide-part-1-history (posted Sept 16, 2022) (accessed March 2, 2025).

4. Ogden, Mastering the Lawless Science of Our Law: A Story of Legal Citation Indexes, 85 L Lib J 1 (Winter 1993).

5. Dabney, Citators: Past, Present, and Future, Borgeson Paper Archive (2007) https://digitalcommons.law.us.edu/law-lib_borgeson/13.

6. Eugene Garfield, Key Figure in Scientific Documentation and UB Honorary Doctorate Dies at Age 91, Universitat de Barcelona https://web.ub.edu/en/web/actualitat/w/eugene-garfield-key-figure-in-scientific-documentation-and-ub-honorary-doctorate-dies-at-age-91 (posted February 28, 2017) (accessed February 28, 2025).

7. Eugene Garfield, Penn Libraries Overseer, 63 University of Pennsylvania Almanac 26 (2017) https://almanac.upenn.edu/articleseugene-garfield-penn-libraries -overseer.

8. Garfield, The History and Meaning of the Journal Impact Factor, 295 J American Medical Ass’n 1 (2006).

9. Id.

10. Id.

11. Masic, The Most Influential Scientist in the Development of Medical Informatics, 25 Acta Informatica Medica 2 (June 2017).

12. Clarivate, Founding Father of Clarivate Analytics’ Web of Science, Dr. Eugene Garfield Dies at 91 https://ir.clarivate.com/news-events/press-releases/news-details/2017/Founding-Father-of-Clarivate-Analytics-Web-of-Science-Dr.-Eugene-Garfield-Dies-at-91/default.aspx (posted Feb 27, 2017) (accessed March 2, 2025).

13. Eugene Garfield, Scientist, Web of Stories https://www.webofstories.com/play/eugene.garfield/25;jses sionid=6296C92E47C873EFECB40B54995E8000 (posted June 23, 2009) (accessed March 2, 2025).

14. Members of The CLEVER Project, Hypersearching the Web, 280 Scientific American Magazine 6 (June 1999).

15. Id.

16. Bensman, Eugene Garfield, Francis Narin, and PageRank: The Theoretical Bases of the Google Search Engine https://garfield.library.upenn.edu/bensman/bensmancornellarchives2014.pdf (accessed May 15, 2025).