{"id":9091,"date":"2020-10-01T11:13:34","date_gmt":"2020-10-01T09:13:34","guid":{"rendered":"https:\/\/newws.leibniz-hbi.de\/?post_type=hbi-publications&p=9091"},"modified":"2026-08-24T10:07:37","modified_gmt":"2026-08-24T08:07:37","slug":"how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models","status":"publish","type":"hbi-publications","link":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\/","title":{"rendered":"How Document Sampling and Vocabulary Pruning Affect the Results of Topic Models"},"content":{"rendered":"

\"CoverIn the new issue of the journal Computational Communication Research, Dr. Gregor Wiedemann<\/a> writes together with three other authors about how Topic Modeling could be simplified. Topic Modeling is an increasingly popular method for analyzing texts in the social sciences. However, for particularly large amounts of text, the computation of topic models can quickly become too time-consuming. This article therefore answers the question whether and how Topic Models can be calculated reliably and without quality loss on smaller samples for the analysis of the population.<\/p>\n

Abstract<\/h2>\n

Topic modeling enables researchers to explore large document corpora. However, accurate model specification requires the calculation of multiple models, which can become infeasibly costly in terms of time and computing resources. In order to circumvent this problem, we test and propose a strategy introducing two easy-to-implement modifications to the modeling process: Instead of modeling the full corpus and the whole vocabulary, we (1) use random document samples and (2) an extensively pruned vocabulary. Using three empirical corpora with different origins and characteristics (news articles, websites, and Tweets), we investigate how different sample sizes and pruning strategies affect the resulting topic models as compared to fully modeled corpora. Our test provides evidence that sampling and pruning are cheap and viable strategies to accelerate model specification. Sample-based topic models closely resemble corpus-based models, if the sample size is large enough (usually >10%). Also, extensive pruning does not compromise the quality of the resulting topics. Altogether, pruning and sample-based modeling leads to increased performance without impairing model quality.<\/p>\n

Maier, D.; Niekler, A.; Wiedemann, G.; Stoltenberg, D. (2020):\u00a0How Document Sampling and Vocabulary Pruning Affect the Results of Topic Models. In: Computational Communication Research, 2(2), pp. 139\u2013152. https:\/\/doi.org\/10.5117\/CCR2020.2.001.MAIE<\/a><\/p>\n","protected":false},"featured_media":2579,"template":"","tags":[398,408],"class_list":["post-9091","hbi-publications","type-hbi-publications","status-publish","has-post-thumbnail","hentry","tag-miscellaneous","tag-other-publication"],"acf":[],"yoast_head":"\nHow Document Sampling and Vocabulary Pruning Affect the Results of Topic Models - Leibniz HBI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How Document Sampling and Vocabulary Pruning Affect the Results of Topic Models\" \/>\n<meta property=\"og:description\" content=\"In the new issue of the journal Computational Communication Research, Dr. Gregor Wiedemann writes together with three other authors about how Topic Modeling could be simplified. Topic Modeling is an increasingly popular method for analyzing texts in the social sciences. However, for particularly large amounts of text, the computation of topic models can quickly become […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\/\" \/>\n<meta property=\"og:site_name\" content=\"Leibniz HBI\" \/>\n<meta property=\"article:modified_time\" content=\"2026-08-24T08:07:37+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/07\/Header-Publikationen.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1380\" \/>\n\t<meta property=\"og:image:height\" content=\"400\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\\\/\",\"url\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\\\/\",\"name\":\"How Document Sampling and Vocabulary Pruning Affect the Results of Topic Models - Leibniz HBI\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/wp-content\\\/uploads\\\/2024\\\/07\\\/Header-Publikationen.jpg\",\"datePublished\":\"2020-10-01T09:13:34+00:00\",\"dateModified\":\"2026-08-24T08:07:37+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\\\/#primaryimage\",\"url\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/wp-content\\\/uploads\\\/2024\\\/07\\\/Header-Publikationen.jpg\",\"contentUrl\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/wp-content\\\/uploads\\\/2024\\\/07\\\/Header-Publikationen.jpg\",\"width\":1380,\"height\":400,\"caption\":\"flying book with open pages in front of a blue sky\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Homepage\",\"item\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How Document Sampling and Vocabulary Pruning Affect the Results of Topic Models\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/\",\"name\":\"Leibniz HBI\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/#organization\",\"name\":\"Leibniz HBI\",\"url\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/HBI_Logo-Kopie-2.png\",\"contentUrl\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/HBI_Logo-Kopie-2.png\",\"width\":462,\"height\":123,\"caption\":\"Leibniz HBI\"},\"image\":{\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How Document Sampling and Vocabulary Pruning Affect the Results of Topic Models - Leibniz HBI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\/","og_locale":"en_US","og_type":"article","og_title":"How Document Sampling and Vocabulary Pruning Affect the Results of Topic Models","og_description":"In the new issue of the journal Computational Communication Research, Dr. Gregor Wiedemann writes together with three other authors about how Topic Modeling could be simplified. Topic Modeling is an increasingly popular method for analyzing texts in the social sciences. However, for particularly large amounts of text, the computation of topic models can quickly become […]","og_url":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\/","og_site_name":"Leibniz HBI","article_modified_time":"2026-08-24T08:07:37+00:00","og_image":[{"width":1380,"height":400,"url":"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/07\/Header-Publikationen.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\/","url":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\/","name":"How Document Sampling and Vocabulary Pruning Affect the Results of Topic Models - Leibniz HBI","isPartOf":{"@id":"https:\/\/newws.leibniz-hbi.de\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\/#primaryimage"},"image":{"@id":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\/#primaryimage"},"thumbnailUrl":"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/07\/Header-Publikationen.jpg","datePublished":"2020-10-01T09:13:34+00:00","dateModified":"2026-08-24T08:07:37+00:00","breadcrumb":{"@id":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\/#primaryimage","url":"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/07\/Header-Publikationen.jpg","contentUrl":"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/07\/Header-Publikationen.jpg","width":1380,"height":400,"caption":"flying book with open pages in front of a blue sky"},{"@type":"BreadcrumbList","@id":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/how-document-sampling-and-vocabulary-pruning-affect-the-results-of-topic-models\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Homepage","item":"https:\/\/newws.leibniz-hbi.de\/en\/"},{"@type":"ListItem","position":2,"name":"How Document Sampling and Vocabulary Pruning Affect the Results of Topic Models"}]},{"@type":"WebSite","@id":"https:\/\/newws.leibniz-hbi.de\/en\/#website","url":"https:\/\/newws.leibniz-hbi.de\/en\/","name":"Leibniz HBI","description":"","publisher":{"@id":"https:\/\/newws.leibniz-hbi.de\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/newws.leibniz-hbi.de\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/newws.leibniz-hbi.de\/en\/#organization","name":"Leibniz HBI","url":"https:\/\/newws.leibniz-hbi.de\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/newws.leibniz-hbi.de\/en\/#\/schema\/logo\/image\/","url":"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/01\/HBI_Logo-Kopie-2.png","contentUrl":"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/01\/HBI_Logo-Kopie-2.png","width":462,"height":123,"caption":"Leibniz HBI"},"image":{"@id":"https:\/\/newws.leibniz-hbi.de\/en\/#\/schema\/logo\/image\/"}}]}},"permalink_manager":null,"_links":{"self":[{"href":"https:\/\/newws.leibniz-hbi.de\/en\/wp-json\/wp\/v2\/hbi-publications\/9091","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newws.leibniz-hbi.de\/en\/wp-json\/wp\/v2\/hbi-publications"}],"about":[{"href":"https:\/\/newws.leibniz-hbi.de\/en\/wp-json\/wp\/v2\/types\/hbi-publications"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newws.leibniz-hbi.de\/en\/wp-json\/wp\/v2\/media\/2579"}],"wp:attachment":[{"href":"https:\/\/newws.leibniz-hbi.de\/en\/wp-json\/wp\/v2\/media?parent=9091"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/newws.leibniz-hbi.de\/en\/wp-json\/wp\/v2\/tags?post=9091"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}