{"id":9083,"date":"2021-11-10T10:30:03","date_gmt":"2021-11-10T09:30:03","guid":{"rendered":"https:\/\/newws.leibniz-hbi.de\/?post_type=hbi-publications&p=9083"},"modified":"2026-08-24T10:30:17","modified_gmt":"2026-08-24T08:30:17","slug":"from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis","status":"publish","type":"hbi-publications","link":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\/","title":{"rendered":"From Frequency Counts to Contextualized Word Embeddings: The Saussurean Turn in Automatic Content Analysis"},"content":{"rendered":"

Dr. Gregor Wiedemann<\/a> and Cornelia Fedtke illustrate in their contribution to the “Handbook of Computational Social Science” the semantic shift of the term “gold pieces” in the context of hate speech in the German Facebook discourse.<\/p>\n

The Handbook is published by Routledge and is partly available as an open access publication<\/a>.<\/a><\/strong><\/p>\n

\"Cover\"Abstract<\/h2>\n

For automatic content analysis, topic models became an increasingly popular research method to reveal thematic structures of large document collections. However, research interests often go beyond topics that are limited to broad discourse-level semantics. On a more fine-grained level, it is also of interest that arguments, stances, frames, or discourse positions are expressed in what specific contexts and how they emerged in the first place. We argue that recent advancements in natural language processing based on deep learning for distributional semantics enable researchers to explicitly combine word-, sentence-, and discourse-level meaning for computational content analysis. In the chapter, we elaborate on how basic text mining and new neural network-based embedding technologies such as BERT relate to linguistic structuralism as the theoretical and methodological foundation of discourse analysis and many other qualitative research methods. We illustrate our argumentation along with an exemplary study of the semantic shift of the term \u201cGoldst\u00fccke\u201d (English: gold pieces) in the context of hate speech in the German Facebook discourse.<\/p>\n

Wiedemann, G.; Fedtke, C. (2021):\u00a0From Frequency Counts to Contextualized Word Embeddings: The Saussurean Turn in Automatic Content Analysis. In: Engel, U.; Quan-Haase, A.; Liu, S. X.; Lyberg, L. (Hrsg.), Handbook of Computational Social Science, Volume 2. Routlegde. https:\/\/doi.org\/10.4324\/9781003025245<\/a><\/p>\n","protected":false},"featured_media":2433,"template":"","tags":[398,408],"class_list":["post-9083","hbi-publications","type-hbi-publications","status-publish","has-post-thumbnail","hentry","tag-miscellaneous","tag-other-publication"],"acf":[],"yoast_head":"\nFrom Frequency Counts to Contextualized Word Embeddings: The Saussurean Turn in Automatic Content Analysis - Leibniz HBI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"From Frequency Counts to Contextualized Word Embeddings: The Saussurean Turn in Automatic Content Analysis\" \/>\n<meta property=\"og:description\" content=\"Dr. Gregor Wiedemann and Cornelia Fedtke illustrate in their contribution to the “Handbook of Computational Social Science” the semantic shift of the term “gold pieces” in the context of hate speech in the German Facebook discourse. The Handbook is published by Routledge and is partly available as an open access publication. Abstract For automatic content […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\/\" \/>\n<meta property=\"og:site_name\" content=\"Leibniz HBI\" \/>\n<meta property=\"article:modified_time\" content=\"2026-08-24T08:30:17+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/07\/Header-Publikationen_e.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1380\" \/>\n\t<meta property=\"og:image:height\" content=\"400\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\\\/\",\"url\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\\\/\",\"name\":\"From Frequency Counts to Contextualized Word Embeddings: The Saussurean Turn in Automatic Content Analysis - Leibniz HBI\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/wp-content\\\/uploads\\\/2024\\\/07\\\/Header-Publikationen_e.jpg\",\"datePublished\":\"2021-11-10T09:30:03+00:00\",\"dateModified\":\"2026-08-24T08:30:17+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\\\/#primaryimage\",\"url\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/wp-content\\\/uploads\\\/2024\\\/07\\\/Header-Publikationen_e.jpg\",\"contentUrl\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/wp-content\\\/uploads\\\/2024\\\/07\\\/Header-Publikationen_e.jpg\",\"width\":1380,\"height\":400,\"caption\":\"flying book with open pages in front of a blue sky\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/hbi-publications\\\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Homepage\",\"item\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"From Frequency Counts to Contextualized Word Embeddings: The Saussurean Turn in Automatic Content Analysis\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/\",\"name\":\"Leibniz HBI\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/#organization\",\"name\":\"Leibniz HBI\",\"url\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/HBI_Logo-Kopie-2.png\",\"contentUrl\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/wp-content\\\/uploads\\\/2024\\\/01\\\/HBI_Logo-Kopie-2.png\",\"width\":462,\"height\":123,\"caption\":\"Leibniz HBI\"},\"image\":{\"@id\":\"https:\\\/\\\/newws.leibniz-hbi.de\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"From Frequency Counts to Contextualized Word Embeddings: The Saussurean Turn in Automatic Content Analysis - Leibniz HBI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\/","og_locale":"en_US","og_type":"article","og_title":"From Frequency Counts to Contextualized Word Embeddings: The Saussurean Turn in Automatic Content Analysis","og_description":"Dr. Gregor Wiedemann and Cornelia Fedtke illustrate in their contribution to the “Handbook of Computational Social Science” the semantic shift of the term “gold pieces” in the context of hate speech in the German Facebook discourse. The Handbook is published by Routledge and is partly available as an open access publication. Abstract For automatic content […]","og_url":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\/","og_site_name":"Leibniz HBI","article_modified_time":"2026-08-24T08:30:17+00:00","og_image":[{"width":1380,"height":400,"url":"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/07\/Header-Publikationen_e.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\/","url":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\/","name":"From Frequency Counts to Contextualized Word Embeddings: The Saussurean Turn in Automatic Content Analysis - Leibniz HBI","isPartOf":{"@id":"https:\/\/newws.leibniz-hbi.de\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\/#primaryimage"},"image":{"@id":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\/#primaryimage"},"thumbnailUrl":"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/07\/Header-Publikationen_e.jpg","datePublished":"2021-11-10T09:30:03+00:00","dateModified":"2026-08-24T08:30:17+00:00","breadcrumb":{"@id":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\/#primaryimage","url":"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/07\/Header-Publikationen_e.jpg","contentUrl":"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/07\/Header-Publikationen_e.jpg","width":1380,"height":400,"caption":"flying book with open pages in front of a blue sky"},{"@type":"BreadcrumbList","@id":"https:\/\/newws.leibniz-hbi.de\/en\/hbi-publications\/from-frequency-counts-to-contextualized-word-embeddings-the-saussurean-turn-in-automatic-content-analysis\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Homepage","item":"https:\/\/newws.leibniz-hbi.de\/en\/"},{"@type":"ListItem","position":2,"name":"From Frequency Counts to Contextualized Word Embeddings: The Saussurean Turn in Automatic Content Analysis"}]},{"@type":"WebSite","@id":"https:\/\/newws.leibniz-hbi.de\/en\/#website","url":"https:\/\/newws.leibniz-hbi.de\/en\/","name":"Leibniz HBI","description":"","publisher":{"@id":"https:\/\/newws.leibniz-hbi.de\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/newws.leibniz-hbi.de\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/newws.leibniz-hbi.de\/en\/#organization","name":"Leibniz HBI","url":"https:\/\/newws.leibniz-hbi.de\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/newws.leibniz-hbi.de\/en\/#\/schema\/logo\/image\/","url":"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/01\/HBI_Logo-Kopie-2.png","contentUrl":"https:\/\/newws.leibniz-hbi.de\/wp-content\/uploads\/2024\/01\/HBI_Logo-Kopie-2.png","width":462,"height":123,"caption":"Leibniz HBI"},"image":{"@id":"https:\/\/newws.leibniz-hbi.de\/en\/#\/schema\/logo\/image\/"}}]}},"permalink_manager":null,"_links":{"self":[{"href":"https:\/\/newws.leibniz-hbi.de\/en\/wp-json\/wp\/v2\/hbi-publications\/9083","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newws.leibniz-hbi.de\/en\/wp-json\/wp\/v2\/hbi-publications"}],"about":[{"href":"https:\/\/newws.leibniz-hbi.de\/en\/wp-json\/wp\/v2\/types\/hbi-publications"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newws.leibniz-hbi.de\/en\/wp-json\/wp\/v2\/media\/2433"}],"wp:attachment":[{"href":"https:\/\/newws.leibniz-hbi.de\/en\/wp-json\/wp\/v2\/media?parent=9083"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/newws.leibniz-hbi.de\/en\/wp-json\/wp\/v2\/tags?post=9083"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}