{"id":3489,"date":"2024-10-18T01:55:55","date_gmt":"2024-10-17T23:55:55","guid":{"rendered":"http:\/\/portlex.usc.gal\/?p=3489"},"modified":"2025-09-29T00:19:29","modified_gmt":"2025-09-28T22:19:29","slug":"ai-and-humans-classifying-word-meaning-who-wins","status":"publish","type":"post","link":"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/","title":{"rendered":"AI and humans classifying word meaning: who wins?"},"content":{"rendered":"<style type=\"text\/css\"><\/style><p><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-3483 alignleft\" src=\"http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1-300x300.jpg\" alt=\"\" width=\"300\" height=\"300\" srcset=\"http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1-300x300.jpg 300w, http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1-1024x1024.jpg 1024w, http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1-150x150.jpg 150w, http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1-768x768.jpg 768w, http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1-60x60.jpg 60w, http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1-580x580.jpg 580w, http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1-860x860.jpg 860w, http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1-1160x1160.jpg 1160w, http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1.jpg 1290w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/p>\n<address data-pm-slice=\"1 1 []\">Carlos Valc\u00e1rcel Riveiro<br \/>\n<em><span style=\"color: #999999;\">Instituto de investgaci\u00f3n Lingua (Universidade de Vigo).<\/span><\/em><\/address>\n<p data-pm-slice=\"1 1 []\">Could an artificial intelligence save us work in our research project? Could it understand the meaning of words and classify them as we want? A group of colleagues from the <a href=\"http:\/\/portlex.usc.gal\/esmas\/\">ESMAS-ES+ project<\/a>, Majo Dom\u00ednguez, Iv\u00e1n Arias, and myself, set out to answer these questions. We analyzed the reliability of several AI models (ChatGPT, Gemini) in semantic tagging of nouns and compared it with that of the project members doing the same task. Who classified nouns better based on their meaning? People or AIs? At what point in the process did each face more challenges?<\/p>\n<p>For now, humans are winning, but not by much. The results were interesting enough to share with other specialists, so we went to Cavtat, near Dubrovnik, to present a poster at the <a href=\"http:\/\/portlex.usc.gal\/eventos\/esmas-es-at-the-21st-euralex-congress\/\">21st EURALEX congress<\/a>. Now that the conference is over and we are back home, it&#8217;s time to reflect on our experience.<\/p>\n<p>During the development of our semantic annotation system with the <a href=\"http:\/\/portlex.usc.gal\/ontologia\/\">PORTLEX lexical ontology<\/a>, we built on the experience of previous projects. This time we used a German text from a TED Talks corpus. This source of varied and multilingual texts gave us a solid foundation, although the\u00a0experiment presented some challenges. One of the biggest challenges was creating an effective prompt for the AI models, which led us to learn about prompt engineering to achieve good results. Additionally, language models are constantly updated, which forced us to adjust our strategies several times.<\/p>\n<p>In this first experiment with AI, we found that language models are quite good at identifying nouns in a text. However, some nouns escape them and are not recognized properly, meaning they fail to identify everything they should. Still, we believe that although the performance of these automatic models does not yet reach the precision of human annotation, the results are a promising starting point, especially with additional adjustments to the prompts.<\/p>\n<p>Attending the EURALEX conference gave us the opportunity to showcase our work to the academic and professional community. The feedback from other specialists helped us see the results of this first experiment from different perspectives, identify key areas for improvement, and validate our methodologies. This type of interaction and collaboration is essential for the growth of projects as specific as ESMAS-ES+. Moreover, in Cavtat we saw that we are not the only ones collaborating with AI in lexicography. The exchange of ideas with colleagues with these interests inspired and motivated us to continue improving the integration between human work and artificial intelligence in this field of applied linguistics.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Carlos Valc\u00e1rcel Riveiro Instituto de investgaci\u00f3n Lingua (Universidade de Vigo). Could an artificial intelligence save us work in our research project? Could it understand the meaning of words and classify them as we want? A group of colleagues from the ESMAS-ES+ project, Majo Dom\u00ednguez, Iv\u00e1n Arias, and myself, set out to answer these questions. We&#8230;<\/p>\n","protected":false},"author":4,"featured_media":3483,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[138,91],"class_list":["post-3489","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-articulos","tag-ia","tag-ontologia"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.1.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>AI and humans classifying word meaning: who wins? - PortLex<\/title>\n<meta name=\"description\" content=\"Could an artificial intelligence save us work in our research project? Could it understand the meaning of words and classify them as we want? A group of colleagues from the ESMAS-ES+ project set out to answer these questions.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AI and humans classifying word meaning: who wins? - PortLex\" \/>\n<meta property=\"og:description\" content=\"Could an artificial intelligence save us work in our research project? Could it understand the meaning of words and classify them as we want? A group of colleagues from the ESMAS-ES+ project set out to answer these questions.\" \/>\n<meta property=\"og:url\" content=\"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/\" \/>\n<meta property=\"og:site_name\" content=\"PortLex\" \/>\n<meta property=\"article:published_time\" content=\"2024-10-17T23:55:55+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-09-28T22:19:29+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1290\" \/>\n\t<meta property=\"og:image:height\" content=\"1290\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Carlos Valc\u00e1rcel Riveiro\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Carlos Valc\u00e1rcel Riveiro\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/\",\"url\":\"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/\",\"name\":\"AI and humans classifying word meaning: who wins? - PortLex\",\"isPartOf\":{\"@id\":\"http:\/\/portlex.usc.gal\/site\/#website\"},\"primaryImageOfPage\":{\"@id\":\"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/#primaryimage\"},\"image\":{\"@id\":\"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1.jpg\",\"datePublished\":\"2024-10-17T23:55:55+00:00\",\"dateModified\":\"2025-09-28T22:19:29+00:00\",\"author\":{\"@id\":\"http:\/\/portlex.usc.gal\/site\/#\/schema\/person\/7ae540bcb93e736e58629fb890a859d8\"},\"description\":\"Could an artificial intelligence save us work in our research project? Could it understand the meaning of words and classify them as we want? A group of colleagues from the ESMAS-ES+ project set out to answer these questions.\",\"breadcrumb\":{\"@id\":\"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/#primaryimage\",\"url\":\"http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1.jpg\",\"contentUrl\":\"http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1.jpg\",\"width\":1290,\"height\":1290},{\"@type\":\"BreadcrumbList\",\"@id\":\"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Portada\",\"item\":\"http:\/\/portlex.usc.gal\/site\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI and humans classifying word meaning: who wins?\"}]},{\"@type\":\"WebSite\",\"@id\":\"http:\/\/portlex.usc.gal\/site\/#website\",\"url\":\"http:\/\/portlex.usc.gal\/site\/\",\"name\":\"PortLex\",\"description\":\"Portal Lexicogr\u00e1fico\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"http:\/\/portlex.usc.gal\/site\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"http:\/\/portlex.usc.gal\/site\/#\/schema\/person\/7ae540bcb93e736e58629fb890a859d8\",\"name\":\"Carlos Valc\u00e1rcel Riveiro\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"http:\/\/portlex.usc.gal\/site\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/2af11a926e824446e5c8e98fbd078186e30fe06773b3d7747f1e2fd700be2320?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/2af11a926e824446e5c8e98fbd078186e30fe06773b3d7747f1e2fd700be2320?s=96&d=mm&r=g\",\"caption\":\"Carlos Valc\u00e1rcel Riveiro\"},\"url\":\"http:\/\/portlex.usc.gal\/site\/author\/carlosvalcarcelriveiro\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"AI and humans classifying word meaning: who wins? - PortLex","description":"Could an artificial intelligence save us work in our research project? Could it understand the meaning of words and classify them as we want? A group of colleagues from the ESMAS-ES+ project set out to answer these questions.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/","og_locale":"en_US","og_type":"article","og_title":"AI and humans classifying word meaning: who wins? - PortLex","og_description":"Could an artificial intelligence save us work in our research project? Could it understand the meaning of words and classify them as we want? A group of colleagues from the ESMAS-ES+ project set out to answer these questions.","og_url":"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/","og_site_name":"PortLex","article_published_time":"2024-10-17T23:55:55+00:00","article_modified_time":"2025-09-28T22:19:29+00:00","og_image":[{"width":1290,"height":1290,"url":"http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1.jpg","type":"image\/jpeg"}],"author":"Carlos Valc\u00e1rcel Riveiro","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Carlos Valc\u00e1rcel Riveiro","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/","url":"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/","name":"AI and humans classifying word meaning: who wins? - PortLex","isPartOf":{"@id":"http:\/\/portlex.usc.gal\/site\/#website"},"primaryImageOfPage":{"@id":"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/#primaryimage"},"image":{"@id":"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/#primaryimage"},"thumbnailUrl":"http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1.jpg","datePublished":"2024-10-17T23:55:55+00:00","dateModified":"2025-09-28T22:19:29+00:00","author":{"@id":"http:\/\/portlex.usc.gal\/site\/#\/schema\/person\/7ae540bcb93e736e58629fb890a859d8"},"description":"Could an artificial intelligence save us work in our research project? Could it understand the meaning of words and classify them as we want? A group of colleagues from the ESMAS-ES+ project set out to answer these questions.","breadcrumb":{"@id":"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/#primaryimage","url":"http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1.jpg","contentUrl":"http:\/\/portlex.usc.gal\/site\/wp-content\/uploads\/2024\/10\/Euralex-1.jpg","width":1290,"height":1290},{"@type":"BreadcrumbList","@id":"http:\/\/portlex.usc.gal\/site\/articulos\/ai-and-humans-classifying-word-meaning-who-wins\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Portada","item":"http:\/\/portlex.usc.gal\/site\/"},{"@type":"ListItem","position":2,"name":"AI and humans classifying word meaning: who wins?"}]},{"@type":"WebSite","@id":"http:\/\/portlex.usc.gal\/site\/#website","url":"http:\/\/portlex.usc.gal\/site\/","name":"PortLex","description":"Portal Lexicogr\u00e1fico","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"http:\/\/portlex.usc.gal\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"http:\/\/portlex.usc.gal\/site\/#\/schema\/person\/7ae540bcb93e736e58629fb890a859d8","name":"Carlos Valc\u00e1rcel Riveiro","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/portlex.usc.gal\/site\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/2af11a926e824446e5c8e98fbd078186e30fe06773b3d7747f1e2fd700be2320?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2af11a926e824446e5c8e98fbd078186e30fe06773b3d7747f1e2fd700be2320?s=96&d=mm&r=g","caption":"Carlos Valc\u00e1rcel Riveiro"},"url":"http:\/\/portlex.usc.gal\/site\/author\/carlosvalcarcelriveiro\/"}]}},"_links":{"self":[{"href":"http:\/\/portlex.usc.gal\/site\/wp-json\/wp\/v2\/posts\/3489","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/portlex.usc.gal\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/portlex.usc.gal\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/portlex.usc.gal\/site\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"http:\/\/portlex.usc.gal\/site\/wp-json\/wp\/v2\/comments?post=3489"}],"version-history":[{"count":4,"href":"http:\/\/portlex.usc.gal\/site\/wp-json\/wp\/v2\/posts\/3489\/revisions"}],"predecessor-version":[{"id":3997,"href":"http:\/\/portlex.usc.gal\/site\/wp-json\/wp\/v2\/posts\/3489\/revisions\/3997"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/portlex.usc.gal\/site\/wp-json\/wp\/v2\/media\/3483"}],"wp:attachment":[{"href":"http:\/\/portlex.usc.gal\/site\/wp-json\/wp\/v2\/media?parent=3489"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/portlex.usc.gal\/site\/wp-json\/wp\/v2\/categories?post=3489"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/portlex.usc.gal\/site\/wp-json\/wp\/v2\/tags?post=3489"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}