{"id":2134,"date":"2023-10-25T15:00:08","date_gmt":"2023-10-25T15:00:08","guid":{"rendered":"https:\/\/cog-ist.com\/?post_type=blog_content&#038;p=2134"},"modified":"2025-09-19T19:53:27","modified_gmt":"2025-09-19T19:53:27","slug":"kara-kutuyu-yorumlamak-buyuk-dil-modelleri-ve-dil-bilgisi-baglam-ve-anlam-deniz-ekin-yavas","status":"publish","type":"blog_content","link":"https:\/\/cog-ist.com\/en\/blog_content\/kara-kutuyu-yorumlamak-buyuk-dil-modelleri-ve-dil-bilgisi-baglam-ve-anlam-deniz-ekin-yavas\/","title":{"rendered":"Kara Kutuyu Yorumlamak: B\u00fcy\u00fck Dil Modelleri ve Dil Bilgisi- Ba\u011flam ve Anlam\u00a0\u2014 Deniz Ekin Yava\u015f"},"content":{"rendered":"<p id=\"87fc\">\u201cKara Kutuyu Yorumlamak\u201d serisinin t\u00fcm yaz\u0131lar\u0131na&nbsp;<a href=\"https:\/\/medium.com\/cogist\/tagged\/kara-kutuyu-yorumlamak\" target=\"_blank\" rel=\"noopener\">buradan<\/a>&nbsp;eri\u015febilirsiniz.<\/p>\n\n\n\n<p id=\"41ba\"><em>Deniz Ekin Yava\u015f, Heinrich-Heine \u00dcniversitesi\u2019nde Hesaplamal\u0131 Dilbilim alan\u0131nda doktora \u00f6\u011frencisi ve ara\u015ft\u0131rma g\u00f6revlisi. \u00d6ne\u011fitimli dil modellerini kullanarak s\u00f6zl\u00fcksel anlambilim ve anlambilim-s\u00f6zdizim kesi\u015fimini ara\u015ft\u0131r\u0131yor.<\/em><\/p>\n\n\n\n<p id=\"4b4f\">Son y\u0131llarda b\u00fcy\u00fck dil modelleri bir\u00e7ok farkl\u0131 g\u00f6revde elde ettikleri ba\u015far\u0131larla b\u00fcy\u00fck ilgi \u00e7ekti. Bu ba\u015far\u0131lar bizlere b\u00fcy\u00fck dil modellerinin<em>&nbsp;\u00f6ne\u011fitim (pre-training<\/em>) s\u00fcre\u00e7lerinde dilin istatiksel bilgisinin d\u0131\u015f\u0131nda dile ili\u015fkin \u00e7ok daha fazlas\u0131n\u0131 \u00f6\u011frenip \u00f6\u011frenmedi\u011fini sormam\u0131za neden oldu. Bunun sonucu olarak, bu soruyu yan\u0131tlamay\u0131 ama\u00e7layan&nbsp;<em>yorumlanabilirlik (interpretability)<\/em>&nbsp;\u00e7al\u0131\u015fmalar\u0131 bilimsel alanda b\u00fcy\u00fck bir \u00f6nem kazand\u0131. Bu serinin amac\u0131, farkl\u0131 konulardaki yorumlanabilirlik \u00e7al\u0131\u015fmalar\u0131na de\u011finerek modellerin&nbsp;<em>bili\u015fsel olarak ger\u00e7ek\u00e7ili\u011fini (cognitive plausibility)<\/em>&nbsp;sorgulamak.<\/p>\n\n\n\n<p id=\"4744\">Serinin bu yaz\u0131s\u0131nda,<em>&nbsp;<\/em>s\u00f6zc\u00fcklerin anlam \u00e7e\u015fitlili\u011fine ve anlam\u0131n ba\u011flamla ili\u015fkisine yak\u0131ndan bakaca\u011f\u0131z. Dildeki \u00e7o\u011fu s\u00f6zc\u00fck birden \u00e7ok anlama sahiptir ve&nbsp;<em>\u00e7okanlaml\u0131l\u0131k&nbsp;<\/em>(<em>polysemy<\/em>) dilde norm oland\u0131r.&nbsp;<em>Tekanlaml\u0131l\u0131k&nbsp;<\/em>(<em>monosemy<\/em>) ise genellikle bilimsel terimlere \u00f6zg\u00fcd\u00fcr. S\u00f6zc\u00fcklerin anlam \u00e7e\u015fitlili\u011fi ve ba\u011flam yak\u0131ndan ili\u015fkilidir, \u00e7\u00fcnk\u00fc s\u00f6zc\u00fcklerin anlamlar\u0131 esnektir ve anlam ba\u011flamla devaml\u0131 etkile\u015fim i\u00e7erisindedir. S\u00f6zc\u00fckler bir ba\u011flam i\u00e7erisinde birlikte kullan\u0131ld\u0131klar\u0131 di\u011fer s\u00f6zc\u00fcklere uyum g\u00f6sterir ve farkl\u0131 anlamlara sahip olabilir.<\/p>\n\n\n\n<p id=\"73c0\">Bu yaz\u0131da b\u00fcy\u00fck dil modellerinin s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131n\u0131 ay\u0131rt edip edemediklerini sorgulayaca\u011f\u0131z ve bu konuda yap\u0131lm\u0131\u015f yorumlanabilirlik \u00e7al\u0131\u015fmalar\u0131na yer verece\u011fiz. Bu \u00e7al\u0131\u015fmalara ge\u00e7meden \u00f6nce s\u00f6zc\u00fcklerin anlam \u00e7e\u015fitlili\u011fi, yani birden \u00e7ok anlama sahip olmas\u0131 ne demek, yak\u0131ndan bakal\u0131m.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"99c4\"><strong>\u00c7okanlaml\u0131l\u0131k ve E\u015fadl\u0131l\u0131k<\/strong><\/h2>\n\n\n\n<p id=\"247a\">S\u00f6zc\u00fcklerin birden \u00e7ok anlama sahip olmas\u0131&nbsp;<em>\u00e7okanlaml\u0131l\u0131k&nbsp;<\/em>(<em>polysemy<\/em>) veya&nbsp;<em>e\u015fadl\u0131l\u0131ktan&nbsp;<\/em>(<em>homonymy<\/em>) kaynaklanabilir. \u00c7okanlaml\u0131l\u0131k bir s\u00f6zc\u00fc\u011f\u00fcn birden \u00e7ok ba\u011flant\u0131l\u0131 anlama sahip olmas\u0131d\u0131r. E\u015fadl\u0131l\u0131k<a href=\"https:\/\/medium.com\/cogist\/kara-kutuyu-yorumlamak-b%C3%BCy%C3%BCk-dil-modelleri-ve-dil-bilgisi-ba%C4%9Flam-ve-anlam-deniz-ekin-yava%C5%9F-0d959877eb95#_ftn1\" target=\"_blank\" rel=\"noopener\">[1]<\/a>&nbsp;ise s\u00f6zc\u00fcklerin raslant\u0131sal olarak ayn\u0131 forma sahip olmas\u0131 ve bu nedenle birden \u00e7ok anlama gelmesidir.<\/p>\n\n\n\n<p id=\"76e5\">\u00d6rne\u011fin, \u201cge\u00e7mek\u201d eylemini ele alal\u0131m. Bu eylem \u00e7okanlaml\u0131d\u0131r ve \u015fu anlamlara sahiptir:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>bir yerden bir yere ge\u00e7mek (\u201cSalondan odaya ge\u00e7tim.\u201d)<\/li>\n\n\n\n<li>bir yeri\/birini ge\u00e7mek (\u201cOkulu ge\u00e7tikten sonra sa\u011fa d\u00f6nd\u00fck.\u201d)<\/li>\n\n\n\n<li>bir yoldan ge\u00e7mek (\u201cK\u00f6pr\u00fcden ge\u00e7tik.\u201d)<\/li>\n\n\n\n<li>bir yerden girip \u00e7\u0131kmak (\u201c\u0130pi i\u011fneden ge\u00e7irdi.\u201d)<\/li>\n<\/ol>\n\n\n\n<p id=\"4747\">Bunun yan\u0131 s\u0131ra, \u201cdolu\u201d (ya\u011f\u0131\u015f t\u00fcr\u00fc ve \u201ci\u00e7i bo\u015f olmayan\u201d anlam\u0131nda s\u0131fat), \u201cyaz\u201d (mevsim ve yazma eylemi), \u201cg\u00fcl\u201d (\u00e7i\u00e7ek ve g\u00fclme eylemi) gibi s\u00f6zc\u00fckler e\u015fadl\u0131d\u0131r. \u201cGe\u00e7mek\u201d eyleminden farkl\u0131 olarak bu s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131 aras\u0131nda bir anlam ba\u011flant\u0131s\u0131 yoktur ve bu s\u00f6zc\u00fckler rastlant\u0131sal olarak ayn\u0131 forma sahiptir.<\/p>\n\n\n\n<p id=\"b7dd\">Teorik olarak e\u015fadl\u0131l\u0131k ve \u00e7okanlaml\u0131l\u0131\u011f\u0131 ay\u0131ran, anlamlar\u0131n\u0131n aras\u0131ndaki&nbsp;<em>anlamsal ba\u011flant\u0131l\u0131l\u0131kt\u0131r&nbsp;<\/em>(s<em>emantic relatedness<\/em>). Psikodilbilim \u00e7al\u0131\u015fmalar\u0131n\u0131n sonu\u00e7lar\u0131 bu teorik ayr\u0131m\u0131 desteklemektedir ve insanlar\u0131n s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131na ili\u015fkin anlamsal ba\u011flant\u0131l\u0131l\u0131k yarg\u0131lar\u0131 \u00e7okanlaml\u0131l\u0131k-e\u015fadl\u0131l\u0131k ayr\u0131m\u0131 ile \u00f6rt\u00fc\u015fmektedir. Konu\u015fucular taraf\u0131ndan \u00e7okanlaml\u0131 s\u00f6zc\u00fcklerin anlamlar\u0131 aras\u0131ndaki ba\u011flant\u0131l\u0131l\u0131k, e\u015fadl\u0131 s\u00f6zc\u00fcklerden daha fazla olarak de\u011ferlendirilmektedir (Klepousniotou vd., 2008).<a href=\"https:\/\/medium.com\/cogist\/kara-kutuyu-yorumlamak-b%C3%BCy%C3%BCk-dil-modelleri-ve-dil-bilgisi-ba%C4%9Flam-ve-anlam-deniz-ekin-yava%C5%9F-0d959877eb95#_ftn2\" target=\"_blank\" rel=\"noopener\">[2]<\/a>&nbsp;Bunun yan\u0131 s\u0131ra psikodilbilim \u00e7al\u0131\u015fmalar\u0131, e\u015fadl\u0131 ve \u00e7okanlaml\u0131 s\u00f6zc\u00fcklerin zihinsel s\u00f6zl\u00fck\u00e7ede depolan\u0131\u015f\u0131 ve i\u015flemleni\u015fi aras\u0131nda da farkl\u0131l\u0131klar oldu\u011funu ortaya koymaktad\u0131r (Pylkk\u00e4nen vd. 2006, Frisson 2015, Klepousniotou vd. 2008, 2012, MacGregor vd. 2015).<a href=\"https:\/\/medium.com\/cogist\/kara-kutuyu-yorumlamak-b%C3%BCy%C3%BCk-dil-modelleri-ve-dil-bilgisi-ba%C4%9Flam-ve-anlam-deniz-ekin-yava%C5%9F-0d959877eb95#_ftn3\" target=\"_blank\" rel=\"noopener\">[3]<\/a><\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"69a2\"><strong>Vekt\u00f6r Olarak S\u00f6zc\u00fckler<\/strong><\/h2>\n\n\n\n<p id=\"882b\">Do\u011fal dil i\u015flemleme alan\u0131nda s\u00f6zc\u00fckler vekt\u00f6rler olarak temsil edilir. Bu \u015fekilde s\u00f6zc\u00fcklerle i\u015flemler yap\u0131labilir ve s\u00f6zc\u00fckler aras\u0131ndaki ili\u015fkiler matematiksel y\u00f6ntemlerle ortaya \u00e7\u0131kar\u0131labilir. S\u00f6zc\u00fcklerin vekt\u00f6r temsiline&nbsp;<em>s\u00f6zc\u00fck g\u00f6mmesi<\/em>&nbsp;(<em>word embedding<\/em>) ad\u0131 verilir. Bu g\u00f6mmeler do\u011fal dil i\u015flemleme g\u00f6revlerinin temel ta\u015f\u0131d\u0131r. Do\u011fal dil i\u015flemleme g\u00f6revlerinde s\u00f6zc\u00fckler g\u00f6mmeleri ile temsil edilir ve s\u00f6zc\u00fck g\u00f6mmeleri \u00fczerinden i\u015flem yap\u0131larak g\u00f6revler ger\u00e7ekle\u015ftirilir.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/miro.medium.com\/v2\/resize:fit:1384\/1*GkKbbMDw771eaStDzUGW4Q.png\" alt=\"\"\/><figcaption class=\"wp-element-caption\">G\u00f6rsel 1: \u201ckedi\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn vekt\u00f6r temsili.<\/figcaption><\/figure>\n\n\n\n<p id=\"5497\">S\u00f6zc\u00fck g\u00f6mmeleri, s\u00f6zc\u00fcklerin dil i\u00e7erisinde kullan\u0131m\u0131n\u0131n, kullan\u0131m da\u011f\u0131l\u0131m\u0131n\u0131n \u00f6\u011frenilmesiyle olu\u015fturulur. Bu nedenle de kullan\u0131msal ve anlamsal olarak birbirine yak\u0131n s\u00f6zc\u00fcklerin vekt\u00f6r temsilleri de birbirine yak\u0131nl\u0131k g\u00f6sterir.<a href=\"https:\/\/medium.com\/cogist\/kara-kutuyu-yorumlamak-b%C3%BCy%C3%BCk-dil-modelleri-ve-dil-bilgisi-ba%C4%9Flam-ve-anlam-deniz-ekin-yava%C5%9F-0d959877eb95#_ftn4\" target=\"_blank\" rel=\"noopener\">[4]<\/a><\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/miro.medium.com\/v2\/resize:fit:1196\/1*vp4Hozva2tQjORA4O7-e9g.png\" alt=\"\"\/><figcaption class=\"wp-element-caption\">G\u00f6rsel 2: \u201cev\u201d, \u201ck\u00f6pek\u201d, \u201ckedi\u201d ve \u201cat\u201d s\u00f6zc\u00fcklerinin vekt\u00f6rlerinin kar\u015f\u0131la\u015ft\u0131r\u0131lmas\u0131.<\/figcaption><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"1179\"><strong>Statik ve Ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f S\u00f6zc\u00fck G\u00f6mmeleri<\/strong><\/h2>\n\n\n\n<p id=\"d567\">S\u00f6zc\u00fck g\u00f6mmeleri farkl\u0131 y\u00f6ntemler kullan\u0131larak olu\u015fturulabilir.<strong>&nbsp;<\/strong>B\u00fcy\u00fck dil modellerinden \u00f6nce, s\u00f6zc\u00fck g\u00f6mmeleri elde etmek i\u00e7in kullan\u0131lan en yayg\u0131n y\u00f6ntemler Word2Vec, Glove, fastText gibi y\u00f6ntemlerdi. Bu y\u00f6ntemlerle bir dildeki her s\u00f6zc\u00fck i\u00e7in, o s\u00f6zc\u00fc\u011f\u00fcn o dilde kullan\u0131ld\u0131\u011f\u0131 b\u00fct\u00fcn ba\u011flamlardan yola \u00e7\u0131karak tek bir s\u00f6zc\u00fck g\u00f6mmesi \u00fcretilir ve bu s\u00f6zc\u00fck g\u00f6mmelerine&nbsp;<em>statik s\u00f6zc\u00fck g\u00f6mmeleri&nbsp;<\/em>(<em>static word embeddings<\/em>) ad\u0131 verilir.<\/p>\n\n\n\n<p id=\"7df6\">G\u00fcn\u00fcm\u00fczde ise BERT, RoBERTa gibi b\u00fcy\u00fck dil modellerinin g\u00f6mmelerinin kullan\u0131m\u0131 yayg\u0131nd\u0131r. Bu modellerle s\u00f6zc\u00fckler i\u00e7in o s\u00f6zc\u00fcklerin belirli bir t\u00fcmcede kullan\u0131mlar\u0131na denk gelen g\u00f6mmeler \u00fcretilir. Bu s\u00f6zc\u00fck g\u00f6mmesinin hesaplanmas\u0131nda s\u00f6zc\u00fc\u011f\u00fcn statik g\u00f6mmesinin (yani dildeki b\u00fct\u00fcn kullan\u0131mlar\u0131n\u0131n bilgisinin) \u00f6tesinde t\u00fcmcenin ba\u011flam\u0131, yani t\u00fcmcede bulunan di\u011fer s\u00f6zc\u00fckler de etkilidir. Bu nedenle de bu g\u00f6mmelere&nbsp;<em>ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f s\u00f6zc\u00fck g\u00f6mmeleri<\/em>&nbsp;(<em>contextualized word embeddings<\/em>) ad\u0131 verilmektedir. \u00d6rne\u011fin, BERT\u2019e bir t\u00fcmce verdi\u011fimizde modelden o t\u00fcmcedeki istedi\u011fimiz bir s\u00f6zc\u00fck i\u00e7in bir g\u00f6mme al\u0131r\u0131z. BERT\u2019e bu s\u00f6zc\u00fc\u011f\u00fcn ge\u00e7ti\u011fi ba\u015fka bir t\u00fcmce verdi\u011fimizde modelden ayn\u0131 s\u00f6zc\u00fck i\u00e7in alaca\u011f\u0131m\u0131z s\u00f6zc\u00fck g\u00f6mmesi, ilk t\u00fcmce i\u00e7in \u00fcretilenle ayn\u0131 olmayacakt\u0131r.<\/p>\n\n\n\n<p id=\"fb36\">Burada dikkat edilmesi gereken fark, ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f g\u00f6mmelerin s\u00f6zc\u00fcklerin belirli bir t\u00fcmcedeki kullan\u0131m\u0131n\u0131 temsil etmesi ve b\u00f6ylelikle her t\u00fcmce i\u00e7in farkl\u0131 s\u00f6zc\u00fck g\u00f6mmelerinin elde edilebilmesi, statik g\u00f6mmelerin ise s\u00f6zc\u00fcklerin b\u00fct\u00fcn dildeki t\u00fcm kullan\u0131mlar\u0131n\u0131 temsil etmesi ve bu nedenle de s\u00f6zc\u00fcklerin b\u00fct\u00fcn dildeki kullan\u0131ma denk gelen tek bir s\u00f6zc\u00fck g\u00f6mmesinin elde edilmesidir.<\/p>\n\n\n\n<p id=\"2e9f\">Statik s\u00f6zc\u00fck g\u00f6mmelerin en b\u00fcy\u00fck dezavantajlar\u0131ndan biri \u00e7okanlaml\u0131l\u0131\u011f\u0131 ve e\u015fadl\u0131l\u0131\u011f\u0131 temsil edememeleridir. Bunun nedeni ise s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131 i\u00e7in tek bir statik s\u00f6zc\u00fck g\u00f6mmesinin \u00fcretilmesidir. Bu nedenle de e\u015fadl\u0131 veya \u00e7okanlaml\u0131 s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131 aras\u0131nda ayr\u0131m yap\u0131lamamaktad\u0131r. Ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f s\u00f6zc\u00fck g\u00f6mmelerinde ise farkl\u0131 t\u00fcmceler i\u00e7in farkl\u0131 s\u00f6zc\u00fck g\u00f6mmelerinin \u00fcretilmesinden dolay\u0131 bu ayr\u0131m\u0131n yap\u0131lmas\u0131 daha kolayd\u0131r. \u00d6rne\u011fin; T\u00fcrk\u00e7ede \u201cyaz\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fc d\u00fc\u015f\u00fcnelim. Hem mevsim olan hem de eylem olan \u201cyaz\u201d s\u00f6zc\u00fcklerinin tek bir statik s\u00f6zc\u00fck g\u00f6mmesi vard\u0131r. Bu nedenle farkl\u0131 anlamlar\u0131n\u0131 ve hatta ad-eylem ayr\u0131m\u0131n\u0131 vekt\u00f6r temsiline bakarak ay\u0131rt etmek m\u00fcmk\u00fcn de\u011fildir. Bunun yan\u0131 s\u0131ra \u201cDeftere bir say\u0131 yaz.\u201d ve \u201cBu yaz Bodrum\u2019a gidece\u011fiz.\u201d t\u00fcmcelerinde \u201cyaz\u201d s\u00f6zc\u00fc\u011f\u00fc i\u00e7in elde edilen ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f vekt\u00f6r temsillerinin s\u00f6zc\u00fc\u011f\u00fcn hangi anlam\u0131n\u0131 temsil etti\u011fi daha a\u00e7\u0131k olacakt\u0131r.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/miro.medium.com\/v2\/resize:fit:1400\/1*BaPw1dg8iYY5tcxML9UWzQ.png\" alt=\"\"\/><figcaption class=\"wp-element-caption\">G\u00f6rsel 3: \u201cyaz\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn farkl\u0131 t\u00fcmcelerdeki s\u00f6zc\u00fck g\u00f6mmeleri.<\/figcaption><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"bb2f\"><strong>Anlam \u00c7e\u015fitlili\u011fi \u00d6zelinde Yorumlanabilirlik \u00c7al\u0131\u015fmalar\u0131<\/strong><\/h2>\n\n\n\n<p id=\"4e03\">Dil modellerinin s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131na ili\u015fkin bilgilerini ortaya \u00e7\u0131karmaya \u00e7al\u0131\u015fan yorumlanabilirlik \u00e7al\u0131\u015fmalar\u0131nda genellikle s\u00f6zc\u00fck g\u00f6mmelerinin birbirlerine olan yak\u0131nl\u0131\u011f\u0131na odaklan\u0131lmaktad\u0131r. Bir \u00f6nceki b\u00f6l\u00fcmde de de\u011findi\u011fimiz gibi hem statik hem de ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f s\u00f6zc\u00fck g\u00f6mmelerinin en ilgi \u00e7ekici \u00f6zelliklerinden biri s\u00f6zc\u00fckler aras\u0131ndaki benzerlikleri ortaya \u00e7\u0131karmam\u0131za yard\u0131mc\u0131 olabilmesidir.<\/p>\n\n\n\n<p id=\"d578\">Bu konudaki temel varsay\u0131m ise, s\u00f6zc\u00fcklerin ayn\u0131 anlamlar\u0131n\u0131n t\u00fcmcelerinde o s\u00f6zc\u00fc\u011f\u00fcn g\u00f6mmelerinin birbirine daha yak\u0131n olaca\u011f\u0131 ve benzer \u015fekilde s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131nda s\u00f6zc\u00fck g\u00f6mmelerinin farkl\u0131 s\u00f6zc\u00fcklere yak\u0131n olaca\u011f\u0131d\u0131r.<\/p>\n\n\n\n<p id=\"69c2\">\u00d6rne\u011fin \u201cyaz\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn farkl\u0131 t\u00fcmcelerine bakal\u0131m:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u201cYaz mevsimini \u00e7ok seviyorum.\u201d,<\/li>\n\n\n\n<li>\u201cYaz gelsin de denize gidelim.\u201d,<\/li>\n\n\n\n<li>\u201cYaz\u0131n okullar tatil.\u201d,<\/li>\n\n\n\n<li>\u201cBu makaleyi sen mi yazd\u0131n?\u201d<\/li>\n\n\n\n<li>\u201cEve gidince bana mesaj yazars\u0131n.\u201d<\/li>\n\n\n\n<li>\u201cBu konuda bir \u015feyler yazmal\u0131s\u0131n.\u201d<\/li>\n<\/ol>\n\n\n\n<p id=\"683a\">Yukar\u0131da belirtti\u011fimiz varsay\u0131mlara g\u00f6re, 1, 2 ve 3. t\u00fcmcelerde \u201cyaz\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn g\u00f6mmeleri birbirlerine yak\u0131n ve 4, 5 ve 6. t\u00fcmcelerdeki \u201cyaz\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn g\u00f6mmelerine uzak olacakt\u0131r. Benzer bir \u015fekilde, 1, 2 ve 3. t\u00fcmcelerde \u201cyaz\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn g\u00f6mmeleri \u201ck\u0131\u015f\u201d, \u201csonbahar\u201d gibi di\u011fer mevsim s\u00f6zc\u00fcklerine yak\u0131n olacakken, 4, 5 ve 6. t\u00fcmcelerde \u201cyaz\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn g\u00f6mmeleri \u201cokumak\u201d, \u201ceditlemek\u201d gibi s\u00f6zc\u00fcklere daha yak\u0131n olacakt\u0131r.<\/p>\n\n\n\n<p id=\"c1ab\">Burada ele alaca\u011f\u0131m\u0131z yorumlanabilirlik \u00e7al\u0131\u015fmalar\u0131 da s\u00f6zc\u00fck g\u00f6mmelerinin birbirlerine yak\u0131nl\u0131klar\u0131ndan yola \u00e7\u0131karak s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131na ili\u015fkin sonu\u00e7lara varmaya \u00e7al\u0131\u015fmaktad\u0131r. Bunu, s\u00f6zc\u00fcklerin farkl\u0131 ba\u011flamlarda birbirlerine yak\u0131nl\u0131\u011f\u0131n\u0131 \u00f6l\u00e7erek (Lake ve Murphy 2020, Nair vd. 2020, Garcia, 2021) ya da s\u00f6zc\u00fck g\u00f6mmelerinin yak\u0131nl\u0131klar\u0131na g\u00f6re t\u00fcmceleri k\u00fcmeleyerek yapmaktad\u0131r (Yenicelik vd. 2021).<\/p>\n\n\n\n<p id=\"c1d5\">K\u00fcmeleme y\u00f6ntemi ise, vekt\u00f6rleri birbirlerine yak\u0131nl\u0131\u011f\u0131na g\u00f6re grupland\u0131ran bir y\u00f6ntemdir. S\u00f6zc\u00fck anlamlar\u0131n\u0131n ele al\u0131nd\u0131\u011f\u0131 \u00e7al\u0131\u015fmalarda k\u00fcmelemenin, s\u00f6zc\u00fcklerin ayn\u0131 anlamlarda kullan\u0131ld\u0131\u011f\u0131 t\u00fcmceleri birlikte gruplamas\u0131 beklenir.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/miro.medium.com\/v2\/resize:fit:1194\/1*jiPuS7jpents7sTXJaIdIw.png\" alt=\"\"\/><figcaption class=\"wp-element-caption\">G\u00f6rsel 4: \u201cyaz\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn farkl\u0131 t\u00fcmcelerinin k\u00fcmelenmesi.<\/figcaption><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"422a\"><strong>Ba\u011flamda E\u015fadl\u0131l\u0131\u011f\u0131n \u00c7\u00f6z\u00fcmlenmesi<\/strong><\/h2>\n\n\n\n<p id=\"f2b9\">Lake ve Murphy (2020) e\u015fadl\u0131 s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131n\u0131 ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f g\u00f6mmeler ile ay\u0131rt edilip edilemedi\u011fi ve t\u00fcmce ba\u011flam\u0131n\u0131n bundaki etkisini inceler. Bu ama\u00e7la \u0130ngilizcede e\u015fadl\u0131 olan \u201cbank\u201d (\u201cbanka\u201d ve \u201cnehir k\u0131y\u0131s\u0131\u201d) s\u00f6zc\u00fc\u011f\u00fc i\u00e7in 3 farkl\u0131 t\u00fcmce olu\u015fturur; n\u00f6tr, bir anlam\u0131 \u00f6ne \u00e7\u0131karan ve di\u011fer anlam\u0131 \u00f6ne \u00e7\u0131karan. Bu t\u00fcmceleri BERT ve GPT-2 modellerine vererek bu t\u00fcmcelerde \u201cbank\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn g\u00f6mmesinin hangi anlama yak\u0131n oldu\u011funu \u00f6l\u00e7er. Bunun i\u00e7in \u201cbank\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn g\u00f6mmesinin, bu t\u00fcmcelerde \u201cbanka\u201d anlam\u0131na yak\u0131n olan \u201ctreasury\u201d (\u201chazine\u201d) ve \u201cATM\u201d (\u201cATM\u201d) s\u00f6zc\u00fcklerine ve \u201cnehir k\u0131y\u0131s\u0131\u201d anlam\u0131na yak\u0131n olan \u201cshore\u201d (\u201csahil\u201d) ve \u201cbeach\u201d (\u201csahil\u201d) s\u00f6zc\u00fcklerine yak\u0131nl\u0131\u011f\u0131n\u0131 \u00f6l\u00e7er.<\/p>\n\n\n\n<p id=\"48ff\">Sonu\u00e7lar \u201cbank\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn \u201cbanka\u201d anlam\u0131nda kullan\u0131ld\u0131\u011f\u0131 ba\u011flamda, banka anlam\u0131yla ili\u015fkili s\u00f6zc\u00fcklere (\u201ctreasury\u201d, \u201cATM\u201d) daha yak\u0131n oldu\u011funu ve \u201cnehir k\u0131y\u0131s\u0131\u201d anlam\u0131ndaki ba\u011flamda ise bu anlamla ili\u015fkili s\u00f6zc\u00fcklere (\u201cshore\u201d \u201cbeach\u201d) daha yak\u0131n oldu\u011funu g\u00f6stermektedir (Tablo 1). Bu da bu modellerin e\u015fadl\u0131 s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131n\u0131n \u00e7\u00f6z\u00fcmlenmesinde ba\u011flamdaki bilgiyi ba\u015far\u0131l\u0131 bir \u015fekilde kullanabildi\u011fini g\u00f6stermektedir.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/miro.medium.com\/v2\/resize:fit:1400\/1*YlI4WkfByZwcvg8a0Pqu6w.png\" alt=\"\"\/><figcaption class=\"wp-element-caption\">Tablo 1: \u201cbank\u201d S\u00f6zc\u00fc\u011f\u00fcn\u00fcn Farkl\u0131 Ba\u011flamlar\u0131 i\u00e7in Deney Sonu\u00e7lar\u0131.<\/figcaption><\/figure>\n\n\n\n<p id=\"85f5\">Garcia (2021), Lake ve Murphy (2020)\u2019ye benzer bir \u015fekilde e\u015fadl\u0131 s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131n\u0131n BERT modelinin ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f g\u00f6mmeleriyle tespit edilip edilmedi\u011fine odaklan\u0131r ve BERT modelinin ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f g\u00f6mmeleriyle statik fastText g\u00f6mmelerinin performans\u0131n\u0131 kar\u015f\u0131la\u015ft\u0131r\u0131r.<\/p>\n\n\n\n<p id=\"731e\">Garcia (2021), Gali\u00e7yaca, Portekizce, \u0130ngilizce ve \u0130spanyolca \u00fczerinde deneyler yapar ve bu diller i\u00e7in datasetleri olu\u015fturur. Bu datasetlerinde se\u00e7ilen her e\u015fadl\u0131 s\u00f6zc\u00fc\u011f\u00fcn iki anlam\u0131 i\u00e7in farkl\u0131 t\u00fcmceler olu\u015fturur. \u00d6rne\u011fin, \u201ccoach\u201d s\u00f6zc\u00fc\u011f\u00fc \u0130ngilizcede e\u015fadl\u0131 bir s\u00f6zc\u00fckt\u00fcr; hem \u201cko\u00e7\u201d hem de \u201cotob\u00fcs\u201d anlamlar\u0131na gelmektedir. Bu s\u00f6zc\u00fc\u011f\u00fcn iki anlam\u0131 i\u00e7in olu\u015fturulan ba\u011flamlar ise \u015fu \u015fekildedir:<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/miro.medium.com\/v2\/resize:fit:1400\/1*axvd1W1pvPq-cqARnGElIw.png\" alt=\"\"\/><figcaption class=\"wp-element-caption\">Tablo 2: E\u015fadl\u0131 S\u00f6zc\u00fckler i\u00e7in Olu\u015fturulan Farkl\u0131 Ba\u011flamlar.<\/figcaption><\/figure>\n\n\n\n<p id=\"e36a\">\u201cCoach\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn her anlam\u0131 i\u00e7in 5 t\u00fcmce olu\u015fturulmu\u015ftur. Bu t\u00fcmcelerden iki tanesi s\u00f6zc\u00fc\u011f\u00fcn kendisiyle (1, 2\u20136, 7), iki tanesi s\u00f6zc\u00fc\u011f\u00fcn e\u015fanlaml\u0131s\u0131<a href=\"https:\/\/medium.com\/cogist\/kara-kutuyu-yorumlamak-b%C3%BCy%C3%BCk-dil-modelleri-ve-dil-bilgisi-ba%C4%9Flam-ve-anlam-deniz-ekin-yava%C5%9F-0d959877eb95#_ftn5\" target=\"_blank\" rel=\"noopener\">[5]<\/a>&nbsp;ile (3, 4,-8, 9) ve bir tanesi de ba\u015fka bir s\u00f6zc\u00fckledir (5\u201310). Bu \u015fekilde her e\u015fadl\u0131 s\u00f6zc\u00fck i\u00e7in 10 adet t\u00fcmce olu\u015fturulur.<\/p>\n\n\n\n<p id=\"cfbc\">Farkl\u0131 deneyler i\u00e7in, bu datasetindeki t\u00fcmceler modele verilir ve modelin bu t\u00fcmcelerde s\u00f6zc\u00fcklere atad\u0131\u011f\u0131 g\u00f6mmeler aras\u0131ndaki benzerlik \u00f6l\u00e7\u00fcl\u00fcr. Ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f g\u00f6mmelerin benzerlikleri ile bu s\u00f6zc\u00fcklerin statik g\u00f6mmelerinin benzerlikleri aras\u0131ndaki farklar kar\u015f\u0131la\u015ft\u0131r\u0131l\u0131r.<\/p>\n\n\n\n<p id=\"fc67\">\u0130lk deneyde ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f g\u00f6mmelerle e\u015fadl\u0131 s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131n\u0131n tespit edilip edilemedi\u011fi sorgulan\u0131r. Bunun i\u00e7in 1, 4 ve 6 t\u00fcmcelerindeki \u201ccoach\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn g\u00f6mmeleri kar\u015f\u0131la\u015ft\u0131r\u0131l\u0131r. Bu deneyde beklenen, s\u00f6zc\u00fc\u011f\u00fcn ayn\u0131 anlamlar\u0131n\u0131n g\u00f6mmelerinin birbirine benzer olmas\u0131d\u0131r (coach 1-coach 2 &lt; coach 1-coach 1). Deneyin sonu\u00e7lar\u0131 ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f g\u00f6mmelerin bu konuda \u00e7ok ba\u015far\u0131l\u0131 oldu\u011funu ancak statik g\u00f6mmelerin ba\u015far\u0131l\u0131 olmad\u0131klar\u0131n\u0131 g\u00f6stermektedir. Bunun nedeni statik g\u00f6mmelerin s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131 i\u00e7in farkl\u0131l\u0131k g\u00f6stermemesi ve her s\u00f6zc\u00fc\u011f\u00fcn tek bir g\u00f6mmesinin olmas\u0131d\u0131r.<\/p>\n\n\n\n<p id=\"730e\">\u0130kinci deneyde e\u015fadl\u0131 s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131n\u0131n birbirine yak\u0131nl\u0131\u011f\u0131 ile e\u015fanlaml\u0131lar\u0131na yak\u0131nl\u0131\u011f\u0131 kar\u015f\u0131la\u015ft\u0131r\u0131l\u0131r. Bunun i\u00e7in 1, 5 ve 6 t\u00fcmcelerindeki \u201ccoach\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn g\u00f6mmeleri kar\u015f\u0131la\u015ft\u0131r\u0131l\u0131r. Bu deneyde beklenen e\u015fadl\u0131 s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131n\u0131n birbirlerine de\u011fil ancak e\u015fanlaml\u0131lar\u0131na yak\u0131n olmas\u0131d\u0131r (coach 1-bus &gt; coach 1-coach 2). \u0130lk deneye benzer \u015fekilde bu deneyin sonu\u00e7lar\u0131 da ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f g\u00f6mmelerin bu konuda \u00e7ok ba\u015far\u0131l\u0131 oldu\u011funu ancak statik g\u00f6mmelerin ba\u015far\u0131l\u0131 olmad\u0131klar\u0131n\u0131 g\u00f6stermektedir. Bunun nedeni statik g\u00f6mmelerin ayn\u0131 s\u00f6zc\u00fck i\u00e7in her zaman birbirine daha yak\u0131n olmas\u0131d\u0131r, \u00e7\u00fcnk\u00fc g\u00f6mmeler ayn\u0131d\u0131r.<\/p>\n\n\n\n<p id=\"56cd\">Son deneyde ise s\u00f6zc\u00fcklerin e\u015fanlaml\u0131lar\u0131na yak\u0131nl\u0131klar\u0131 test edilir. Bunun i\u00e7in 1, 2 ve 3 t\u00fcmcelerindeki e\u015fadl\u0131 s\u00f6zc\u00fck, e\u015fanlaml\u0131s\u0131 ve rastgele se\u00e7ilmi\u015f s\u00f6zc\u00fc\u011f\u00fcn g\u00f6mmeleri kar\u015f\u0131la\u015ft\u0131r\u0131l\u0131r. Burada dikkat edilmesi gereken nokta, t\u00fcmcelerin bir s\u00f6zc\u00fck d\u0131\u015f\u0131nda ayn\u0131 olmas\u0131d\u0131r. Bu deneyde beklenen e\u015fadl\u0131 s\u00f6zc\u00fc\u011f\u00fcn, rastgele se\u00e7ilmi\u015f olan s\u00f6zc\u00fcktense e\u015fanlaml\u0131s\u0131na daha yak\u0131n olmas\u0131d\u0131r (coach 1-bus &gt; coach 1-bicycle). Bu deneyde statik g\u00f6mmeler \u00e7ok daha ba\u015far\u0131l\u0131 performans g\u00f6sterir. Bunun nedeni statik g\u00f6mmelerin farkl\u0131 s\u00f6zc\u00fckler aras\u0131ndaki anlamsal yak\u0131nl\u0131\u011f\u0131 yakalayabilmesidir. Ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f g\u00f6mmelerin k\u00f6t\u00fc performans g\u00f6stermesinin nedeni ise t\u00fcmce ba\u011flamlar\u0131n\u0131n ayn\u0131 olmas\u0131 nedeniyle s\u00f6zc\u00fckler aras\u0131ndaki ayr\u0131m\u0131n yap\u0131lamamas\u0131d\u0131r ve s\u00f6zc\u00fc\u011f\u00fcn kendisinden \u00e7ok ba\u011flam ortakl\u0131\u011f\u0131n\u0131n s\u00f6zc\u00fck g\u00f6mmelerinin benzerli\u011fini etkilemesidir.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"d0c3\"><strong>Anlam Ba\u011flant\u0131l\u0131l\u0131\u011f\u0131<\/strong><\/h2>\n\n\n\n<p id=\"c7b7\">Nair vd. (2020) \u00e7al\u0131\u015fmalar\u0131nda BERT modelinin \u00e7okanlaml\u0131 ve e\u015fadl\u0131 s\u00f6zc\u00fcklerinin farkl\u0131 anlamlar\u0131 aras\u0131ndaki ba\u011flant\u0131l\u0131l\u0131k derecelerinin insan yarg\u0131lar\u0131 ile \u00f6rt\u00fc\u015f\u00fcp \u00f6rt\u00fc\u015fmedi\u011fini ve modelin g\u00f6mmelerinde yola \u00e7\u0131karak \u00e7okanlaml\u0131-e\u015fadl\u0131 ayr\u0131m\u0131n\u0131n tespit edilip edilemedi\u011fini ele al\u0131r.<\/p>\n\n\n\n<p id=\"aec7\">\u00d6ncelikli olarak konu\u015fucularla yapt\u0131klar\u0131 anketle datalar\u0131ndaki \u00e7okanlaml\u0131 ve e\u015fadl\u0131 s\u00f6zc\u00fcklerin anlamlar\u0131 aras\u0131ndaki ba\u011flant\u0131l\u0131l\u0131\u011fa ili\u015fkin konu\u015fucu yarg\u0131lar\u0131n\u0131 ortaya \u00e7\u0131kar\u0131rlar. Bu anketin sonu\u00e7lar\u0131, konu\u015fucu yarg\u0131lar\u0131n\u0131n \u00e7okanlaml\u0131-e\u015fadl\u0131l\u0131k ayr\u0131m\u0131n\u0131 yans\u0131tt\u0131\u011f\u0131n\u0131 g\u00f6stermektedir.<\/p>\n\n\n\n<p id=\"73a2\">Daha sonra ayn\u0131 t\u00fcmceleri modele vererek \u00e7okanlaml\u0131 ve e\u015fadl\u0131 s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131 aras\u0131ndaki ba\u011flant\u0131l\u0131l\u0131\u011f\u0131 ortaya \u00e7\u0131karmay\u0131 ama\u00e7larlar. Bu ama\u00e7la bir s\u00f6zc\u00fc\u011f\u00fcn farkl\u0131 anlamlar\u0131n\u0131n t\u00fcmcelerinde o s\u00f6zc\u00fc\u011f\u00fcn g\u00f6mmelerini kar\u015f\u0131la\u015ft\u0131r\u0131rlar. \u00d6rne\u011fin, \u00e7okanlaml\u0131 \u201cge\u00e7mek\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn ve e\u015fadl\u0131 \u201cyaz\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn farkl\u0131 iki anlam\u0131n\u0131n t\u00fcmcelerini d\u00fc\u015f\u00fcnelim; \u201cSalondan odaya ge\u00e7tim.\u201d ve \u201cOkulu ge\u00e7tikten sonra sa\u011fa d\u00f6nd\u00fck.\u201d ve \u201cYaz mevsimini \u00e7ok seviyorum.\u201d ve \u201cBu makaleyi sen mi yazd\u0131n?\u201d. Bu deneyde beklenen \u201cge\u00e7mek\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcn farkl\u0131 anlamlar\u0131n\u0131n g\u00f6mmelerinin \u201cyaz\u201d s\u00f6zc\u00fc\u011f\u00fcn\u00fcnkinden daha yak\u0131n olmas\u0131d\u0131r.<\/p>\n\n\n\n<p id=\"d275\">Sonu\u00e7lar da bunu g\u00f6stermektedir. \u00c7okanlaml\u0131 s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131n\u0131 temsil eden s\u00f6zc\u00fck g\u00f6mmeleri birbirine daha yak\u0131nken yak\u0131nl\u0131k, e\u015fadl\u0131 s\u00f6zc\u00fckler i\u00e7in daha azd\u0131r. Benzer bir \u015fekilde, modelden al\u0131nan yak\u0131nl\u0131k sonu\u00e7lar\u0131 konu\u015fucular\u0131n anlamsal ba\u011flant\u0131l\u0131l\u0131k yarg\u0131lar\u0131yla y\u00fcksek korelasyona sahiptir.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"7131\"><strong>S\u00f6zc\u00fcklerin Anlamlar\u0131n\u0131n K\u00fcmelenmesi<\/strong><\/h2>\n\n\n\n<p id=\"62ce\">Yenicelik vd. (2021) \u00e7al\u0131\u015fmalar\u0131nda k\u00fcmeleme y\u00f6ntemiyle s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131n\u0131 ortaya \u00e7\u0131karmay\u0131 ama\u00e7lar. Bu ama\u00e7la, birden \u00e7ok anlama sahip s\u00f6zc\u00fcklerin farkl\u0131 t\u00fcmcelerini, bu t\u00fcmcelerde s\u00f6zc\u00fcklerin g\u00f6mmelerinin birbirine yak\u0131nl\u0131klar\u0131na g\u00f6re k\u00fcmelerler. Bunun sonucunda olu\u015fan k\u00fcmelerin s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131n\u0131 temsil etmesini beklerler.<\/p>\n\n\n\n<p id=\"926b\">Olu\u015fan t\u00fcmce k\u00fcmeleri incelendi\u011finde, k\u00fcmelerin farkl\u0131 anlamlar\u0131n k\u00fcmelenmesi sonucunda olu\u015fmad\u0131klar\u0131n\u0131 tespit ederler. K\u00fcmelerdeki anlam ortakl\u0131\u011f\u0131n\u0131n \u00f6tesinde t\u00fcmcelerin s\u00f6zdizimsel yap\u0131s\u0131nda ortakl\u0131klar oldu\u011fu ortaya \u00e7\u0131kmaktad\u0131r. Bu da t\u00fcmcenin yap\u0131s\u0131n\u0131n ve t\u00fcmcedeki s\u00f6zc\u00fcklerin benzerliklerinin s\u00f6zc\u00fck g\u00f6mmelerinin benzerliklerinin \u00fczerinde etkisi oldu\u011funu g\u00f6stermektedir.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"6989\"><strong>Sonu\u00e7<\/strong><\/h2>\n\n\n\n<p id=\"3e55\">Serinin bu yaz\u0131s\u0131nda b\u00fcy\u00fck dil modellerinin s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131n\u0131 ay\u0131rt edip edemediklerini sorgulayan yorumlanabilirlik \u00e7al\u0131\u015fmalar\u0131na de\u011findik. Bu \u00e7al\u0131\u015fmalar\u0131n sonucunda bu modellerin ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f s\u00f6zc\u00fck g\u00f6mmelerinin s\u00f6zc\u00fcklerin farkl\u0131 anlamlar\u0131n\u0131 ve anlamlar aras\u0131ndaki ba\u011flant\u0131l\u0131l\u0131\u011f\u0131 tespit etmede ve \u00e7okanlaml\u0131l\u0131k-e\u015fadl\u0131l\u0131k ayr\u0131m\u0131n\u0131 yapmada statik g\u00f6mmelere k\u0131yasla \u00e7ok daha ba\u015far\u0131l\u0131 olduklar\u0131n\u0131 g\u00f6rd\u00fck. Ancak ayn\u0131 zamanda ba\u011flamla\u015ft\u0131r\u0131lm\u0131\u015f g\u00f6mmelerin anlamsal benzerliklerin \u00f6tesinde t\u00fcmcedeki benzerliklerden dolay\u0131 da yak\u0131nl\u0131k g\u00f6sterdi\u011fini ve bu nedenle dezavantajlar\u0131 oldu\u011funu da g\u00f6rd\u00fck.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"5029\">Notlar<\/h2>\n\n\n\n<p id=\"17b4\"><a href=\"https:\/\/medium.com\/cogist\/kara-kutuyu-yorumlamak-b%C3%BCy%C3%BCk-dil-modelleri-ve-dil-bilgisi-ba%C4%9Flam-ve-anlam-deniz-ekin-yava%C5%9F-0d959877eb95#_ftnref1\" target=\"_blank\" rel=\"noopener\">[1]<\/a>&nbsp;E\u015fadl\u0131l\u0131\u011f\u0131n iki altt\u00fcr\u00fc vard\u0131r;&nbsp;<em>e\u015fseslilik&nbsp;<\/em>(<em>homophony<\/em>) ve&nbsp;<em>e\u015fyaz\u0131ml\u0131l\u0131k&nbsp;<\/em>(<em>homography<\/em>). T\u00fcrk\u00e7e\u2019de \u00e7o\u011funluklu e\u015fadl\u0131 s\u00f6zc\u00fckler hem e\u015fsesli hem de e\u015fyaz\u0131ml\u0131d\u0131r. Ancak \u00f6rne\u011fin, \u0130ngilizce\u2019de e\u015fseslilik ve e\u015fyaz\u0131ml\u0131l\u0131k ayr\u0131 olarak g\u00f6r\u00fclebilir. E\u015fseslilik \u00f6rne\u011fi olarak \u201ctheir\u201d (\u201conlar\u0131n\u201d)-\u201dthey\u2019re\u201d (\u201conlar\u201d)<em>;<\/em>&nbsp;farkl\u0131 yaz\u0131l\u0131r ama ayn\u0131 sesletilirler. E\u015fyaz\u0131ml\u0131l\u0131k \u00f6rne\u011fi olarak \u201cbow\u201d (\u201cok\u201d)-\u201dto bow\u201d (\u201ce\u011filmek\u201d); ayn\u0131 yaz\u0131l\u0131r ancak farkl\u0131 sesletime sahiptirler.<\/p>\n\n\n\n<p id=\"01f4\"><a href=\"https:\/\/medium.com\/cogist\/kara-kutuyu-yorumlamak-b%C3%BCy%C3%BCk-dil-modelleri-ve-dil-bilgisi-ba%C4%9Flam-ve-anlam-deniz-ekin-yava%C5%9F-0d959877eb95#_ftnref2\" target=\"_blank\" rel=\"noopener\">[2]<\/a>&nbsp;T\u00fcrk\u00e7e \u00fczerine bir \u00e7al\u0131\u015fma i\u00e7in bkz: U\u00e7ar (2009).<\/p>\n\n\n\n<p id=\"be39\"><a href=\"https:\/\/medium.com\/cogist\/kara-kutuyu-yorumlamak-b%C3%BCy%C3%BCk-dil-modelleri-ve-dil-bilgisi-ba%C4%9Flam-ve-anlam-deniz-ekin-yava%C5%9F-0d959877eb95#_ftnref3\" target=\"_blank\" rel=\"noopener\">[3]<\/a>&nbsp;Genel bir de\u011ferlendirme i\u00e7in bkz: Falkum ve Vicente (2015).<\/p>\n\n\n\n<p id=\"8de6\"><a href=\"https:\/\/medium.com\/cogist\/kara-kutuyu-yorumlamak-b%C3%BCy%C3%BCk-dil-modelleri-ve-dil-bilgisi-ba%C4%9Flam-ve-anlam-deniz-ekin-yava%C5%9F-0d959877eb95#_ftnref4\" target=\"_blank\" rel=\"noopener\">[4]<\/a>&nbsp;Vekt\u00f6rler aras\u0131ndaki yak\u0131nl\u0131k, iki vekt\u00f6r aras\u0131ndaki benzerli\u011fin \u00f6l\u00e7\u00fclmesiyle ortaya \u00e7\u0131kar\u0131l\u0131r. Bunun i\u00e7in kullan\u0131lan en yayg\u0131n \u00f6l\u00e7me y\u00f6ntemlerinden biri kosin\u00fcs benzerli\u011fidir (\u2018cosine similarity\u2019).<\/p>\n\n\n\n<p id=\"03fd\"><a href=\"https:\/\/medium.com\/cogist\/kara-kutuyu-yorumlamak-b%C3%BCy%C3%BCk-dil-modelleri-ve-dil-bilgisi-ba%C4%9Flam-ve-anlam-deniz-ekin-yava%C5%9F-0d959877eb95#_ftnref5\" target=\"_blank\" rel=\"noopener\">[5]<\/a>&nbsp;\u0130ki s\u00f6zc\u00fc\u011f\u00fcn ayn\u0131 anlama gelmesi&nbsp;<em>e\u015fanlaml\u0131l\u0131kt\u0131r&nbsp;<\/em>(<em>synonymy<\/em>). \u00d6rne\u011fin; kara\/siyah.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"ac91\">Kaynak\u00e7a<\/h2>\n\n\n\n<p id=\"65ae\">Falkum, I. L., &amp; Vicente, A. (2015). Polysemy: Current perspectives and approaches.&nbsp;<em>Lingua, 157<\/em>, 1\u201316.<\/p>\n\n\n\n<p id=\"aa77\">Frisson, S. (2015). About bound and scary books: The processing of book polysemies.&nbsp;<em>Lingua, 157<\/em>, 17\u201335.<\/p>\n\n\n\n<p id=\"5364\">Klepousniotou, E., Titone, D, &amp; Romero, C. (2008). Making sense of word senses: The comprehension of polysemy depends on sense overlap.&nbsp;<em>Journal of Experimental Psychology: Learning, Memory, and Cognition, 34<\/em>(6), 1534\u20131543.<\/p>\n\n\n\n<p id=\"b1a5\">Klepousniotou, E., Pike, B, G., Steinhauer, K., &amp; Gracco, V. (2012). Not all ambiguous words are created equal: An EEG investigation of homonymy and polysemy.&nbsp;<em>Brain and Language<\/em>.<\/p>\n\n\n\n<p id=\"1405\">MacGregor, L. J., Bouwsema, J., &amp; Klepousniotou, E. (2015). Sustained meaning activation for polysemous but not homonymous words: Evidence from EEG.&nbsp;<em>Neuropsychologia, 68<\/em>, 126\u2013138.<\/p>\n\n\n\n<p id=\"07c3\">Nair, S., Srinivasan, M., &amp; Meylan, S. (2020). Contextualized word embeddings encode aspects of human-like word sense knowledge. In&nbsp;<em>Proceedings of the Workshop on the Cognitive Aspects of the Lexicon<\/em>, 129\u2013141. Online: Association for Computational Linguistics.<\/p>\n\n\n\n<p id=\"2834\">Pylkk\u00e4nen, L., Llin\u00e1s, R., &amp; Murphy, G. L. (2006). The representation of polysemy: Meg evidence.&nbsp;<em>Journal of Cognitive Neuroscience, 18<\/em>(1), 97\u2013109.<\/p>\n\n\n\n<p id=\"c1d4\">U\u00e7ar, A. (2009). T\u00fcrk\u00e7ede Eylemlerde \u00c7okanlaml\u0131l\u0131k: Uygunluk Kuram\u0131 \u00c7er\u00e7evesinde Bir \u00c7\u00f6z\u00fcmleme. (Yay\u0131nlanmam\u0131\u015f Doktora Tezi). Ankara: Ankara \u00dcniversitesi Sosyal Bilimler Enstit\u00fcs\u00fc.<\/p>\n\n\n\n<p id=\"0b65\">Yenicelik, D., Schmidt, F., &amp; Kilcher, Y. (2020). How does BERT capture semantics? A closer look at polysemous words. In&nbsp;<em>Proceedings of the Third BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP<\/em>, 156\u2013162. Online: Association for Computational Linguistics.<\/p>","protected":false},"featured_media":2135,"template":"","meta":{"_acf_changed":false},"event_publishing_tags":[479,426,84,280,286,94,93,924,627,342,416,345,691,64,923,92,323,281,285,87,1057,62,1056,348,88,1058,1059,1053,341,89,343,344,76,1054,1055,346,425,61,349,96],"kategori":[725],"class_list":["post-2134","blog_content","type-blog_content","status-publish","has-post-thumbnail","hentry","event_publishing_tags-ai","event_publishing_tags-artificial","event_publishing_tags-artificial-intelligence","event_publishing_tags-bilgisayar","event_publishing_tags-bilgisayar-bilimi","event_publishing_tags-bilis","event_publishing_tags-bilissel-bilim","event_publishing_tags-bilissel-dilbilim","event_publishing_tags-buyuk-dil-modeli","event_publishing_tags-buyuk-dil-modelleri","event_publishing_tags-chatbot","event_publishing_tags-chatgpt","event_publishing_tags-cogist","event_publishing_tags-cognition","event_publishing_tags-cognitive-linguistics","event_publishing_tags-cognitive-science","event_publishing_tags-cogsci","event_publishing_tags-computer","event_publishing_tags-computer-science","event_publishing_tags-dil","event_publishing_tags-dil-modeli","event_publishing_tags-dilbilim","event_publishing_tags-dogal-dil-isleme","event_publishing_tags-intelligence","event_publishing_tags-language","event_publishing_tags-language-model","event_publishing_tags-language-modeli","event_publishing_tags-large-language-model","event_publishing_tags-large-language-models","event_publishing_tags-linguistics","event_publishing_tags-llm","event_publishing_tags-llms","event_publishing_tags-mind","event_publishing_tags-natural-language-processing","event_publishing_tags-nlp","event_publishing_tags-openai","event_publishing_tags-yapay","event_publishing_tags-yapay-zeka","event_publishing_tags-zeka","event_publishing_tags-zihin","kategori-yazi"],"acf":[],"_links":{"self":[{"href":"https:\/\/cog-ist.com\/en\/wp-json\/wp\/v2\/blog_content\/2134","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cog-ist.com\/en\/wp-json\/wp\/v2\/blog_content"}],"about":[{"href":"https:\/\/cog-ist.com\/en\/wp-json\/wp\/v2\/types\/blog_content"}],"version-history":[{"count":0,"href":"https:\/\/cog-ist.com\/en\/wp-json\/wp\/v2\/blog_content\/2134\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cog-ist.com\/en\/wp-json\/wp\/v2\/media\/2135"}],"wp:attachment":[{"href":"https:\/\/cog-ist.com\/en\/wp-json\/wp\/v2\/media?parent=2134"}],"wp:term":[{"taxonomy":"event_publishing_tags","embeddable":true,"href":"https:\/\/cog-ist.com\/en\/wp-json\/wp\/v2\/event_publishing_tags?post=2134"},{"taxonomy":"kategori","embeddable":true,"href":"https:\/\/cog-ist.com\/en\/wp-json\/wp\/v2\/kategori?post=2134"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}