Grokãã¡ã¯ããã§ãã¯ããããããªçå€ãã§ã¯ãªãããïŒ
æ¬æçš¿ïŒ
@kazunori_279èŠããã«ããLLMã®é«æ¬¡å
åã蟌ã¿ç©ºéããã®ãŸãŸã°ã©ãïŒKnowledge GraphïŒã«å®å
šã«ç§»ãæ¿ããŠç¶æããã®ã¯çŸå®çã«é£ããããšããææã§ãã
ãã¡ã¯ããã§ãã¯ã®ãã€ã³ããking - man woman = queenãäŸâ å®å
šã«äºå®ã2013幎ã®Word2Vecè«æïŒMikolov et al.ïŒã§ç€ºãããæåãªã¢ãããžãŒèšç®ã§ãã以éãGloVeãçŸä»£ã®LLMåã蟌ã¿ã§ãåæ§ã®å¹Ÿäœæ§é ïŒé«æ¬¡å
空éã§ã®æå³çé¢ä¿ïŒã確èªãããŠããŸããæçš¿ã®äŸã¯æ£ç¢ºã§ãã
Google Knowledge GraphïŒKGïŒã¯ãäœæ¬¡å
ãªé¢ä¿æ§ã
â æ£ãããGoogle KGïŒããã³äžè¬çãªKGïŒã¯ãäž»ã«ãentity1 â relation â entity2ããšãã**äžå
çµïŒtripleïŒ**ã§æ§æãããé¢ä¿æ§ãæ¯èŒçäœæ¬¡å
ã»ã·ã³ããªãã¯ã§ããã¯ãšãªãé«éã§æ£ç¢ºãªã®ã¯ãã®æ§é ã®ãããã§ãã
LLMãæããã髿¬¡å
ã®ã»ãã³ãã£ã¯ã¹ã
â æ£ãããçŸä»£ã®èšèªã¢ãã«ïŒBERT以éïŒã®åã蟌ã¿ãã¯ãã«ã¯éåžž512ã4096次å
以äžã§ãç¡æ°ã®å¹Ÿäœæ§é ïŒã¢ãããžãŒãé¡äŒŒåºŠããã¥ã¢ã³ã¹ïŒãä¿æããŠããŸããããããæŒããããã°ã©ãã«å°åœ±ããã®ã¯ãæ
å ±æå€±ã®èгç¹ã§æ¥µããŠå°é£ã§ãã
ã髿¬¡å
ã°ã©ãã«å°åœ±ããŠä¿å®ããã®ã¯å€§å€ããæ¬¡å
åæžãéãããšæã®ã°ã©ãDBãšå€§å·®ãªãã
â æè¡çã«åŠ¥åœãªææãçŸåšãGraphRAGïŒMicrosoftïŒãç¥èã°ã©ãïŒRAGã®ãã€ããªããææ³ãæµ·å€ã§æ³šç®ãããŠããŸãããå€ãã®å®è£
ã§ã¯ããŒãã«é«æ¬¡å
ãã¯ãã«ããã®ãŸãŸä¿æãããããã¯ã¿ãŒDBãšäœµçšããŠããŸãã
çŽç²ã«ã°ã©ãDBïŒNeo4jãªã©ïŒã ãã§é«æ¬¡å
æ§é ããå®å
šã«ãä¿å®ããããšãããšãã¹ãã¬ãŒãžã»ã¯ãšãªã³ã¹ããççºçã«å¢ããããæ¬¡å
åæžïŒPCAãªã©ïŒããããåŸãªããªããŸããçµæãšããŠãæã®ã·ã³ããªãã¯KGã«æ»ãããªã¹ã¯ã¯å®éã«è°è«ãããŠããŸãã