" shradda meeku kavalasindalla " ​​ paiper modhatisaarigaa trance ‌ faarmer modal ‌ nu pratipaadinchindi ,  idi tadupari  LLM pai teevra prabhavanni choopindi .  dayachesi yea paiper ‌ loo vivarimchina trance ‌ faarmer yokka pradhaana aalochananu ivvande 
 trance ‌ faarmer anede lothaina abhyasa namoonaa ,  idi in ‌ putt detaloni prathi bhaagam yokka praamukhyatanu bhedaatmakamgaa anchana vese sveeya - shradda yokka yantraamgaanni avalambistundi .  idi prathamikangaa sahaja basha prosessing  (NLP)  mariyu computers vijen  (CV)  rangaalalo upayoginchabadutundi .

 punaraavruta neural nett ‌ varey ‌ l  (RNN lu )  vale ,  trance ‌ formerlu anuvaadham mariyu text saransham vento panula choose aplication ‌ lato sahaja bhaasha vento sequential in ‌ putt deetaanu prosess cheyadanki ruupomdimchabaddaayi .  ayinappatikee , RNN l vale kakunda ,  trance ‌ formerlu motham in ‌ putt ‌ nu oksari prosess chestaayi .  attension mconism in ‌ putt sequence ‌ loni edaina sdhaanaaniki sandarbhaanni andistundi .  udaharanaku ,  in ‌ putt deetaa sahaja basha vakyam ayithe ,  trance ‌ faarmer ooka samayamlo ooka padaanni prosess cheyavalasina avsaram ledhu .  idi  RNN l kante ekuva samaantareekarananu anumatistundi mariyu anevalla sikshnha samayanni taggistundi .

 trance ‌ faarmer ‌ lanu  2017 loo gugle brain ‌ loni brundam parichayam chesindi mariyu lang shortt - term memary  (LSTM)  vento  RNN  modal ‌ lanu bhartee chesthu  NLP  samasyalaku empika modal ‌ gaaa maarutondi .  adanapu sikshnha samaantareekarana peddha dataset ‌ lapai sikshanhanu anumatistundi .  idi wekepedia corpus mariyu comon crall vento peddha basha dataset ‌ lato sikshnha pondina  BERT ( badi disaatmaka ene ‌ coder representations phraam trance ‌ pharmers )  mariyu  GPT ( generative pree - trained trance ‌ faarmer )  vento pree - trained sistom ‌ l abhivruddhiki dhaaritheesindhi mariyu baagane umtumdi -  nirdishta panula choose tune cheyabadindhi .
 yea paiper vaswani ,  ashsish  &  shajir ,  nom  &  parmar ,  niki  &  usj ‌ coreate ,  jacob  &  jones ,  leonean  &  gomez ,  idan  &  keizer ,  lucasz  &  polosukhin ,  ilia .  mariyu  2017 loo prachurinchabadindhi .  idi tadupari  GPT  siriis modal ‌ lu mariyu  BERT  siriis modal ‌ laku punaadi vesindhi . GPT  modal trance ‌ fommer yokka decoder bhaganni upayogistundi ,  ayithe  BERT  modal trance ‌ fommer yokka ene ‌ coder bhaganni upayogistundi .  trance ‌ faarmer modal yokka pradhaana korr arkhitekture ‌ loo ivi unnayi :  sveeya - attension mconism ,  positional ene ‌ kooding ,  ene ‌ coder - decoder arkhitekture ,  multy - hd attension .
 trance ‌ faarmer attension meconismnu upayoginchadam dwara munupati  RNN/LSTM  modal yokka clistamaina samantara samasyanu samardhavanthamgaa parishkaristundi .  sveeya - attension ‌ ni upayoginchadam valana  NLP loo parimitha lebul deetaa samasyanu parishkaristundi .  in ‌ putt text ‌ loni sequence Datia positional ene ‌ kooding dwara bhadraparachabadutundi .  mariyu multy - hd attension  CNN  modal ‌ loni channel consept maadirigaane vividha takala sikshnha deetaanu telusukovadaniki trance ‌ faarmer ‌ ni anumatistundi .