 peddha basha namunala gurinchina yea peragraph ‌ lanu batti , LLM lu eppudi udhbhavinchaayi ?
 larges longuage modal  (LLM)  anede anek paaraamitulatoe  ( saadharanamga biliyanla koddi baruvulu ledha anthakante ekuva )  neural nett ‌ varey ‌ thoo koodina basha namoonaa ,  sveeya - paryavekshinche abhyaasaanni upayoginchi peddha motthamloo lebul cheyani text ‌ pai sikshnha pondindi . LLM lu  2018 loo udhbhavinchaayi mariyu anek takala task ‌ lalo bagaa pania chestaayi .  idi sahaja basha prosessing parisoedhana yokka drhushtini nirdishta panula choose pratyeka paryavekshan namunala sikshnha yokka munupati namoonaa nundi dooramgaa marchindhi .

 lakshanhaalu 
 larges longuage modal aney padhaniki adhikarika nirvachanam lenappatiki ,  idi tarachugaa biliyanlu ledha anthakante ekuva sankhyalo paraamiti ganananu kaligi unna lothaina abhyasa namunalanu suchisthundi . LLM lu sadarana priyojana namuunaalu ,  ivi ooka nirdishta pania  ( centiment visleshana ,  peruu pettabadina entity ricognition ledha mathematically reasoning vantivi )  choose sikshnha pondakunda ,  visthrutha shraeniki panulalo raanistaayi .  varu vidhulanu sadhinche naipunyam mariyu varu cheyagaligina panula paridhi ,  aadhaarapadani vidhamgaa variki ketaayinchina vanarula  ( deetaa ,  paramiter - parimaanam ,  computing sakta )  yokka vidhigaa kanipistundhi .  design ‌ loo adanapu purogatulapai .

 vaakyamlo tadupari padaanni anchana vese paddhatilo saralamaina panulapai sikshnha pondinappatikii ,  thaginantha sikshnha mariyu paramiter gananalatho koodina naadii basha namuunaalu human bhaasha yokka chaaala vaakyanirmaanam mariyu ardhaalanu sangrahinchadaaniki kanugonabaddaayi .  adanamga ,  peddha basha namuunaalu prapamcham girinchi gananiyamaina sadarana gnaanaanni pradarsistaayi mariyu sikshnha samayamlo chaaala vaasthavaalanu  " gurthunchukogalavu ".

 bhraantulu 
 pradhaana vyasam :  bhraanthi  ( krutrima medhassu )
 saadharanamga krutrima medhassulo mariyu pratyekinchi peddha basha namuunaalaloo , " bhraanthi "  anede modal yokka sikshnha deetaa dwara samarthinchabadani ooka nammakamaina pratispandana .

 atyavasara saamarthyaalu 

 prasnalaku samadhanamivvadam vento anek sahaja basha bench ‌ marque ‌ lalo ,  modal ‌ lu ooka nirdishta sthaayiki chaerukunae varku yaadruchhika avaksam kante merugga pania chaeyavu  ( yea sandarbhamlo ,  sikshnha ganana dwara kolustaaru ),  aa samayamlo vaati paniteeru bagaa perugutundhi .  ivi emergency saamardhyaalaku udaaharanalu .
 peddha basha namuunaalaloo gamaninchabadina anoohyamaina saamarthyaalanu saadharanamga  " atyavasara saamarthyaalu "  antaruu . " chinna modalla paniteerunu ex ‌ trapolate cheeyadam dwara ituvante saamarthyaalanu anchana veyalemu "  ani parisodhakulu gamanincharu .  yea saamardhyaalu prograamme - in ledha design kakunda kanugonabadataayi ,  konni sandarbhaallo  LLM  piblic ‌ gaaa amalu cheyabadina tarwata Bara .  vandalaadi aavirbhava saamarthyaalu vivarinchabaddaayi .  udaharanalalo bahulha - dasala ankaganitam ,  kalaasaala - stayi parikshalu tiisukoevadam ,  ooka padm yokka uddeeshinchina ardhaanni gurtimchadam ,  alochanala srenini prerepinchadam ,  antarjaateeya phonetic alphabet ‌ nu decoding cheeyadam ,  padm yokka aksharaalanu an ‌ scramb cheeyadam ,  hinglish peraallo abhyantarakaramaina content ‌ nu gurtimchadam  ( mishramam hiindi mariyu inglishu ),  mariyu kiswahili saametalaku samaanamaina inglishunu ruupomdimchadam .

 arkhitekture mariyu sikshnha 
 peddha basha namuunaalu saadharanamga trance ‌ faarmer arkhitekture ‌ nu upayoginchaayi ,  idi  2018  nundi sequential deetaa choose praamaanika lothaina abhyasa saanketikatagaa marindi  ( gatamlo , LSTM  vento punaraavruta nirmaanaalu sarvasaadhaaranam ). LLM lu ullekhinchani vachanampai paryavekshinchabadani paddhatilo sikshnha pondhaaru .  munupati sandarbhaanni batti sikshnha detaloni tadupari padhaniki ketaayinchina sambhaavyatanu penchadaaniki edama nundi kudiki trance ‌ faarmer sikshnha pondindi .  pratyaamnaayamgaa ,  ooka  LLM  dvi disaatmaka trance ‌ faarmer ‌ nu upayoeginchavachchu  (BERT  udaharanalo vale ),  idi mundhu mariyu krindhi sandarbhaalaku yaakses ichina padaalapai sambhaavyata pampineeni ketayistundi .  tadupari padaanni anchana vaeyadam ledha  " khaaliilanu poorinchadam "  aney panitho paatu , LLM lu sahaayaka panulapai sikshnha pomdavacchu ,  ivi tadupari vakyala anchana  (NSP)  vento deetaa pampineepai vaari avagaahananu pareekshinchagalavu ,  veetilo jatha vaakyaalanu pradharshinchaaru mariyu sikshnha corpus ‌ loo avi pakkapakkane kanipistayo ledo modal tappanisariga anchana veyali .

 praarambha  LLM lu biliyanla padaala kramaanni kaligi unna karporapai sikshnha pondhaaru . OpenAI  yokka  GPT  siriis ‌ loni modati modal  2018 loo boq ‌ corpus ‌ loo  985  mallan padaalatoe sikshnha pondindi .  adae samvatsaramlo , BERT  boq ‌ corpus mariyu english wikipediala kalayikapai sikshnha pondindi ,  motham  3.3  biliyan padealu .  apati nundi samvatsaraalalo , LLM l choose sikshnha carpora parimaanam yokka aurdar ‌ l dwara pergindhi ,  vandala biliyanlu ledha trillianla token ‌ laku chaerukumdi .

LLM lu sikshnha pondenduku gananaparamgaa kharidainavi . 2020  adhyayanam  1.5  biliyan paramiter modal ‌ ku  ( apati kala kante  1-2  aurdar ‌ lu chinnadi )  sikshnha karchu  $1.6  millionluga anchana vesindhi .

 paaraamitula sanka ,  sikshnha deetaa parimaanam mariyu sikshnha choose upayoegimchae gananato pvr laaw relation ‌ ship ‌ loo naadii basha namunala saamarthyam  ( sikshnha nashtam dwara kolavabadinadi )  sajavuga perigindani  2020  visleshana kanugondi .  yea sambandhaalu visthrutha shraeniki viluvalalo  ( edu aurdar ‌ l parimaanam varku )  pareekshinchabaddaayi mariyu shraeniki yokka athyadhika mugimpulo  ( trillianla paramiter ‌ l varku nett ‌ varey parimaanaalatoe sahaa )  sambandam yokka atenuiation gamaninchabadaledu .

 dhiguva panulaku aplication 
2018  mariyu  2020  Madhya ,  nirdishta naturally longuage prosessing  (NLP)  task choose  LLM ni upayoginchakovadaaniki praamaanika paddathi adanapu task - nirdishta sikshanato modal ‌ nu chakkaga teerchididdadam . GPT-3  vento marinta saktivantamaina  LLM lu  " prompting "  technic ‌ l dwara adanapu sikshnha lekunda panulanu parishkarinchagalavani taruvaata kanugonabadindi ,  dheenilo parishkarinchaalsina samasya namuunaaaku text prompt ‌ gaaa andincabadutundi ,  bahusa ilanti vatiki sambamdhinchina konni paatya udaaharanalatoo samasyalu mariyu vaati parishkaaralu .

 fine - tuning 
 pradhaana vyasam :  fine - tuning  ( yantra abhyasam )
 fine - tuning anede ooka nirdishta task ‌ pai  ( udaa .  centiment visleshana ,  paerunna entity ricognition ledha part - af - speach tagging )  sikshnha dwara  ( paryavekshinchabadina paddhatilo )  ippatike unna pritrined longuage modal ‌ nu savarinche paddathi .  idi badilee abhyasam yokka ooka roopam .  idi saadharanamga longuage modal yokka chivari poranu dhiguva task yokka avut ‌ putt ‌ ki anusandhaaninche kothha baruvula sett ‌ nu parichayam chesthundu .  basha namoonaa yokka asalaina baruvulu  " stambhimpajeyabadi "  vumdavacchu ,  tadwara vatini avut ‌ putt ‌ ki anusandhaaninche kothha baruvula pora Bara sikshnha samayamlo nerchukuntaru .  pratyaamnaayamgaa ,  asalau baruvulu chinna app ‌ date ‌ lanu andukovachu  ( bahusa munupati layer ‌ lu stambhimpajesi vumdavacchu ).

 prompt chestondi 
 ivi kudaa chudandi :  prompt inginiiring mariyu konni - shat lerning  ( sahaja basha prosessing )
 prompting namunalo , GPT-3  dwara praacuryam pondindi ,  parishkarinchaalsina samasya text prompt dwara ruupomdimchabadimdi ,  namoonaa porthi cheeyadam dwara  ( anumati dwara )  parishkarinchaali . " konni - shat prompting " loo ,  prompt saaroopya  ( samasya ,  parishkaaram )  jatalaku sambamdhinchina chinna sankhyalo udaaharanalanu kaligi umtumdi .  udaharanaku ,  chalanachitra sameeksha yokka centiment ‌ nu lebul chese centiment visleshana pania krindhi vidhamgaa prompt cheyabaduthundhi :

 rivyuu :  yea cinma kampu kodutondi .
 centiment :  pratikula 

 sameeksha :  yea cinma adbhutam !
 centiment :

 modal  " positive "  avut ‌ putt cheestee ,  adi panini sariggaa parishkarinchindi .  zaro - shat prompting ‌ loo ,  parishkaara udaaharanalu andinchabadaledu .  adae centiment visleshana task ‌ ku zaro - shat prompt ‌ ki udaharanaga  " cinma sameekshato anubandhinchabadina centiment  ' yea chitram adhbhuthanga Pali !'  Pali ".

LLM l yokka konni - shat paniteeru  NLP  task ‌ lapai pooti phalithaalanu saadhinchagaladani choopabadindi ,  konnisarlu idi munupati state af dhi art fine - tuning vidhanalanu adhigamistundi .  atuvanti  NLP  task ‌ laku udaaharanalu anuvaadham ,  prasnalaku samadhanamivvadam ,  closes task ‌ lu ,  padalanu an ‌ scrambling cheeyadam mariyu vaakyamlo navala padaanni upayoginchadam .  atuvanti prompt ‌ l srusti mariyu optimization ‌ nu prompt inginiiring antaruu .

 suchanala tuning 
 in ‌ struction tuning anede marinta sahajamaina mariyu khachitamaina zaro - shat prompting interaction ‌ lanu sulabhatharam cheyadanki roopondinchabadina fine - tuning yokka ooka roopam .  text in ‌ putt ichinatlayithe ,  mundhuga sikshnha pondina basha namoonaa adi sikshnha pondina text pampineeki saripole puurtini roopondistundi . " hamlet yokka pradhaana itivruttaala girinchi ooka vyasam vraayandi "  aney prompt andimchabadina ooka amayaka basha namoonaa . " marchi  17  tarwata svikarinchina samarpanalaku rojuku  10%  aalasyamaina penalti vartinchabadutundi "  vento puurtini andinchavachhu .  in ‌ struction tuning ‌ loo ,  samuchita pratispandanalatho paatu sahaja basha suchanala vale roopondinchabadina anek panula udaaharanalapai basha namoonaa sikshnha pondutundi .  suchanala tuning choose vividha padhathulu aacharanalo upayoginchabaddaayi . OpenAI  yokka  InstructGPT  protocal human - srustinchina  ( prompt ,  responses )  jatala dataset ‌ pai paryavekshinchabade fine - tuning ‌ nu kaligi umtumdi ,  tarwata human abhipraayaala  (RLHF)  nundi upabala abhyasam umtumdi ,  dheenilo human praadhaanyatala dataset aadhaaramga reward function nerchukuntaru .  maroka saanketikata , " selfi - in ‌ struct ", LLM ( human - utpatthi udaaharanala yokka chinna praarambha sett nundi boot ‌ strap cheyabadindhi )  dwara roopondinchabadina sikshnhaa udaaharanala sett ‌ pai basha namuunaanu chakkaga tune chesthundu .

https://en.wikipedia.org/wiki/Large_language_model
 dadapu  2018.