{"id":4690,"date":"2024-04-18T18:44:56","date_gmt":"2024-04-19T01:44:56","guid":{"rendered":"https:\/\/blog.sociamonials.com\/glossary\/gpt-3\/"},"modified":"2024-04-18T18:44:56","modified_gmt":"2024-04-19T01:44:56","slug":"gpt-3","status":"publish","type":"glossary","link":"https:\/\/blog.sociamonials.com\/es\/glossary\/gpt-3\/","title":{"rendered":"GPT-3"},"content":{"rendered":"<p>The innovative language model, GPT-3, developed by OpenAI, is the third installment in the GPT series and is distinguished by its unprecedented scale, making it the largest non-sparse language model currently available. Outperforming its predecessor, <a class=\"glossaryLink\"  href=\"https:\/\/blog.sociamonials.com\/es\/glossary\/gpt-2\/\"  target=\"_blank\"  data-mobile-support=\"0\"  data-gt-translate-attributes='[{\"attribute\":\"data-cmtooltip\", \"format\":\"html\"}]' tabindex='0' role='link'>GPT-2<\/a><span id=\"cmttFootnoteLink1-0\" class=\"cmtt-footnote\"><sup><a class=\"et_smooth_scroll_disabled cmtt_footnote_link cmtt-footnote-deflink\" href=\"#cmttFootnoteLink1\" style=\"font-size: 14px; color: #325afb; font-style : none ;\">[1]<\/a><\/sup><\/span>, and Microsoft&rsquo;s Turing NLG, GPT-3 has ten times the capacity of the latter. It is renowned for its capability to generate text, including news articles, and aid in coding tasks, though it also poses potential misuse threats such as the propagation of misinformation or phishing. GPT-3 comes in various versions to accommodate different needs, with davinci, possessing 175 billion parameters, being the largest. The subsequent GPT-3.5 series introduced new models and abilities. GPT-3 plays a pivotal role in both industry and research, supporting products like <a class=\"glossaryLink\"  href=\"https:\/\/blog.sociamonials.com\/es\/glossary\/github\/\"  target=\"_blank\"  data-mobile-support=\"0\"  data-gt-translate-attributes='[{\"attribute\":\"data-cmtooltip\", \"format\":\"html\"}]' tabindex='0' role='link'>GitHub<\/a><span id=\"cmttFootnoteLink2-0\" class=\"cmtt-footnote\"><sup><a class=\"et_smooth_scroll_disabled cmtt_footnote_link cmtt-footnote-deflink\" href=\"#cmttFootnoteLink2\" style=\"font-size: 14px; color: #325afb; font-style : none ;\">[2]<\/a><\/sup><\/span> Copilot and finding application in several Microsoft products. However, it also raises ethical and academic issues.<\/p>\n<div class=\"cmtt-footnotes-block\"><div class=\"cmtt-footnote-header\">Terms definitions<\/div><div class=\"cmtt-footnote-header-border\"><\/div><div class=\"cmtt-footnote-def \" id=\"cmttFootnoteLink1\"><span class=\"cmtt-footnote-def-number\">1. <\/span><span class=\"cmtt-footnote-def-back\"><a class=\"cmtt_footnote_link cmtt-footnote-backlink\" href=\"#cmttFootnoteLink1-0\" style=\"font-size: 14px; color: #325afb; font-style : none ;\"> &#8593; <\/a><\/span><span class=\"cmtt-footnote-def-key\"> <a aria-describedby=\"tt\" href=\"https:\/\/blog.sociamonials.com\/es\/glossary\/gpt-2\/\" class=\"glossaryLink\" target=\"_blank\">GPT-2<\/a> ( GPT-2 ) <\/span><span class=\"cmtt-footnote-def-content\"> Generative Pretrained Transformer 2, or GPT-2, is an advanced AI model specifically engineered for natural language processing tasks. This model, launched by OpenAI in February 2019, is renowned for its versatility in generating a wide array of text types, with its prowess extending to answering queries and completing code automatically. GPT-2's training involved a vast online text corpus, WebText, and it operates on a staggering 1.5 billion parameters. Despite its resource-intensive nature, GPT-2 has found usage in diverse and innovative applications such as text-centric adventure games and subreddit simulations. Initial misuse fears led to the full GPT-2 model's release in November 2019 when the concerns didn't manifest. However, to address resource constraints, a smaller model, DistilGPT2, was developed. The innovations and successes of GPT-2 set the stage for future progress in AI text generation. <\/span><\/div><div class=\"cmtt-footnote-def \" id=\"cmttFootnoteLink2\"><span class=\"cmtt-footnote-def-number\">2. <\/span><span class=\"cmtt-footnote-def-back\"><a class=\"cmtt_footnote_link cmtt-footnote-backlink\" href=\"#cmttFootnoteLink2-0\" style=\"font-size: 14px; color: #325afb; font-style : none ;\"> &#8593; <\/a><\/span><span class=\"cmtt-footnote-def-key\"> <a aria-describedby=\"tt\" href=\"https:\/\/blog.sociamonials.com\/es\/glossary\/github\/\" class=\"glossaryLink\" target=\"_blank\">GitHub<\/a> ( GitHub ) <\/span><span class=\"cmtt-footnote-def-content\"> Primarily designed for developers, GitHub is a platform that facilitates the creation, storage, management, and sharing of code. Built upon Git software, it provides features such as version control, access control, and bug tracking. Since becoming a Microsoft subsidiary in 2018, GitHub has established itself as a premier host for open source software projects. As of January 2023, it boasts a vibrant community of over 100 million developers and is home to more than 420 million repositories. GitHub was conceived in 2008 by its four founders and initially operated as a flat organization, fostering autonomy, flexibility, and collaboration among its members. In addition to version control, GitHub also provides services such as task management, continuous integration, and support for project wikis. It is more than just a platform; it's a comprehensive suite of tools for software development. <\/span><\/div><\/div><div class=\"cmtt-footnote-bottom-border\"><\/div>","protected":false},"excerpt":{"rendered":"<p>The innovative language model, GPT-3, developed by OpenAI, is the third installment in the GPT series and is distinguished by its unprecedented scale, making it the largest non-sparse language model currently available. Outperforming its predecessor, GPT-2, and Microsoft&rsquo;s Turing NLG, GPT-3 has ten times the capacity of the latter. It is renowned for its capability [&hellip;]<\/p>\n<div class=\"cmtt-footnotes-block\">\n<div class=\"cmtt-footnote-header\">Terms definitions<\/div>\n<div class=\"cmtt-footnote-header-border\"><\/div>\n<div class=\"cmtt-footnote-def \" id=\"cmttFootnoteLink1\"><span class=\"cmtt-footnote-def-number\">1. <\/span><span class=\"cmtt-footnote-def-back\"><a class=\"cmtt_footnote_link cmtt-footnote-backlink\" href=\"#cmttFootnoteLink1-0\" style=\"font-size: 14px; color: #325afb; font-style : none ;\"> &uarr; <\/a><\/span><span class=\"cmtt-footnote-def-key\"> <a aria-describedby=\"tt\" href=\"https:\/\/blog.sociamonials.com\/es\/glossary\/gpt-2\/\" class=\"glossaryLink\" target=\"_blank\">GPT-2<\/a> ( GPT-2 ) <\/span><span class=\"cmtt-footnote-def-content\"> Generative Pretrained Transformer 2, or GPT-2, is an advanced AI model specifically engineered for natural language processing tasks. This model, launched by OpenAI in February 2019, is renowned for its versatility in generating a wide array of text types, with its prowess extending to answering queries and completing code automatically. GPT-2&rsquo;s training involved a vast online text corpus, WebText, and it operates on a staggering 1.5 billion parameters. Despite its resource-intensive nature, GPT-2 has found usage in diverse and innovative applications such as text-centric adventure games and subreddit simulations. Initial misuse fears led to the full GPT-2 model&rsquo;s release in November 2019 when the concerns didn&rsquo;t manifest. However, to address resource constraints, a smaller model, DistilGPT2, was developed. The innovations and successes of GPT-2 set the stage for future progress in AI text generation. <\/span><\/div>\n<div class=\"cmtt-footnote-def \" id=\"cmttFootnoteLink2\"><span class=\"cmtt-footnote-def-number\">2. <\/span><span class=\"cmtt-footnote-def-back\"><a class=\"cmtt_footnote_link cmtt-footnote-backlink\" href=\"#cmttFootnoteLink2-0\" style=\"font-size: 14px; color: #325afb; font-style : none ;\"> &uarr; <\/a><\/span><span class=\"cmtt-footnote-def-key\"> <a aria-describedby=\"tt\" href=\"https:\/\/blog.sociamonials.com\/es\/glossary\/github\/\" class=\"glossaryLink\" target=\"_blank\">GitHub<\/a> ( GitHub ) <\/span><span class=\"cmtt-footnote-def-content\"> Primarily designed for developers, GitHub is a platform that facilitates the creation, storage, management, and sharing of code. Built upon Git software, it provides features such as version control, access control, and bug tracking. Since becoming a Microsoft subsidiary in 2018, GitHub has established itself as a premier host for open source software projects. As of January 2023, it boasts a vibrant community of over 100 million developers and is home to more than 420 million repositories. GitHub was conceived in 2008 by its four founders and initially operated as a flat organization, fostering autonomy, flexibility, and collaboration among its members. In addition to version control, GitHub also provides services such as task management, continuous integration, and support for project wikis. It is more than just a platform; it&rsquo;s a comprehensive suite of tools for software development. <\/span><\/div>\n<\/div>\n<div class=\"cmtt-footnote-bottom-border\"><\/div>\n<div class=\"cmtt-footnotes-block\"><div class=\"cmtt-footnote-header\">Terms definitions<\/div><div class=\"cmtt-footnote-header-border\"><\/div><div class=\"cmtt-footnote-def \" id=\"cmttFootnoteLink1\"><span class=\"cmtt-footnote-def-number\">1. <\/span><span class=\"cmtt-footnote-def-back\"><a class=\"cmtt_footnote_link cmtt-footnote-backlink\" href=\"#cmttFootnoteLink1-0\" style=\"font-size: 14px; color: #325afb; font-style : none ;\"> &#8593; <\/a><\/span><span class=\"cmtt-footnote-def-key\"> <a aria-describedby=\"tt\" href=\"https:\/\/blog.sociamonials.com\/es\/glossary\/gpt-2\/\" class=\"glossaryLink\" target=\"_blank\">GPT-2<\/a> ( GPT-2 ) <\/span><span class=\"cmtt-footnote-def-content\"> Generative Pretrained Transformer 2, or GPT-2, is an advanced AI model specifically engineered for natural language processing tasks. This model, launched by OpenAI in February 2019, is renowned for its versatility in generating a wide array of text types, with its prowess extending to answering queries and completing code automatically. GPT-2's training involved a vast online text corpus, WebText, and it operates on a staggering 1.5 billion parameters. Despite its resource-intensive nature, GPT-2 has found usage in diverse and innovative applications such as text-centric adventure games and subreddit simulations. Initial misuse fears led to the full GPT-2 model's release in November 2019 when the concerns didn't manifest. However, to address resource constraints, a smaller model, DistilGPT2, was developed. The innovations and successes of GPT-2 set the stage for future progress in AI text generation. <\/span><\/div><div class=\"cmtt-footnote-def \" id=\"cmttFootnoteLink2\"><span class=\"cmtt-footnote-def-number\">2. <\/span><span class=\"cmtt-footnote-def-back\"><a class=\"cmtt_footnote_link cmtt-footnote-backlink\" href=\"#cmttFootnoteLink2-0\" style=\"font-size: 14px; color: #325afb; font-style : none ;\"> &#8593; <\/a><\/span><span class=\"cmtt-footnote-def-key\"> <a aria-describedby=\"tt\" href=\"https:\/\/blog.sociamonials.com\/es\/glossary\/github\/\" class=\"glossaryLink\" target=\"_blank\">GitHub<\/a> ( GitHub ) <\/span><span class=\"cmtt-footnote-def-content\"> Primarily designed for developers, GitHub is a platform that facilitates the creation, storage, management, and sharing of code. Built upon Git software, it provides features such as version control, access control, and bug tracking. Since becoming a Microsoft subsidiary in 2018, GitHub has established itself as a premier host for open source software projects. As of January 2023, it boasts a vibrant community of over 100 million developers and is home to more than 420 million repositories. GitHub was conceived in 2008 by its four founders and initially operated as a flat organization, fostering autonomy, flexibility, and collaboration among its members. In addition to version control, GitHub also provides services such as task management, continuous integration, and support for project wikis. It is more than just a platform; it's a comprehensive suite of tools for software development. <\/span><\/div><\/div><div class=\"cmtt-footnote-bottom-border\"><\/div>","protected":false},"author":4,"featured_media":0,"menu_order":0,"template":"","meta":{"footnotes":""},"glossary-categories":[],"glossary-tags":[],"glossary-languages":[],"class_list":["post-4690","glossary","type-glossary","status-publish","hentry"],"post_title":"GPT-3","post_content":"The innovative language model, GPT-3, developed by OpenAI, is the third installment in the GPT series and is distinguished by its unprecedented scale, making it the largest non-sparse language model currently available. Outperforming its predecessor, GPT-2, and Microsoft's Turing NLG, GPT-3 has ten times the capacity of the latter. It is renowned for its capability to generate text, including news articles, and aid in coding tasks, though it also poses potential misuse threats such as the propagation of misinformation or phishing. GPT-3 comes in various versions to accommodate different needs, with davinci, possessing 175 billion parameters, being the largest. The subsequent GPT-3.5 series introduced new models and abilities. GPT-3 plays a pivotal role in both industry and research, supporting products like GitHub Copilot and finding application in several Microsoft products. However, it also raises ethical and academic issues.","_links":{"self":[{"href":"https:\/\/blog.sociamonials.com\/es\/wp-json\/wp\/v2\/glossary\/4690","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.sociamonials.com\/es\/wp-json\/wp\/v2\/glossary"}],"about":[{"href":"https:\/\/blog.sociamonials.com\/es\/wp-json\/wp\/v2\/types\/glossary"}],"author":[{"embeddable":true,"href":"https:\/\/blog.sociamonials.com\/es\/wp-json\/wp\/v2\/users\/4"}],"version-history":[{"count":0,"href":"https:\/\/blog.sociamonials.com\/es\/wp-json\/wp\/v2\/glossary\/4690\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.sociamonials.com\/es\/wp-json\/wp\/v2\/media?parent=4690"}],"wp:term":[{"taxonomy":"glossary-categories","embeddable":true,"href":"https:\/\/blog.sociamonials.com\/es\/wp-json\/wp\/v2\/glossary-categories?post=4690"},{"taxonomy":"glossary-tags","embeddable":true,"href":"https:\/\/blog.sociamonials.com\/es\/wp-json\/wp\/v2\/glossary-tags?post=4690"},{"taxonomy":"glossary-languages","embeddable":true,"href":"https:\/\/blog.sociamonials.com\/es\/wp-json\/wp\/v2\/glossary-languages?post=4690"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}