{"id":25207,"date":"2021-01-13T11:42:54","date_gmt":"2021-01-13T10:42:54","guid":{"rendered":"https:\/\/cio.umh.es\/?p=25207"},"modified":"2022-01-13T11:52:13","modified_gmt":"2022-01-13T10:52:13","slug":"hernandez-a-amigo-j-m-2021-attention-mechanisms-and-their-applications-to-complex-systems-entropy-23-31-18-283","status":"publish","type":"post","link":"https:\/\/cio.umh.es\/en\/2021\/01\/13\/hernandez-a-amigo-j-m-2021-attention-mechanisms-and-their-applications-to-complex-systems-entropy-23-31-18-283\/","title":{"rendered":"Hern\u00e1ndez, A., Amig\u00f3, J.M. (2021) \u00abAttention mechanisms and their applications to complex systems\u00bb, Entropy, 23 (3):1\u201318, 283"},"content":{"rendered":"<p class=\"AuthorHeader-module__syvlN margin-size-4-t\"><strong>Adri\u00e1n Hern\u00e1ndez and Jos\u00e9 Mar\u00eda Amig\u00f3 (<em>MHU<\/em>)<\/strong><\/p>\n<p style=\"text-align: justify\"><strong>Abstract:<\/strong> <span>Deep learning models and graphics processing units have completely transformed the field of machine learning. Recurrent neural networks and long short-term memories have been successfully used to model and predict complex systems. However, these classic models do not perform sequential reasoning, a process that guides a task based on perception and memory. In recent years, attention mechanisms have emerged as a promising solution to these problems. In this review, we describe the key aspects of attention mechanisms and some relevant attention techniques and point out why they are a remarkable advance in machine learning. Then, we illustrate some important applications of these techniques in the modeling of complex systems.<\/span><\/p>","protected":false},"excerpt":{"rendered":"<p>Adri\u00e1n Hern\u00e1ndez and Jos\u00e9 Mar\u00eda Amig\u00f3 (Universidad Miguel Hern\u00e1ndez de Elche)<br \/>\nAbstract: Deep learning models and graphics processing units have completely transformed the field of machine learning. Recurrent neural networks and long short-term memories have been successfully used to model and predict complex systems. However, these classic models do not perform sequential reasoning, a process that [&#8230;]<\/p>","protected":false},"author":5675,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_links_to":"","_links_to_target":""},"categories":[369888],"tags":[],"_links":{"self":[{"href":"https:\/\/cio.umh.es\/en\/wp-json\/wp\/v2\/posts\/25207"}],"collection":[{"href":"https:\/\/cio.umh.es\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cio.umh.es\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cio.umh.es\/en\/wp-json\/wp\/v2\/users\/5675"}],"replies":[{"embeddable":true,"href":"https:\/\/cio.umh.es\/en\/wp-json\/wp\/v2\/comments?post=25207"}],"version-history":[{"count":0,"href":"https:\/\/cio.umh.es\/en\/wp-json\/wp\/v2\/posts\/25207\/revisions"}],"wp:attachment":[{"href":"https:\/\/cio.umh.es\/en\/wp-json\/wp\/v2\/media?parent=25207"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cio.umh.es\/en\/wp-json\/wp\/v2\/categories?post=25207"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cio.umh.es\/en\/wp-json\/wp\/v2\/tags?post=25207"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}