{"id":67,"date":"2020-06-01T16:44:59","date_gmt":"2020-06-01T16:44:59","guid":{"rendered":"http:\/\/mlhpc2.peter-zaspel.de\/?p=67"},"modified":"2020-06-15T16:42:45","modified_gmt":"2020-06-15T16:42:45","slug":"neuronal-network-compression-by-low-rank-approximation","status":"publish","type":"post","link":"https:\/\/www.peter-zaspel.de\/?p=67","title":{"rendered":"Neural Network Compression by Low Rank Approximation"},"content":{"rendered":"\n<p>This is a very technical topic, which I would be interested to explore. It involves:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>neural networks<\/li><li>low rank matrix approximation<\/li><\/ul>\n\n\n\n<p>Here the idea is to speed up neural network inference and maybe even training by approximating fully connected layers (i.e. matrices) by low-rank approximations of them.<\/p>\n\n\n\n<p><strong>WARNING:<\/strong> This is again a very mathematical topic.<br>References to be collected:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li><a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0925231220302253\">https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0925231220302253<\/a><\/li><\/ul>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This is a very technical topic, which I would be interested to explore. It involves: neural networks low rank matrix approximation Here the idea is to speed up neural network inference and maybe even training by approximating fully connected layers<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_import_markdown_pro_load_document_selector":0,"_import_markdown_pro_submit_text_textarea":"","footnotes":""},"categories":[4],"tags":[],"class_list":["post-67","post","type-post","status-publish","format-standard","hentry","category-summer-research-topics"],"_links":{"self":[{"href":"https:\/\/www.peter-zaspel.de\/index.php?rest_route=\/wp\/v2\/posts\/67","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.peter-zaspel.de\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.peter-zaspel.de\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.peter-zaspel.de\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.peter-zaspel.de\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=67"}],"version-history":[{"count":3,"href":"https:\/\/www.peter-zaspel.de\/index.php?rest_route=\/wp\/v2\/posts\/67\/revisions"}],"predecessor-version":[{"id":111,"href":"https:\/\/www.peter-zaspel.de\/index.php?rest_route=\/wp\/v2\/posts\/67\/revisions\/111"}],"wp:attachment":[{"href":"https:\/\/www.peter-zaspel.de\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=67"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.peter-zaspel.de\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=67"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.peter-zaspel.de\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=67"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}