{"id":28355,"date":"2016-09-01T18:35:55","date_gmt":"2016-09-01T15:35:55","guid":{"rendered":"https:\/\/www.altoros.com\/blog\/?p=28355"},"modified":"2021-03-05T13:50:51","modified_gmt":"2021-03-05T10:50:51","slug":"under-the-hood-mechanisms-of-neural-networks-with-tensorflow","status":"publish","type":"post","link":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/","title":{"rendered":"Under-the-Hood Mechanisms of Neural Networks with TensorFlow"},"content":{"rendered":"<p><img decoding=\"async\" src=\"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2016\/09\/tensorflow_seattle-v11.jpeg\" alt=\"tensorflow_seattle-v11\" width=\"180\" style=\"padding: 0px 0px 20px 20px;\" class=\"alignright size-full wp-image-28660\" \/><\/p>\n<p>Neural networks are actively applied to improve speech recognition, facial identification, reading emotions, <a href=\"https:\/\/www.altoros.com\/blog\/tensorflow-for-recommendation-engines-and-customer-feedback-analysis\/\">sentiment analysis<\/a>, <a href=\"https:\/\/www.altoros.com\/blog\/tensorflow-and-openpower-driving-faster-cancer-recognition-and-diagnosis\/\">disease diagnosis<\/a>, etc. At the recent <a href=\"https:\/\/www.meetup.com\/TensorFlow-Seattle\/events\/232539223\/\" target=\"_blank\" rel=\"noopener noreferrer\">TensorFlow meetup<\/a> in Seattle, the attendees were plunged into the world of convolutional and recurrent neural networks, their under-the-hood mechanisms, and usage with TensorFlow, learning some handy tricks on the way.<\/p>\n<p><!--more-->&nbsp;<\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_2 counter-hierarchy ez-toc-counter ez-toc-transparent ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/#All_things_neural\" >All things neural<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/#Want_details_Watch_the_video\" >Want details? Watch the video!<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/#Related_slides\" >Related slides<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/#Further_reading\" >Further reading<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/#About_the_expert\" >About the expert<\/a><\/li><\/ul><\/nav><\/div>\n<h3><span class=\"ez-toc-section\" id=\"All_things_neural\"><\/span>All things neural<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>In his session, <a href=\"https:\/\/www.linkedin.com\/in\/nick-mcclure-89809159\" target=\"_blank\" rel=\"noopener noreferrer\">Nick McClure<\/a> of PayScale took a close look at neural networks. He introduced the audience to a basic unit of a neural network\u2014an operational gate\u2014and explained how to make use of multiple gates. Then, Nick moved on to:<\/p>\n<ul>\n<li>loss functions<\/li>\n<li>learning rate (it determines how much of a change can be applied to model parameters)<\/li>\n<li><a href=\"https:\/\/www.altoros.com\/blog\/using-logistic-and-softmax-regression-with-tensorflow\/\">logistic regression<\/a> as a neural network<\/li>\n<li>activation functions<\/li>\n<\/ul>\n<p><center><\/p>\n<blockquote class=\"twitter-tweet\" data-lang=\"en\">\n<p lang=\"en\" dir=\"ltr\">Why neural networks? If we can copy design of human brain, we can solve &quot;hard 4 computer, easy 4 humans&quot; problems. <a href=\"https:\/\/twitter.com\/dragonc\/status\/758484244670717952\/photo\/1\">pic.twitter.com\/ak17PcLwWM<\/a><\/p>\n<p>&mdash; Nikki Chau (@dragonc) <a href=\"https:\/\/twitter.com\/dragonc\/status\/758484244670717952\">July 28, 2016<\/a><\/p><\/blockquote>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/center><\/p>\n<p>Nick outlined that neural networks can have a bunch of \u201chidden layers\u201d and it\u2019s possible to make them as deep as wanted. He also mentioned that neural networks can have as many inputs \/ outputs as necessary.<\/p>\n<p>Nick overviewed the perks of TensorFlow as a library for deep learning, highlighting the following aspects:<\/p>\n<ul>\n<li>how TensorFlow algorithms work<\/li>\n<li>a one-hidden layer neural network in TensorFlow<\/li>\n<li><a href=\"https:\/\/www.altoros.com\/research-papers\/performance-of-distributed-tensorflow-a-multi-node-and-multi-gpu-configuration\/\" target=\"_blank\" rel=\"noopener noreferrer\">distributed TensorFlow<\/a><\/li>\n<li>GPU capabilities<\/li>\n<li><a href=\"https:\/\/www.altoros.com\/blog\/visualizing-tensorflow-graphs-with-tensorboard\/\">TensorBoard<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/tensorflow\/tensorflow\/tree\/master\/tensorflow\/contrib\/learn\/python\/learn\" target=\"_blank\" rel=\"noopener noreferrer\">skflow<\/a><\/li>\n<\/ul>\n<p>Overviewing <a href=\"https:\/\/www.altoros.com\/blog\/using-convolutional-neural-networks-and-tensorflow-for-image-classification\/\">convolutional neural networks<\/a> (CNN), Nick touched upon reduction of parameters and showed some tricks to try out: pooling and dropout. He also talked about using a regional CNN and a recurrent neural network for image captioning.<\/p>\n<p><center><\/p>\n<blockquote class=\"twitter-tweet\" data-lang=\"en\">\n<p lang=\"en\" dir=\"ltr\">A different kind of CNN: Convolutional Neural Network \u2013 used for pattern recognition, like a cat&#39;s face. <a href=\"https:\/\/twitter.com\/_davmar\">@_davmar<\/a> &#x1f63a;&#x1f63b; <a href=\"https:\/\/t.co\/JJhx57vVXE\">pic.twitter.com\/JJhx57vVXE<\/a><\/p>\n<p>&mdash; Nikki Chau (@dragonc) <a href=\"https:\/\/twitter.com\/dragonc\/status\/758493606541832194\">July 28, 2016<\/a><\/p><\/blockquote>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/center><\/p>\n<p>You can find Nick&#8217;s &#8220;<a href=\"https:\/\/github.com\/nfmcclure\/tensorflow_cookbook\" target=\"_blank\" rel=\"noopener noreferrer\">TensorFlow Machine Learning Cookbook<\/a>&#8221; on his GitHub&#8217;s profile.<\/p>\n<p>&nbsp;<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Want_details_Watch_the_video\"><\/span>Want details? Watch the video!<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><center><script src=\"\/\/fast.wistia.com\/embed\/medias\/s1gzl0r7za.jsonp\" async><\/script><script src=\"\/\/fast.wistia.com\/assets\/external\/E-v1.js\" async><\/script><\/p>\n<div class=\"wistia_embed wistia_async_s1gzl0r7za\" style=\"height:360px;width:640px\">&nbsp;<\/div>\n<p><\/center><\/p>\n<p>&nbsp;<\/p>\n<p>Join the <a href=\"https:\/\/www.meetup.com\/TensorFlow-Seattle\/\" target=\"_blank\" rel=\"noopener noreferrer\">meetup group<\/a> to get informed about the upcoming events.<\/p>\n<p>&nbsp;<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Related_slides\"><\/span>Related slides<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><center><iframe loading=\"lazy\" src=\"\/\/www.slideshare.net\/slideshow\/embed_code\/key\/ogHGgI6dDsVCN6\" width=\"595\" height=\"485\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\" style=\"border:1px solid #CCC; border-width:1px; margin-bottom:5px; max-width: 100%;\" allowfullscreen><\/iframe><\/center><\/p>\n<p>&nbsp;<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Further_reading\"><\/span>Further reading<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ul>\n<li><a href=\"https:\/\/www.altoros.com\/blog\/image-and-text-recognition-with-tensorflow-using-convolutional-neural-networks\/\">Image and Text Recognition with TensorFlow Using Convolutional Neural Networks<\/a><\/li>\n<li><a href=\"https:\/\/www.altoros.com\/blog\/using-convolutional-neural-networks-and-tensorflow-for-image-classification\/\">Using Convolutional Neural Networks and TensorFlow for Image Classification<\/a><\/li>\n<li><a href=\"https:\/\/www.altoros.com\/blog\/distributed-tensorflow-and-classification-of-time-series-data-using-neural-networks\/\">Distributed TensorFlow and Classification of Time Series Data Using Neural Networks<\/a><\/li>\n<li><a href=\"https:\/\/www.altoros.com\/research-papers\/performance-of-distributed-tensorflow-a-multi-node-and-multi-gpu-configuration\/\" target=\"_blank\" rel=\"noopener noreferrer\">Performance of Distributed TensorFlow: A Multi-Node and Multi-GPU Configuration<\/a><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h3><span class=\"ez-toc-section\" id=\"About_the_expert\"><\/span>About the expert<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div>\n<div style=\"float: right;\"><a href=\"https:\/\/www.linkedin.com\/in\/nick-mcclure-89809159\" rel=\"noopener noreferrer\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2016\/09\/nick-mcclure-payscale.png\" alt=\"\" width=\"150\" height=\"150\" class=\"alignright size-full wp-image-60439\" \/><\/a><\/div>\n<div style=\"width: 600px;\"><small><a href=\"https:\/\/www.linkedin.com\/in\/nick-mcclure-89809159\" rel=\"noopener noreferrer\" target=\"_blank\">Nick McClure<\/a> is Senior Data Scientist at PayScale, where he works on machine learning and natural language processing algorithms. He has experience in house price estimation, image recognition, casino game design, optimal slot machine placement, and customer worth prediction. Nick has a PhD in applied mathematics from the University of Montana and currently works as Instructor at the University of Washington, teaching students data science and applied mathematics.<\/small><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<\/p>\n<p>Neural networks are actively applied to improve speech recognition, facial identification, reading emotions, sentiment analysis, disease diagnosis, etc. At the recent TensorFlow meetup in Seattle, the attendees were plunged into the world of convolutional and recurrent neural networks, their under-the-hood mechanisms, and usage with TensorFlow, learning some handy tricks on [&#8230;]<\/p>\n","protected":false},"author":3,"featured_media":60438,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[214],"tags":[748,749],"class_list":["post-28355","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tutorials","tag-machine-learning","tag-tensorflow"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Under-the-Hood Mechanisms of Neural Networks with TensorFlow | Altoros<\/title>\n<meta name=\"description\" content=\"Learn about the capabilities of convolutional and recurrent neural networks, their application to image captioning, as well as the implementation in TensorFlow.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Under-the-Hood Mechanisms of Neural Networks with TensorFlow | Altoros\" \/>\n<meta property=\"og:description\" content=\"Neural networks are actively applied to improve speech recognition, facial identification, reading emotions, sentiment analysis, disease diagnosis, etc. At the recent TensorFlow meetup in Seattle, the attendees were plunged into the world of convolutional and recurrent neural networks, their under-the-hood mechanisms, and usage with TensorFlow, learning some handy tricks on [...]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/\" \/>\n<meta property=\"og:site_name\" content=\"Altoros\" \/>\n<meta property=\"article:published_time\" content=\"2016-09-01T15:35:55+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-03-05T10:50:51+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2016\/09\/convolutional-and-recurrent-neural-networks-for-image-captioning-operational-gate-loss-function-learning-rate-tensorflow-deep-learning-library.gif\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"767\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/gif\" \/>\n<meta name=\"author\" content=\"Sophia Turol\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Sophia Turol\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\\\/\"},\"author\":{\"name\":\"Sophia Turol\",\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/#\\\/schema\\\/person\\\/58194952af19fe7b2b830846e077a58e\"},\"headline\":\"Under-the-Hood Mechanisms of Neural Networks with TensorFlow\",\"datePublished\":\"2016-09-01T15:35:55+00:00\",\"dateModified\":\"2021-03-05T10:50:51+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\\\/\"},\"wordCount\":453,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/wp-content\\\/uploads\\\/2016\\\/09\\\/convolutional-and-recurrent-neural-networks-for-image-captioning-operational-gate-loss-function-learning-rate-tensorflow-deep-learning-library.gif\",\"keywords\":[\"Machine Learning\",\"TensorFlow\"],\"articleSection\":[\"Tutorials\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.altoros.com\\\/blog\\\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\\\/\",\"url\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\\\/\",\"name\":\"Under-the-Hood Mechanisms of Neural Networks with TensorFlow | Altoros\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/wp-content\\\/uploads\\\/2016\\\/09\\\/convolutional-and-recurrent-neural-networks-for-image-captioning-operational-gate-loss-function-learning-rate-tensorflow-deep-learning-library.gif\",\"datePublished\":\"2016-09-01T15:35:55+00:00\",\"dateModified\":\"2021-03-05T10:50:51+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/#\\\/schema\\\/person\\\/58194952af19fe7b2b830846e077a58e\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.altoros.com\\\/blog\\\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/wp-content\\\/uploads\\\/2016\\\/09\\\/convolutional-and-recurrent-neural-networks-for-image-captioning-operational-gate-loss-function-learning-rate-tensorflow-deep-learning-library.gif\",\"contentUrl\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/wp-content\\\/uploads\\\/2016\\\/09\\\/convolutional-and-recurrent-neural-networks-for-image-captioning-operational-gate-loss-function-learning-rate-tensorflow-deep-learning-library.gif\",\"width\":1024,\"height\":767},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Under-the-Hood Mechanisms of Neural Networks with TensorFlow\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/\",\"name\":\"Altoros\",\"description\":\"Insight\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/#\\\/schema\\\/person\\\/58194952af19fe7b2b830846e077a58e\",\"name\":\"Sophia Turol\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/wp-content\\\/uploads\\\/2019\\\/05\\\/trello_card-96x96.jpg\",\"url\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/wp-content\\\/uploads\\\/2019\\\/05\\\/trello_card-96x96.jpg\",\"contentUrl\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/wp-content\\\/uploads\\\/2019\\\/05\\\/trello_card-96x96.jpg\",\"caption\":\"Sophia Turol\"},\"description\":\"Sophia Turol is passionate about delivering well-structured articles that cater for picky technical audience. With 3+ years in technical writing and 5+ years in editorship, she enjoys collaboration with developers to create insightful, yet intelligible technical tutorials, overviews, and case studies. Sophie is enthusiastic about deep learning solutions\u2014TensorFlow in particular\u2014and PaaS systems, such as Cloud Foundry.\",\"url\":\"https:\\\/\\\/www.altoros.com\\\/blog\\\/author\\\/sophie-turol\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Under-the-Hood Mechanisms of Neural Networks with TensorFlow | Altoros","description":"Learn about the capabilities of convolutional and recurrent neural networks, their application to image captioning, as well as the implementation in TensorFlow.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/","og_locale":"en_US","og_type":"article","og_title":"Under-the-Hood Mechanisms of Neural Networks with TensorFlow | Altoros","og_description":"Neural networks are actively applied to improve speech recognition, facial identification, reading emotions, sentiment analysis, disease diagnosis, etc. At the recent TensorFlow meetup in Seattle, the attendees were plunged into the world of convolutional and recurrent neural networks, their under-the-hood mechanisms, and usage with TensorFlow, learning some handy tricks on [...]","og_url":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/","og_site_name":"Altoros","article_published_time":"2016-09-01T15:35:55+00:00","article_modified_time":"2021-03-05T10:50:51+00:00","og_image":[{"width":1024,"height":767,"url":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2016\/09\/convolutional-and-recurrent-neural-networks-for-image-captioning-operational-gate-loss-function-learning-rate-tensorflow-deep-learning-library.gif","type":"image\/gif"}],"author":"Sophia Turol","twitter_misc":{"Written by":"Sophia Turol","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/#article","isPartOf":{"@id":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/"},"author":{"name":"Sophia Turol","@id":"https:\/\/www.altoros.com\/blog\/#\/schema\/person\/58194952af19fe7b2b830846e077a58e"},"headline":"Under-the-Hood Mechanisms of Neural Networks with TensorFlow","datePublished":"2016-09-01T15:35:55+00:00","dateModified":"2021-03-05T10:50:51+00:00","mainEntityOfPage":{"@id":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/"},"wordCount":453,"commentCount":0,"image":{"@id":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/#primaryimage"},"thumbnailUrl":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2016\/09\/convolutional-and-recurrent-neural-networks-for-image-captioning-operational-gate-loss-function-learning-rate-tensorflow-deep-learning-library.gif","keywords":["Machine Learning","TensorFlow"],"articleSection":["Tutorials"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/","url":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/","name":"Under-the-Hood Mechanisms of Neural Networks with TensorFlow | Altoros","isPartOf":{"@id":"https:\/\/www.altoros.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/#primaryimage"},"image":{"@id":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/#primaryimage"},"thumbnailUrl":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2016\/09\/convolutional-and-recurrent-neural-networks-for-image-captioning-operational-gate-loss-function-learning-rate-tensorflow-deep-learning-library.gif","datePublished":"2016-09-01T15:35:55+00:00","dateModified":"2021-03-05T10:50:51+00:00","author":{"@id":"https:\/\/www.altoros.com\/blog\/#\/schema\/person\/58194952af19fe7b2b830846e077a58e"},"breadcrumb":{"@id":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/#primaryimage","url":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2016\/09\/convolutional-and-recurrent-neural-networks-for-image-captioning-operational-gate-loss-function-learning-rate-tensorflow-deep-learning-library.gif","contentUrl":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2016\/09\/convolutional-and-recurrent-neural-networks-for-image-captioning-operational-gate-loss-function-learning-rate-tensorflow-deep-learning-library.gif","width":1024,"height":767},{"@type":"BreadcrumbList","@id":"https:\/\/www.altoros.com\/blog\/under-the-hood-mechanisms-of-neural-networks-with-tensorflow\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.altoros.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Under-the-Hood Mechanisms of Neural Networks with TensorFlow"}]},{"@type":"WebSite","@id":"https:\/\/www.altoros.com\/blog\/#website","url":"https:\/\/www.altoros.com\/blog\/","name":"Altoros","description":"Insight","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.altoros.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.altoros.com\/blog\/#\/schema\/person\/58194952af19fe7b2b830846e077a58e","name":"Sophia Turol","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2019\/05\/trello_card-96x96.jpg","url":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2019\/05\/trello_card-96x96.jpg","contentUrl":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2019\/05\/trello_card-96x96.jpg","caption":"Sophia Turol"},"description":"Sophia Turol is passionate about delivering well-structured articles that cater for picky technical audience. With 3+ years in technical writing and 5+ years in editorship, she enjoys collaboration with developers to create insightful, yet intelligible technical tutorials, overviews, and case studies. Sophie is enthusiastic about deep learning solutions\u2014TensorFlow in particular\u2014and PaaS systems, such as Cloud Foundry.","url":"https:\/\/www.altoros.com\/blog\/author\/sophie-turol\/"}]}},"_links":{"self":[{"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/posts\/28355","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/comments?post=28355"}],"version-history":[{"count":12,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/posts\/28355\/revisions"}],"predecessor-version":[{"id":60441,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/posts\/28355\/revisions\/60441"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/media\/60438"}],"wp:attachment":[{"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/media?parent=28355"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/categories?post=28355"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/tags?post=28355"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}