{"id":19896,"date":"2016-05-16T19:51:42","date_gmt":"2016-05-17T03:51:42","guid":{"rendered":"https:\/\/www.altoros.com\/blog\/?p=19896"},"modified":"2021-02-15T16:31:05","modified_gmt":"2021-02-15T13:31:05","slug":"tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning","status":"publish","type":"post","link":"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/","title":{"rendered":"TensorFlow in Action: TensorBoard, Training a Model, and Deep Q-learning"},"content":{"rendered":"<p><img decoding=\"async\" src=\"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2016\/05\/videos-and-slides-from-tensorflow-meetup-in-london-march-2016.jpeg\" alt=\"videos-and-slides-from-tensorflow-meetup-in-london-march-2016\" width=\"160\" style=\"margin: 0px 0px 20px 20px;\" class=\"alignright size-full wp-image-19898\" \/><\/p>\n<p>In data science, <a href=\"https:\/\/en.wikipedia.org\/wiki\/Q-learning\" target=\"_blank\" rel=\"noopener noreferrer\">Q-learning<\/a> represents an approach to learning about a state space and following the optimal policy thereafter. A classic example is a robot navigating a maze. Below are the videos from the <a href=\"https:\/\/www.meetup.com\/TensorFlow-London\/events\/226800160\/\" target=\"_blank\" rel=\"noopener noreferrer\">TensorFlow London meetup<\/a> featuring deep dive into TensorFlow&#8217;s architecture and a Q-learning example.<\/p>\n<p>&nbsp;<\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_79_2 counter-hierarchy ez-toc-counter ez-toc-transparent ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#Technical_overview_of_TensorFlow\" >Technical overview of TensorFlow<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#Deep_Q-learning_with_TensorFlow_and_PyGame\" >Deep Q-learning with TensorFlow and PyGame<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#Fireside_chat\" >Fireside chat<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#Further_reading\" >Further reading<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#About_the_speakers\" >About the speakers<\/a><\/li><\/ul><\/nav><\/div>\n<h3><span class=\"ez-toc-section\" id=\"Technical_overview_of_TensorFlow\"><\/span>Technical overview of TensorFlow<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>In her session, <a href=\"https:\/\/www.linkedin.com\/in\/rebeccaroisin\" target=\"_blank\" rel=\"noopener noreferrer\">Rebecca Murphy<\/a> of Ocado Technology focused on TensorFlow under-the-hood mechanisms and demonstrated how to install the solution, load data, feed, checkpoint, and load the model. Then, she moved on to explaining what <a href=\"https:\/\/www.altoros.com\/blog\/visualizing-tensorflow-graphs-with-tensorboard\/\">TensorBoard<\/a> is and how to use it for visualizing learning. Finally, she talked about the further development of TensorFlow.<\/p>\n<p><center><script charset=\"ISO-8859-1\" src=\"\/\/fast.wistia.com\/assets\/external\/E-v1.js\" async><\/script><\/p>\n<div class=\"wistia_embed wistia_async_y307ta50tx\" style=\"height:360px;width:640px\">&nbsp;<\/div>\n<p><\/center><\/p>\n<p>&nbsp;<\/p>\n<p>Below, you can check out the full slides by Rebecca.<\/p>\n<p><center><script async class=\"speakerdeck-embed\" data-id=\"6d0f25ea158c4657a59c366266ad1cd5\" data-ratio=\"1.77777777777778\" src=\"\/\/speakerdeck.com\/assets\/embed.js\"><\/script><\/center><\/p>\n<p>&nbsp;<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Deep_Q-learning_with_TensorFlow_and_PyGame\"><\/span>Deep Q-learning with TensorFlow and PyGame<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>In his presentation, <a href=\"https:\/\/www.linkedin.com\/in\/daniel-slater-3032a016\" target=\"_blank\" rel=\"noopener noreferrer\">Daniel Slater<\/a> from Bank of America Merrill Lynch touched upon such topics as <a href=\"https:\/\/www.altoros.com\/blog\/what-is-behind-deep-reinforcement-learning-and-transfer-learning-with-tensorflow\/\">reinforcement learning<\/a> and Q-learning and how to apply these techniques to implement the PyGame framework with TensorFlow.<\/p>\n<p><center><script async class=\"speakerdeck-embed\" data-id=\"1144a30e01a34744a2ce2cc4ec3c03df\" data-ratio=\"1.77777777777778\" src=\"\/\/speakerdeck.com\/assets\/embed.js\"><\/script><\/center><\/p>\n<p>&nbsp;<\/p>\n<p>The PyGame solution described by Daniel Slater was also presented at the PyData conference earlier this year. In addition to a detailed description and great live demo, Daniel talked on TensorFlow, <a href=\"https:\/\/www.altoros.com\/blog\/introduction-to-neural-networks-and-metaframeworks-with-tensorflow\/\">neural networks<\/a>, reinforcement learning, Q-learning, and <a href=\"https:\/\/www.altoros.com\/blog\/using-convolutional-neural-networks-and-tensorflow-for-image-classification\/\">convolutional networks<\/a>.<\/p>\n<p><center><iframe loading=\"lazy\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/n8NdT_3y9oY\" frameborder=\"0\" allowfullscreen><\/iframe><\/center><\/p>\n<p>&nbsp;<\/p>\n<p>For more details, read a <a href=\"https:\/\/danielslater.net\/2016\/03\/deep-q-learning-pong-with-tensorflow.html\" target=\"_blank\" rel=\"noopener noreferrer\">blog post<\/a> on the matter by Daniel Slater or check out <a href=\"https:\/\/github.com\/DanielSlater\/PyGamePlayer\/\" target=\"_blank\" rel=\"noopener noreferrer\">this project<\/a> on GitHub.<\/p>\n<p>&nbsp;<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Fireside_chat\"><\/span>Fireside chat<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>On delivering the presentations, <a href=\"https:\/\/www.linkedin.com\/in\/daniel-slater-3032a016\" target=\"_blank\" rel=\"noopener noreferrer\">Daniel Slater<\/a>, <a href=\"https:\/\/www.linkedin.com\/in\/rebeccaroisin\" target=\"_blank\" rel=\"noopener noreferrer\">Rebecca Murphy<\/a>, and <a href=\"https:\/\/www.linkedin.com\/in\/peter-morgan-8b7ba2\" target=\"_blank\" rel=\"noopener noreferrer\">Peter Morgan<\/a> shared their vision on:<\/p>\n<ul>\n<li>What are the main challenges that can be solved with TensorFlow?<\/li>\n<li>The recommendations for those getting started with TensorFlow <\/li>\n<li>How can TensorFlow be further improved? How can the community contribute?<\/li>\n<\/ul>\n<p>&nbsp;<br \/>\n<center><script charset=\"ISO-8859-1\" src=\"\/\/fast.wistia.com\/assets\/external\/E-v1.js\" async><\/script><\/p>\n<div class=\"wistia_embed wistia_async_kxj8nfkgb5\" style=\"height:360px;width:640px\">&nbsp;<\/div>\n<p><\/center><\/p>\n<p>&nbsp;<\/p>\n<p>Join <a href=\"https:\/\/www.meetup.com\/TensorFlow-London\/\" target=\"_blank\" rel=\"noopener noreferrer\">our group<\/a> to get informed about the upcoming meetups!<\/p>\n<p>&nbsp;<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Further_reading\"><\/span>Further reading<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ul>\n<li><a href=\"https:\/\/www.altoros.com\/blog\/visualizing-tensorflow-graphs-with-tensorboard\/\">Visualizing TensorFlow Graphs with TensorBoard<\/a><\/li>\n<li><a href=\"https:\/\/www.altoros.com\/blog\/monitoring-and-visualizing-tensorflow-operations-in-real-time-with-guild-ai\/\">Monitoring and Visualizing TensorFlow Operations in Real Time with Guild AI<\/a><\/li>\n<li><a href=\"https:\/\/www.altoros.com\/blog\/learning-game-control-strategies-with-deep-q-networks-and-tensorflow\/\">Learning Game Control Strategies with Deep Q-Networks and TensorFlow<\/a><\/li>\n<li><a href=\"https:\/\/www.altoros.com\/blog\/mastering-game-development-with-deep-reinforcement-learning-and-gpus\/\">Mastering Game Development with Deep Reinforcement Learning and GPUs<\/a><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h3><span class=\"ez-toc-section\" id=\"About_the_speakers\"><\/span>About the speakers<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div>\n<div style=\"float: right;\"><a href=\"https:\/\/www.linkedin.com\/in\/peter-morgan-8b7ba2\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2017\/01\/peter-morgan.png\" alt=\"peter-morgan\" width=\"140\" class=\"aligncenter size-full wp-image-19955\" \/><\/a><\/div>\n<div style=\"width: 600px;\"><small><a href=\"https:\/\/www.linkedin.com\/in\/peter-morgan-8b7ba2\" target=\"_blank\" rel=\"noopener noreferrer\">Peter Morgan<\/a> is a published author and computer science industry veteran with twenty years of experience in IT. Before entering the industry, he focused on high energy physics during his PhD studies at the University of Massachusetts and participated as Research Associate in Stanford University\u2019s experiment that aimed to measure the mass of a neutrino. Peter is Cofounder and Technical Director of Data Science Partnership, where he currently oversees business development and helps clients to design and implement deep learning solutions.<br \/>\n<\/small><\/div>\n<\/div>\n<p>&nbsp;<\/p>\n<div>\n<div style=\"float: right;\"><a href=\"https:\/\/www.linkedin.com\/in\/rebeccaroisin\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2016\/05\/rebecca-murphy-ocado-technology.png\" alt=\"\" width=\"140\" class=\"alignright size-full wp-image-60226\" \/><\/a><\/a><\/div>\n<div style=\"width: 600px;\"><small><a href=\"https:\/\/www.linkedin.com\/in\/rebeccaroisin\" target=\"_blank\" rel=\"noopener noreferrer\">Rebecca Murphy<\/a><\/strong> is Data Scientist at Ocado Technology, where she uses deep learning techniques to understand the intricacies of a customer choice. She has recently completed a PhD at the University of Cambridge, where she spent four years playing with high-power lasers and developed Monte Carlo methods to analyze data from fluorescently labeled protein molecules.<\/small><\/div>\n<\/div>\n<p>&nbsp;<\/p>\n<div>\n<div style=\"float: right;\"><a href=\"https:\/\/www.linkedin.com\/in\/daniel-slater-3032a016\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2017\/01\/daniel-slater.png\" alt=\"daniel-slater\" width=\"140\" class=\"aligncenter size-full wp-image-19954\" \/><\/a><\/div>\n<div style=\"width: 600px;\"><small><a href=\"https:\/\/www.linkedin.com\/in\/daniel-slater-3032a016\" target=\"_blank\" rel=\"noopener noreferrer\">Daniel Slater<\/a><\/strong> is an avid programmer who has worked across finance, computer games, and e-commerce. He is currently working as Assistant Vice President at Bank of America Merrill Lynch and doing his Master of Research in machine learning with a focus on reinforcement learning.<\/small><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<\/p>\n<p>In data science, Q-learning represents an approach to learning about a state space and following the optimal policy thereafter. A classic example is a robot navigating a maze. Below are the videos from the TensorFlow London meetup featuring deep dive into TensorFlow&#8217;s architecture and a Q-learning example.<\/p>\n<p>&nbsp;<\/p>\n<p>Technical overview of TensorFlow<\/p>\n<p>In [&#8230;]<\/p>\n","protected":false},"author":3,"featured_media":60244,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[214],"tags":[748,749],"class_list":["post-19896","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tutorials","tag-machine-learning","tag-tensorflow"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>TensorFlow in Action: TensorBoard, Training a Model, and Deep Q-learning | Altoros<\/title>\n<meta name=\"description\" content=\"This blog post discusses TensorFlow\u2019s mechanics of learning, overviews TensorBoard, as well as looks into Q-learning and convolutional networks.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"TensorFlow in Action: TensorBoard, Training a Model, and Deep Q-learning | Altoros\" \/>\n<meta property=\"og:description\" content=\"In data science, Q-learning represents an approach to learning about a state space and following the optimal policy thereafter. A classic example is a robot navigating a maze. Below are the videos from the TensorFlow London meetup featuring deep dive into TensorFlow&#8217;s architecture and a Q-learning example. &nbsp; Technical overview of TensorFlow In [...]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/\" \/>\n<meta property=\"og:site_name\" content=\"Altoros\" \/>\n<meta property=\"article:published_time\" content=\"2016-05-17T03:51:42+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-02-15T13:31:05+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2021\/02\/q-learning-reinforcement-learning-in-tensorflow-and-pygame.gif\" \/>\n\t<meta property=\"og:image:width\" content=\"1011\" \/>\n\t<meta property=\"og:image:height\" content=\"525\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/gif\" \/>\n<meta name=\"author\" content=\"Sophia Turol\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Sophia Turol\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/\",\"url\":\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/\",\"name\":\"TensorFlow in Action: TensorBoard, Training a Model, and Deep Q-learning | Altoros\",\"isPartOf\":{\"@id\":\"https:\/\/www.altoros.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2021\/02\/q-learning-reinforcement-learning-in-tensorflow-and-pygame.gif\",\"datePublished\":\"2016-05-17T03:51:42+00:00\",\"dateModified\":\"2021-02-15T13:31:05+00:00\",\"author\":{\"@id\":\"https:\/\/www.altoros.com\/blog\/#\/schema\/person\/58194952af19fe7b2b830846e077a58e\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#primaryimage\",\"url\":\"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2021\/02\/q-learning-reinforcement-learning-in-tensorflow-and-pygame.gif\",\"contentUrl\":\"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2021\/02\/q-learning-reinforcement-learning-in-tensorflow-and-pygame.gif\",\"width\":1011,\"height\":525},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.altoros.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"TensorFlow in Action: TensorBoard, Training a Model, and Deep Q-learning\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.altoros.com\/blog\/#website\",\"url\":\"https:\/\/www.altoros.com\/blog\/\",\"name\":\"Altoros\",\"description\":\"Insight\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.altoros.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.altoros.com\/blog\/#\/schema\/person\/58194952af19fe7b2b830846e077a58e\",\"name\":\"Sophia Turol\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.altoros.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2019\/05\/trello_card-96x96.jpg\",\"contentUrl\":\"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2019\/05\/trello_card-96x96.jpg\",\"caption\":\"Sophia Turol\"},\"description\":\"Sophia Turol is passionate about delivering well-structured articles that cater for picky technical audience. With 3+ years in technical writing and 5+ years in editorship, she enjoys collaboration with developers to create insightful, yet intelligible technical tutorials, overviews, and case studies. Sophie is enthusiastic about deep learning solutions\u2014TensorFlow in particular\u2014and PaaS systems, such as Cloud Foundry.\",\"url\":\"https:\/\/www.altoros.com\/blog\/author\/sophie-turol\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"TensorFlow in Action: TensorBoard, Training a Model, and Deep Q-learning | Altoros","description":"This blog post discusses TensorFlow\u2019s mechanics of learning, overviews TensorBoard, as well as looks into Q-learning and convolutional networks.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/","og_locale":"en_US","og_type":"article","og_title":"TensorFlow in Action: TensorBoard, Training a Model, and Deep Q-learning | Altoros","og_description":"In data science, Q-learning represents an approach to learning about a state space and following the optimal policy thereafter. A classic example is a robot navigating a maze. Below are the videos from the TensorFlow London meetup featuring deep dive into TensorFlow&#8217;s architecture and a Q-learning example. &nbsp; Technical overview of TensorFlow In [...]","og_url":"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/","og_site_name":"Altoros","article_published_time":"2016-05-17T03:51:42+00:00","article_modified_time":"2021-02-15T13:31:05+00:00","og_image":[{"width":1011,"height":525,"url":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2021\/02\/q-learning-reinforcement-learning-in-tensorflow-and-pygame.gif","type":"image\/gif"}],"author":"Sophia Turol","twitter_misc":{"Written by":"Sophia Turol","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/","url":"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/","name":"TensorFlow in Action: TensorBoard, Training a Model, and Deep Q-learning | Altoros","isPartOf":{"@id":"https:\/\/www.altoros.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#primaryimage"},"image":{"@id":"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#primaryimage"},"thumbnailUrl":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2021\/02\/q-learning-reinforcement-learning-in-tensorflow-and-pygame.gif","datePublished":"2016-05-17T03:51:42+00:00","dateModified":"2021-02-15T13:31:05+00:00","author":{"@id":"https:\/\/www.altoros.com\/blog\/#\/schema\/person\/58194952af19fe7b2b830846e077a58e"},"breadcrumb":{"@id":"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#primaryimage","url":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2021\/02\/q-learning-reinforcement-learning-in-tensorflow-and-pygame.gif","contentUrl":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2021\/02\/q-learning-reinforcement-learning-in-tensorflow-and-pygame.gif","width":1011,"height":525},{"@type":"BreadcrumbList","@id":"https:\/\/www.altoros.com\/blog\/tensorflow-in-action-tensorboard-training-a-model-and-deep-q-learning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.altoros.com\/blog\/"},{"@type":"ListItem","position":2,"name":"TensorFlow in Action: TensorBoard, Training a Model, and Deep Q-learning"}]},{"@type":"WebSite","@id":"https:\/\/www.altoros.com\/blog\/#website","url":"https:\/\/www.altoros.com\/blog\/","name":"Altoros","description":"Insight","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.altoros.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.altoros.com\/blog\/#\/schema\/person\/58194952af19fe7b2b830846e077a58e","name":"Sophia Turol","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.altoros.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2019\/05\/trello_card-96x96.jpg","contentUrl":"https:\/\/www.altoros.com\/blog\/wp-content\/uploads\/2019\/05\/trello_card-96x96.jpg","caption":"Sophia Turol"},"description":"Sophia Turol is passionate about delivering well-structured articles that cater for picky technical audience. With 3+ years in technical writing and 5+ years in editorship, she enjoys collaboration with developers to create insightful, yet intelligible technical tutorials, overviews, and case studies. Sophie is enthusiastic about deep learning solutions\u2014TensorFlow in particular\u2014and PaaS systems, such as Cloud Foundry.","url":"https:\/\/www.altoros.com\/blog\/author\/sophie-turol\/"}]}},"_links":{"self":[{"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/posts\/19896","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/comments?post=19896"}],"version-history":[{"count":18,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/posts\/19896\/revisions"}],"predecessor-version":[{"id":60245,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/posts\/19896\/revisions\/60245"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/media\/60244"}],"wp:attachment":[{"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/media?parent=19896"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/categories?post=19896"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.altoros.com\/blog\/wp-json\/wp\/v2\/tags?post=19896"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}