Overview of summary operations
Summaries provide a way to export condensed information about a model, which is then accessible in tools such as TensorBoard.
Some of the commonly used summary functions are:
scalarhistogramaudioimagemergemerge_all
A scalar summary operation returns a scalar, that is, the value of a certain metric over an increasing number of epochs.
A histogram summary operation returns the histogram of various values—potentially weights and biases at each layer.
The image and audio summary operations return images and audio, which can be visualized and played in TensorBoard respectively.
A merge operation returns the union of all the values of input summaries, while merge_all returns the union of all the summaries contained in the model specification.
A visualization of some of the summaries discussed here will be provided in the next section.
Ways to debug the code
In order to understand how TensorBoard helps, let's initialize a model structure as follows, one that is bound not to...
