Ch10_Recurrent_Neural_Networks/Gated_Recurrent_Units.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Gated Recurrent Units (GRU)\n",
    "\n",
    "In the previous section we discussed how gradients are calculated in a recurrent neural network. In particular we found that long products of matrices can lead to vanishing or divergent gradients. Let’s briefly think about what such gradient anomalies mean in practice:\n",
    "\n",
    "* We might encounter a situation where an early observation is highly significant for predicting all future observations. Consider the somewhat contrived case where the first observation contains a checksum and the goal is to discern whether the checksum is correct at the end of the sequence. In this case the influence of the first token is vital. We would like to have some mechanism for storing vital early information in a memory cell. Without such a mechanism we will have to assign a very large gradient to this observation, since it affects all subsequent observations.\n",
    "* We might encounter situations where some symbols carry no pertinent observation. For instance, when parsing a webpage there might be auxiliary HTML code that is irrelevant for the purpose of assessing the sentiment conveyed on the page. We would like to have some mechanism for skipping such symbols in the latent state representation.\n",
    "* We might encounter situations where there is a logical break between parts of a sequence. For instance there might be a transition between chapters in a book, a transition between a bear and a bull market for securities, etc.; In this case it would be nice to have a means of resetting our internal state representation.\n",
    "\n",
    "A number of methods have been proposed to address this. One of the earliest is the Long Short Term Memory (LSTM)\n",
    "of [Hochreiter and Schmidhuber, $1997^{175}$](http://papers.nips.cc/paper/1215-lstm-can-solve-hard-long-time-lag-problems.pdf) which we will discuss in Section 10.9. The Gated Recurrent Unit (GRU) of\n",
    "[Cho et al., $2014^{176}$](https://arxiv.org/abs/1409.1259) is a slightly more streamlined variant that often offers comparable performance and is significantly faster to compute. See also [Chung et al., $2014^{177}$](https://arxiv.org/abs/1412.3555) for more details. Due to its simplicity we start with the GRU."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Gating the Hidden State\n",
    "\n",
    "The key distinction between regular RNNs and GRUs is that the latter support gating of the hidden state. This means\n",
    "that we have dedicated mechanisms for when the hidden state should be updated and also when it should be reset. These\n",
    "mechanisms are learned and they address the concerns listed above. For instance, if the first symbol is of great importance\n",
    "we will learn not to update the hidden state after the first observation. Likewise, we will learn to skip irrelevant temporary\n",
    "observations. Lastly, we will learn to reset the latent state whenever needed. We discuss this in detail below."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Reset Gates and Update Gates\n",
    "\n",
    "The first thing we need to introduce are reset and update gates. We engineer them to be vectors with entries in (0, 1) such\n",
    "that we can perform convex combinations, e.g. of a hidden state and an alternative. For instance, a reset variable would\n",
    "allow us to control how much of the previous state we might still want to remember. Likewise, an update variable would\n",
    "allow us to control how much of the new state is just a copy of the old state.\n",
    "\n",
    "We begin by engineering gates to generate these variables. The figure below illustrates the inputs for both reset and update\n",
    "gates in a GRU, given the current time step input $X_t$ and the hidden state of the previous time step $H_{t−1}$ . The output is\n",
    "given by a fully connected layer with a sigmoid as its activation function.\n",
    "\n",
    "Here, we assume there are h hidden units and, for a given time step t, the mini-batch input is $X_t$ ∈ $R^{n×d}$ (number of\n",
    "examples: n, number of inputs: d) and the hidden state of the last time step is $H_{t−1}$ ∈ $R^{n×h}$ . Then, the reset gate\n",
    "$R_t$ ∈ $R^{n×h}$ and update gate $Z_t$ ∈ $R^{n×h}$ are computed as follows:\n",
    "$$R_t = σ(X_t W_{xr} + H_{t−1} W_{hr} + b_r )$$\n",
    "$$Z_t = σ(X_t W_{xz} + H_{t−1} W_{hz} + b_z )$$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/svg+xml": [
       "<svg height=\"212pt\" version=\"1.1\" viewBox=\"0 0 414 212\" width=\"414pt\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<defs>\n",
       "<g>\n",
       "<symbol id=\"glyph0-0\" overflow=\"visible\">\n",
       "<path d=\"M 1.125 0 L 1.125 -5.625 L 5.625 -5.625 L 5.625 0 Z M 1.265625 -0.140625 L 5.484375 -0.140625 L 5.484375 -5.484375 L 1.265625 -5.484375 Z M 1.265625 -0.140625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph0-1\" overflow=\"visible\">\n",
       "<path d=\"M 5.796875 -4.671875 L 5.671875 -4 L 4.5 -4 C 4.726562 -3.675781 4.84375 -3.269531 4.84375 -2.78125 C 4.84375 -2.019531 4.617188 -1.347656 4.171875 -0.765625 C 3.722656 -0.179688 3.113281 0.109375 2.34375 0.109375 C 1.75 0.109375 1.28125 -0.0625 0.9375 -0.40625 C 0.601562 -0.757812 0.4375 -1.21875 0.4375 -1.78125 C 0.4375 -2.613281 0.664062 -3.316406 1.125 -3.890625 C 1.59375 -4.472656 2.195312 -4.765625 2.9375 -4.765625 C 3.175781 -4.765625 3.394531 -4.734375 3.59375 -4.671875 Z M 1.234375 -1.796875 C 1.234375 -1.421875 1.332031 -1.113281 1.53125 -0.875 C 1.726562 -0.632812 2 -0.515625 2.34375 -0.515625 C 2.875 -0.515625 3.289062 -0.765625 3.59375 -1.265625 C 3.894531 -1.773438 4.046875 -2.289062 4.046875 -2.8125 C 4.046875 -3.25 3.945312 -3.582031 3.75 -3.8125 C 3.5625 -4.039062 3.300781 -4.15625 2.96875 -4.15625 C 2.4375 -4.15625 2.015625 -3.914062 1.703125 -3.4375 C 1.390625 -2.957031 1.234375 -2.410156 1.234375 -1.796875 Z M 1.234375 -1.796875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-0\" overflow=\"visible\">\n",
       "<path d=\"M 1.125 0 L 1.125 -5.625 L 5.625 -5.625 L 5.625 0 Z M 1.265625 -0.140625 L 5.484375 -0.140625 L 5.484375 -5.484375 L 1.265625 -5.484375 Z M 1.265625 -0.140625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-1\" overflow=\"visible\">\n",
       "<path d=\"M 0.703125 0 L 0.703125 -6.4375 L 3.5625 -6.4375 C 4.132812 -6.4375 4.570312 -6.378906 4.875 -6.265625 C 5.175781 -6.148438 5.414062 -5.945312 5.59375 -5.65625 C 5.769531 -5.363281 5.859375 -5.039062 5.859375 -4.6875 C 5.859375 -4.226562 5.707031 -3.84375 5.40625 -3.53125 C 5.113281 -3.21875 4.660156 -3.019531 4.046875 -2.9375 C 4.265625 -2.820312 4.4375 -2.710938 4.5625 -2.609375 C 4.8125 -2.378906 5.046875 -2.09375 5.265625 -1.75 L 6.390625 0 L 5.3125 0 L 4.453125 -1.34375 C 4.210938 -1.726562 4.007812 -2.019531 3.84375 -2.21875 C 3.6875 -2.425781 3.539062 -2.570312 3.40625 -2.65625 C 3.28125 -2.738281 3.15625 -2.796875 3.03125 -2.828125 C 2.925781 -2.847656 2.765625 -2.859375 2.546875 -2.859375 L 1.5625 -2.859375 L 1.5625 0 Z M 1.5625 -3.59375 L 3.390625 -3.59375 C 3.785156 -3.59375 4.09375 -3.632812 4.3125 -3.71875 C 4.53125 -3.800781 4.695312 -3.929688 4.8125 -4.109375 C 4.925781 -4.285156 4.984375 -4.476562 4.984375 -4.6875 C 4.984375 -4.988281 4.867188 -5.238281 4.640625 -5.4375 C 4.421875 -5.632812 4.070312 -5.734375 3.59375 -5.734375 L 1.5625 -5.734375 Z M 1.5625 -3.59375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-2\" overflow=\"visible\">\n",
       "<path d=\"M 3.78125 -1.5 L 4.609375 -1.40625 C 4.472656 -0.925781 4.226562 -0.550781 3.875 -0.28125 C 3.53125 -0.0195312 3.085938 0.109375 2.546875 0.109375 C 1.867188 0.109375 1.328125 -0.0976562 0.921875 -0.515625 C 0.523438 -0.941406 0.328125 -1.535156 0.328125 -2.296875 C 0.328125 -3.078125 0.53125 -3.679688 0.9375 -4.109375 C 1.34375 -4.546875 1.867188 -4.765625 2.515625 -4.765625 C 3.140625 -4.765625 3.644531 -4.550781 4.03125 -4.125 C 4.425781 -3.707031 4.625 -3.113281 4.625 -2.34375 C 4.625 -2.289062 4.625 -2.21875 4.625 -2.125 L 1.140625 -2.125 C 1.171875 -1.613281 1.316406 -1.222656 1.578125 -0.953125 C 1.835938 -0.679688 2.164062 -0.546875 2.5625 -0.546875 C 2.851562 -0.546875 3.097656 -0.617188 3.296875 -0.765625 C 3.503906 -0.921875 3.664062 -1.164062 3.78125 -1.5 Z M 1.1875 -2.78125 L 3.796875 -2.78125 C 3.765625 -3.175781 3.664062 -3.472656 3.5 -3.671875 C 3.25 -3.972656 2.921875 -4.125 2.515625 -4.125 C 2.148438 -4.125 1.84375 -4 1.59375 -3.75 C 1.351562 -3.507812 1.21875 -3.1875 1.1875 -2.78125 Z M 1.1875 -2.78125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-3\" overflow=\"visible\">\n",
       "<path d=\"M 0.28125 -1.390625 L 1.0625 -1.515625 C 1.101562 -1.203125 1.222656 -0.960938 1.421875 -0.796875 C 1.628906 -0.628906 1.910156 -0.546875 2.265625 -0.546875 C 2.628906 -0.546875 2.898438 -0.617188 3.078125 -0.765625 C 3.253906 -0.910156 3.34375 -1.082031 3.34375 -1.28125 C 3.34375 -1.46875 3.265625 -1.609375 3.109375 -1.703125 C 2.992188 -1.773438 2.722656 -1.867188 2.296875 -1.984375 C 1.710938 -2.128906 1.304688 -2.253906 1.078125 -2.359375 C 0.859375 -2.460938 0.691406 -2.609375 0.578125 -2.796875 C 0.460938 -2.984375 0.40625 -3.191406 0.40625 -3.421875 C 0.40625 -3.628906 0.453125 -3.820312 0.546875 -4 C 0.640625 -4.175781 0.769531 -4.328125 0.9375 -4.453125 C 1.0625 -4.535156 1.226562 -4.609375 1.4375 -4.671875 C 1.65625 -4.734375 1.882812 -4.765625 2.125 -4.765625 C 2.488281 -4.765625 2.804688 -4.710938 3.078125 -4.609375 C 3.359375 -4.503906 3.566406 -4.363281 3.703125 -4.1875 C 3.835938 -4.007812 3.929688 -3.769531 3.984375 -3.46875 L 3.203125 -3.359375 C 3.171875 -3.597656 3.066406 -3.785156 2.890625 -3.921875 C 2.722656 -4.054688 2.488281 -4.125 2.1875 -4.125 C 1.820312 -4.125 1.5625 -4.0625 1.40625 -3.9375 C 1.25 -3.820312 1.171875 -3.679688 1.171875 -3.515625 C 1.171875 -3.410156 1.203125 -3.320312 1.265625 -3.25 C 1.328125 -3.15625 1.429688 -3.082031 1.578125 -3.03125 C 1.648438 -3 1.878906 -2.929688 2.265625 -2.828125 C 2.828125 -2.679688 3.21875 -2.5625 3.4375 -2.46875 C 3.664062 -2.375 3.84375 -2.234375 3.96875 -2.046875 C 4.09375 -1.867188 4.15625 -1.644531 4.15625 -1.375 C 4.15625 -1.101562 4.078125 -0.851562 3.921875 -0.625 C 3.765625 -0.394531 3.539062 -0.210938 3.25 -0.078125 C 2.96875 0.046875 2.640625 0.109375 2.265625 0.109375 C 1.660156 0.109375 1.195312 -0.015625 0.875 -0.265625 C 0.5625 -0.523438 0.363281 -0.898438 0.28125 -1.390625 Z M 0.28125 -1.390625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-4\" overflow=\"visible\">\n",
       "<path d=\"M 2.328125 -0.703125 L 2.4375 -0.015625 C 2.207031 0.0351562 2.007812 0.0625 1.84375 0.0625 C 1.550781 0.0625 1.328125 0.015625 1.171875 -0.078125 C 1.015625 -0.171875 0.898438 -0.289062 0.828125 -0.4375 C 0.765625 -0.582031 0.734375 -0.890625 0.734375 -1.359375 L 0.734375 -4.046875 L 0.15625 -4.046875 L 0.15625 -4.671875 L 0.734375 -4.671875 L 0.734375 -5.828125 L 1.53125 -6.296875 L 1.53125 -4.671875 L 2.328125 -4.671875 L 2.328125 -4.046875 L 1.53125 -4.046875 L 1.53125 -1.328125 C 1.53125 -1.097656 1.539062 -0.953125 1.5625 -0.890625 C 1.59375 -0.828125 1.640625 -0.773438 1.703125 -0.734375 C 1.765625 -0.691406 1.851562 -0.671875 1.96875 -0.671875 C 2.0625 -0.671875 2.179688 -0.679688 2.328125 -0.703125 Z M 2.328125 -0.703125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-5\" overflow=\"visible\">\n",
       "<path d=\"M 0.453125 0.390625 L 1.21875 0.5 C 1.25 0.738281 1.335938 0.910156 1.484375 1.015625 C 1.679688 1.160156 1.953125 1.234375 2.296875 1.234375 C 2.660156 1.234375 2.941406 1.160156 3.140625 1.015625 C 3.335938 0.867188 3.472656 0.664062 3.546875 0.40625 C 3.585938 0.238281 3.601562 -0.0976562 3.59375 -0.609375 C 3.25 -0.203125 2.820312 0 2.3125 0 C 1.664062 0 1.164062 -0.226562 0.8125 -0.6875 C 0.46875 -1.15625 0.296875 -1.710938 0.296875 -2.359375 C 0.296875 -2.804688 0.375 -3.21875 0.53125 -3.59375 C 0.695312 -3.96875 0.929688 -4.253906 1.234375 -4.453125 C 1.535156 -4.660156 1.894531 -4.765625 2.3125 -4.765625 C 2.863281 -4.765625 3.316406 -4.546875 3.671875 -4.109375 L 3.671875 -4.671875 L 4.40625 -4.671875 L 4.40625 -0.640625 C 4.40625 0.0859375 4.328125 0.601562 4.171875 0.90625 C 4.023438 1.207031 3.789062 1.445312 3.46875 1.625 C 3.15625 1.800781 2.765625 1.890625 2.296875 1.890625 C 1.734375 1.890625 1.28125 1.765625 0.9375 1.515625 C 0.601562 1.265625 0.441406 0.890625 0.453125 0.390625 Z M 1.109375 -2.421875 C 1.109375 -1.804688 1.226562 -1.359375 1.46875 -1.078125 C 1.707031 -0.796875 2.007812 -0.65625 2.375 -0.65625 C 2.738281 -0.65625 3.046875 -0.796875 3.296875 -1.078125 C 3.546875 -1.359375 3.671875 -1.796875 3.671875 -2.390625 C 3.671875 -2.960938 3.539062 -3.394531 3.28125 -3.6875 C 3.03125 -3.976562 2.726562 -4.125 2.375 -4.125 C 2.019531 -4.125 1.71875 -3.976562 1.46875 -3.6875 C 1.226562 -3.40625 1.109375 -2.984375 1.109375 -2.421875 Z M 1.109375 -2.421875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-6\" overflow=\"visible\">\n",
       "<path d=\"M 3.640625 -0.578125 C 3.347656 -0.328125 3.066406 -0.148438 2.796875 -0.046875 C 2.523438 0.0546875 2.234375 0.109375 1.921875 0.109375 C 1.410156 0.109375 1.015625 -0.015625 0.734375 -0.265625 C 0.460938 -0.515625 0.328125 -0.835938 0.328125 -1.234375 C 0.328125 -1.460938 0.378906 -1.671875 0.484375 -1.859375 C 0.585938 -2.046875 0.722656 -2.195312 0.890625 -2.3125 C 1.054688 -2.425781 1.242188 -2.515625 1.453125 -2.578125 C 1.609375 -2.609375 1.84375 -2.644531 2.15625 -2.6875 C 2.800781 -2.757812 3.273438 -2.851562 3.578125 -2.96875 C 3.578125 -3.070312 3.578125 -3.140625 3.578125 -3.171875 C 3.578125 -3.492188 3.503906 -3.71875 3.359375 -3.84375 C 3.148438 -4.03125 2.847656 -4.125 2.453125 -4.125 C 2.078125 -4.125 1.800781 -4.054688 1.625 -3.921875 C 1.445312 -3.796875 1.316406 -3.566406 1.234375 -3.234375 L 0.46875 -3.328125 C 0.53125 -3.660156 0.640625 -3.925781 0.796875 -4.125 C 0.960938 -4.332031 1.195312 -4.488281 1.5 -4.59375 C 1.8125 -4.707031 2.164062 -4.765625 2.5625 -4.765625 C 2.96875 -4.765625 3.289062 -4.71875 3.53125 -4.625 C 3.78125 -4.53125 3.960938 -4.410156 4.078125 -4.265625 C 4.203125 -4.128906 4.285156 -3.953125 4.328125 -3.734375 C 4.359375 -3.597656 4.375 -3.359375 4.375 -3.015625 L 4.375 -1.953125 C 4.375 -1.222656 4.390625 -0.757812 4.421875 -0.5625 C 4.453125 -0.363281 4.519531 -0.175781 4.625 0 L 3.796875 0 C 3.710938 -0.164062 3.660156 -0.359375 3.640625 -0.578125 Z M 3.578125 -2.34375 C 3.285156 -2.226562 2.851562 -2.128906 2.28125 -2.046875 C 1.957031 -1.992188 1.726562 -1.9375 1.59375 -1.875 C 1.457031 -1.820312 1.351562 -1.738281 1.28125 -1.625 C 1.207031 -1.507812 1.171875 -1.382812 1.171875 -1.25 C 1.171875 -1.039062 1.25 -0.863281 1.40625 -0.71875 C 1.5625 -0.582031 1.796875 -0.515625 2.109375 -0.515625 C 2.410156 -0.515625 2.679688 -0.582031 2.921875 -0.71875 C 3.160156 -0.851562 3.335938 -1.035156 3.453125 -1.265625 C 3.535156 -1.441406 3.578125 -1.703125 3.578125 -2.046875 Z M 3.578125 -2.34375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-7\" overflow=\"visible\">\n",
       "<path d=\"M 4.921875 -6.4375 L 5.78125 -6.4375 L 5.78125 -2.71875 C 5.78125 -2.070312 5.703125 -1.554688 5.546875 -1.171875 C 5.398438 -0.796875 5.132812 -0.488281 4.75 -0.25 C 4.375 -0.0078125 3.875 0.109375 3.25 0.109375 C 2.644531 0.109375 2.148438 0.00390625 1.765625 -0.203125 C 1.390625 -0.410156 1.117188 -0.710938 0.953125 -1.109375 C 0.785156 -1.503906 0.703125 -2.039062 0.703125 -2.71875 L 0.703125 -6.4375 L 1.5625 -6.4375 L 1.5625 -2.71875 C 1.5625 -2.164062 1.613281 -1.753906 1.71875 -1.484375 C 1.820312 -1.222656 2 -1.019531 2.25 -0.875 C 2.5 -0.726562 2.8125 -0.65625 3.1875 -0.65625 C 3.8125 -0.65625 4.253906 -0.796875 4.515625 -1.078125 C 4.785156 -1.367188 4.921875 -1.914062 4.921875 -2.71875 Z M 4.921875 -6.4375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-8\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 1.78125 L 0.59375 -4.671875 L 1.3125 -4.671875 L 1.3125 -4.0625 C 1.476562 -4.300781 1.664062 -4.476562 1.875 -4.59375 C 2.09375 -4.707031 2.359375 -4.765625 2.671875 -4.765625 C 3.066406 -4.765625 3.414062 -4.660156 3.71875 -4.453125 C 4.019531 -4.253906 4.25 -3.96875 4.40625 -3.59375 C 4.5625 -3.21875 4.640625 -2.8125 4.640625 -2.375 C 4.640625 -1.894531 4.550781 -1.460938 4.375 -1.078125 C 4.207031 -0.691406 3.960938 -0.394531 3.640625 -0.1875 C 3.316406 0.0078125 2.972656 0.109375 2.609375 0.109375 C 2.347656 0.109375 2.113281 0.0507812 1.90625 -0.0625 C 1.695312 -0.175781 1.523438 -0.316406 1.390625 -0.484375 L 1.390625 1.78125 Z M 1.3125 -2.3125 C 1.3125 -1.707031 1.429688 -1.257812 1.671875 -0.96875 C 1.921875 -0.6875 2.21875 -0.546875 2.5625 -0.546875 C 2.90625 -0.546875 3.203125 -0.691406 3.453125 -0.984375 C 3.710938 -1.285156 3.84375 -1.75 3.84375 -2.375 C 3.84375 -2.96875 3.71875 -3.410156 3.46875 -3.703125 C 3.226562 -4.003906 2.9375 -4.15625 2.59375 -4.15625 C 2.257812 -4.15625 1.960938 -3.992188 1.703125 -3.671875 C 1.441406 -3.359375 1.3125 -2.90625 1.3125 -2.3125 Z M 1.3125 -2.3125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-9\" overflow=\"visible\">\n",
       "<path d=\"M 3.625 0 L 3.625 -0.59375 C 3.320312 -0.125 2.882812 0.109375 2.3125 0.109375 C 1.945312 0.109375 1.609375 0.00390625 1.296875 -0.203125 C 0.984375 -0.410156 0.738281 -0.695312 0.5625 -1.0625 C 0.394531 -1.425781 0.3125 -1.847656 0.3125 -2.328125 C 0.3125 -2.796875 0.390625 -3.21875 0.546875 -3.59375 C 0.703125 -3.976562 0.929688 -4.269531 1.234375 -4.46875 C 1.546875 -4.664062 1.894531 -4.765625 2.28125 -4.765625 C 2.5625 -4.765625 2.8125 -4.707031 3.03125 -4.59375 C 3.25 -4.476562 3.425781 -4.320312 3.5625 -4.125 L 3.5625 -6.4375 L 4.359375 -6.4375 L 4.359375 0 Z M 1.125 -2.328125 C 1.125 -1.734375 1.25 -1.285156 1.5 -0.984375 C 1.75 -0.691406 2.046875 -0.546875 2.390625 -0.546875 C 2.734375 -0.546875 3.023438 -0.6875 3.265625 -0.96875 C 3.515625 -1.25 3.640625 -1.679688 3.640625 -2.265625 C 3.640625 -2.898438 3.515625 -3.367188 3.265625 -3.671875 C 3.015625 -3.972656 2.710938 -4.125 2.359375 -4.125 C 2.003906 -4.125 1.707031 -3.976562 1.46875 -3.6875 C 1.238281 -3.394531 1.125 -2.941406 1.125 -2.328125 Z M 1.125 -2.328125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-10\" overflow=\"visible\">\n",
       "<path d=\"M 0.71875 0 L 0.71875 -6.4375 L 1.578125 -6.4375 L 1.578125 -3.796875 L 4.921875 -3.796875 L 4.921875 -6.4375 L 5.78125 -6.4375 L 5.78125 0 L 4.921875 0 L 4.921875 -3.03125 L 1.578125 -3.03125 L 1.578125 0 Z M 0.71875 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-11\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 -5.53125 L 0.59375 -6.4375 L 1.390625 -6.4375 L 1.390625 -5.53125 Z M 0.59375 0 L 0.59375 -4.671875 L 1.390625 -4.671875 L 1.390625 0 Z M 0.59375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-12\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 0 L 0.59375 -4.671875 L 1.3125 -4.671875 L 1.3125 -4 C 1.644531 -4.507812 2.140625 -4.765625 2.796875 -4.765625 C 3.078125 -4.765625 3.332031 -4.710938 3.5625 -4.609375 C 3.800781 -4.515625 3.976562 -4.382812 4.09375 -4.21875 C 4.207031 -4.0625 4.289062 -3.867188 4.34375 -3.640625 C 4.375 -3.492188 4.390625 -3.238281 4.390625 -2.875 L 4.390625 0 L 3.59375 0 L 3.59375 -2.84375 C 3.59375 -3.164062 3.5625 -3.40625 3.5 -3.5625 C 3.4375 -3.71875 3.328125 -3.84375 3.171875 -3.9375 C 3.015625 -4.039062 2.832031 -4.09375 2.625 -4.09375 C 2.289062 -4.09375 2 -3.984375 1.75 -3.765625 C 1.507812 -3.554688 1.390625 -3.148438 1.390625 -2.546875 L 1.390625 0 Z M 0.59375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-13\" overflow=\"visible\">\n",
       "<path d=\"\" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-14\" overflow=\"visible\">\n",
       "<path d=\"M 0.71875 0 L 0.71875 -6.4375 L 5.375 -6.4375 L 5.375 -5.6875 L 1.5625 -5.6875 L 1.5625 -3.703125 L 5.125 -3.703125 L 5.125 -2.953125 L 1.5625 -2.953125 L 1.5625 -0.765625 L 5.515625 -0.765625 L 5.515625 0 Z M 0.71875 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-15\" overflow=\"visible\">\n",
       "<path d=\"M 0.578125 0 L 0.578125 -6.4375 L 1.359375 -6.4375 L 1.359375 0 Z M 0.578125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-16\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 0 L 0.59375 -4.671875 L 1.296875 -4.671875 L 1.296875 -4.015625 C 1.441406 -4.242188 1.632812 -4.425781 1.875 -4.5625 C 2.125 -4.695312 2.40625 -4.765625 2.71875 -4.765625 C 3.0625 -4.765625 3.34375 -4.691406 3.5625 -4.546875 C 3.78125 -4.410156 3.9375 -4.210938 4.03125 -3.953125 C 4.40625 -4.492188 4.882812 -4.765625 5.46875 -4.765625 C 5.9375 -4.765625 6.296875 -4.632812 6.546875 -4.375 C 6.796875 -4.125 6.921875 -3.734375 6.921875 -3.203125 L 6.921875 0 L 6.125 0 L 6.125 -2.9375 C 6.125 -3.257812 6.097656 -3.488281 6.046875 -3.625 C 6.003906 -3.757812 5.914062 -3.867188 5.78125 -3.953125 C 5.644531 -4.046875 5.484375 -4.09375 5.296875 -4.09375 C 4.972656 -4.09375 4.703125 -3.984375 4.484375 -3.765625 C 4.265625 -3.546875 4.15625 -3.195312 4.15625 -2.71875 L 4.15625 0 L 3.359375 0 L 3.359375 -3.03125 C 3.359375 -3.382812 3.296875 -3.648438 3.171875 -3.828125 C 3.046875 -4.003906 2.835938 -4.09375 2.546875 -4.09375 C 2.316406 -4.09375 2.109375 -4.03125 1.921875 -3.90625 C 1.734375 -3.789062 1.597656 -3.617188 1.515625 -3.390625 C 1.429688 -3.171875 1.390625 -2.847656 1.390625 -2.421875 L 1.390625 0 Z M 0.59375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-17\" overflow=\"visible\">\n",
       "<path d=\"M 0.28125 -1.9375 L 0.28125 -2.734375 L 2.71875 -2.734375 L 2.71875 -1.9375 Z M 0.28125 -1.9375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-18\" overflow=\"visible\">\n",
       "<path d=\"M 1.453125 0 L 0.03125 -4.671875 L 0.84375 -4.671875 L 1.59375 -1.96875 L 1.859375 -0.96875 C 1.867188 -1.019531 1.953125 -1.34375 2.109375 -1.9375 L 2.84375 -4.671875 L 3.65625 -4.671875 L 4.359375 -1.953125 L 4.59375 -1.0625 L 4.859375 -1.96875 L 5.65625 -4.671875 L 6.421875 -4.671875 L 4.96875 0 L 4.15625 0 L 3.40625 -2.796875 L 3.21875 -3.59375 L 2.28125 0 Z M 1.453125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-19\" overflow=\"visible\">\n",
       "<path d=\"M 0.4375 -3.140625 C 0.4375 -4.203125 0.722656 -5.035156 1.296875 -5.640625 C 1.867188 -6.253906 2.609375 -6.5625 3.515625 -6.5625 C 4.109375 -6.5625 4.644531 -6.414062 5.125 -6.125 C 5.601562 -5.84375 5.96875 -5.445312 6.21875 -4.9375 C 6.46875 -4.425781 6.59375 -3.851562 6.59375 -3.21875 C 6.59375 -2.5625 6.460938 -1.972656 6.203125 -1.453125 C 5.941406 -0.941406 5.566406 -0.550781 5.078125 -0.28125 C 4.597656 -0.0195312 4.078125 0.109375 3.515625 0.109375 C 2.910156 0.109375 2.367188 -0.0351562 1.890625 -0.328125 C 1.410156 -0.617188 1.046875 -1.019531 0.796875 -1.53125 C 0.554688 -2.039062 0.4375 -2.578125 0.4375 -3.140625 Z M 1.3125 -3.125 C 1.3125 -2.34375 1.519531 -1.726562 1.9375 -1.28125 C 2.351562 -0.84375 2.878906 -0.625 3.515625 -0.625 C 4.148438 -0.625 4.675781 -0.847656 5.09375 -1.296875 C 5.507812 -1.742188 5.71875 -2.382812 5.71875 -3.21875 C 5.71875 -3.738281 5.628906 -4.191406 5.453125 -4.578125 C 5.273438 -4.972656 5.015625 -5.28125 4.671875 -5.5 C 4.328125 -5.71875 3.945312 -5.828125 3.53125 -5.828125 C 2.925781 -5.828125 2.40625 -5.617188 1.96875 -5.203125 C 1.53125 -4.785156 1.3125 -4.09375 1.3125 -3.125 Z M 1.3125 -3.125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-20\" overflow=\"visible\">\n",
       "<path d=\"M 0.578125 0 L 0.578125 -4.671875 L 1.296875 -4.671875 L 1.296875 -3.953125 C 1.472656 -4.285156 1.640625 -4.503906 1.796875 -4.609375 C 1.953125 -4.710938 2.125 -4.765625 2.3125 -4.765625 C 2.570312 -4.765625 2.84375 -4.679688 3.125 -4.515625 L 2.84375 -3.78125 C 2.65625 -3.894531 2.460938 -3.953125 2.265625 -3.953125 C 2.097656 -3.953125 1.941406 -3.898438 1.796875 -3.796875 C 1.660156 -3.691406 1.5625 -3.546875 1.5 -3.359375 C 1.414062 -3.078125 1.375 -2.769531 1.375 -2.4375 L 1.375 0 Z M 0.578125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-21\" overflow=\"visible\">\n",
       "<path d=\"M 0.296875 -2.328125 C 0.296875 -3.191406 0.535156 -3.832031 1.015625 -4.25 C 1.421875 -4.59375 1.910156 -4.765625 2.484375 -4.765625 C 3.128906 -4.765625 3.65625 -4.554688 4.0625 -4.140625 C 4.46875 -3.722656 4.671875 -3.144531 4.671875 -2.40625 C 4.671875 -1.800781 4.578125 -1.328125 4.390625 -0.984375 C 4.210938 -0.640625 3.953125 -0.367188 3.609375 -0.171875 C 3.265625 0.015625 2.890625 0.109375 2.484375 0.109375 C 1.828125 0.109375 1.296875 -0.0976562 0.890625 -0.515625 C 0.492188 -0.941406 0.296875 -1.546875 0.296875 -2.328125 Z M 1.109375 -2.328125 C 1.109375 -1.734375 1.238281 -1.285156 1.5 -0.984375 C 1.757812 -0.691406 2.085938 -0.546875 2.484375 -0.546875 C 2.878906 -0.546875 3.207031 -0.691406 3.46875 -0.984375 C 3.726562 -1.285156 3.859375 -1.742188 3.859375 -2.359375 C 3.859375 -2.929688 3.726562 -3.367188 3.46875 -3.671875 C 3.207031 -3.972656 2.878906 -4.125 2.484375 -4.125 C 2.085938 -4.125 1.757812 -3.972656 1.5 -3.671875 C 1.238281 -3.378906 1.109375 -2.929688 1.109375 -2.328125 Z M 1.109375 -2.328125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-22\" overflow=\"visible\">\n",
       "<path d=\"M 0.734375 0 L 0.734375 -6.4375 L 5.078125 -6.4375 L 5.078125 -5.6875 L 1.59375 -5.6875 L 1.59375 -3.6875 L 4.609375 -3.6875 L 4.609375 -2.921875 L 1.59375 -2.921875 L 1.59375 0 Z M 0.734375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-23\" overflow=\"visible\">\n",
       "<path d=\"M 5.296875 -2.265625 L 6.140625 -2.046875 C 5.960938 -1.347656 5.640625 -0.8125 5.171875 -0.4375 C 4.710938 -0.0703125 4.144531 0.109375 3.46875 0.109375 C 2.78125 0.109375 2.21875 -0.03125 1.78125 -0.3125 C 1.34375 -0.59375 1.007812 -1 0.78125 -1.53125 C 0.5625 -2.070312 0.453125 -2.648438 0.453125 -3.265625 C 0.453125 -3.941406 0.578125 -4.53125 0.828125 -5.03125 C 1.085938 -5.53125 1.453125 -5.90625 1.921875 -6.15625 C 2.398438 -6.414062 2.921875 -6.546875 3.484375 -6.546875 C 4.128906 -6.546875 4.671875 -6.378906 5.109375 -6.046875 C 5.554688 -5.722656 5.863281 -5.265625 6.03125 -4.671875 L 5.1875 -4.484375 C 5.039062 -4.953125 4.828125 -5.289062 4.546875 -5.5 C 4.265625 -5.71875 3.90625 -5.828125 3.46875 -5.828125 C 2.976562 -5.828125 2.566406 -5.707031 2.234375 -5.46875 C 1.898438 -5.226562 1.664062 -4.90625 1.53125 -4.5 C 1.394531 -4.101562 1.328125 -3.695312 1.328125 -3.28125 C 1.328125 -2.726562 1.40625 -2.242188 1.5625 -1.828125 C 1.726562 -1.421875 1.976562 -1.117188 2.3125 -0.921875 C 2.644531 -0.722656 3.007812 -0.625 3.40625 -0.625 C 3.882812 -0.625 4.285156 -0.757812 4.609375 -1.03125 C 4.941406 -1.3125 5.171875 -1.722656 5.296875 -2.265625 Z M 5.296875 -2.265625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-24\" overflow=\"visible\">\n",
       "<path d=\"M 0.5625 1.796875 L 0.46875 1.0625 C 0.644531 1.101562 0.796875 1.125 0.921875 1.125 C 1.097656 1.125 1.238281 1.09375 1.34375 1.03125 C 1.445312 0.976562 1.535156 0.898438 1.609375 0.796875 C 1.648438 0.710938 1.726562 0.515625 1.84375 0.203125 C 1.863281 0.160156 1.890625 0.0976562 1.921875 0.015625 L 0.140625 -4.671875 L 1 -4.671875 L 1.96875 -1.96875 C 2.09375 -1.625 2.207031 -1.265625 2.3125 -0.890625 C 2.394531 -1.242188 2.5 -1.597656 2.625 -1.953125 L 3.625 -4.671875 L 4.421875 -4.671875 L 2.640625 0.078125 C 2.453125 0.585938 2.304688 0.941406 2.203125 1.140625 C 2.054688 1.398438 1.894531 1.585938 1.71875 1.703125 C 1.539062 1.828125 1.320312 1.890625 1.0625 1.890625 C 0.914062 1.890625 0.75 1.859375 0.5625 1.796875 Z M 0.5625 1.796875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-25\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 0 L 0.59375 -6.4375 L 1.390625 -6.4375 L 1.390625 -4.125 C 1.753906 -4.550781 2.21875 -4.765625 2.78125 -4.765625 C 3.125 -4.765625 3.421875 -4.695312 3.671875 -4.5625 C 3.929688 -4.425781 4.113281 -4.238281 4.21875 -4 C 4.332031 -3.757812 4.390625 -3.410156 4.390625 -2.953125 L 4.390625 0 L 3.609375 0 L 3.609375 -2.953125 C 3.609375 -3.347656 3.519531 -3.632812 3.34375 -3.8125 C 3.175781 -4 2.9375 -4.09375 2.625 -4.09375 C 2.382812 -4.09375 2.160156 -4.03125 1.953125 -3.90625 C 1.742188 -3.789062 1.597656 -3.628906 1.515625 -3.421875 C 1.429688 -3.210938 1.390625 -2.921875 1.390625 -2.546875 L 1.390625 0 Z M 0.59375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-26\" overflow=\"visible\">\n",
       "<path d=\"M 3.640625 -1.703125 L 4.421875 -1.609375 C 4.335938 -1.066406 4.117188 -0.644531 3.765625 -0.34375 C 3.410156 -0.0390625 2.976562 0.109375 2.46875 0.109375 C 1.832031 0.109375 1.320312 -0.0976562 0.9375 -0.515625 C 0.550781 -0.929688 0.359375 -1.53125 0.359375 -2.3125 C 0.359375 -2.820312 0.441406 -3.265625 0.609375 -3.640625 C 0.773438 -4.015625 1.023438 -4.296875 1.359375 -4.484375 C 1.703125 -4.671875 2.078125 -4.765625 2.484375 -4.765625 C 2.984375 -4.765625 3.394531 -4.632812 3.71875 -4.375 C 4.039062 -4.125 4.25 -3.765625 4.34375 -3.296875 L 3.578125 -3.171875 C 3.503906 -3.484375 3.375 -3.71875 3.1875 -3.875 C 3 -4.039062 2.773438 -4.125 2.515625 -4.125 C 2.109375 -4.125 1.78125 -3.976562 1.53125 -3.6875 C 1.289062 -3.40625 1.171875 -2.957031 1.171875 -2.34375 C 1.171875 -1.707031 1.289062 -1.25 1.53125 -0.96875 C 1.769531 -0.6875 2.082031 -0.546875 2.46875 -0.546875 C 2.78125 -0.546875 3.039062 -0.640625 3.25 -0.828125 C 3.457031 -1.015625 3.585938 -1.304688 3.640625 -1.703125 Z M 3.640625 -1.703125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-27\" overflow=\"visible\">\n",
       "<path d=\"M 1.890625 0 L 0.109375 -4.671875 L 0.953125 -4.671875 L 1.953125 -1.875 C 2.054688 -1.570312 2.15625 -1.257812 2.25 -0.9375 C 2.320312 -1.175781 2.421875 -1.46875 2.546875 -1.8125 L 3.578125 -4.671875 L 4.390625 -4.671875 L 2.625 0 Z M 1.890625 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-28\" overflow=\"visible\">\n",
       "<path d=\"M 0.78125 0 L 0.78125 -4.046875 L 0.078125 -4.046875 L 0.078125 -4.671875 L 0.78125 -4.671875 L 0.78125 -5.15625 C 0.78125 -5.476562 0.804688 -5.710938 0.859375 -5.859375 C 0.941406 -6.066406 1.078125 -6.234375 1.265625 -6.359375 C 1.460938 -6.484375 1.734375 -6.546875 2.078125 -6.546875 C 2.296875 -6.546875 2.539062 -6.519531 2.8125 -6.46875 L 2.6875 -5.78125 C 2.53125 -5.8125 2.378906 -5.828125 2.234375 -5.828125 C 1.992188 -5.828125 1.820312 -5.773438 1.71875 -5.671875 C 1.613281 -5.566406 1.5625 -5.375 1.5625 -5.09375 L 1.5625 -4.671875 L 2.484375 -4.671875 L 2.484375 -4.046875 L 1.5625 -4.046875 L 1.5625 0 Z M 0.78125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-29\" overflow=\"visible\">\n",
       "<path d=\"M 3.65625 0 L 3.65625 -0.6875 C 3.289062 -0.15625 2.796875 0.109375 2.171875 0.109375 C 1.898438 0.109375 1.644531 0.0546875 1.40625 -0.046875 C 1.164062 -0.160156 0.984375 -0.296875 0.859375 -0.453125 C 0.742188 -0.609375 0.664062 -0.800781 0.625 -1.03125 C 0.59375 -1.1875 0.578125 -1.4375 0.578125 -1.78125 L 0.578125 -4.671875 L 1.359375 -4.671875 L 1.359375 -2.078125 C 1.359375 -1.660156 1.378906 -1.382812 1.421875 -1.25 C 1.460938 -1.039062 1.5625 -0.875 1.71875 -0.75 C 1.882812 -0.632812 2.085938 -0.578125 2.328125 -0.578125 C 2.566406 -0.578125 2.789062 -0.632812 3 -0.75 C 3.207031 -0.875 3.351562 -1.039062 3.4375 -1.25 C 3.519531 -1.457031 3.5625 -1.765625 3.5625 -2.171875 L 3.5625 -4.671875 L 4.359375 -4.671875 L 4.359375 0 Z M 3.65625 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-0\" overflow=\"visible\">\n",
       "<path d=\"M 1.125 0 L 1.125 -5.625 L 5.625 -5.625 L 5.625 0 Z M 1.265625 -0.140625 L 5.484375 -0.140625 L 5.484375 -5.484375 L 1.265625 -5.484375 Z M 1.265625 -0.140625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-1\" overflow=\"visible\">\n",
       "<path d=\"M 1.71875 0 L 0.390625 0 L 1.75 -6.4375 L 4.609375 -6.4375 C 5.097656 -6.4375 5.476562 -6.382812 5.75 -6.28125 C 6.03125 -6.1875 6.253906 -6.003906 6.421875 -5.734375 C 6.585938 -5.460938 6.671875 -5.132812 6.671875 -4.75 C 6.671875 -4.207031 6.503906 -3.753906 6.171875 -3.390625 C 5.847656 -3.035156 5.351562 -2.816406 4.6875 -2.734375 C 4.851562 -2.585938 5.015625 -2.390625 5.171875 -2.140625 C 5.460938 -1.628906 5.789062 -0.914062 6.15625 0 L 4.734375 0 C 4.617188 -0.363281 4.394531 -0.929688 4.0625 -1.703125 C 3.875 -2.117188 3.679688 -2.398438 3.484375 -2.546875 C 3.359375 -2.628906 3.140625 -2.671875 2.828125 -2.671875 L 2.28125 -2.671875 Z M 2.484375 -3.640625 L 3.1875 -3.640625 C 3.894531 -3.640625 4.363281 -3.679688 4.59375 -3.765625 C 4.832031 -3.847656 5.015625 -3.976562 5.140625 -4.15625 C 5.273438 -4.34375 5.34375 -4.535156 5.34375 -4.734375 C 5.34375 -4.960938 5.25 -5.140625 5.0625 -5.265625 C 4.945312 -5.328125 4.691406 -5.359375 4.296875 -5.359375 L 2.84375 -5.359375 Z M 2.484375 -3.640625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-2\" overflow=\"visible\">\n",
       "<path d=\"M 0.21875 0 L 0.4375 -1.015625 L 4.140625 -5.359375 L 1.140625 -5.359375 L 1.359375 -6.4375 L 6.015625 -6.4375 L 5.8125 -5.4375 L 2.0625 -1.0625 C 2.46875 -1.0625 2.703125 -1.0625 2.765625 -1.0625 C 3.046875 -1.0625 3.429688 -1.066406 3.921875 -1.078125 L 5.4375 -1.078125 L 5.21875 0 Z M 0.21875 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-3\" overflow=\"visible\">\n",
       "<path d=\"M 1.4375 0 L -0.265625 0 L 2.578125 -3.265625 L 0.96875 -6.4375 L 2.359375 -6.4375 L 2.984375 -5.234375 C 3.003906 -5.191406 3.148438 -4.894531 3.421875 -4.34375 C 3.429688 -4.3125 3.445312 -4.269531 3.46875 -4.21875 C 3.832031 -4.65625 4.132812 -5.015625 4.375 -5.296875 L 5.390625 -6.4375 L 7.046875 -6.4375 L 4.109375 -3.046875 L 5.6875 0 L 4.203125 0 L 3.71875 -0.96875 C 3.457031 -1.476562 3.289062 -1.847656 3.21875 -2.078125 C 3.101562 -1.898438 2.804688 -1.539062 2.328125 -1 Z M 1.4375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-4\" overflow=\"visible\">\n",
       "<path d=\"M 4.8125 -2.875 L 2.328125 -2.875 L 1.71875 0 L 0.390625 0 L 1.734375 -6.4375 L 3.0625 -6.4375 L 2.546875 -3.953125 L 5.03125 -3.953125 L 5.5625 -6.4375 L 6.875 -6.4375 L 5.53125 0 L 4.203125 0 Z M 4.8125 -2.875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-0\" overflow=\"visible\">\n",
       "<path d=\"M 1.125 0 L 1.125 -5.625 L 5.625 -5.625 L 5.625 0 Z M 1.265625 -0.140625 L 5.484375 -0.140625 L 5.484375 -5.484375 L 1.265625 -5.484375 Z M 1.265625 -0.140625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-1\" overflow=\"visible\">\n",
       "<path d=\"M 2.15625 -0.640625 L 2.03125 0 C 1.832031 0.0507812 1.644531 0.078125 1.46875 0.078125 C 1.15625 0.078125 0.90625 0 0.71875 -0.15625 C 0.570312 -0.269531 0.5 -0.429688 0.5 -0.640625 C 0.5 -0.734375 0.539062 -0.96875 0.625 -1.34375 L 1.1875 -4.046875 L 0.5625 -4.046875 L 0.6875 -4.671875 L 1.3125 -4.671875 L 1.5625 -5.8125 L 2.46875 -6.359375 L 2.109375 -4.671875 L 2.890625 -4.671875 L 2.765625 -4.046875 L 1.984375 -4.046875 L 1.4375 -1.46875 C 1.375 -1.144531 1.34375 -0.953125 1.34375 -0.890625 C 1.34375 -0.796875 1.367188 -0.722656 1.421875 -0.671875 C 1.472656 -0.617188 1.5625 -0.59375 1.6875 -0.59375 C 1.863281 -0.59375 2.019531 -0.609375 2.15625 -0.640625 Z M 2.15625 -0.640625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-2\" overflow=\"visible\">\n",
       "<path d=\"M 0.421875 -1.9375 L 0.578125 -2.734375 L 3.015625 -2.734375 L 2.84375 -1.9375 Z M 0.421875 -1.9375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-3\" overflow=\"visible\">\n",
       "<path d=\"M 2.171875 0 L 3.1875 -4.859375 C 2.75 -4.515625 2.128906 -4.238281 1.328125 -4.03125 L 1.484375 -4.75 C 1.878906 -4.914062 2.269531 -5.125 2.65625 -5.375 C 3.039062 -5.625 3.328125 -5.847656 3.515625 -6.046875 C 3.640625 -6.160156 3.753906 -6.300781 3.859375 -6.46875 L 4.3125 -6.46875 L 2.96875 0 Z M 2.171875 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-0\" overflow=\"visible\">\n",
       "<path d=\"\" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-1\" overflow=\"visible\">\n",
       "<path d=\"M 0.703125 -6.421875 L 0.703125 0 L 1.4375 0 L 1.4375 -6.421875 Z M 0.703125 -6.421875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-2\" overflow=\"visible\">\n",
       "<path d=\"M 2.734375 -4.78125 C 2.4375 -4.78125 2.15625 -4.703125 1.90625 -4.5625 C 1.640625 -4.421875 1.4375 -4.234375 1.28125 -3.96875 L 1.28125 -4.65625 L 0.5625 -4.65625 L 0.5625 0 L 1.28125 0 L 1.28125 -2.8125 C 1.3125 -3.234375 1.4375 -3.5625 1.6875 -3.8125 C 1.921875 -4.046875 2.203125 -4.171875 2.53125 -4.171875 C 3.34375 -4.171875 3.75 -3.71875 3.75 -2.8125 L 3.75 0 L 4.46875 0 L 4.46875 -2.859375 C 4.46875 -4.140625 3.890625 -4.78125 2.734375 -4.78125 Z M 2.734375 -4.78125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-3\" overflow=\"visible\">\n",
       "<path d=\"M 2.78125 -4.78125 C 2.078125 -4.78125 1.5625 -4.484375 1.234375 -3.890625 L 1.234375 -4.65625 L 0.5625 -4.65625 L 0.5625 1.78125 L 1.28125 1.78125 L 1.28125 -0.84375 C 1.640625 -0.203125 2.15625 0.125 2.8125 0.125 C 3.484375 0.125 4 -0.125 4.375 -0.609375 C 4.71875 -1.0625 4.890625 -1.625 4.890625 -2.3125 C 4.890625 -3.015625 4.71875 -3.578125 4.359375 -4.03125 C 3.984375 -4.53125 3.453125 -4.78125 2.78125 -4.78125 Z M 2.6875 -4.1875 C 3.1875 -4.1875 3.5625 -4 3.828125 -3.625 C 4.046875 -3.296875 4.15625 -2.859375 4.15625 -2.3125 C 4.15625 -1.75 4.046875 -1.3125 3.8125 -0.984375 C 3.546875 -0.640625 3.171875 -0.46875 2.65625 -0.46875 C 2.234375 -0.46875 1.90625 -0.640625 1.640625 -0.96875 C 1.375 -1.296875 1.25 -1.734375 1.25 -2.265625 L 1.25 -2.359375 C 1.25 -2.875 1.375 -3.3125 1.609375 -3.640625 C 1.859375 -4 2.21875 -4.1875 2.6875 -4.1875 Z M 2.6875 -4.1875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-4\" overflow=\"visible\">\n",
       "<path d=\"M 0.5625 -4.65625 L 0.5625 -1.765625 C 0.5625 -0.515625 1.109375 0.125 2.25 0.125 C 2.875 0.125 3.390625 -0.15625 3.765625 -0.71875 L 3.765625 0 L 4.484375 0 L 4.484375 -4.65625 L 3.765625 -4.65625 L 3.765625 -1.8125 C 3.703125 -1.421875 3.5625 -1.09375 3.296875 -0.84375 C 3.0625 -0.609375 2.78125 -0.484375 2.46875 -0.484375 C 2.046875 -0.484375 1.75 -0.609375 1.5625 -0.8125 C 1.375 -1.03125 1.28125 -1.375 1.28125 -1.8125 L 1.28125 -4.65625 Z M 0.5625 -4.65625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-5\" overflow=\"visible\">\n",
       "<path d=\"M 1.796875 -6.15625 L 1.09375 -5.859375 L 1.09375 -4.65625 L 0.15625 -4.65625 L 0.15625 -4.046875 L 1.09375 -4.046875 L 1.09375 -1.09375 C 1.09375 -0.734375 1.15625 -0.484375 1.3125 -0.296875 C 1.46875 -0.09375 1.75 0 2.140625 0 L 2.828125 0 L 2.828125 -0.609375 L 2.234375 -0.609375 C 2.078125 -0.609375 1.96875 -0.640625 1.90625 -0.71875 C 1.828125 -0.796875 1.796875 -0.921875 1.796875 -1.09375 L 1.796875 -4.046875 L 2.953125 -4.046875 L 2.953125 -4.65625 L 1.796875 -4.65625 Z M 1.796875 -6.15625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-6\" overflow=\"visible\">\n",
       "<path d=\"\" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-0\" overflow=\"visible\">\n",
       "<path d=\"M 0.296875 0 L 0.296875 -6 L 2.703125 -6 L 2.703125 0 Z M 2.40625 -0.296875 L 2.40625 -5.703125 L 0.59375 -5.703125 L 0.59375 -0.296875 Z M 2.40625 -0.296875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-1\" overflow=\"visible\">\n",
       "<path d=\"M 1.203125 0 L 0.5625 0 L 2.65625 -2.4375 L 0.5625 -4.84375 L 1.25 -4.84375 L 3 -3.015625 L 4.8125 -4.84375 L 5.4375 -4.84375 L 3.3125 -2.4375 L 5.4375 0 L 4.75 0 L 3 -1.953125 Z M 1.203125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "</g>\n",
       "</defs>\n",
       "<g id=\"surface1\">\n",
       "<path d=\"M 292 232 L 464 232 C 470.628906 232 476 237.371094 476 244 L 476 364 C 476 370.628906 470.628906 376 464 376 L 292 376 C 285.371094 376 280 370.628906 280 364 L 280 244 C 280 237.371094 285.371094 232 292 232 Z M 292 232 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 326.203125 320 L 354.203125 320 L 354.203125 336 L 326.203125 336 Z M 326.203125 320 \" style=\"fill-rule:nonzero;fill:rgb(39.99939%,74.902344%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"194.4877\" xlink:href=\"#glyph0-1\" y=\"99.5\"/>\n",
       "</g>\n",
       "<path d=\"M 265.5 251.59375 L 292 251.324219 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 269.375 251.554688 L 293.957031 251.371094 C 297.269531 251.347656 299.976562 254.011719 300 257.328125 C 300 257.339844 300 257.355469 300 257.371094 L 300 346 C 300 349.3125 302.6875 352 306 352 L 334.050781 352 C 337.34375 352 340.023438 349.34375 340.050781 346.050781 L 340.085938 341.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 340.117188 337.898438 L 340.085938 341.898438 M 338.585938 341.886719 L 340.117188 337.898438 L 341.585938 341.914062 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 377.945312 320 L 405.945312 320 L 405.945312 336 L 377.945312 336 Z M 377.945312 320 \" style=\"fill-rule:nonzero;fill:rgb(39.99939%,74.902344%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"246.2302\" xlink:href=\"#glyph0-1\" y=\"99.5\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"185.4883\" xlink:href=\"#glyph1-1\" y=\"44.8904\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"191.9881\" xlink:href=\"#glyph1-2\" y=\"44.8904\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"196.9939\" xlink:href=\"#glyph1-3\" y=\"44.8904\"/>\n",
       "  <use x=\"201.4939\" xlink:href=\"#glyph1-2\" y=\"44.8904\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"206.4997\" xlink:href=\"#glyph1-4\" y=\"44.8904\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"188.4854\" xlink:href=\"#glyph1-5\" y=\"55.1848\"/>\n",
       "  <use x=\"193.4912\" xlink:href=\"#glyph1-6\" y=\"55.1848\"/>\n",
       "  <use x=\"198.497\" xlink:href=\"#glyph1-4\" y=\"55.1848\"/>\n",
       "  <use x=\"201.0008\" xlink:href=\"#glyph1-2\" y=\"55.1848\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"192.7437\" xlink:href=\"#glyph2-1\" y=\"65.4793\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"199.2432\" xlink:href=\"#glyph3-1\" y=\"69.4793\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"234.4992\" xlink:href=\"#glyph1-7\" y=\"43.8906\"/>\n",
       "  <use x=\"240.999\" xlink:href=\"#glyph1-8\" y=\"43.8906\"/>\n",
       "  <use x=\"246.0048\" xlink:href=\"#glyph1-9\" y=\"43.8906\"/>\n",
       "  <use x=\"251.0106\" xlink:href=\"#glyph1-6\" y=\"43.8906\"/>\n",
       "  <use x=\"256.0164\" xlink:href=\"#glyph1-4\" y=\"43.8906\"/>\n",
       "  <use x=\"258.5202\" xlink:href=\"#glyph1-2\" y=\"43.8906\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"240.2517\" xlink:href=\"#glyph1-5\" y=\"54.185\"/>\n",
       "  <use x=\"245.2575\" xlink:href=\"#glyph1-6\" y=\"54.185\"/>\n",
       "  <use x=\"250.2633\" xlink:href=\"#glyph1-4\" y=\"54.185\"/>\n",
       "  <use x=\"252.7671\" xlink:href=\"#glyph1-2\" y=\"54.185\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"245.0109\" xlink:href=\"#glyph2-2\" y=\"64.4794\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"250.5085\" xlink:href=\"#glyph3-1\" y=\"68.4794\"/>\n",
       "</g>\n",
       "<path d=\"M 319.960938 352 L 386 352 C 389.3125 352 392 349.3125 392 346 L 392 341.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 392 337.898438 L 392 341.898438 M 390.5 341.898438 L 392 337.898438 L 393.5 341.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 300.035156 384 L 300.007812 358.007812 C 300.003906 354.691406 302.6875 352.003906 306 352 C 306.003906 352 306.003906 352 306.007812 352 L 325.636719 352 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"140.9659\" xlink:href=\"#glyph4-1\" y=\"168\"/>\n",
       "  <use x=\"143.0989\" xlink:href=\"#glyph4-2\" y=\"168\"/>\n",
       "  <use x=\"148.1299\" xlink:href=\"#glyph4-3\" y=\"168\"/>\n",
       "  <use x=\"153.4039\" xlink:href=\"#glyph4-4\" y=\"168\"/>\n",
       "  <use x=\"158.4439\" xlink:href=\"#glyph4-5\" y=\"168\"/>\n",
       "  <use x=\"161.6389\" xlink:href=\"#glyph4-6\" y=\"168\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"164.6359\" xlink:href=\"#glyph2-3\" y=\"168\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"170.6389\" xlink:href=\"#glyph3-1\" y=\"172\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"66.7336\" xlink:href=\"#glyph1-10\" y=\"16.4014\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"73.2334\" xlink:href=\"#glyph1-11\" y=\"16.4014\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"75.2332\" xlink:href=\"#glyph1-9\" y=\"16.4014\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"80.239\" xlink:href=\"#glyph1-9\" y=\"16.4014\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"85.2448\" xlink:href=\"#glyph1-2\" y=\"16.4014\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"90.2506\" xlink:href=\"#glyph1-12\" y=\"16.4014\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"95.2564\" xlink:href=\"#glyph1-13\" y=\"16.4014\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"97.7566\" xlink:href=\"#glyph1-3\" y=\"16.4014\"/>\n",
       "  <use x=\"102.2566\" xlink:href=\"#glyph1-4\" y=\"16.4014\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"104.7568\" xlink:href=\"#glyph1-6\" y=\"16.4014\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"109.7626\" xlink:href=\"#glyph1-4\" y=\"16.4014\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"112.2628\" xlink:href=\"#glyph1-2\" y=\"16.4014\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"83.4988\" xlink:href=\"#glyph2-4\" y=\"26.6959\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"89.9983\" xlink:href=\"#glyph3-1\" y=\"30.6959\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"92.4985\" xlink:href=\"#glyph3-2\" y=\"30.6959\"/>\n",
       "  <use x=\"95.4955\" xlink:href=\"#glyph3-3\" y=\"30.6959\"/>\n",
       "</g>\n",
       "<path d=\"M 340.210938 320 L 340.21875 308.789062 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 340.222656 304.789062 L 340.21875 308.789062 M 338.71875 308.789062 L 340.222656 304.789062 L 341.71875 308.792969 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 391.957031 320 L 391.976562 309.230469 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 391.984375 305.230469 L 391.976562 309.230469 M 390.476562 309.230469 L 391.984375 305.230469 L 393.476562 309.234375 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 144 420 L 172 420 L 172 436 L 144 436 Z M 144 420 \" style=\"fill-rule:nonzero;fill:rgb(39.99939%,74.902344%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"12.2864\" xlink:href=\"#glyph0-1\" y=\"199.5\"/>\n",
       "</g>\n",
       "<path d=\"M 464 424 L 486.101562 424 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 490.101562 424 L 486.101562 424 M 486.101562 422.5 L 490.101562 424 L 486.101562 425.5 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 473 436 L 473 430 C 473 426.6875 475.6875 424 479 424 L 489.789062 424 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 384 435 L 406.101562 435 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 410.101562 435 L 406.101562 435 M 406.101562 433.5 L 410.101562 435 L 406.101562 436.5 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 384 435 L 390 435 C 393.3125 435 396 432.3125 396 429 L 396 424.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 396 420.898438 L 396 424.898438 M 394.5 424.898438 L 396 420.898438 L 397.5 424.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<path d=\"M 293.65625 422.34375 C 296.78125 425.46875 296.78125 430.53125 293.65625 433.65625 C 290.53125 436.78125 285.46875 436.78125 282.34375 433.65625 C 279.21875 430.53125 279.21875 425.46875 282.34375 422.34375 C 285.46875 419.21875 290.53125 419.21875 293.65625 422.34375 \" style=\"fill-rule:nonzero;fill:rgb(69.804382%,85.098267%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-143,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"142.0029\" xlink:href=\"#glyph5-1\" y=\"198.5\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"161.4912\" xlink:href=\"#glyph1-14\" y=\"194\"/>\n",
       "  <use x=\"167.4942\" xlink:href=\"#glyph1-15\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"169.494\" xlink:href=\"#glyph1-2\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"174.4998\" xlink:href=\"#glyph1-16\" y=\"194\"/>\n",
       "  <use x=\"181.9968\" xlink:href=\"#glyph1-2\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"187.0026\" xlink:href=\"#glyph1-12\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"192.0084\" xlink:href=\"#glyph1-4\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"194.5086\" xlink:href=\"#glyph1-17\" y=\"194\"/>\n",
       "  <use x=\"197.5056\" xlink:href=\"#glyph1-18\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"204.0054\" xlink:href=\"#glyph1-11\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"206.0052\" xlink:href=\"#glyph1-3\" y=\"194\"/>\n",
       "  <use x=\"210.5052\" xlink:href=\"#glyph1-2\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"170.7417\" xlink:href=\"#glyph1-19\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"177.7419\" xlink:href=\"#glyph1-8\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"182.7477\" xlink:href=\"#glyph1-2\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"187.7535\" xlink:href=\"#glyph1-20\" y=\"204.2944\"/>\n",
       "  <use x=\"190.7505\" xlink:href=\"#glyph1-6\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"195.7563\" xlink:href=\"#glyph1-4\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"198.2565\" xlink:href=\"#glyph1-21\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"203.2623\" xlink:href=\"#glyph1-20\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"49.7449\" xlink:href=\"#glyph1-22\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"55.2421\" xlink:href=\"#glyph1-23\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"64.2421\" xlink:href=\"#glyph1-15\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"66.2419\" xlink:href=\"#glyph1-6\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"71.2477\" xlink:href=\"#glyph1-24\" y=\"194\"/>\n",
       "  <use x=\"75.7477\" xlink:href=\"#glyph1-2\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"80.7535\" xlink:href=\"#glyph1-20\" y=\"194\"/>\n",
       "  <use x=\"83.7505\" xlink:href=\"#glyph1-13\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"86.2507\" xlink:href=\"#glyph1-18\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"92.7505\" xlink:href=\"#glyph1-11\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"94.7503\" xlink:href=\"#glyph1-4\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"97.2505\" xlink:href=\"#glyph1-25\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"42.4807\" xlink:href=\"#glyph1-6\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"47.4865\" xlink:href=\"#glyph1-26\" y=\"204.2944\"/>\n",
       "  <use x=\"51.9865\" xlink:href=\"#glyph1-4\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"54.4867\" xlink:href=\"#glyph1-11\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"56.4865\" xlink:href=\"#glyph1-27\" y=\"204.2944\"/>\n",
       "  <use x=\"60.9865\" xlink:href=\"#glyph1-6\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"65.9923\" xlink:href=\"#glyph1-4\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"68.4925\" xlink:href=\"#glyph1-11\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"70.4923\" xlink:href=\"#glyph1-21\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"75.4981\" xlink:href=\"#glyph1-12\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"80.5039\" xlink:href=\"#glyph1-13\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"83.0041\" xlink:href=\"#glyph1-28\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"85.5043\" xlink:href=\"#glyph1-29\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"90.5101\" xlink:href=\"#glyph1-26\" y=\"204.2944\"/>\n",
       "  <use x=\"95.0101\" xlink:href=\"#glyph1-4\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"97.5103\" xlink:href=\"#glyph1-11\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"99.5101\" xlink:href=\"#glyph1-21\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"104.5159\" xlink:href=\"#glyph1-12\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"357.481\" xlink:href=\"#glyph1-23\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"363.9808\" xlink:href=\"#glyph1-21\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"368.9866\" xlink:href=\"#glyph1-12\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"373.9924\" xlink:href=\"#glyph1-26\" y=\"198\"/>\n",
       "  <use x=\"378.4924\" xlink:href=\"#glyph1-6\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"383.4982\" xlink:href=\"#glyph1-4\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"385.9984\" xlink:href=\"#glyph1-2\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"391.0042\" xlink:href=\"#glyph1-12\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"396.01\" xlink:href=\"#glyph1-6\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"401.0158\" xlink:href=\"#glyph1-4\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"403.516\" xlink:href=\"#glyph1-2\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"278.4949\" xlink:href=\"#glyph1-23\" y=\"198\"/>\n",
       "  <use x=\"284.9947\" xlink:href=\"#glyph1-21\" y=\"198\"/>\n",
       "  <use x=\"290.0005\" xlink:href=\"#glyph1-8\" y=\"198\"/>\n",
       "  <use x=\"295.0063\" xlink:href=\"#glyph1-24\" y=\"198\"/>\n",
       "</g>\n",
       "</g>\n",
       "</svg>"
      ],
      "text/plain": [
       "<IPython.core.display.SVG object>"
      ]
     },
     "execution_count": 1,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from IPython.display import SVG\n",
    "SVG(filename= '../img/gru_1.svg')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Fig. 10.8.1: Reset and update gate in a GRU."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Here, $W_{xr}$ , $W_{xz}$ ∈ $R^{d×h}$ and $W_{hr}$ , $W_{hz}$ ∈ $R^{h×h}$ are weight parameters and $b_r$ , $b_z$ ∈ $R^{1×h}$ are biases. We use a\n",
    "sigmoid function (see e.g. refer to Section 6.1 for a description) to transform values to the interval (0, 1)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Reset Gate in Action\n",
    "\n",
    "We begin by integrating the reset gate with a regular latent state updating mechanism. In a conventional deep RNN we\n",
    "would have an update of the form\n",
    "\n",
    "$$H_t = tanh(X_t W_{xh} + H_{t−1} W_{hh} + b_h ).$$\n",
    "\n",
    "This is essentially identical to the discussion of the previous section, albeit with a nonlinearity in the form of tanh to\n",
    "ensure that the values of the hidden state remain in the interval (−1, 1). If we want to be able to reduce the influence\n",
    "of previous states we can multiply $H_{t−1}$ with $R_t$ elementwise. Whenever the entries in $R_t$ are close to 1 we recover a\n",
    "conventional deep RNN. For all entries of $R_t$ that are close to 0 the hidden state is the result of an MLP with $X_t$ as input.\n",
    "Any pre-existing hidden state is thus ‘reset’ to defaults. This leads to the following candidate for a new hidden state (it is\n",
    "a candidate since we still need to incorporate the action of the update gate).\n",
    "\n",
    "$$H̃_t = tanh(X_t W_{xh} + (R_t ⊙ H_{t−1} ) W_{hh} + b_h )$$\n",
    "\n",
    "The figure below illustrates the computational flow after applying the reset gate. The symbol ⊙ indicates pointwise\n",
    "multiplication between tensors."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Update Gate in Action\n",
    "\n",
    "Next we need to incorporate the effect of the update gate. This determines the extent to which the new state $H_t$ is just the\n",
    "old state $H_{t−1}$ and by how much the new candidate state $H̃_t$ is used. The gating variable $Z_t$ can be used for this purpose,\n",
    "simply by taking elementwise convex combinations between both candidates. This leads to the final update equation for\n",
    "the GRU.\n",
    "\n",
    "$$H_t = Z_t ⊙ H_{t−1} + (1 − Z_t ) ⊙ H̃_t .$$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/svg+xml": [
       "<svg height=\"212pt\" version=\"1.1\" viewBox=\"0 0 414 212\" width=\"414pt\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<defs>\n",
       "<g>\n",
       "<symbol id=\"glyph0-0\" overflow=\"visible\">\n",
       "<path d=\"M 1.125 0 L 1.125 -5.625 L 5.625 -5.625 L 5.625 0 Z M 1.265625 -0.140625 L 5.484375 -0.140625 L 5.484375 -5.484375 L 1.265625 -5.484375 Z M 1.265625 -0.140625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph0-1\" overflow=\"visible\">\n",
       "<path d=\"M 5.796875 -4.671875 L 5.671875 -4 L 4.5 -4 C 4.726562 -3.675781 4.84375 -3.269531 4.84375 -2.78125 C 4.84375 -2.019531 4.617188 -1.347656 4.171875 -0.765625 C 3.722656 -0.179688 3.113281 0.109375 2.34375 0.109375 C 1.75 0.109375 1.28125 -0.0625 0.9375 -0.40625 C 0.601562 -0.757812 0.4375 -1.21875 0.4375 -1.78125 C 0.4375 -2.613281 0.664062 -3.316406 1.125 -3.890625 C 1.59375 -4.472656 2.195312 -4.765625 2.9375 -4.765625 C 3.175781 -4.765625 3.394531 -4.734375 3.59375 -4.671875 Z M 1.234375 -1.796875 C 1.234375 -1.421875 1.332031 -1.113281 1.53125 -0.875 C 1.726562 -0.632812 2 -0.515625 2.34375 -0.515625 C 2.875 -0.515625 3.289062 -0.765625 3.59375 -1.265625 C 3.894531 -1.773438 4.046875 -2.289062 4.046875 -2.8125 C 4.046875 -3.25 3.945312 -3.582031 3.75 -3.8125 C 3.5625 -4.039062 3.300781 -4.15625 2.96875 -4.15625 C 2.4375 -4.15625 2.015625 -3.914062 1.703125 -3.4375 C 1.390625 -2.957031 1.234375 -2.410156 1.234375 -1.796875 Z M 1.234375 -1.796875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-0\" overflow=\"visible\">\n",
       "<path d=\"M 0.296875 0 L 0.296875 -6 L 2.703125 -6 L 2.703125 0 Z M 2.40625 -0.296875 L 2.40625 -5.703125 L 0.59375 -5.703125 L 0.59375 -0.296875 Z M 2.40625 -0.296875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-1\" overflow=\"visible\">\n",
       "<path d=\"M 1.203125 0 L 0.5625 0 L 2.65625 -2.4375 L 0.5625 -4.84375 L 1.25 -4.84375 L 3 -3.015625 L 4.8125 -4.84375 L 5.4375 -4.84375 L 3.3125 -2.4375 L 5.4375 0 L 4.75 0 L 3 -1.953125 Z M 1.203125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-0\" overflow=\"visible\">\n",
       "<path d=\"M 1.125 0 L 1.125 -5.625 L 5.625 -5.625 L 5.625 0 Z M 1.265625 -0.140625 L 5.484375 -0.140625 L 5.484375 -5.484375 L 1.265625 -5.484375 Z M 1.265625 -0.140625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-1\" overflow=\"visible\">\n",
       "<path d=\"M 0.703125 0 L 0.703125 -6.4375 L 3.5625 -6.4375 C 4.132812 -6.4375 4.570312 -6.378906 4.875 -6.265625 C 5.175781 -6.148438 5.414062 -5.945312 5.59375 -5.65625 C 5.769531 -5.363281 5.859375 -5.039062 5.859375 -4.6875 C 5.859375 -4.226562 5.707031 -3.84375 5.40625 -3.53125 C 5.113281 -3.21875 4.660156 -3.019531 4.046875 -2.9375 C 4.265625 -2.820312 4.4375 -2.710938 4.5625 -2.609375 C 4.8125 -2.378906 5.046875 -2.09375 5.265625 -1.75 L 6.390625 0 L 5.3125 0 L 4.453125 -1.34375 C 4.210938 -1.726562 4.007812 -2.019531 3.84375 -2.21875 C 3.6875 -2.425781 3.539062 -2.570312 3.40625 -2.65625 C 3.28125 -2.738281 3.15625 -2.796875 3.03125 -2.828125 C 2.925781 -2.847656 2.765625 -2.859375 2.546875 -2.859375 L 1.5625 -2.859375 L 1.5625 0 Z M 1.5625 -3.59375 L 3.390625 -3.59375 C 3.785156 -3.59375 4.09375 -3.632812 4.3125 -3.71875 C 4.53125 -3.800781 4.695312 -3.929688 4.8125 -4.109375 C 4.925781 -4.285156 4.984375 -4.476562 4.984375 -4.6875 C 4.984375 -4.988281 4.867188 -5.238281 4.640625 -5.4375 C 4.421875 -5.632812 4.070312 -5.734375 3.59375 -5.734375 L 1.5625 -5.734375 Z M 1.5625 -3.59375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-2\" overflow=\"visible\">\n",
       "<path d=\"M 3.78125 -1.5 L 4.609375 -1.40625 C 4.472656 -0.925781 4.226562 -0.550781 3.875 -0.28125 C 3.53125 -0.0195312 3.085938 0.109375 2.546875 0.109375 C 1.867188 0.109375 1.328125 -0.0976562 0.921875 -0.515625 C 0.523438 -0.941406 0.328125 -1.535156 0.328125 -2.296875 C 0.328125 -3.078125 0.53125 -3.679688 0.9375 -4.109375 C 1.34375 -4.546875 1.867188 -4.765625 2.515625 -4.765625 C 3.140625 -4.765625 3.644531 -4.550781 4.03125 -4.125 C 4.425781 -3.707031 4.625 -3.113281 4.625 -2.34375 C 4.625 -2.289062 4.625 -2.21875 4.625 -2.125 L 1.140625 -2.125 C 1.171875 -1.613281 1.316406 -1.222656 1.578125 -0.953125 C 1.835938 -0.679688 2.164062 -0.546875 2.5625 -0.546875 C 2.851562 -0.546875 3.097656 -0.617188 3.296875 -0.765625 C 3.503906 -0.921875 3.664062 -1.164062 3.78125 -1.5 Z M 1.1875 -2.78125 L 3.796875 -2.78125 C 3.765625 -3.175781 3.664062 -3.472656 3.5 -3.671875 C 3.25 -3.972656 2.921875 -4.125 2.515625 -4.125 C 2.148438 -4.125 1.84375 -4 1.59375 -3.75 C 1.351562 -3.507812 1.21875 -3.1875 1.1875 -2.78125 Z M 1.1875 -2.78125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-3\" overflow=\"visible\">\n",
       "<path d=\"M 0.28125 -1.390625 L 1.0625 -1.515625 C 1.101562 -1.203125 1.222656 -0.960938 1.421875 -0.796875 C 1.628906 -0.628906 1.910156 -0.546875 2.265625 -0.546875 C 2.628906 -0.546875 2.898438 -0.617188 3.078125 -0.765625 C 3.253906 -0.910156 3.34375 -1.082031 3.34375 -1.28125 C 3.34375 -1.46875 3.265625 -1.609375 3.109375 -1.703125 C 2.992188 -1.773438 2.722656 -1.867188 2.296875 -1.984375 C 1.710938 -2.128906 1.304688 -2.253906 1.078125 -2.359375 C 0.859375 -2.460938 0.691406 -2.609375 0.578125 -2.796875 C 0.460938 -2.984375 0.40625 -3.191406 0.40625 -3.421875 C 0.40625 -3.628906 0.453125 -3.820312 0.546875 -4 C 0.640625 -4.175781 0.769531 -4.328125 0.9375 -4.453125 C 1.0625 -4.535156 1.226562 -4.609375 1.4375 -4.671875 C 1.65625 -4.734375 1.882812 -4.765625 2.125 -4.765625 C 2.488281 -4.765625 2.804688 -4.710938 3.078125 -4.609375 C 3.359375 -4.503906 3.566406 -4.363281 3.703125 -4.1875 C 3.835938 -4.007812 3.929688 -3.769531 3.984375 -3.46875 L 3.203125 -3.359375 C 3.171875 -3.597656 3.066406 -3.785156 2.890625 -3.921875 C 2.722656 -4.054688 2.488281 -4.125 2.1875 -4.125 C 1.820312 -4.125 1.5625 -4.0625 1.40625 -3.9375 C 1.25 -3.820312 1.171875 -3.679688 1.171875 -3.515625 C 1.171875 -3.410156 1.203125 -3.320312 1.265625 -3.25 C 1.328125 -3.15625 1.429688 -3.082031 1.578125 -3.03125 C 1.648438 -3 1.878906 -2.929688 2.265625 -2.828125 C 2.828125 -2.679688 3.21875 -2.5625 3.4375 -2.46875 C 3.664062 -2.375 3.84375 -2.234375 3.96875 -2.046875 C 4.09375 -1.867188 4.15625 -1.644531 4.15625 -1.375 C 4.15625 -1.101562 4.078125 -0.851562 3.921875 -0.625 C 3.765625 -0.394531 3.539062 -0.210938 3.25 -0.078125 C 2.96875 0.046875 2.640625 0.109375 2.265625 0.109375 C 1.660156 0.109375 1.195312 -0.015625 0.875 -0.265625 C 0.5625 -0.523438 0.363281 -0.898438 0.28125 -1.390625 Z M 0.28125 -1.390625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-4\" overflow=\"visible\">\n",
       "<path d=\"M 2.328125 -0.703125 L 2.4375 -0.015625 C 2.207031 0.0351562 2.007812 0.0625 1.84375 0.0625 C 1.550781 0.0625 1.328125 0.015625 1.171875 -0.078125 C 1.015625 -0.171875 0.898438 -0.289062 0.828125 -0.4375 C 0.765625 -0.582031 0.734375 -0.890625 0.734375 -1.359375 L 0.734375 -4.046875 L 0.15625 -4.046875 L 0.15625 -4.671875 L 0.734375 -4.671875 L 0.734375 -5.828125 L 1.53125 -6.296875 L 1.53125 -4.671875 L 2.328125 -4.671875 L 2.328125 -4.046875 L 1.53125 -4.046875 L 1.53125 -1.328125 C 1.53125 -1.097656 1.539062 -0.953125 1.5625 -0.890625 C 1.59375 -0.828125 1.640625 -0.773438 1.703125 -0.734375 C 1.765625 -0.691406 1.851562 -0.671875 1.96875 -0.671875 C 2.0625 -0.671875 2.179688 -0.679688 2.328125 -0.703125 Z M 2.328125 -0.703125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-5\" overflow=\"visible\">\n",
       "<path d=\"M 0.453125 0.390625 L 1.21875 0.5 C 1.25 0.738281 1.335938 0.910156 1.484375 1.015625 C 1.679688 1.160156 1.953125 1.234375 2.296875 1.234375 C 2.660156 1.234375 2.941406 1.160156 3.140625 1.015625 C 3.335938 0.867188 3.472656 0.664062 3.546875 0.40625 C 3.585938 0.238281 3.601562 -0.0976562 3.59375 -0.609375 C 3.25 -0.203125 2.820312 0 2.3125 0 C 1.664062 0 1.164062 -0.226562 0.8125 -0.6875 C 0.46875 -1.15625 0.296875 -1.710938 0.296875 -2.359375 C 0.296875 -2.804688 0.375 -3.21875 0.53125 -3.59375 C 0.695312 -3.96875 0.929688 -4.253906 1.234375 -4.453125 C 1.535156 -4.660156 1.894531 -4.765625 2.3125 -4.765625 C 2.863281 -4.765625 3.316406 -4.546875 3.671875 -4.109375 L 3.671875 -4.671875 L 4.40625 -4.671875 L 4.40625 -0.640625 C 4.40625 0.0859375 4.328125 0.601562 4.171875 0.90625 C 4.023438 1.207031 3.789062 1.445312 3.46875 1.625 C 3.15625 1.800781 2.765625 1.890625 2.296875 1.890625 C 1.734375 1.890625 1.28125 1.765625 0.9375 1.515625 C 0.601562 1.265625 0.441406 0.890625 0.453125 0.390625 Z M 1.109375 -2.421875 C 1.109375 -1.804688 1.226562 -1.359375 1.46875 -1.078125 C 1.707031 -0.796875 2.007812 -0.65625 2.375 -0.65625 C 2.738281 -0.65625 3.046875 -0.796875 3.296875 -1.078125 C 3.546875 -1.359375 3.671875 -1.796875 3.671875 -2.390625 C 3.671875 -2.960938 3.539062 -3.394531 3.28125 -3.6875 C 3.03125 -3.976562 2.726562 -4.125 2.375 -4.125 C 2.019531 -4.125 1.71875 -3.976562 1.46875 -3.6875 C 1.226562 -3.40625 1.109375 -2.984375 1.109375 -2.421875 Z M 1.109375 -2.421875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-6\" overflow=\"visible\">\n",
       "<path d=\"M 3.640625 -0.578125 C 3.347656 -0.328125 3.066406 -0.148438 2.796875 -0.046875 C 2.523438 0.0546875 2.234375 0.109375 1.921875 0.109375 C 1.410156 0.109375 1.015625 -0.015625 0.734375 -0.265625 C 0.460938 -0.515625 0.328125 -0.835938 0.328125 -1.234375 C 0.328125 -1.460938 0.378906 -1.671875 0.484375 -1.859375 C 0.585938 -2.046875 0.722656 -2.195312 0.890625 -2.3125 C 1.054688 -2.425781 1.242188 -2.515625 1.453125 -2.578125 C 1.609375 -2.609375 1.84375 -2.644531 2.15625 -2.6875 C 2.800781 -2.757812 3.273438 -2.851562 3.578125 -2.96875 C 3.578125 -3.070312 3.578125 -3.140625 3.578125 -3.171875 C 3.578125 -3.492188 3.503906 -3.71875 3.359375 -3.84375 C 3.148438 -4.03125 2.847656 -4.125 2.453125 -4.125 C 2.078125 -4.125 1.800781 -4.054688 1.625 -3.921875 C 1.445312 -3.796875 1.316406 -3.566406 1.234375 -3.234375 L 0.46875 -3.328125 C 0.53125 -3.660156 0.640625 -3.925781 0.796875 -4.125 C 0.960938 -4.332031 1.195312 -4.488281 1.5 -4.59375 C 1.8125 -4.707031 2.164062 -4.765625 2.5625 -4.765625 C 2.96875 -4.765625 3.289062 -4.71875 3.53125 -4.625 C 3.78125 -4.53125 3.960938 -4.410156 4.078125 -4.265625 C 4.203125 -4.128906 4.285156 -3.953125 4.328125 -3.734375 C 4.359375 -3.597656 4.375 -3.359375 4.375 -3.015625 L 4.375 -1.953125 C 4.375 -1.222656 4.390625 -0.757812 4.421875 -0.5625 C 4.453125 -0.363281 4.519531 -0.175781 4.625 0 L 3.796875 0 C 3.710938 -0.164062 3.660156 -0.359375 3.640625 -0.578125 Z M 3.578125 -2.34375 C 3.285156 -2.226562 2.851562 -2.128906 2.28125 -2.046875 C 1.957031 -1.992188 1.726562 -1.9375 1.59375 -1.875 C 1.457031 -1.820312 1.351562 -1.738281 1.28125 -1.625 C 1.207031 -1.507812 1.171875 -1.382812 1.171875 -1.25 C 1.171875 -1.039062 1.25 -0.863281 1.40625 -0.71875 C 1.5625 -0.582031 1.796875 -0.515625 2.109375 -0.515625 C 2.410156 -0.515625 2.679688 -0.582031 2.921875 -0.71875 C 3.160156 -0.851562 3.335938 -1.035156 3.453125 -1.265625 C 3.535156 -1.441406 3.578125 -1.703125 3.578125 -2.046875 Z M 3.578125 -2.34375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-7\" overflow=\"visible\">\n",
       "<path d=\"M 4.921875 -6.4375 L 5.78125 -6.4375 L 5.78125 -2.71875 C 5.78125 -2.070312 5.703125 -1.554688 5.546875 -1.171875 C 5.398438 -0.796875 5.132812 -0.488281 4.75 -0.25 C 4.375 -0.0078125 3.875 0.109375 3.25 0.109375 C 2.644531 0.109375 2.148438 0.00390625 1.765625 -0.203125 C 1.390625 -0.410156 1.117188 -0.710938 0.953125 -1.109375 C 0.785156 -1.503906 0.703125 -2.039062 0.703125 -2.71875 L 0.703125 -6.4375 L 1.5625 -6.4375 L 1.5625 -2.71875 C 1.5625 -2.164062 1.613281 -1.753906 1.71875 -1.484375 C 1.820312 -1.222656 2 -1.019531 2.25 -0.875 C 2.5 -0.726562 2.8125 -0.65625 3.1875 -0.65625 C 3.8125 -0.65625 4.253906 -0.796875 4.515625 -1.078125 C 4.785156 -1.367188 4.921875 -1.914062 4.921875 -2.71875 Z M 4.921875 -6.4375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-8\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 1.78125 L 0.59375 -4.671875 L 1.3125 -4.671875 L 1.3125 -4.0625 C 1.476562 -4.300781 1.664062 -4.476562 1.875 -4.59375 C 2.09375 -4.707031 2.359375 -4.765625 2.671875 -4.765625 C 3.066406 -4.765625 3.414062 -4.660156 3.71875 -4.453125 C 4.019531 -4.253906 4.25 -3.96875 4.40625 -3.59375 C 4.5625 -3.21875 4.640625 -2.8125 4.640625 -2.375 C 4.640625 -1.894531 4.550781 -1.460938 4.375 -1.078125 C 4.207031 -0.691406 3.960938 -0.394531 3.640625 -0.1875 C 3.316406 0.0078125 2.972656 0.109375 2.609375 0.109375 C 2.347656 0.109375 2.113281 0.0507812 1.90625 -0.0625 C 1.695312 -0.175781 1.523438 -0.316406 1.390625 -0.484375 L 1.390625 1.78125 Z M 1.3125 -2.3125 C 1.3125 -1.707031 1.429688 -1.257812 1.671875 -0.96875 C 1.921875 -0.6875 2.21875 -0.546875 2.5625 -0.546875 C 2.90625 -0.546875 3.203125 -0.691406 3.453125 -0.984375 C 3.710938 -1.285156 3.84375 -1.75 3.84375 -2.375 C 3.84375 -2.96875 3.71875 -3.410156 3.46875 -3.703125 C 3.226562 -4.003906 2.9375 -4.15625 2.59375 -4.15625 C 2.257812 -4.15625 1.960938 -3.992188 1.703125 -3.671875 C 1.441406 -3.359375 1.3125 -2.90625 1.3125 -2.3125 Z M 1.3125 -2.3125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-9\" overflow=\"visible\">\n",
       "<path d=\"M 3.625 0 L 3.625 -0.59375 C 3.320312 -0.125 2.882812 0.109375 2.3125 0.109375 C 1.945312 0.109375 1.609375 0.00390625 1.296875 -0.203125 C 0.984375 -0.410156 0.738281 -0.695312 0.5625 -1.0625 C 0.394531 -1.425781 0.3125 -1.847656 0.3125 -2.328125 C 0.3125 -2.796875 0.390625 -3.21875 0.546875 -3.59375 C 0.703125 -3.976562 0.929688 -4.269531 1.234375 -4.46875 C 1.546875 -4.664062 1.894531 -4.765625 2.28125 -4.765625 C 2.5625 -4.765625 2.8125 -4.707031 3.03125 -4.59375 C 3.25 -4.476562 3.425781 -4.320312 3.5625 -4.125 L 3.5625 -6.4375 L 4.359375 -6.4375 L 4.359375 0 Z M 1.125 -2.328125 C 1.125 -1.734375 1.25 -1.285156 1.5 -0.984375 C 1.75 -0.691406 2.046875 -0.546875 2.390625 -0.546875 C 2.734375 -0.546875 3.023438 -0.6875 3.265625 -0.96875 C 3.515625 -1.25 3.640625 -1.679688 3.640625 -2.265625 C 3.640625 -2.898438 3.515625 -3.367188 3.265625 -3.671875 C 3.015625 -3.972656 2.710938 -4.125 2.359375 -4.125 C 2.003906 -4.125 1.707031 -3.976562 1.46875 -3.6875 C 1.238281 -3.394531 1.125 -2.941406 1.125 -2.328125 Z M 1.125 -2.328125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-10\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 0 L 0.59375 -4.671875 L 1.3125 -4.671875 L 1.3125 -4 C 1.644531 -4.507812 2.140625 -4.765625 2.796875 -4.765625 C 3.078125 -4.765625 3.332031 -4.710938 3.5625 -4.609375 C 3.800781 -4.515625 3.976562 -4.382812 4.09375 -4.21875 C 4.207031 -4.0625 4.289062 -3.867188 4.34375 -3.640625 C 4.375 -3.492188 4.390625 -3.238281 4.390625 -2.875 L 4.390625 0 L 3.59375 0 L 3.59375 -2.84375 C 3.59375 -3.164062 3.5625 -3.40625 3.5 -3.5625 C 3.4375 -3.71875 3.328125 -3.84375 3.171875 -3.9375 C 3.015625 -4.039062 2.832031 -4.09375 2.625 -4.09375 C 2.289062 -4.09375 2 -3.984375 1.75 -3.765625 C 1.507812 -3.554688 1.390625 -3.148438 1.390625 -2.546875 L 1.390625 0 Z M 0.59375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-11\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 0 L 0.59375 -6.4375 L 1.390625 -6.4375 L 1.390625 -4.125 C 1.753906 -4.550781 2.21875 -4.765625 2.78125 -4.765625 C 3.125 -4.765625 3.421875 -4.695312 3.671875 -4.5625 C 3.929688 -4.425781 4.113281 -4.238281 4.21875 -4 C 4.332031 -3.757812 4.390625 -3.410156 4.390625 -2.953125 L 4.390625 0 L 3.609375 0 L 3.609375 -2.953125 C 3.609375 -3.347656 3.519531 -3.632812 3.34375 -3.8125 C 3.175781 -4 2.9375 -4.09375 2.625 -4.09375 C 2.382812 -4.09375 2.160156 -4.03125 1.953125 -3.90625 C 1.742188 -3.789062 1.597656 -3.628906 1.515625 -3.421875 C 1.429688 -3.210938 1.390625 -2.921875 1.390625 -2.546875 L 1.390625 0 Z M 0.59375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-12\" overflow=\"visible\">\n",
       "<path d=\"M 0.71875 0 L 0.71875 -6.4375 L 1.578125 -6.4375 L 1.578125 -3.796875 L 4.921875 -3.796875 L 4.921875 -6.4375 L 5.78125 -6.4375 L 5.78125 0 L 4.921875 0 L 4.921875 -3.03125 L 1.578125 -3.03125 L 1.578125 0 Z M 0.71875 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-13\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 -5.53125 L 0.59375 -6.4375 L 1.390625 -6.4375 L 1.390625 -5.53125 Z M 0.59375 0 L 0.59375 -4.671875 L 1.390625 -4.671875 L 1.390625 0 Z M 0.59375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-14\" overflow=\"visible\">\n",
       "<path d=\"\" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-15\" overflow=\"visible\">\n",
       "<path d=\"M 5.296875 -2.265625 L 6.140625 -2.046875 C 5.960938 -1.347656 5.640625 -0.8125 5.171875 -0.4375 C 4.710938 -0.0703125 4.144531 0.109375 3.46875 0.109375 C 2.78125 0.109375 2.21875 -0.03125 1.78125 -0.3125 C 1.34375 -0.59375 1.007812 -1 0.78125 -1.53125 C 0.5625 -2.070312 0.453125 -2.648438 0.453125 -3.265625 C 0.453125 -3.941406 0.578125 -4.53125 0.828125 -5.03125 C 1.085938 -5.53125 1.453125 -5.90625 1.921875 -6.15625 C 2.398438 -6.414062 2.921875 -6.546875 3.484375 -6.546875 C 4.128906 -6.546875 4.671875 -6.378906 5.109375 -6.046875 C 5.554688 -5.722656 5.863281 -5.265625 6.03125 -4.671875 L 5.1875 -4.484375 C 5.039062 -4.953125 4.828125 -5.289062 4.546875 -5.5 C 4.265625 -5.71875 3.90625 -5.828125 3.46875 -5.828125 C 2.976562 -5.828125 2.566406 -5.707031 2.234375 -5.46875 C 1.898438 -5.226562 1.664062 -4.90625 1.53125 -4.5 C 1.394531 -4.101562 1.328125 -3.695312 1.328125 -3.28125 C 1.328125 -2.726562 1.40625 -2.242188 1.5625 -1.828125 C 1.726562 -1.421875 1.976562 -1.117188 2.3125 -0.921875 C 2.644531 -0.722656 3.007812 -0.625 3.40625 -0.625 C 3.882812 -0.625 4.285156 -0.757812 4.609375 -1.03125 C 4.941406 -1.3125 5.171875 -1.722656 5.296875 -2.265625 Z M 5.296875 -2.265625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-16\" overflow=\"visible\">\n",
       "<path d=\"M 0.375 -2.453125 L 0.375 -3.34375 C 0.6875 -3.695312 1.097656 -3.875 1.609375 -3.875 C 1.785156 -3.875 1.96875 -3.847656 2.15625 -3.796875 C 2.351562 -3.742188 2.628906 -3.644531 2.984375 -3.5 C 3.179688 -3.40625 3.332031 -3.34375 3.4375 -3.3125 C 3.539062 -3.289062 3.644531 -3.28125 3.75 -3.28125 C 3.9375 -3.28125 4.128906 -3.335938 4.328125 -3.453125 C 4.535156 -3.566406 4.71875 -3.710938 4.875 -3.890625 L 4.875 -2.953125 C 4.6875 -2.773438 4.492188 -2.644531 4.296875 -2.5625 C 4.109375 -2.488281 3.894531 -2.453125 3.65625 -2.453125 C 3.476562 -2.453125 3.3125 -2.472656 3.15625 -2.515625 C 3 -2.554688 2.742188 -2.65625 2.390625 -2.8125 C 2.046875 -2.96875 1.757812 -3.046875 1.53125 -3.046875 C 1.34375 -3.046875 1.164062 -3.003906 1 -2.921875 C 0.832031 -2.835938 0.625 -2.679688 0.375 -2.453125 Z M 0.375 -2.453125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-17\" overflow=\"visible\">\n",
       "<path d=\"M 0.71875 0 L 0.71875 -6.4375 L 5.375 -6.4375 L 5.375 -5.6875 L 1.5625 -5.6875 L 1.5625 -3.703125 L 5.125 -3.703125 L 5.125 -2.953125 L 1.5625 -2.953125 L 1.5625 -0.765625 L 5.515625 -0.765625 L 5.515625 0 Z M 0.71875 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-18\" overflow=\"visible\">\n",
       "<path d=\"M 0.578125 0 L 0.578125 -6.4375 L 1.359375 -6.4375 L 1.359375 0 Z M 0.578125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-19\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 0 L 0.59375 -4.671875 L 1.296875 -4.671875 L 1.296875 -4.015625 C 1.441406 -4.242188 1.632812 -4.425781 1.875 -4.5625 C 2.125 -4.695312 2.40625 -4.765625 2.71875 -4.765625 C 3.0625 -4.765625 3.34375 -4.691406 3.5625 -4.546875 C 3.78125 -4.410156 3.9375 -4.210938 4.03125 -3.953125 C 4.40625 -4.492188 4.882812 -4.765625 5.46875 -4.765625 C 5.9375 -4.765625 6.296875 -4.632812 6.546875 -4.375 C 6.796875 -4.125 6.921875 -3.734375 6.921875 -3.203125 L 6.921875 0 L 6.125 0 L 6.125 -2.9375 C 6.125 -3.257812 6.097656 -3.488281 6.046875 -3.625 C 6.003906 -3.757812 5.914062 -3.867188 5.78125 -3.953125 C 5.644531 -4.046875 5.484375 -4.09375 5.296875 -4.09375 C 4.972656 -4.09375 4.703125 -3.984375 4.484375 -3.765625 C 4.265625 -3.546875 4.15625 -3.195312 4.15625 -2.71875 L 4.15625 0 L 3.359375 0 L 3.359375 -3.03125 C 3.359375 -3.382812 3.296875 -3.648438 3.171875 -3.828125 C 3.046875 -4.003906 2.835938 -4.09375 2.546875 -4.09375 C 2.316406 -4.09375 2.109375 -4.03125 1.921875 -3.90625 C 1.734375 -3.789062 1.597656 -3.617188 1.515625 -3.390625 C 1.429688 -3.171875 1.390625 -2.847656 1.390625 -2.421875 L 1.390625 0 Z M 0.59375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-20\" overflow=\"visible\">\n",
       "<path d=\"M 0.28125 -1.9375 L 0.28125 -2.734375 L 2.71875 -2.734375 L 2.71875 -1.9375 Z M 0.28125 -1.9375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-21\" overflow=\"visible\">\n",
       "<path d=\"M 1.453125 0 L 0.03125 -4.671875 L 0.84375 -4.671875 L 1.59375 -1.96875 L 1.859375 -0.96875 C 1.867188 -1.019531 1.953125 -1.34375 2.109375 -1.9375 L 2.84375 -4.671875 L 3.65625 -4.671875 L 4.359375 -1.953125 L 4.59375 -1.0625 L 4.859375 -1.96875 L 5.65625 -4.671875 L 6.421875 -4.671875 L 4.96875 0 L 4.15625 0 L 3.40625 -2.796875 L 3.21875 -3.59375 L 2.28125 0 Z M 1.453125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-22\" overflow=\"visible\">\n",
       "<path d=\"M 0.4375 -3.140625 C 0.4375 -4.203125 0.722656 -5.035156 1.296875 -5.640625 C 1.867188 -6.253906 2.609375 -6.5625 3.515625 -6.5625 C 4.109375 -6.5625 4.644531 -6.414062 5.125 -6.125 C 5.601562 -5.84375 5.96875 -5.445312 6.21875 -4.9375 C 6.46875 -4.425781 6.59375 -3.851562 6.59375 -3.21875 C 6.59375 -2.5625 6.460938 -1.972656 6.203125 -1.453125 C 5.941406 -0.941406 5.566406 -0.550781 5.078125 -0.28125 C 4.597656 -0.0195312 4.078125 0.109375 3.515625 0.109375 C 2.910156 0.109375 2.367188 -0.0351562 1.890625 -0.328125 C 1.410156 -0.617188 1.046875 -1.019531 0.796875 -1.53125 C 0.554688 -2.039062 0.4375 -2.578125 0.4375 -3.140625 Z M 1.3125 -3.125 C 1.3125 -2.34375 1.519531 -1.726562 1.9375 -1.28125 C 2.351562 -0.84375 2.878906 -0.625 3.515625 -0.625 C 4.148438 -0.625 4.675781 -0.847656 5.09375 -1.296875 C 5.507812 -1.742188 5.71875 -2.382812 5.71875 -3.21875 C 5.71875 -3.738281 5.628906 -4.191406 5.453125 -4.578125 C 5.273438 -4.972656 5.015625 -5.28125 4.671875 -5.5 C 4.328125 -5.71875 3.945312 -5.828125 3.53125 -5.828125 C 2.925781 -5.828125 2.40625 -5.617188 1.96875 -5.203125 C 1.53125 -4.785156 1.3125 -4.09375 1.3125 -3.125 Z M 1.3125 -3.125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-23\" overflow=\"visible\">\n",
       "<path d=\"M 0.578125 0 L 0.578125 -4.671875 L 1.296875 -4.671875 L 1.296875 -3.953125 C 1.472656 -4.285156 1.640625 -4.503906 1.796875 -4.609375 C 1.953125 -4.710938 2.125 -4.765625 2.3125 -4.765625 C 2.570312 -4.765625 2.84375 -4.679688 3.125 -4.515625 L 2.84375 -3.78125 C 2.65625 -3.894531 2.460938 -3.953125 2.265625 -3.953125 C 2.097656 -3.953125 1.941406 -3.898438 1.796875 -3.796875 C 1.660156 -3.691406 1.5625 -3.546875 1.5 -3.359375 C 1.414062 -3.078125 1.375 -2.769531 1.375 -2.4375 L 1.375 0 Z M 0.578125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-24\" overflow=\"visible\">\n",
       "<path d=\"M 0.296875 -2.328125 C 0.296875 -3.191406 0.535156 -3.832031 1.015625 -4.25 C 1.421875 -4.59375 1.910156 -4.765625 2.484375 -4.765625 C 3.128906 -4.765625 3.65625 -4.554688 4.0625 -4.140625 C 4.46875 -3.722656 4.671875 -3.144531 4.671875 -2.40625 C 4.671875 -1.800781 4.578125 -1.328125 4.390625 -0.984375 C 4.210938 -0.640625 3.953125 -0.367188 3.609375 -0.171875 C 3.265625 0.015625 2.890625 0.109375 2.484375 0.109375 C 1.828125 0.109375 1.296875 -0.0976562 0.890625 -0.515625 C 0.492188 -0.941406 0.296875 -1.546875 0.296875 -2.328125 Z M 1.109375 -2.328125 C 1.109375 -1.734375 1.238281 -1.285156 1.5 -0.984375 C 1.757812 -0.691406 2.085938 -0.546875 2.484375 -0.546875 C 2.878906 -0.546875 3.207031 -0.691406 3.46875 -0.984375 C 3.726562 -1.285156 3.859375 -1.742188 3.859375 -2.359375 C 3.859375 -2.929688 3.726562 -3.367188 3.46875 -3.671875 C 3.207031 -3.972656 2.878906 -4.125 2.484375 -4.125 C 2.085938 -4.125 1.757812 -3.972656 1.5 -3.671875 C 1.238281 -3.378906 1.109375 -2.929688 1.109375 -2.328125 Z M 1.109375 -2.328125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-25\" overflow=\"visible\">\n",
       "<path d=\"M 0.734375 0 L 0.734375 -6.4375 L 5.078125 -6.4375 L 5.078125 -5.6875 L 1.59375 -5.6875 L 1.59375 -3.6875 L 4.609375 -3.6875 L 4.609375 -2.921875 L 1.59375 -2.921875 L 1.59375 0 Z M 0.734375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-26\" overflow=\"visible\">\n",
       "<path d=\"M 0.5625 1.796875 L 0.46875 1.0625 C 0.644531 1.101562 0.796875 1.125 0.921875 1.125 C 1.097656 1.125 1.238281 1.09375 1.34375 1.03125 C 1.445312 0.976562 1.535156 0.898438 1.609375 0.796875 C 1.648438 0.710938 1.726562 0.515625 1.84375 0.203125 C 1.863281 0.160156 1.890625 0.0976562 1.921875 0.015625 L 0.140625 -4.671875 L 1 -4.671875 L 1.96875 -1.96875 C 2.09375 -1.625 2.207031 -1.265625 2.3125 -0.890625 C 2.394531 -1.242188 2.5 -1.597656 2.625 -1.953125 L 3.625 -4.671875 L 4.421875 -4.671875 L 2.640625 0.078125 C 2.453125 0.585938 2.304688 0.941406 2.203125 1.140625 C 2.054688 1.398438 1.894531 1.585938 1.71875 1.703125 C 1.539062 1.828125 1.320312 1.890625 1.0625 1.890625 C 0.914062 1.890625 0.75 1.859375 0.5625 1.796875 Z M 0.5625 1.796875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-27\" overflow=\"visible\">\n",
       "<path d=\"M 3.640625 -1.703125 L 4.421875 -1.609375 C 4.335938 -1.066406 4.117188 -0.644531 3.765625 -0.34375 C 3.410156 -0.0390625 2.976562 0.109375 2.46875 0.109375 C 1.832031 0.109375 1.320312 -0.0976562 0.9375 -0.515625 C 0.550781 -0.929688 0.359375 -1.53125 0.359375 -2.3125 C 0.359375 -2.820312 0.441406 -3.265625 0.609375 -3.640625 C 0.773438 -4.015625 1.023438 -4.296875 1.359375 -4.484375 C 1.703125 -4.671875 2.078125 -4.765625 2.484375 -4.765625 C 2.984375 -4.765625 3.394531 -4.632812 3.71875 -4.375 C 4.039062 -4.125 4.25 -3.765625 4.34375 -3.296875 L 3.578125 -3.171875 C 3.503906 -3.484375 3.375 -3.71875 3.1875 -3.875 C 3 -4.039062 2.773438 -4.125 2.515625 -4.125 C 2.109375 -4.125 1.78125 -3.976562 1.53125 -3.6875 C 1.289062 -3.40625 1.171875 -2.957031 1.171875 -2.34375 C 1.171875 -1.707031 1.289062 -1.25 1.53125 -0.96875 C 1.769531 -0.6875 2.082031 -0.546875 2.46875 -0.546875 C 2.78125 -0.546875 3.039062 -0.640625 3.25 -0.828125 C 3.457031 -1.015625 3.585938 -1.304688 3.640625 -1.703125 Z M 3.640625 -1.703125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-28\" overflow=\"visible\">\n",
       "<path d=\"M 1.890625 0 L 0.109375 -4.671875 L 0.953125 -4.671875 L 1.953125 -1.875 C 2.054688 -1.570312 2.15625 -1.257812 2.25 -0.9375 C 2.320312 -1.175781 2.421875 -1.46875 2.546875 -1.8125 L 3.578125 -4.671875 L 4.390625 -4.671875 L 2.625 0 Z M 1.890625 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-29\" overflow=\"visible\">\n",
       "<path d=\"M 0.78125 0 L 0.78125 -4.046875 L 0.078125 -4.046875 L 0.078125 -4.671875 L 0.78125 -4.671875 L 0.78125 -5.15625 C 0.78125 -5.476562 0.804688 -5.710938 0.859375 -5.859375 C 0.941406 -6.066406 1.078125 -6.234375 1.265625 -6.359375 C 1.460938 -6.484375 1.734375 -6.546875 2.078125 -6.546875 C 2.296875 -6.546875 2.539062 -6.519531 2.8125 -6.46875 L 2.6875 -5.78125 C 2.53125 -5.8125 2.378906 -5.828125 2.234375 -5.828125 C 1.992188 -5.828125 1.820312 -5.773438 1.71875 -5.671875 C 1.613281 -5.566406 1.5625 -5.375 1.5625 -5.09375 L 1.5625 -4.671875 L 2.484375 -4.671875 L 2.484375 -4.046875 L 1.5625 -4.046875 L 1.5625 0 Z M 0.78125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-30\" overflow=\"visible\">\n",
       "<path d=\"M 3.65625 0 L 3.65625 -0.6875 C 3.289062 -0.15625 2.796875 0.109375 2.171875 0.109375 C 1.898438 0.109375 1.644531 0.0546875 1.40625 -0.046875 C 1.164062 -0.160156 0.984375 -0.296875 0.859375 -0.453125 C 0.742188 -0.609375 0.664062 -0.800781 0.625 -1.03125 C 0.59375 -1.1875 0.578125 -1.4375 0.578125 -1.78125 L 0.578125 -4.671875 L 1.359375 -4.671875 L 1.359375 -2.078125 C 1.359375 -1.660156 1.378906 -1.382812 1.421875 -1.25 C 1.460938 -1.039062 1.5625 -0.875 1.71875 -0.75 C 1.882812 -0.632812 2.085938 -0.578125 2.328125 -0.578125 C 2.566406 -0.578125 2.789062 -0.632812 3 -0.75 C 3.207031 -0.875 3.351562 -1.039062 3.4375 -1.25 C 3.519531 -1.457031 3.5625 -1.765625 3.5625 -2.171875 L 3.5625 -4.671875 L 4.359375 -4.671875 L 4.359375 0 Z M 3.65625 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-0\" overflow=\"visible\">\n",
       "<path d=\"M 1.125 0 L 1.125 -5.625 L 5.625 -5.625 L 5.625 0 Z M 1.265625 -0.140625 L 5.484375 -0.140625 L 5.484375 -5.484375 L 1.265625 -5.484375 Z M 1.265625 -0.140625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-1\" overflow=\"visible\">\n",
       "<path d=\"M 1.71875 0 L 0.390625 0 L 1.75 -6.4375 L 4.609375 -6.4375 C 5.097656 -6.4375 5.476562 -6.382812 5.75 -6.28125 C 6.03125 -6.1875 6.253906 -6.003906 6.421875 -5.734375 C 6.585938 -5.460938 6.671875 -5.132812 6.671875 -4.75 C 6.671875 -4.207031 6.503906 -3.753906 6.171875 -3.390625 C 5.847656 -3.035156 5.351562 -2.816406 4.6875 -2.734375 C 4.851562 -2.585938 5.015625 -2.390625 5.171875 -2.140625 C 5.460938 -1.628906 5.789062 -0.914062 6.15625 0 L 4.734375 0 C 4.617188 -0.363281 4.394531 -0.929688 4.0625 -1.703125 C 3.875 -2.117188 3.679688 -2.398438 3.484375 -2.546875 C 3.359375 -2.628906 3.140625 -2.671875 2.828125 -2.671875 L 2.28125 -2.671875 Z M 2.484375 -3.640625 L 3.1875 -3.640625 C 3.894531 -3.640625 4.363281 -3.679688 4.59375 -3.765625 C 4.832031 -3.847656 5.015625 -3.976562 5.140625 -4.15625 C 5.273438 -4.34375 5.34375 -4.535156 5.34375 -4.734375 C 5.34375 -4.960938 5.25 -5.140625 5.0625 -5.265625 C 4.945312 -5.328125 4.691406 -5.359375 4.296875 -5.359375 L 2.84375 -5.359375 Z M 2.484375 -3.640625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-2\" overflow=\"visible\">\n",
       "<path d=\"M 0.21875 0 L 0.4375 -1.015625 L 4.140625 -5.359375 L 1.140625 -5.359375 L 1.359375 -6.4375 L 6.015625 -6.4375 L 5.8125 -5.4375 L 2.0625 -1.0625 C 2.46875 -1.0625 2.703125 -1.0625 2.765625 -1.0625 C 3.046875 -1.0625 3.429688 -1.066406 3.921875 -1.078125 L 5.4375 -1.078125 L 5.21875 0 Z M 0.21875 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-3\" overflow=\"visible\">\n",
       "<path d=\"M 1.4375 0 L -0.265625 0 L 2.578125 -3.265625 L 0.96875 -6.4375 L 2.359375 -6.4375 L 2.984375 -5.234375 C 3.003906 -5.191406 3.148438 -4.894531 3.421875 -4.34375 C 3.429688 -4.3125 3.445312 -4.269531 3.46875 -4.21875 C 3.832031 -4.65625 4.132812 -5.015625 4.375 -5.296875 L 5.390625 -6.4375 L 7.046875 -6.4375 L 4.109375 -3.046875 L 5.6875 0 L 4.203125 0 L 3.71875 -0.96875 C 3.457031 -1.476562 3.289062 -1.847656 3.21875 -2.078125 C 3.101562 -1.898438 2.804688 -1.539062 2.328125 -1 Z M 1.4375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-4\" overflow=\"visible\">\n",
       "<path d=\"M 4.8125 -2.875 L 2.328125 -2.875 L 1.71875 0 L 0.390625 0 L 1.734375 -6.4375 L 3.0625 -6.4375 L 2.546875 -3.953125 L 5.03125 -3.953125 L 5.5625 -6.4375 L 6.875 -6.4375 L 5.53125 0 L 4.203125 0 Z M 4.8125 -2.875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-0\" overflow=\"visible\">\n",
       "<path d=\"M 1.125 0 L 1.125 -5.625 L 5.625 -5.625 L 5.625 0 Z M 1.265625 -0.140625 L 5.484375 -0.140625 L 5.484375 -5.484375 L 1.265625 -5.484375 Z M 1.265625 -0.140625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-1\" overflow=\"visible\">\n",
       "<path d=\"M 2.15625 -0.640625 L 2.03125 0 C 1.832031 0.0507812 1.644531 0.078125 1.46875 0.078125 C 1.15625 0.078125 0.90625 0 0.71875 -0.15625 C 0.570312 -0.269531 0.5 -0.429688 0.5 -0.640625 C 0.5 -0.734375 0.539062 -0.96875 0.625 -1.34375 L 1.1875 -4.046875 L 0.5625 -4.046875 L 0.6875 -4.671875 L 1.3125 -4.671875 L 1.5625 -5.8125 L 2.46875 -6.359375 L 2.109375 -4.671875 L 2.890625 -4.671875 L 2.765625 -4.046875 L 1.984375 -4.046875 L 1.4375 -1.46875 C 1.375 -1.144531 1.34375 -0.953125 1.34375 -0.890625 C 1.34375 -0.796875 1.367188 -0.722656 1.421875 -0.671875 C 1.472656 -0.617188 1.5625 -0.59375 1.6875 -0.59375 C 1.863281 -0.59375 2.019531 -0.609375 2.15625 -0.640625 Z M 2.15625 -0.640625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-2\" overflow=\"visible\">\n",
       "<path d=\"M 0.421875 -1.9375 L 0.578125 -2.734375 L 3.015625 -2.734375 L 2.84375 -1.9375 Z M 0.421875 -1.9375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-3\" overflow=\"visible\">\n",
       "<path d=\"M 2.171875 0 L 3.1875 -4.859375 C 2.75 -4.515625 2.128906 -4.238281 1.328125 -4.03125 L 1.484375 -4.75 C 1.878906 -4.914062 2.269531 -5.125 2.65625 -5.375 C 3.039062 -5.625 3.328125 -5.847656 3.515625 -6.046875 C 3.640625 -6.160156 3.753906 -6.300781 3.859375 -6.46875 L 4.3125 -6.46875 L 2.96875 0 Z M 2.171875 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-0\" overflow=\"visible\">\n",
       "<path d=\"\" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-1\" overflow=\"visible\">\n",
       "<path d=\"M 0.703125 -6.421875 L 0.703125 0 L 1.4375 0 L 1.4375 -6.421875 Z M 0.703125 -6.421875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-2\" overflow=\"visible\">\n",
       "<path d=\"M 2.734375 -4.78125 C 2.4375 -4.78125 2.15625 -4.703125 1.90625 -4.5625 C 1.640625 -4.421875 1.4375 -4.234375 1.28125 -3.96875 L 1.28125 -4.65625 L 0.5625 -4.65625 L 0.5625 0 L 1.28125 0 L 1.28125 -2.8125 C 1.3125 -3.234375 1.4375 -3.5625 1.6875 -3.8125 C 1.921875 -4.046875 2.203125 -4.171875 2.53125 -4.171875 C 3.34375 -4.171875 3.75 -3.71875 3.75 -2.8125 L 3.75 0 L 4.46875 0 L 4.46875 -2.859375 C 4.46875 -4.140625 3.890625 -4.78125 2.734375 -4.78125 Z M 2.734375 -4.78125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-3\" overflow=\"visible\">\n",
       "<path d=\"M 2.78125 -4.78125 C 2.078125 -4.78125 1.5625 -4.484375 1.234375 -3.890625 L 1.234375 -4.65625 L 0.5625 -4.65625 L 0.5625 1.78125 L 1.28125 1.78125 L 1.28125 -0.84375 C 1.640625 -0.203125 2.15625 0.125 2.8125 0.125 C 3.484375 0.125 4 -0.125 4.375 -0.609375 C 4.71875 -1.0625 4.890625 -1.625 4.890625 -2.3125 C 4.890625 -3.015625 4.71875 -3.578125 4.359375 -4.03125 C 3.984375 -4.53125 3.453125 -4.78125 2.78125 -4.78125 Z M 2.6875 -4.1875 C 3.1875 -4.1875 3.5625 -4 3.828125 -3.625 C 4.046875 -3.296875 4.15625 -2.859375 4.15625 -2.3125 C 4.15625 -1.75 4.046875 -1.3125 3.8125 -0.984375 C 3.546875 -0.640625 3.171875 -0.46875 2.65625 -0.46875 C 2.234375 -0.46875 1.90625 -0.640625 1.640625 -0.96875 C 1.375 -1.296875 1.25 -1.734375 1.25 -2.265625 L 1.25 -2.359375 C 1.25 -2.875 1.375 -3.3125 1.609375 -3.640625 C 1.859375 -4 2.21875 -4.1875 2.6875 -4.1875 Z M 2.6875 -4.1875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-4\" overflow=\"visible\">\n",
       "<path d=\"M 0.5625 -4.65625 L 0.5625 -1.765625 C 0.5625 -0.515625 1.109375 0.125 2.25 0.125 C 2.875 0.125 3.390625 -0.15625 3.765625 -0.71875 L 3.765625 0 L 4.484375 0 L 4.484375 -4.65625 L 3.765625 -4.65625 L 3.765625 -1.8125 C 3.703125 -1.421875 3.5625 -1.09375 3.296875 -0.84375 C 3.0625 -0.609375 2.78125 -0.484375 2.46875 -0.484375 C 2.046875 -0.484375 1.75 -0.609375 1.5625 -0.8125 C 1.375 -1.03125 1.28125 -1.375 1.28125 -1.8125 L 1.28125 -4.65625 Z M 0.5625 -4.65625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-5\" overflow=\"visible\">\n",
       "<path d=\"M 1.796875 -6.15625 L 1.09375 -5.859375 L 1.09375 -4.65625 L 0.15625 -4.65625 L 0.15625 -4.046875 L 1.09375 -4.046875 L 1.09375 -1.09375 C 1.09375 -0.734375 1.15625 -0.484375 1.3125 -0.296875 C 1.46875 -0.09375 1.75 0 2.140625 0 L 2.828125 0 L 2.828125 -0.609375 L 2.234375 -0.609375 C 2.078125 -0.609375 1.96875 -0.640625 1.90625 -0.71875 C 1.828125 -0.796875 1.796875 -0.921875 1.796875 -1.09375 L 1.796875 -4.046875 L 2.953125 -4.046875 L 2.953125 -4.65625 L 1.796875 -4.65625 Z M 1.796875 -6.15625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-6\" overflow=\"visible\">\n",
       "<path d=\"\" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "</g>\n",
       "</defs>\n",
       "<g id=\"surface1\">\n",
       "<path d=\"M 292 232 L 464 232 C 470.628906 232 476 237.371094 476 244 L 476 364 C 476 370.628906 470.628906 376 464 376 L 292 376 C 285.371094 376 280 370.628906 280 364 L 280 244 C 280 237.371094 285.371094 232 292 232 Z M 292 232 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 326.203125 320 L 354.203125 320 L 354.203125 336 L 326.203125 336 Z M 326.203125 320 \" style=\"fill-rule:nonzero;fill:rgb(39.99939%,74.902344%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"190.4877\" xlink:href=\"#glyph0-1\" y=\"99.5\"/>\n",
       "</g>\n",
       "<path d=\"M 265.5 252.410156 L 300.042969 252.128906 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 322.207031 296.925781 C 325.332031 300.050781 325.332031 305.113281 322.207031 308.238281 C 319.082031 311.363281 314.019531 311.363281 310.894531 308.238281 C 307.769531 305.113281 307.769531 300.050781 310.894531 296.925781 C 314.019531 293.800781 319.082031 293.800781 322.207031 296.925781 \" style=\"fill-rule:nonzero;fill:rgb(69.804382%,85.098267%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"166.5534\" xlink:href=\"#glyph1-1\" y=\"73.0822\"/>\n",
       "</g>\n",
       "<path d=\"M 270.554688 252.371094 L 293.925781 252.078125 C 297.238281 252.035156 299.957031 254.6875 300 258 C 300 258.027344 300 258.050781 300 258.074219 L 300 346 C 300 349.3125 302.6875 352 306 352 L 334.050781 352 C 337.34375 352 340.023438 349.34375 340.050781 346.050781 L 340.085938 341.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 340.117188 337.898438 L 340.085938 341.898438 M 338.585938 341.886719 L 340.117188 337.898438 L 341.585938 341.914062 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 340.132812 320 L 340.046875 309.429688 C 340.019531 306.347656 337.664062 303.785156 334.59375 303.503906 L 330.425781 303.121094 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 326.441406 302.753906 L 330.425781 303.121094 M 330.289062 304.613281 L 326.441406 302.753906 L 330.5625 301.628906 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 377.945312 320 L 405.945312 320 L 405.945312 336 L 377.945312 336 Z M 377.945312 320 \" style=\"fill-rule:nonzero;fill:rgb(39.99939%,74.902344%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"242.2302\" xlink:href=\"#glyph0-1\" y=\"99.5\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"189.2446\" xlink:href=\"#glyph2-1\" y=\"48\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"195.7444\" xlink:href=\"#glyph2-2\" y=\"48\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"200.7502\" xlink:href=\"#glyph2-3\" y=\"48\"/>\n",
       "  <use x=\"205.2502\" xlink:href=\"#glyph2-2\" y=\"48\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"210.256\" xlink:href=\"#glyph2-4\" y=\"48\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"192.2417\" xlink:href=\"#glyph2-5\" y=\"58.2944\"/>\n",
       "  <use x=\"197.2475\" xlink:href=\"#glyph2-6\" y=\"58.2944\"/>\n",
       "  <use x=\"202.2533\" xlink:href=\"#glyph2-4\" y=\"58.2944\"/>\n",
       "  <use x=\"204.7571\" xlink:href=\"#glyph2-2\" y=\"58.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"196.5\" xlink:href=\"#glyph3-1\" y=\"68.5889\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"202.9995\" xlink:href=\"#glyph4-1\" y=\"72.5889\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"229.4893\" xlink:href=\"#glyph2-7\" y=\"48\"/>\n",
       "  <use x=\"235.9891\" xlink:href=\"#glyph2-8\" y=\"48\"/>\n",
       "  <use x=\"240.9949\" xlink:href=\"#glyph2-9\" y=\"48\"/>\n",
       "  <use x=\"246.0007\" xlink:href=\"#glyph2-6\" y=\"48\"/>\n",
       "  <use x=\"251.0065\" xlink:href=\"#glyph2-4\" y=\"48\"/>\n",
       "  <use x=\"253.5103\" xlink:href=\"#glyph2-2\" y=\"48\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"235.2417\" xlink:href=\"#glyph2-5\" y=\"58.2944\"/>\n",
       "  <use x=\"240.2475\" xlink:href=\"#glyph2-6\" y=\"58.2944\"/>\n",
       "  <use x=\"245.2533\" xlink:href=\"#glyph2-4\" y=\"58.2944\"/>\n",
       "  <use x=\"247.7571\" xlink:href=\"#glyph2-2\" y=\"58.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"240.001\" xlink:href=\"#glyph3-2\" y=\"68.5889\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"245.4985\" xlink:href=\"#glyph4-1\" y=\"72.5889\"/>\n",
       "</g>\n",
       "<path d=\"M 316.550781 310.582031 L 316.0625 357.9375 C 316.027344 361.25 318.6875 363.964844 322 364 C 322.019531 364 322.042969 364 322.0625 364 L 333.191406 364 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 320.316406 352 L 386 352 C 389.3125 352 392 349.3125 392 346 L 392 341.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 392 337.898438 L 392 341.898438 M 390.5 341.898438 L 392 337.898438 L 393.5 341.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 300.035156 384 L 300.007812 358.007812 C 300.003906 354.691406 302.6875 352.003906 306 352 C 306.003906 352 306.003906 352 306.007812 352 L 325.933594 352 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 430.277344 320 L 458.277344 320 L 458.277344 336 L 430.277344 336 Z M 430.277344 320 \" style=\"fill-rule:nonzero;fill:rgb(39.99939%,74.902344%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"288.5196\" xlink:href=\"#glyph2-4\" y=\"99.5\"/>\n",
       "  <use x=\"291.0198\" xlink:href=\"#glyph2-6\" y=\"99.5\"/>\n",
       "  <use x=\"296.022\" xlink:href=\"#glyph2-10\" y=\"99.5\"/>\n",
       "  <use x=\"301.0242\" xlink:href=\"#glyph2-11\" y=\"99.5\"/>\n",
       "</g>\n",
       "<path d=\"M 300.027344 376.171875 L 300.015625 370.015625 C 300.007812 366.699219 302.6875 364.007812 306 364 C 306.003906 364 306.007812 364 306.015625 364 L 438.046875 364 C 441.34375 364 444.019531 361.34375 444.046875 358.046875 L 444.171875 341.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 444.203125 337.898438 L 444.171875 341.898438 M 442.671875 341.886719 L 444.203125 337.898438 L 445.671875 341.910156 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 277.230469 252.316406 L 310.027344 252.046875 C 313.332031 252.023438 316.035156 254.667969 316.078125 257.972656 L 316.472656 288.683594 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 316.527344 292.683594 L 316.472656 288.683594 M 317.972656 288.664062 L 316.527344 292.683594 L 314.972656 288.703125 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"136.9659\" xlink:href=\"#glyph5-1\" y=\"168\"/>\n",
       "  <use x=\"139.0989\" xlink:href=\"#glyph5-2\" y=\"168\"/>\n",
       "  <use x=\"144.1299\" xlink:href=\"#glyph5-3\" y=\"168\"/>\n",
       "  <use x=\"149.4039\" xlink:href=\"#glyph5-4\" y=\"168\"/>\n",
       "  <use x=\"154.4439\" xlink:href=\"#glyph5-5\" y=\"168\"/>\n",
       "  <use x=\"157.6389\" xlink:href=\"#glyph5-6\" y=\"168\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"160.6359\" xlink:href=\"#glyph3-3\" y=\"168\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"166.6389\" xlink:href=\"#glyph4-1\" y=\"172\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"62.7336\" xlink:href=\"#glyph2-12\" y=\"17.1594\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"69.2334\" xlink:href=\"#glyph2-13\" y=\"17.1594\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"71.2332\" xlink:href=\"#glyph2-9\" y=\"17.1594\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"76.239\" xlink:href=\"#glyph2-9\" y=\"17.1594\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"81.2448\" xlink:href=\"#glyph2-2\" y=\"17.1594\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"86.2506\" xlink:href=\"#glyph2-10\" y=\"17.1594\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"91.2564\" xlink:href=\"#glyph2-14\" y=\"17.1594\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"93.7566\" xlink:href=\"#glyph2-3\" y=\"17.1594\"/>\n",
       "  <use x=\"98.2566\" xlink:href=\"#glyph2-4\" y=\"17.1594\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"100.7568\" xlink:href=\"#glyph2-6\" y=\"17.1594\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"105.7626\" xlink:href=\"#glyph2-4\" y=\"17.1594\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"108.2628\" xlink:href=\"#glyph2-2\" y=\"17.1594\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"79.4988\" xlink:href=\"#glyph3-4\" y=\"27.4539\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"85.9983\" xlink:href=\"#glyph4-1\" y=\"31.4539\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"88.4985\" xlink:href=\"#glyph4-2\" y=\"31.4539\"/>\n",
       "  <use x=\"91.4955\" xlink:href=\"#glyph4-3\" y=\"31.4539\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"276.4841\" xlink:href=\"#glyph2-15\" y=\"43\"/>\n",
       "  <use x=\"282.9839\" xlink:href=\"#glyph2-6\" y=\"43\"/>\n",
       "  <use x=\"287.9897\" xlink:href=\"#glyph2-10\" y=\"43\"/>\n",
       "  <use x=\"292.9955\" xlink:href=\"#glyph2-9\" y=\"43\"/>\n",
       "  <use x=\"298.0013\" xlink:href=\"#glyph2-13\" y=\"43\"/>\n",
       "  <use x=\"300.0011\" xlink:href=\"#glyph2-9\" y=\"43\"/>\n",
       "  <use x=\"305.0069\" xlink:href=\"#glyph2-6\" y=\"43\"/>\n",
       "  <use x=\"310.0127\" xlink:href=\"#glyph2-4\" y=\"43\"/>\n",
       "  <use x=\"312.5165\" xlink:href=\"#glyph2-2\" y=\"43\"/>\n",
       "  <use x=\"317.5223\" xlink:href=\"#glyph2-14\" y=\"43\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"271.7336\" xlink:href=\"#glyph2-12\" y=\"53.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"278.2334\" xlink:href=\"#glyph2-13\" y=\"53.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"280.2332\" xlink:href=\"#glyph2-9\" y=\"53.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"285.239\" xlink:href=\"#glyph2-9\" y=\"53.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"290.2448\" xlink:href=\"#glyph2-2\" y=\"53.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"295.2506\" xlink:href=\"#glyph2-10\" y=\"53.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"300.2564\" xlink:href=\"#glyph2-14\" y=\"53.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"302.7566\" xlink:href=\"#glyph2-3\" y=\"53.2944\"/>\n",
       "  <use x=\"307.2566\" xlink:href=\"#glyph2-4\" y=\"53.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"309.7568\" xlink:href=\"#glyph2-6\" y=\"53.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"314.7626\" xlink:href=\"#glyph2-4\" y=\"53.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"317.2628\" xlink:href=\"#glyph2-2\" y=\"53.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"292.5\" xlink:href=\"#glyph3-4\" y=\"68.5889\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"298.9995\" xlink:href=\"#glyph4-1\" y=\"72.5889\"/>\n",
       "</g>\n",
       "<path d=\"M 391.753906 320 L 391.558594 311.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 391.464844 307.898438 L 391.558594 311.898438 M 390.058594 311.933594 L 391.464844 307.898438 L 393.058594 311.863281 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 444.226562 320 L 444.171875 311.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 444.144531 307.898438 L 444.171875 311.898438 M 442.671875 311.910156 L 444.144531 307.898438 L 445.671875 311.890625 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"294.3721\" xlink:href=\"#glyph2-16\" y=\"62\"/>\n",
       "</g>\n",
       "<path d=\"M 148 420 L 176 420 L 176 436 L 148 436 Z M 148 420 \" style=\"fill-rule:nonzero;fill:rgb(39.99939%,74.902344%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"12.2864\" xlink:href=\"#glyph0-1\" y=\"199.5\"/>\n",
       "</g>\n",
       "<path d=\"M 468 424 L 490.101562 424 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 494.101562 424 L 490.101562 424 M 490.101562 422.5 L 494.101562 424 L 490.101562 425.5 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 477 436 L 477 430 C 477 426.6875 479.6875 424 483 424 L 493.789062 424 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 388 435 L 410.101562 435 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 414.101562 435 L 410.101562 435 M 410.101562 433.5 L 414.101562 435 L 410.101562 436.5 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 388 435 L 394 435 C 397.3125 435 400 432.3125 400 429 L 400 424.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 400 420.898438 L 400 424.898438 M 398.5 424.898438 L 400 420.898438 L 401.5 424.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<path d=\"M 297.65625 422.34375 C 300.78125 425.46875 300.78125 430.53125 297.65625 433.65625 C 294.53125 436.78125 289.46875 436.78125 286.34375 433.65625 C 283.21875 430.53125 283.21875 425.46875 286.34375 422.34375 C 289.46875 419.21875 294.53125 419.21875 297.65625 422.34375 \" style=\"fill-rule:nonzero;fill:rgb(69.804382%,85.098267%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-147,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"142.0029\" xlink:href=\"#glyph1-1\" y=\"198.5\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"161.4912\" xlink:href=\"#glyph2-17\" y=\"194\"/>\n",
       "  <use x=\"167.4942\" xlink:href=\"#glyph2-18\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"169.494\" xlink:href=\"#glyph2-2\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"174.4998\" xlink:href=\"#glyph2-19\" y=\"194\"/>\n",
       "  <use x=\"181.9968\" xlink:href=\"#glyph2-2\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"187.0026\" xlink:href=\"#glyph2-10\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"192.0084\" xlink:href=\"#glyph2-4\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"194.5086\" xlink:href=\"#glyph2-20\" y=\"194\"/>\n",
       "  <use x=\"197.5056\" xlink:href=\"#glyph2-21\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"204.0054\" xlink:href=\"#glyph2-13\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"206.0052\" xlink:href=\"#glyph2-3\" y=\"194\"/>\n",
       "  <use x=\"210.5052\" xlink:href=\"#glyph2-2\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"170.7417\" xlink:href=\"#glyph2-22\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"177.7419\" xlink:href=\"#glyph2-8\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"182.7477\" xlink:href=\"#glyph2-2\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"187.7535\" xlink:href=\"#glyph2-23\" y=\"204.2944\"/>\n",
       "  <use x=\"190.7505\" xlink:href=\"#glyph2-6\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"195.7563\" xlink:href=\"#glyph2-4\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"198.2565\" xlink:href=\"#glyph2-24\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"203.2623\" xlink:href=\"#glyph2-23\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"49.7449\" xlink:href=\"#glyph2-25\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"55.2421\" xlink:href=\"#glyph2-15\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"64.2421\" xlink:href=\"#glyph2-18\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"66.2419\" xlink:href=\"#glyph2-6\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"71.2477\" xlink:href=\"#glyph2-26\" y=\"194\"/>\n",
       "  <use x=\"75.7477\" xlink:href=\"#glyph2-2\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"80.7535\" xlink:href=\"#glyph2-23\" y=\"194\"/>\n",
       "  <use x=\"83.7505\" xlink:href=\"#glyph2-14\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"86.2507\" xlink:href=\"#glyph2-21\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"92.7505\" xlink:href=\"#glyph2-13\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"94.7503\" xlink:href=\"#glyph2-4\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"97.2505\" xlink:href=\"#glyph2-11\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"42.4807\" xlink:href=\"#glyph2-6\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"47.4865\" xlink:href=\"#glyph2-27\" y=\"204.2944\"/>\n",
       "  <use x=\"51.9865\" xlink:href=\"#glyph2-4\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"54.4867\" xlink:href=\"#glyph2-13\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"56.4865\" xlink:href=\"#glyph2-28\" y=\"204.2944\"/>\n",
       "  <use x=\"60.9865\" xlink:href=\"#glyph2-6\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"65.9923\" xlink:href=\"#glyph2-4\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"68.4925\" xlink:href=\"#glyph2-13\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"70.4923\" xlink:href=\"#glyph2-24\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"75.4981\" xlink:href=\"#glyph2-10\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"80.5039\" xlink:href=\"#glyph2-14\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"83.0041\" xlink:href=\"#glyph2-29\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"85.5043\" xlink:href=\"#glyph2-30\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"90.5101\" xlink:href=\"#glyph2-27\" y=\"204.2944\"/>\n",
       "  <use x=\"95.0101\" xlink:href=\"#glyph2-4\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"97.5103\" xlink:href=\"#glyph2-13\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"99.5101\" xlink:href=\"#glyph2-24\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"104.5159\" xlink:href=\"#glyph2-10\" y=\"204.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"357.481\" xlink:href=\"#glyph2-15\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"363.9808\" xlink:href=\"#glyph2-24\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"368.9866\" xlink:href=\"#glyph2-10\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"373.9924\" xlink:href=\"#glyph2-27\" y=\"198\"/>\n",
       "  <use x=\"378.4924\" xlink:href=\"#glyph2-6\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"383.4982\" xlink:href=\"#glyph2-4\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"385.9984\" xlink:href=\"#glyph2-2\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"391.0042\" xlink:href=\"#glyph2-10\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"396.01\" xlink:href=\"#glyph2-6\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"401.0158\" xlink:href=\"#glyph2-4\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"403.516\" xlink:href=\"#glyph2-2\" y=\"198\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"278.4949\" xlink:href=\"#glyph2-15\" y=\"198\"/>\n",
       "  <use x=\"284.9947\" xlink:href=\"#glyph2-24\" y=\"198\"/>\n",
       "  <use x=\"290.0005\" xlink:href=\"#glyph2-8\" y=\"198\"/>\n",
       "  <use x=\"295.0063\" xlink:href=\"#glyph2-26\" y=\"198\"/>\n",
       "</g>\n",
       "</g>\n",
       "</svg>"
      ],
      "text/plain": [
       "<IPython.core.display.SVG object>"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "SVG(filename= '../img/gru_2.svg')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Fig. 10.8.2: Candidate hidden state computation in a GRU. The multiplication is carried out elementwise."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Whenever the update gate is close to 1 we simply retain the old state. In this case the information from $X_t$ is essentially\n",
    "ignored, effectively skipping time step t in the dependency chain. Whenever it is close to 0 the new latent state $H_t$\n",
    "approaches the candidate latent state $H̃_t$ . These designs can help cope with the vanishing gradient problem in RNNs and\n",
    "better capture dependencies for time series with large time step distances. In summary GRUs have the following two\n",
    "distinguishing features:\n",
    "\n",
    "* Reset gates help capture short-term dependencies in time series.\n",
    "\n",
    "* Update gates help capture long-term dependencies in time series."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Implementation from Scratch\n",
    "\n",
    "To gain a better understanding of the model let us implement a GRU from scratch."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Reading the Data Set\n",
    "\n",
    "We begin by reading The *Time Machine* corpus that we used in Section 10.5. The code for reading the data set is given\n",
    "below:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "import sys\n",
    "sys.path.insert(0, '..')\n",
    "\n",
    "import d2l\n",
    "import torch\n",
    "import torch.nn as nn\n",
    "from d2l import RNNModel \n",
    "from d2l import load_data_time_machine\n",
    "from d2l import train_and_predict_rnn\n",
    "from d2l import train_and_predict_rnn_nn\n",
    "torch.set_default_tensor_type('torch.cuda.FloatTensor')\n",
    "\n",
    "corpus_indices, vocab = load_data_time_machine()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/svg+xml": [
       "<svg height=\"208pt\" version=\"1.1\" viewBox=\"0 0 414 208\" width=\"414pt\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<defs>\n",
       "<g>\n",
       "<symbol id=\"glyph0-0\" overflow=\"visible\">\n",
       "<path d=\"M 1.125 0 L 1.125 -5.625 L 5.625 -5.625 L 5.625 0 Z M 1.265625 -0.140625 L 5.484375 -0.140625 L 5.484375 -5.484375 L 1.265625 -5.484375 Z M 1.265625 -0.140625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph0-1\" overflow=\"visible\">\n",
       "<path d=\"M 5.796875 -4.671875 L 5.671875 -4 L 4.5 -4 C 4.726562 -3.675781 4.84375 -3.269531 4.84375 -2.78125 C 4.84375 -2.019531 4.617188 -1.347656 4.171875 -0.765625 C 3.722656 -0.179688 3.113281 0.109375 2.34375 0.109375 C 1.75 0.109375 1.28125 -0.0625 0.9375 -0.40625 C 0.601562 -0.757812 0.4375 -1.21875 0.4375 -1.78125 C 0.4375 -2.613281 0.664062 -3.316406 1.125 -3.890625 C 1.59375 -4.472656 2.195312 -4.765625 2.9375 -4.765625 C 3.175781 -4.765625 3.394531 -4.734375 3.59375 -4.671875 Z M 1.234375 -1.796875 C 1.234375 -1.421875 1.332031 -1.113281 1.53125 -0.875 C 1.726562 -0.632812 2 -0.515625 2.34375 -0.515625 C 2.875 -0.515625 3.289062 -0.765625 3.59375 -1.265625 C 3.894531 -1.773438 4.046875 -2.289062 4.046875 -2.8125 C 4.046875 -3.25 3.945312 -3.582031 3.75 -3.8125 C 3.5625 -4.039062 3.300781 -4.15625 2.96875 -4.15625 C 2.4375 -4.15625 2.015625 -3.914062 1.703125 -3.4375 C 1.390625 -2.957031 1.234375 -2.410156 1.234375 -1.796875 Z M 1.234375 -1.796875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-0\" overflow=\"visible\">\n",
       "<path d=\"M 0.296875 0 L 0.296875 -6 L 2.703125 -6 L 2.703125 0 Z M 2.40625 -0.296875 L 2.40625 -5.703125 L 0.59375 -5.703125 L 0.59375 -0.296875 Z M 2.40625 -0.296875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph1-1\" overflow=\"visible\">\n",
       "<path d=\"M 1.203125 0 L 0.5625 0 L 2.65625 -2.4375 L 0.5625 -4.84375 L 1.25 -4.84375 L 3 -3.015625 L 4.8125 -4.84375 L 5.4375 -4.84375 L 3.3125 -2.4375 L 5.4375 0 L 4.75 0 L 3 -1.953125 Z M 1.203125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-0\" overflow=\"visible\">\n",
       "<path d=\"M 1.125 0 L 1.125 -5.625 L 5.625 -5.625 L 5.625 0 Z M 1.265625 -0.140625 L 5.484375 -0.140625 L 5.484375 -5.484375 L 1.265625 -5.484375 Z M 1.265625 -0.140625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-1\" overflow=\"visible\">\n",
       "<path d=\"M 3.359375 0 L 2.5625 0 L 2.5625 -5.046875 C 2.375 -4.859375 2.125 -4.671875 1.8125 -4.484375 C 1.5 -4.304688 1.222656 -4.175781 0.984375 -4.09375 L 0.984375 -4.859375 C 1.421875 -5.054688 1.804688 -5.300781 2.140625 -5.59375 C 2.472656 -5.894531 2.707031 -6.1875 2.84375 -6.46875 L 3.359375 -6.46875 Z M 3.359375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-2\" overflow=\"visible\">\n",
       "<path d=\"M 0.28125 -1.9375 L 0.28125 -2.734375 L 2.71875 -2.734375 L 2.71875 -1.9375 Z M 0.28125 -1.9375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-3\" overflow=\"visible\">\n",
       "<path d=\"M 0.703125 0 L 0.703125 -6.4375 L 3.5625 -6.4375 C 4.132812 -6.4375 4.570312 -6.378906 4.875 -6.265625 C 5.175781 -6.148438 5.414062 -5.945312 5.59375 -5.65625 C 5.769531 -5.363281 5.859375 -5.039062 5.859375 -4.6875 C 5.859375 -4.226562 5.707031 -3.84375 5.40625 -3.53125 C 5.113281 -3.21875 4.660156 -3.019531 4.046875 -2.9375 C 4.265625 -2.820312 4.4375 -2.710938 4.5625 -2.609375 C 4.8125 -2.378906 5.046875 -2.09375 5.265625 -1.75 L 6.390625 0 L 5.3125 0 L 4.453125 -1.34375 C 4.210938 -1.726562 4.007812 -2.019531 3.84375 -2.21875 C 3.6875 -2.425781 3.539062 -2.570312 3.40625 -2.65625 C 3.28125 -2.738281 3.15625 -2.796875 3.03125 -2.828125 C 2.925781 -2.847656 2.765625 -2.859375 2.546875 -2.859375 L 1.5625 -2.859375 L 1.5625 0 Z M 1.5625 -3.59375 L 3.390625 -3.59375 C 3.785156 -3.59375 4.09375 -3.632812 4.3125 -3.71875 C 4.53125 -3.800781 4.695312 -3.929688 4.8125 -4.109375 C 4.925781 -4.285156 4.984375 -4.476562 4.984375 -4.6875 C 4.984375 -4.988281 4.867188 -5.238281 4.640625 -5.4375 C 4.421875 -5.632812 4.070312 -5.734375 3.59375 -5.734375 L 1.5625 -5.734375 Z M 1.5625 -3.59375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-4\" overflow=\"visible\">\n",
       "<path d=\"M 3.78125 -1.5 L 4.609375 -1.40625 C 4.472656 -0.925781 4.226562 -0.550781 3.875 -0.28125 C 3.53125 -0.0195312 3.085938 0.109375 2.546875 0.109375 C 1.867188 0.109375 1.328125 -0.0976562 0.921875 -0.515625 C 0.523438 -0.941406 0.328125 -1.535156 0.328125 -2.296875 C 0.328125 -3.078125 0.53125 -3.679688 0.9375 -4.109375 C 1.34375 -4.546875 1.867188 -4.765625 2.515625 -4.765625 C 3.140625 -4.765625 3.644531 -4.550781 4.03125 -4.125 C 4.425781 -3.707031 4.625 -3.113281 4.625 -2.34375 C 4.625 -2.289062 4.625 -2.21875 4.625 -2.125 L 1.140625 -2.125 C 1.171875 -1.613281 1.316406 -1.222656 1.578125 -0.953125 C 1.835938 -0.679688 2.164062 -0.546875 2.5625 -0.546875 C 2.851562 -0.546875 3.097656 -0.617188 3.296875 -0.765625 C 3.503906 -0.921875 3.664062 -1.164062 3.78125 -1.5 Z M 1.1875 -2.78125 L 3.796875 -2.78125 C 3.765625 -3.175781 3.664062 -3.472656 3.5 -3.671875 C 3.25 -3.972656 2.921875 -4.125 2.515625 -4.125 C 2.148438 -4.125 1.84375 -4 1.59375 -3.75 C 1.351562 -3.507812 1.21875 -3.1875 1.1875 -2.78125 Z M 1.1875 -2.78125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-5\" overflow=\"visible\">\n",
       "<path d=\"M 0.28125 -1.390625 L 1.0625 -1.515625 C 1.101562 -1.203125 1.222656 -0.960938 1.421875 -0.796875 C 1.628906 -0.628906 1.910156 -0.546875 2.265625 -0.546875 C 2.628906 -0.546875 2.898438 -0.617188 3.078125 -0.765625 C 3.253906 -0.910156 3.34375 -1.082031 3.34375 -1.28125 C 3.34375 -1.46875 3.265625 -1.609375 3.109375 -1.703125 C 2.992188 -1.773438 2.722656 -1.867188 2.296875 -1.984375 C 1.710938 -2.128906 1.304688 -2.253906 1.078125 -2.359375 C 0.859375 -2.460938 0.691406 -2.609375 0.578125 -2.796875 C 0.460938 -2.984375 0.40625 -3.191406 0.40625 -3.421875 C 0.40625 -3.628906 0.453125 -3.820312 0.546875 -4 C 0.640625 -4.175781 0.769531 -4.328125 0.9375 -4.453125 C 1.0625 -4.535156 1.226562 -4.609375 1.4375 -4.671875 C 1.65625 -4.734375 1.882812 -4.765625 2.125 -4.765625 C 2.488281 -4.765625 2.804688 -4.710938 3.078125 -4.609375 C 3.359375 -4.503906 3.566406 -4.363281 3.703125 -4.1875 C 3.835938 -4.007812 3.929688 -3.769531 3.984375 -3.46875 L 3.203125 -3.359375 C 3.171875 -3.597656 3.066406 -3.785156 2.890625 -3.921875 C 2.722656 -4.054688 2.488281 -4.125 2.1875 -4.125 C 1.820312 -4.125 1.5625 -4.0625 1.40625 -3.9375 C 1.25 -3.820312 1.171875 -3.679688 1.171875 -3.515625 C 1.171875 -3.410156 1.203125 -3.320312 1.265625 -3.25 C 1.328125 -3.15625 1.429688 -3.082031 1.578125 -3.03125 C 1.648438 -3 1.878906 -2.929688 2.265625 -2.828125 C 2.828125 -2.679688 3.21875 -2.5625 3.4375 -2.46875 C 3.664062 -2.375 3.84375 -2.234375 3.96875 -2.046875 C 4.09375 -1.867188 4.15625 -1.644531 4.15625 -1.375 C 4.15625 -1.101562 4.078125 -0.851562 3.921875 -0.625 C 3.765625 -0.394531 3.539062 -0.210938 3.25 -0.078125 C 2.96875 0.046875 2.640625 0.109375 2.265625 0.109375 C 1.660156 0.109375 1.195312 -0.015625 0.875 -0.265625 C 0.5625 -0.523438 0.363281 -0.898438 0.28125 -1.390625 Z M 0.28125 -1.390625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-6\" overflow=\"visible\">\n",
       "<path d=\"M 2.328125 -0.703125 L 2.4375 -0.015625 C 2.207031 0.0351562 2.007812 0.0625 1.84375 0.0625 C 1.550781 0.0625 1.328125 0.015625 1.171875 -0.078125 C 1.015625 -0.171875 0.898438 -0.289062 0.828125 -0.4375 C 0.765625 -0.582031 0.734375 -0.890625 0.734375 -1.359375 L 0.734375 -4.046875 L 0.15625 -4.046875 L 0.15625 -4.671875 L 0.734375 -4.671875 L 0.734375 -5.828125 L 1.53125 -6.296875 L 1.53125 -4.671875 L 2.328125 -4.671875 L 2.328125 -4.046875 L 1.53125 -4.046875 L 1.53125 -1.328125 C 1.53125 -1.097656 1.539062 -0.953125 1.5625 -0.890625 C 1.59375 -0.828125 1.640625 -0.773438 1.703125 -0.734375 C 1.765625 -0.691406 1.851562 -0.671875 1.96875 -0.671875 C 2.0625 -0.671875 2.179688 -0.679688 2.328125 -0.703125 Z M 2.328125 -0.703125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-7\" overflow=\"visible\">\n",
       "<path d=\"M 0.453125 0.390625 L 1.21875 0.5 C 1.25 0.738281 1.335938 0.910156 1.484375 1.015625 C 1.679688 1.160156 1.953125 1.234375 2.296875 1.234375 C 2.660156 1.234375 2.941406 1.160156 3.140625 1.015625 C 3.335938 0.867188 3.472656 0.664062 3.546875 0.40625 C 3.585938 0.238281 3.601562 -0.0976562 3.59375 -0.609375 C 3.25 -0.203125 2.820312 0 2.3125 0 C 1.664062 0 1.164062 -0.226562 0.8125 -0.6875 C 0.46875 -1.15625 0.296875 -1.710938 0.296875 -2.359375 C 0.296875 -2.804688 0.375 -3.21875 0.53125 -3.59375 C 0.695312 -3.96875 0.929688 -4.253906 1.234375 -4.453125 C 1.535156 -4.660156 1.894531 -4.765625 2.3125 -4.765625 C 2.863281 -4.765625 3.316406 -4.546875 3.671875 -4.109375 L 3.671875 -4.671875 L 4.40625 -4.671875 L 4.40625 -0.640625 C 4.40625 0.0859375 4.328125 0.601562 4.171875 0.90625 C 4.023438 1.207031 3.789062 1.445312 3.46875 1.625 C 3.15625 1.800781 2.765625 1.890625 2.296875 1.890625 C 1.734375 1.890625 1.28125 1.765625 0.9375 1.515625 C 0.601562 1.265625 0.441406 0.890625 0.453125 0.390625 Z M 1.109375 -2.421875 C 1.109375 -1.804688 1.226562 -1.359375 1.46875 -1.078125 C 1.707031 -0.796875 2.007812 -0.65625 2.375 -0.65625 C 2.738281 -0.65625 3.046875 -0.796875 3.296875 -1.078125 C 3.546875 -1.359375 3.671875 -1.796875 3.671875 -2.390625 C 3.671875 -2.960938 3.539062 -3.394531 3.28125 -3.6875 C 3.03125 -3.976562 2.726562 -4.125 2.375 -4.125 C 2.019531 -4.125 1.71875 -3.976562 1.46875 -3.6875 C 1.226562 -3.40625 1.109375 -2.984375 1.109375 -2.421875 Z M 1.109375 -2.421875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-8\" overflow=\"visible\">\n",
       "<path d=\"M 3.640625 -0.578125 C 3.347656 -0.328125 3.066406 -0.148438 2.796875 -0.046875 C 2.523438 0.0546875 2.234375 0.109375 1.921875 0.109375 C 1.410156 0.109375 1.015625 -0.015625 0.734375 -0.265625 C 0.460938 -0.515625 0.328125 -0.835938 0.328125 -1.234375 C 0.328125 -1.460938 0.378906 -1.671875 0.484375 -1.859375 C 0.585938 -2.046875 0.722656 -2.195312 0.890625 -2.3125 C 1.054688 -2.425781 1.242188 -2.515625 1.453125 -2.578125 C 1.609375 -2.609375 1.84375 -2.644531 2.15625 -2.6875 C 2.800781 -2.757812 3.273438 -2.851562 3.578125 -2.96875 C 3.578125 -3.070312 3.578125 -3.140625 3.578125 -3.171875 C 3.578125 -3.492188 3.503906 -3.71875 3.359375 -3.84375 C 3.148438 -4.03125 2.847656 -4.125 2.453125 -4.125 C 2.078125 -4.125 1.800781 -4.054688 1.625 -3.921875 C 1.445312 -3.796875 1.316406 -3.566406 1.234375 -3.234375 L 0.46875 -3.328125 C 0.53125 -3.660156 0.640625 -3.925781 0.796875 -4.125 C 0.960938 -4.332031 1.195312 -4.488281 1.5 -4.59375 C 1.8125 -4.707031 2.164062 -4.765625 2.5625 -4.765625 C 2.96875 -4.765625 3.289062 -4.71875 3.53125 -4.625 C 3.78125 -4.53125 3.960938 -4.410156 4.078125 -4.265625 C 4.203125 -4.128906 4.285156 -3.953125 4.328125 -3.734375 C 4.359375 -3.597656 4.375 -3.359375 4.375 -3.015625 L 4.375 -1.953125 C 4.375 -1.222656 4.390625 -0.757812 4.421875 -0.5625 C 4.453125 -0.363281 4.519531 -0.175781 4.625 0 L 3.796875 0 C 3.710938 -0.164062 3.660156 -0.359375 3.640625 -0.578125 Z M 3.578125 -2.34375 C 3.285156 -2.226562 2.851562 -2.128906 2.28125 -2.046875 C 1.957031 -1.992188 1.726562 -1.9375 1.59375 -1.875 C 1.457031 -1.820312 1.351562 -1.738281 1.28125 -1.625 C 1.207031 -1.507812 1.171875 -1.382812 1.171875 -1.25 C 1.171875 -1.039062 1.25 -0.863281 1.40625 -0.71875 C 1.5625 -0.582031 1.796875 -0.515625 2.109375 -0.515625 C 2.410156 -0.515625 2.679688 -0.582031 2.921875 -0.71875 C 3.160156 -0.851562 3.335938 -1.035156 3.453125 -1.265625 C 3.535156 -1.441406 3.578125 -1.703125 3.578125 -2.046875 Z M 3.578125 -2.34375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-9\" overflow=\"visible\">\n",
       "<path d=\"M 4.921875 -6.4375 L 5.78125 -6.4375 L 5.78125 -2.71875 C 5.78125 -2.070312 5.703125 -1.554688 5.546875 -1.171875 C 5.398438 -0.796875 5.132812 -0.488281 4.75 -0.25 C 4.375 -0.0078125 3.875 0.109375 3.25 0.109375 C 2.644531 0.109375 2.148438 0.00390625 1.765625 -0.203125 C 1.390625 -0.410156 1.117188 -0.710938 0.953125 -1.109375 C 0.785156 -1.503906 0.703125 -2.039062 0.703125 -2.71875 L 0.703125 -6.4375 L 1.5625 -6.4375 L 1.5625 -2.71875 C 1.5625 -2.164062 1.613281 -1.753906 1.71875 -1.484375 C 1.820312 -1.222656 2 -1.019531 2.25 -0.875 C 2.5 -0.726562 2.8125 -0.65625 3.1875 -0.65625 C 3.8125 -0.65625 4.253906 -0.796875 4.515625 -1.078125 C 4.785156 -1.367188 4.921875 -1.914062 4.921875 -2.71875 Z M 4.921875 -6.4375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-10\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 1.78125 L 0.59375 -4.671875 L 1.3125 -4.671875 L 1.3125 -4.0625 C 1.476562 -4.300781 1.664062 -4.476562 1.875 -4.59375 C 2.09375 -4.707031 2.359375 -4.765625 2.671875 -4.765625 C 3.066406 -4.765625 3.414062 -4.660156 3.71875 -4.453125 C 4.019531 -4.253906 4.25 -3.96875 4.40625 -3.59375 C 4.5625 -3.21875 4.640625 -2.8125 4.640625 -2.375 C 4.640625 -1.894531 4.550781 -1.460938 4.375 -1.078125 C 4.207031 -0.691406 3.960938 -0.394531 3.640625 -0.1875 C 3.316406 0.0078125 2.972656 0.109375 2.609375 0.109375 C 2.347656 0.109375 2.113281 0.0507812 1.90625 -0.0625 C 1.695312 -0.175781 1.523438 -0.316406 1.390625 -0.484375 L 1.390625 1.78125 Z M 1.3125 -2.3125 C 1.3125 -1.707031 1.429688 -1.257812 1.671875 -0.96875 C 1.921875 -0.6875 2.21875 -0.546875 2.5625 -0.546875 C 2.90625 -0.546875 3.203125 -0.691406 3.453125 -0.984375 C 3.710938 -1.285156 3.84375 -1.75 3.84375 -2.375 C 3.84375 -2.96875 3.71875 -3.410156 3.46875 -3.703125 C 3.226562 -4.003906 2.9375 -4.15625 2.59375 -4.15625 C 2.257812 -4.15625 1.960938 -3.992188 1.703125 -3.671875 C 1.441406 -3.359375 1.3125 -2.90625 1.3125 -2.3125 Z M 1.3125 -2.3125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-11\" overflow=\"visible\">\n",
       "<path d=\"M 3.625 0 L 3.625 -0.59375 C 3.320312 -0.125 2.882812 0.109375 2.3125 0.109375 C 1.945312 0.109375 1.609375 0.00390625 1.296875 -0.203125 C 0.984375 -0.410156 0.738281 -0.695312 0.5625 -1.0625 C 0.394531 -1.425781 0.3125 -1.847656 0.3125 -2.328125 C 0.3125 -2.796875 0.390625 -3.21875 0.546875 -3.59375 C 0.703125 -3.976562 0.929688 -4.269531 1.234375 -4.46875 C 1.546875 -4.664062 1.894531 -4.765625 2.28125 -4.765625 C 2.5625 -4.765625 2.8125 -4.707031 3.03125 -4.59375 C 3.25 -4.476562 3.425781 -4.320312 3.5625 -4.125 L 3.5625 -6.4375 L 4.359375 -6.4375 L 4.359375 0 Z M 1.125 -2.328125 C 1.125 -1.734375 1.25 -1.285156 1.5 -0.984375 C 1.75 -0.691406 2.046875 -0.546875 2.390625 -0.546875 C 2.734375 -0.546875 3.023438 -0.6875 3.265625 -0.96875 C 3.515625 -1.25 3.640625 -1.679688 3.640625 -2.265625 C 3.640625 -2.898438 3.515625 -3.367188 3.265625 -3.671875 C 3.015625 -3.972656 2.710938 -4.125 2.359375 -4.125 C 2.003906 -4.125 1.707031 -3.976562 1.46875 -3.6875 C 1.238281 -3.394531 1.125 -2.941406 1.125 -2.328125 Z M 1.125 -2.328125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-12\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 0 L 0.59375 -4.671875 L 1.3125 -4.671875 L 1.3125 -4 C 1.644531 -4.507812 2.140625 -4.765625 2.796875 -4.765625 C 3.078125 -4.765625 3.332031 -4.710938 3.5625 -4.609375 C 3.800781 -4.515625 3.976562 -4.382812 4.09375 -4.21875 C 4.207031 -4.0625 4.289062 -3.867188 4.34375 -3.640625 C 4.375 -3.492188 4.390625 -3.238281 4.390625 -2.875 L 4.390625 0 L 3.59375 0 L 3.59375 -2.84375 C 3.59375 -3.164062 3.5625 -3.40625 3.5 -3.5625 C 3.4375 -3.71875 3.328125 -3.84375 3.171875 -3.9375 C 3.015625 -4.039062 2.832031 -4.09375 2.625 -4.09375 C 2.289062 -4.09375 2 -3.984375 1.75 -3.765625 C 1.507812 -3.554688 1.390625 -3.148438 1.390625 -2.546875 L 1.390625 0 Z M 0.59375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-13\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 0 L 0.59375 -6.4375 L 1.390625 -6.4375 L 1.390625 -4.125 C 1.753906 -4.550781 2.21875 -4.765625 2.78125 -4.765625 C 3.125 -4.765625 3.421875 -4.695312 3.671875 -4.5625 C 3.929688 -4.425781 4.113281 -4.238281 4.21875 -4 C 4.332031 -3.757812 4.390625 -3.410156 4.390625 -2.953125 L 4.390625 0 L 3.609375 0 L 3.609375 -2.953125 C 3.609375 -3.347656 3.519531 -3.632812 3.34375 -3.8125 C 3.175781 -4 2.9375 -4.09375 2.625 -4.09375 C 2.382812 -4.09375 2.160156 -4.03125 1.953125 -3.90625 C 1.742188 -3.789062 1.597656 -3.628906 1.515625 -3.421875 C 1.429688 -3.210938 1.390625 -2.921875 1.390625 -2.546875 L 1.390625 0 Z M 0.59375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-14\" overflow=\"visible\">\n",
       "<path d=\"M 0.71875 0 L 0.71875 -6.4375 L 1.578125 -6.4375 L 1.578125 -3.796875 L 4.921875 -3.796875 L 4.921875 -6.4375 L 5.78125 -6.4375 L 5.78125 0 L 4.921875 0 L 4.921875 -3.03125 L 1.578125 -3.03125 L 1.578125 0 Z M 0.71875 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-15\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 -5.53125 L 0.59375 -6.4375 L 1.390625 -6.4375 L 1.390625 -5.53125 Z M 0.59375 0 L 0.59375 -4.671875 L 1.390625 -4.671875 L 1.390625 0 Z M 0.59375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-16\" overflow=\"visible\">\n",
       "<path d=\"M 0.71875 0 L 0.71875 -6.4375 L 5.375 -6.4375 L 5.375 -5.6875 L 1.5625 -5.6875 L 1.5625 -3.703125 L 5.125 -3.703125 L 5.125 -2.953125 L 1.5625 -2.953125 L 1.5625 -0.765625 L 5.515625 -0.765625 L 5.515625 0 Z M 0.71875 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-17\" overflow=\"visible\">\n",
       "<path d=\"M 0.578125 0 L 0.578125 -6.4375 L 1.359375 -6.4375 L 1.359375 0 Z M 0.578125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-18\" overflow=\"visible\">\n",
       "<path d=\"M 0.59375 0 L 0.59375 -4.671875 L 1.296875 -4.671875 L 1.296875 -4.015625 C 1.441406 -4.242188 1.632812 -4.425781 1.875 -4.5625 C 2.125 -4.695312 2.40625 -4.765625 2.71875 -4.765625 C 3.0625 -4.765625 3.34375 -4.691406 3.5625 -4.546875 C 3.78125 -4.410156 3.9375 -4.210938 4.03125 -3.953125 C 4.40625 -4.492188 4.882812 -4.765625 5.46875 -4.765625 C 5.9375 -4.765625 6.296875 -4.632812 6.546875 -4.375 C 6.796875 -4.125 6.921875 -3.734375 6.921875 -3.203125 L 6.921875 0 L 6.125 0 L 6.125 -2.9375 C 6.125 -3.257812 6.097656 -3.488281 6.046875 -3.625 C 6.003906 -3.757812 5.914062 -3.867188 5.78125 -3.953125 C 5.644531 -4.046875 5.484375 -4.09375 5.296875 -4.09375 C 4.972656 -4.09375 4.703125 -3.984375 4.484375 -3.765625 C 4.265625 -3.546875 4.15625 -3.195312 4.15625 -2.71875 L 4.15625 0 L 3.359375 0 L 3.359375 -3.03125 C 3.359375 -3.382812 3.296875 -3.648438 3.171875 -3.828125 C 3.046875 -4.003906 2.835938 -4.09375 2.546875 -4.09375 C 2.316406 -4.09375 2.109375 -4.03125 1.921875 -3.90625 C 1.734375 -3.789062 1.597656 -3.617188 1.515625 -3.390625 C 1.429688 -3.171875 1.390625 -2.847656 1.390625 -2.421875 L 1.390625 0 Z M 0.59375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-19\" overflow=\"visible\">\n",
       "<path d=\"M 1.453125 0 L 0.03125 -4.671875 L 0.84375 -4.671875 L 1.59375 -1.96875 L 1.859375 -0.96875 C 1.867188 -1.019531 1.953125 -1.34375 2.109375 -1.9375 L 2.84375 -4.671875 L 3.65625 -4.671875 L 4.359375 -1.953125 L 4.59375 -1.0625 L 4.859375 -1.96875 L 5.65625 -4.671875 L 6.421875 -4.671875 L 4.96875 0 L 4.15625 0 L 3.40625 -2.796875 L 3.21875 -3.59375 L 2.28125 0 Z M 1.453125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-20\" overflow=\"visible\">\n",
       "<path d=\"M 0.4375 -3.140625 C 0.4375 -4.203125 0.722656 -5.035156 1.296875 -5.640625 C 1.867188 -6.253906 2.609375 -6.5625 3.515625 -6.5625 C 4.109375 -6.5625 4.644531 -6.414062 5.125 -6.125 C 5.601562 -5.84375 5.96875 -5.445312 6.21875 -4.9375 C 6.46875 -4.425781 6.59375 -3.851562 6.59375 -3.21875 C 6.59375 -2.5625 6.460938 -1.972656 6.203125 -1.453125 C 5.941406 -0.941406 5.566406 -0.550781 5.078125 -0.28125 C 4.597656 -0.0195312 4.078125 0.109375 3.515625 0.109375 C 2.910156 0.109375 2.367188 -0.0351562 1.890625 -0.328125 C 1.410156 -0.617188 1.046875 -1.019531 0.796875 -1.53125 C 0.554688 -2.039062 0.4375 -2.578125 0.4375 -3.140625 Z M 1.3125 -3.125 C 1.3125 -2.34375 1.519531 -1.726562 1.9375 -1.28125 C 2.351562 -0.84375 2.878906 -0.625 3.515625 -0.625 C 4.148438 -0.625 4.675781 -0.847656 5.09375 -1.296875 C 5.507812 -1.742188 5.71875 -2.382812 5.71875 -3.21875 C 5.71875 -3.738281 5.628906 -4.191406 5.453125 -4.578125 C 5.273438 -4.972656 5.015625 -5.28125 4.671875 -5.5 C 4.328125 -5.71875 3.945312 -5.828125 3.53125 -5.828125 C 2.925781 -5.828125 2.40625 -5.617188 1.96875 -5.203125 C 1.53125 -4.785156 1.3125 -4.09375 1.3125 -3.125 Z M 1.3125 -3.125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-21\" overflow=\"visible\">\n",
       "<path d=\"M 0.578125 0 L 0.578125 -4.671875 L 1.296875 -4.671875 L 1.296875 -3.953125 C 1.472656 -4.285156 1.640625 -4.503906 1.796875 -4.609375 C 1.953125 -4.710938 2.125 -4.765625 2.3125 -4.765625 C 2.570312 -4.765625 2.84375 -4.679688 3.125 -4.515625 L 2.84375 -3.78125 C 2.65625 -3.894531 2.460938 -3.953125 2.265625 -3.953125 C 2.097656 -3.953125 1.941406 -3.898438 1.796875 -3.796875 C 1.660156 -3.691406 1.5625 -3.546875 1.5 -3.359375 C 1.414062 -3.078125 1.375 -2.769531 1.375 -2.4375 L 1.375 0 Z M 0.578125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-22\" overflow=\"visible\">\n",
       "<path d=\"M 0.296875 -2.328125 C 0.296875 -3.191406 0.535156 -3.832031 1.015625 -4.25 C 1.421875 -4.59375 1.910156 -4.765625 2.484375 -4.765625 C 3.128906 -4.765625 3.65625 -4.554688 4.0625 -4.140625 C 4.46875 -3.722656 4.671875 -3.144531 4.671875 -2.40625 C 4.671875 -1.800781 4.578125 -1.328125 4.390625 -0.984375 C 4.210938 -0.640625 3.953125 -0.367188 3.609375 -0.171875 C 3.265625 0.015625 2.890625 0.109375 2.484375 0.109375 C 1.828125 0.109375 1.296875 -0.0976562 0.890625 -0.515625 C 0.492188 -0.941406 0.296875 -1.546875 0.296875 -2.328125 Z M 1.109375 -2.328125 C 1.109375 -1.734375 1.238281 -1.285156 1.5 -0.984375 C 1.757812 -0.691406 2.085938 -0.546875 2.484375 -0.546875 C 2.878906 -0.546875 3.207031 -0.691406 3.46875 -0.984375 C 3.726562 -1.285156 3.859375 -1.742188 3.859375 -2.359375 C 3.859375 -2.929688 3.726562 -3.367188 3.46875 -3.671875 C 3.207031 -3.972656 2.878906 -4.125 2.484375 -4.125 C 2.085938 -4.125 1.757812 -3.972656 1.5 -3.671875 C 1.238281 -3.378906 1.109375 -2.929688 1.109375 -2.328125 Z M 1.109375 -2.328125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-23\" overflow=\"visible\">\n",
       "<path d=\"M 5.296875 -2.265625 L 6.140625 -2.046875 C 5.960938 -1.347656 5.640625 -0.8125 5.171875 -0.4375 C 4.710938 -0.0703125 4.144531 0.109375 3.46875 0.109375 C 2.78125 0.109375 2.21875 -0.03125 1.78125 -0.3125 C 1.34375 -0.59375 1.007812 -1 0.78125 -1.53125 C 0.5625 -2.070312 0.453125 -2.648438 0.453125 -3.265625 C 0.453125 -3.941406 0.578125 -4.53125 0.828125 -5.03125 C 1.085938 -5.53125 1.453125 -5.90625 1.921875 -6.15625 C 2.398438 -6.414062 2.921875 -6.546875 3.484375 -6.546875 C 4.128906 -6.546875 4.671875 -6.378906 5.109375 -6.046875 C 5.554688 -5.722656 5.863281 -5.265625 6.03125 -4.671875 L 5.1875 -4.484375 C 5.039062 -4.953125 4.828125 -5.289062 4.546875 -5.5 C 4.265625 -5.71875 3.90625 -5.828125 3.46875 -5.828125 C 2.976562 -5.828125 2.566406 -5.707031 2.234375 -5.46875 C 1.898438 -5.226562 1.664062 -4.90625 1.53125 -4.5 C 1.394531 -4.101562 1.328125 -3.695312 1.328125 -3.28125 C 1.328125 -2.726562 1.40625 -2.242188 1.5625 -1.828125 C 1.726562 -1.421875 1.976562 -1.117188 2.3125 -0.921875 C 2.644531 -0.722656 3.007812 -0.625 3.40625 -0.625 C 3.882812 -0.625 4.285156 -0.757812 4.609375 -1.03125 C 4.941406 -1.3125 5.171875 -1.722656 5.296875 -2.265625 Z M 5.296875 -2.265625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-24\" overflow=\"visible\">\n",
       "<path d=\"\" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-25\" overflow=\"visible\">\n",
       "<path d=\"M 0.375 -2.453125 L 0.375 -3.34375 C 0.6875 -3.695312 1.097656 -3.875 1.609375 -3.875 C 1.785156 -3.875 1.96875 -3.847656 2.15625 -3.796875 C 2.351562 -3.742188 2.628906 -3.644531 2.984375 -3.5 C 3.179688 -3.40625 3.332031 -3.34375 3.4375 -3.3125 C 3.539062 -3.289062 3.644531 -3.28125 3.75 -3.28125 C 3.9375 -3.28125 4.128906 -3.335938 4.328125 -3.453125 C 4.535156 -3.566406 4.71875 -3.710938 4.875 -3.890625 L 4.875 -2.953125 C 4.6875 -2.773438 4.492188 -2.644531 4.296875 -2.5625 C 4.109375 -2.488281 3.894531 -2.453125 3.65625 -2.453125 C 3.476562 -2.453125 3.3125 -2.472656 3.15625 -2.515625 C 3 -2.554688 2.742188 -2.65625 2.390625 -2.8125 C 2.046875 -2.96875 1.757812 -3.046875 1.53125 -3.046875 C 1.34375 -3.046875 1.164062 -3.003906 1 -2.921875 C 0.832031 -2.835938 0.625 -2.679688 0.375 -2.453125 Z M 0.375 -2.453125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-26\" overflow=\"visible\">\n",
       "<path d=\"M 2.25 -1.046875 L 2.25 -2.8125 L 0.5 -2.8125 L 0.5 -3.546875 L 2.25 -3.546875 L 2.25 -5.296875 L 3 -5.296875 L 3 -3.546875 L 4.75 -3.546875 L 4.75 -2.8125 L 3 -2.8125 L 3 -1.046875 Z M 2.25 -1.046875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-27\" overflow=\"visible\">\n",
       "<path d=\"M 0.734375 0 L 0.734375 -6.4375 L 5.078125 -6.4375 L 5.078125 -5.6875 L 1.59375 -5.6875 L 1.59375 -3.6875 L 4.609375 -3.6875 L 4.609375 -2.921875 L 1.59375 -2.921875 L 1.59375 0 Z M 0.734375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-28\" overflow=\"visible\">\n",
       "<path d=\"M 0.5625 1.796875 L 0.46875 1.0625 C 0.644531 1.101562 0.796875 1.125 0.921875 1.125 C 1.097656 1.125 1.238281 1.09375 1.34375 1.03125 C 1.445312 0.976562 1.535156 0.898438 1.609375 0.796875 C 1.648438 0.710938 1.726562 0.515625 1.84375 0.203125 C 1.863281 0.160156 1.890625 0.0976562 1.921875 0.015625 L 0.140625 -4.671875 L 1 -4.671875 L 1.96875 -1.96875 C 2.09375 -1.625 2.207031 -1.265625 2.3125 -0.890625 C 2.394531 -1.242188 2.5 -1.597656 2.625 -1.953125 L 3.625 -4.671875 L 4.421875 -4.671875 L 2.640625 0.078125 C 2.453125 0.585938 2.304688 0.941406 2.203125 1.140625 C 2.054688 1.398438 1.894531 1.585938 1.71875 1.703125 C 1.539062 1.828125 1.320312 1.890625 1.0625 1.890625 C 0.914062 1.890625 0.75 1.859375 0.5625 1.796875 Z M 0.5625 1.796875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-29\" overflow=\"visible\">\n",
       "<path d=\"M 3.640625 -1.703125 L 4.421875 -1.609375 C 4.335938 -1.066406 4.117188 -0.644531 3.765625 -0.34375 C 3.410156 -0.0390625 2.976562 0.109375 2.46875 0.109375 C 1.832031 0.109375 1.320312 -0.0976562 0.9375 -0.515625 C 0.550781 -0.929688 0.359375 -1.53125 0.359375 -2.3125 C 0.359375 -2.820312 0.441406 -3.265625 0.609375 -3.640625 C 0.773438 -4.015625 1.023438 -4.296875 1.359375 -4.484375 C 1.703125 -4.671875 2.078125 -4.765625 2.484375 -4.765625 C 2.984375 -4.765625 3.394531 -4.632812 3.71875 -4.375 C 4.039062 -4.125 4.25 -3.765625 4.34375 -3.296875 L 3.578125 -3.171875 C 3.503906 -3.484375 3.375 -3.71875 3.1875 -3.875 C 3 -4.039062 2.773438 -4.125 2.515625 -4.125 C 2.109375 -4.125 1.78125 -3.976562 1.53125 -3.6875 C 1.289062 -3.40625 1.171875 -2.957031 1.171875 -2.34375 C 1.171875 -1.707031 1.289062 -1.25 1.53125 -0.96875 C 1.769531 -0.6875 2.082031 -0.546875 2.46875 -0.546875 C 2.78125 -0.546875 3.039062 -0.640625 3.25 -0.828125 C 3.457031 -1.015625 3.585938 -1.304688 3.640625 -1.703125 Z M 3.640625 -1.703125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-30\" overflow=\"visible\">\n",
       "<path d=\"M 1.890625 0 L 0.109375 -4.671875 L 0.953125 -4.671875 L 1.953125 -1.875 C 2.054688 -1.570312 2.15625 -1.257812 2.25 -0.9375 C 2.320312 -1.175781 2.421875 -1.46875 2.546875 -1.8125 L 3.578125 -4.671875 L 4.390625 -4.671875 L 2.625 0 Z M 1.890625 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-31\" overflow=\"visible\">\n",
       "<path d=\"M 0.78125 0 L 0.78125 -4.046875 L 0.078125 -4.046875 L 0.078125 -4.671875 L 0.78125 -4.671875 L 0.78125 -5.15625 C 0.78125 -5.476562 0.804688 -5.710938 0.859375 -5.859375 C 0.941406 -6.066406 1.078125 -6.234375 1.265625 -6.359375 C 1.460938 -6.484375 1.734375 -6.546875 2.078125 -6.546875 C 2.296875 -6.546875 2.539062 -6.519531 2.8125 -6.46875 L 2.6875 -5.78125 C 2.53125 -5.8125 2.378906 -5.828125 2.234375 -5.828125 C 1.992188 -5.828125 1.820312 -5.773438 1.71875 -5.671875 C 1.613281 -5.566406 1.5625 -5.375 1.5625 -5.09375 L 1.5625 -4.671875 L 2.484375 -4.671875 L 2.484375 -4.046875 L 1.5625 -4.046875 L 1.5625 0 Z M 0.78125 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph2-32\" overflow=\"visible\">\n",
       "<path d=\"M 3.65625 0 L 3.65625 -0.6875 C 3.289062 -0.15625 2.796875 0.109375 2.171875 0.109375 C 1.898438 0.109375 1.644531 0.0546875 1.40625 -0.046875 C 1.164062 -0.160156 0.984375 -0.296875 0.859375 -0.453125 C 0.742188 -0.609375 0.664062 -0.800781 0.625 -1.03125 C 0.59375 -1.1875 0.578125 -1.4375 0.578125 -1.78125 L 0.578125 -4.671875 L 1.359375 -4.671875 L 1.359375 -2.078125 C 1.359375 -1.660156 1.378906 -1.382812 1.421875 -1.25 C 1.460938 -1.039062 1.5625 -0.875 1.71875 -0.75 C 1.882812 -0.632812 2.085938 -0.578125 2.328125 -0.578125 C 2.566406 -0.578125 2.789062 -0.632812 3 -0.75 C 3.207031 -0.875 3.351562 -1.039062 3.4375 -1.25 C 3.519531 -1.457031 3.5625 -1.765625 3.5625 -2.171875 L 3.5625 -4.671875 L 4.359375 -4.671875 L 4.359375 0 Z M 3.65625 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-0\" overflow=\"visible\">\n",
       "<path d=\"M 1.125 0 L 1.125 -5.625 L 5.625 -5.625 L 5.625 0 Z M 1.265625 -0.140625 L 5.484375 -0.140625 L 5.484375 -5.484375 L 1.265625 -5.484375 Z M 1.265625 -0.140625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-1\" overflow=\"visible\">\n",
       "<path d=\"M 1.71875 0 L 0.390625 0 L 1.75 -6.4375 L 4.609375 -6.4375 C 5.097656 -6.4375 5.476562 -6.382812 5.75 -6.28125 C 6.03125 -6.1875 6.253906 -6.003906 6.421875 -5.734375 C 6.585938 -5.460938 6.671875 -5.132812 6.671875 -4.75 C 6.671875 -4.207031 6.503906 -3.753906 6.171875 -3.390625 C 5.847656 -3.035156 5.351562 -2.816406 4.6875 -2.734375 C 4.851562 -2.585938 5.015625 -2.390625 5.171875 -2.140625 C 5.460938 -1.628906 5.789062 -0.914062 6.15625 0 L 4.734375 0 C 4.617188 -0.363281 4.394531 -0.929688 4.0625 -1.703125 C 3.875 -2.117188 3.679688 -2.398438 3.484375 -2.546875 C 3.359375 -2.628906 3.140625 -2.671875 2.828125 -2.671875 L 2.28125 -2.671875 Z M 2.484375 -3.640625 L 3.1875 -3.640625 C 3.894531 -3.640625 4.363281 -3.679688 4.59375 -3.765625 C 4.832031 -3.847656 5.015625 -3.976562 5.140625 -4.15625 C 5.273438 -4.34375 5.34375 -4.535156 5.34375 -4.734375 C 5.34375 -4.960938 5.25 -5.140625 5.0625 -5.265625 C 4.945312 -5.328125 4.691406 -5.359375 4.296875 -5.359375 L 2.84375 -5.359375 Z M 2.484375 -3.640625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-2\" overflow=\"visible\">\n",
       "<path d=\"M 0.21875 0 L 0.4375 -1.015625 L 4.140625 -5.359375 L 1.140625 -5.359375 L 1.359375 -6.4375 L 6.015625 -6.4375 L 5.8125 -5.4375 L 2.0625 -1.0625 C 2.46875 -1.0625 2.703125 -1.0625 2.765625 -1.0625 C 3.046875 -1.0625 3.429688 -1.066406 3.921875 -1.078125 L 5.4375 -1.078125 L 5.21875 0 Z M 0.21875 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-3\" overflow=\"visible\">\n",
       "<path d=\"M 1.4375 0 L -0.265625 0 L 2.578125 -3.265625 L 0.96875 -6.4375 L 2.359375 -6.4375 L 2.984375 -5.234375 C 3.003906 -5.191406 3.148438 -4.894531 3.421875 -4.34375 C 3.429688 -4.3125 3.445312 -4.269531 3.46875 -4.21875 C 3.832031 -4.65625 4.132812 -5.015625 4.375 -5.296875 L 5.390625 -6.4375 L 7.046875 -6.4375 L 4.109375 -3.046875 L 5.6875 0 L 4.203125 0 L 3.71875 -0.96875 C 3.457031 -1.476562 3.289062 -1.847656 3.21875 -2.078125 C 3.101562 -1.898438 2.804688 -1.539062 2.328125 -1 Z M 1.4375 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph3-4\" overflow=\"visible\">\n",
       "<path d=\"M 4.8125 -2.875 L 2.328125 -2.875 L 1.71875 0 L 0.390625 0 L 1.734375 -6.4375 L 3.0625 -6.4375 L 2.546875 -3.953125 L 5.03125 -3.953125 L 5.5625 -6.4375 L 6.875 -6.4375 L 5.53125 0 L 4.203125 0 Z M 4.8125 -2.875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-0\" overflow=\"visible\">\n",
       "<path d=\"M 1.125 0 L 1.125 -5.625 L 5.625 -5.625 L 5.625 0 Z M 1.265625 -0.140625 L 5.484375 -0.140625 L 5.484375 -5.484375 L 1.265625 -5.484375 Z M 1.265625 -0.140625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-1\" overflow=\"visible\">\n",
       "<path d=\"M 2.15625 -0.640625 L 2.03125 0 C 1.832031 0.0507812 1.644531 0.078125 1.46875 0.078125 C 1.15625 0.078125 0.90625 0 0.71875 -0.15625 C 0.570312 -0.269531 0.5 -0.429688 0.5 -0.640625 C 0.5 -0.734375 0.539062 -0.96875 0.625 -1.34375 L 1.1875 -4.046875 L 0.5625 -4.046875 L 0.6875 -4.671875 L 1.3125 -4.671875 L 1.5625 -5.8125 L 2.46875 -6.359375 L 2.109375 -4.671875 L 2.890625 -4.671875 L 2.765625 -4.046875 L 1.984375 -4.046875 L 1.4375 -1.46875 C 1.375 -1.144531 1.34375 -0.953125 1.34375 -0.890625 C 1.34375 -0.796875 1.367188 -0.722656 1.421875 -0.671875 C 1.472656 -0.617188 1.5625 -0.59375 1.6875 -0.59375 C 1.863281 -0.59375 2.019531 -0.609375 2.15625 -0.640625 Z M 2.15625 -0.640625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-2\" overflow=\"visible\">\n",
       "<path d=\"M 0.421875 -1.9375 L 0.578125 -2.734375 L 3.015625 -2.734375 L 2.84375 -1.9375 Z M 0.421875 -1.9375 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph4-3\" overflow=\"visible\">\n",
       "<path d=\"M 2.171875 0 L 3.1875 -4.859375 C 2.75 -4.515625 2.128906 -4.238281 1.328125 -4.03125 L 1.484375 -4.75 C 1.878906 -4.914062 2.269531 -5.125 2.65625 -5.375 C 3.039062 -5.625 3.328125 -5.847656 3.515625 -6.046875 C 3.640625 -6.160156 3.753906 -6.300781 3.859375 -6.46875 L 4.3125 -6.46875 L 2.96875 0 Z M 2.171875 0 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-0\" overflow=\"visible\">\n",
       "<path d=\"\" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-1\" overflow=\"visible\">\n",
       "<path d=\"M 0.703125 -6.421875 L 0.703125 0 L 1.4375 0 L 1.4375 -6.421875 Z M 0.703125 -6.421875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-2\" overflow=\"visible\">\n",
       "<path d=\"M 2.734375 -4.78125 C 2.4375 -4.78125 2.15625 -4.703125 1.90625 -4.5625 C 1.640625 -4.421875 1.4375 -4.234375 1.28125 -3.96875 L 1.28125 -4.65625 L 0.5625 -4.65625 L 0.5625 0 L 1.28125 0 L 1.28125 -2.8125 C 1.3125 -3.234375 1.4375 -3.5625 1.6875 -3.8125 C 1.921875 -4.046875 2.203125 -4.171875 2.53125 -4.171875 C 3.34375 -4.171875 3.75 -3.71875 3.75 -2.8125 L 3.75 0 L 4.46875 0 L 4.46875 -2.859375 C 4.46875 -4.140625 3.890625 -4.78125 2.734375 -4.78125 Z M 2.734375 -4.78125 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-3\" overflow=\"visible\">\n",
       "<path d=\"M 2.78125 -4.78125 C 2.078125 -4.78125 1.5625 -4.484375 1.234375 -3.890625 L 1.234375 -4.65625 L 0.5625 -4.65625 L 0.5625 1.78125 L 1.28125 1.78125 L 1.28125 -0.84375 C 1.640625 -0.203125 2.15625 0.125 2.8125 0.125 C 3.484375 0.125 4 -0.125 4.375 -0.609375 C 4.71875 -1.0625 4.890625 -1.625 4.890625 -2.3125 C 4.890625 -3.015625 4.71875 -3.578125 4.359375 -4.03125 C 3.984375 -4.53125 3.453125 -4.78125 2.78125 -4.78125 Z M 2.6875 -4.1875 C 3.1875 -4.1875 3.5625 -4 3.828125 -3.625 C 4.046875 -3.296875 4.15625 -2.859375 4.15625 -2.3125 C 4.15625 -1.75 4.046875 -1.3125 3.8125 -0.984375 C 3.546875 -0.640625 3.171875 -0.46875 2.65625 -0.46875 C 2.234375 -0.46875 1.90625 -0.640625 1.640625 -0.96875 C 1.375 -1.296875 1.25 -1.734375 1.25 -2.265625 L 1.25 -2.359375 C 1.25 -2.875 1.375 -3.3125 1.609375 -3.640625 C 1.859375 -4 2.21875 -4.1875 2.6875 -4.1875 Z M 2.6875 -4.1875 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-4\" overflow=\"visible\">\n",
       "<path d=\"M 0.5625 -4.65625 L 0.5625 -1.765625 C 0.5625 -0.515625 1.109375 0.125 2.25 0.125 C 2.875 0.125 3.390625 -0.15625 3.765625 -0.71875 L 3.765625 0 L 4.484375 0 L 4.484375 -4.65625 L 3.765625 -4.65625 L 3.765625 -1.8125 C 3.703125 -1.421875 3.5625 -1.09375 3.296875 -0.84375 C 3.0625 -0.609375 2.78125 -0.484375 2.46875 -0.484375 C 2.046875 -0.484375 1.75 -0.609375 1.5625 -0.8125 C 1.375 -1.03125 1.28125 -1.375 1.28125 -1.8125 L 1.28125 -4.65625 Z M 0.5625 -4.65625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-5\" overflow=\"visible\">\n",
       "<path d=\"M 1.796875 -6.15625 L 1.09375 -5.859375 L 1.09375 -4.65625 L 0.15625 -4.65625 L 0.15625 -4.046875 L 1.09375 -4.046875 L 1.09375 -1.09375 C 1.09375 -0.734375 1.15625 -0.484375 1.3125 -0.296875 C 1.46875 -0.09375 1.75 0 2.140625 0 L 2.828125 0 L 2.828125 -0.609375 L 2.234375 -0.609375 C 2.078125 -0.609375 1.96875 -0.640625 1.90625 -0.71875 C 1.828125 -0.796875 1.796875 -0.921875 1.796875 -1.09375 L 1.796875 -4.046875 L 2.953125 -4.046875 L 2.953125 -4.65625 L 1.796875 -4.65625 Z M 1.796875 -6.15625 \" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "<symbol id=\"glyph5-6\" overflow=\"visible\">\n",
       "<path d=\"\" style=\"stroke:none;\"/>\n",
       "</symbol>\n",
       "</g>\n",
       "</defs>\n",
       "<g id=\"surface1\">\n",
       "<path d=\"M 292 232 L 464 232 C 470.628906 232 476 237.371094 476 244 L 476 364 C 476 370.628906 470.628906 376 464 376 L 292 376 C 285.371094 376 280 370.628906 280 364 L 280 244 C 280 237.371094 285.371094 232 292 232 Z M 292 232 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 326.203125 320 L 354.203125 320 L 354.203125 336 L 326.203125 336 Z M 326.203125 320 \" style=\"fill-rule:nonzero;fill:rgb(39.99939%,74.902344%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"182.4877\" xlink:href=\"#glyph0-1\" y=\"99.5\"/>\n",
       "</g>\n",
       "<path d=\"M 397.65625 246.34375 C 400.78125 249.46875 400.78125 254.53125 397.65625 257.65625 C 394.53125 260.78125 389.46875 260.78125 386.34375 257.65625 C 383.21875 254.53125 383.21875 249.46875 386.34375 246.34375 C 389.46875 243.21875 394.53125 243.21875 397.65625 246.34375 \" style=\"fill-rule:nonzero;fill:rgb(69.804382%,85.098267%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"234.0029\" xlink:href=\"#glyph1-1\" y=\"22.5\"/>\n",
       "</g>\n",
       "<path d=\"M 265 251.601562 L 378.101562 251.980469 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 382.101562 251.992188 L 378.101562 251.980469 M 378.105469 250.480469 L 382.101562 251.992188 L 378.09375 253.480469 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 322.207031 296.925781 C 325.332031 300.050781 325.332031 305.113281 322.207031 308.238281 C 319.082031 311.363281 314.019531 311.363281 310.894531 308.238281 C 307.769531 305.113281 307.769531 300.050781 310.894531 296.925781 C 314.019531 293.800781 319.082031 293.800781 322.207031 296.925781 \" style=\"fill-rule:nonzero;fill:rgb(69.804382%,85.098267%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"158.5534\" xlink:href=\"#glyph1-1\" y=\"73.0822\"/>\n",
       "</g>\n",
       "<path d=\"M 282.40625 251.660156 L 294.117188 251.886719 C 297.382812 251.949219 300 254.617188 300 257.886719 L 300 346 C 300 349.3125 302.6875 352 306 352 L 334.050781 352 C 337.34375 352 340.023438 349.34375 340.050781 346.050781 L 340.085938 341.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 340.117188 337.898438 L 340.085938 341.898438 M 338.585938 341.886719 L 340.117188 337.898438 L 341.585938 341.914062 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 340.203125 320 L 340.203125 309.480469 C 340.203125 306.378906 337.832031 303.785156 334.742188 303.503906 L 330.425781 303.113281 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 326.441406 302.753906 L 330.425781 303.113281 M 330.292969 304.609375 L 326.441406 302.753906 L 330.5625 301.621094 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 377.945312 320 L 405.945312 320 L 405.945312 336 L 377.945312 336 Z M 377.945312 320 \" style=\"fill-rule:nonzero;fill:rgb(39.99939%,74.902344%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"234.2302\" xlink:href=\"#glyph0-1\" y=\"99.5\"/>\n",
       "</g>\n",
       "<path d=\"M 421.65625 278.34375 C 424.78125 281.46875 424.78125 286.53125 421.65625 289.65625 C 418.53125 292.78125 413.46875 292.78125 410.34375 289.65625 C 407.21875 286.53125 407.21875 281.46875 410.34375 278.34375 C 413.46875 275.21875 418.53125 275.21875 421.65625 278.34375 \" style=\"fill-rule:nonzero;fill:rgb(69.804382%,85.098267%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"256.9988\" xlink:href=\"#glyph2-1\" y=\"55.5\"/>\n",
       "  <use x=\"262.0046\" xlink:href=\"#glyph2-2\" y=\"55.5\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"197.2446\" xlink:href=\"#glyph2-3\" y=\"73\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"203.7444\" xlink:href=\"#glyph2-4\" y=\"73\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"208.7502\" xlink:href=\"#glyph2-5\" y=\"73\"/>\n",
       "  <use x=\"213.2502\" xlink:href=\"#glyph2-4\" y=\"73\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"218.256\" xlink:href=\"#glyph2-6\" y=\"73\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"200.2417\" xlink:href=\"#glyph2-7\" y=\"83.2944\"/>\n",
       "  <use x=\"205.2475\" xlink:href=\"#glyph2-8\" y=\"83.2944\"/>\n",
       "  <use x=\"210.2533\" xlink:href=\"#glyph2-6\" y=\"83.2944\"/>\n",
       "  <use x=\"212.7571\" xlink:href=\"#glyph2-4\" y=\"83.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"204.5\" xlink:href=\"#glyph3-1\" y=\"93.5889\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"210.9995\" xlink:href=\"#glyph4-1\" y=\"97.5889\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"246.4893\" xlink:href=\"#glyph2-9\" y=\"74\"/>\n",
       "  <use x=\"252.9891\" xlink:href=\"#glyph2-10\" y=\"74\"/>\n",
       "  <use x=\"257.9949\" xlink:href=\"#glyph2-11\" y=\"74\"/>\n",
       "  <use x=\"263.0007\" xlink:href=\"#glyph2-8\" y=\"74\"/>\n",
       "  <use x=\"268.0065\" xlink:href=\"#glyph2-6\" y=\"74\"/>\n",
       "  <use x=\"270.5103\" xlink:href=\"#glyph2-4\" y=\"74\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"252.2417\" xlink:href=\"#glyph2-7\" y=\"84.2944\"/>\n",
       "  <use x=\"257.2475\" xlink:href=\"#glyph2-8\" y=\"84.2944\"/>\n",
       "  <use x=\"262.2533\" xlink:href=\"#glyph2-6\" y=\"84.2944\"/>\n",
       "  <use x=\"264.7571\" xlink:href=\"#glyph2-4\" y=\"84.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"257.001\" xlink:href=\"#glyph3-2\" y=\"94.5889\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"262.4985\" xlink:href=\"#glyph4-1\" y=\"98.5889\"/>\n",
       "</g>\n",
       "<path d=\"M 316.550781 310.582031 L 316.0625 357.9375 C 316.027344 361.25 318.6875 363.964844 322 364 C 322.019531 364 322.042969 364 322.0625 364 L 334.964844 364 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 322.527344 352 L 386 352 C 389.3125 352 392 349.3125 392 346 L 392 341.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 392 337.898438 L 392 341.898438 M 390.5 341.898438 L 392 337.898438 L 393.5 341.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 300.035156 384 L 300.007812 358.007812 C 300.003906 354.691406 302.6875 352.003906 306 352 C 306.003906 352 306.003906 352 306.007812 352 L 327.78125 352 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 430.277344 320 L 458.277344 320 L 458.277344 336 L 430.277344 336 Z M 430.277344 320 \" style=\"fill-rule:nonzero;fill:rgb(39.99939%,74.902344%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"280.5196\" xlink:href=\"#glyph2-6\" y=\"99.5\"/>\n",
       "  <use x=\"283.0198\" xlink:href=\"#glyph2-8\" y=\"99.5\"/>\n",
       "  <use x=\"288.022\" xlink:href=\"#glyph2-12\" y=\"99.5\"/>\n",
       "  <use x=\"293.0242\" xlink:href=\"#glyph2-13\" y=\"99.5\"/>\n",
       "</g>\n",
       "<path d=\"M 449.65625 278.34375 C 452.78125 281.46875 452.78125 286.53125 449.65625 289.65625 C 446.53125 292.78125 441.46875 292.78125 438.34375 289.65625 C 435.21875 286.53125 435.21875 281.46875 438.34375 278.34375 C 441.46875 275.21875 446.53125 275.21875 449.65625 278.34375 \" style=\"fill-rule:nonzero;fill:rgb(69.804382%,85.098267%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"286.0029\" xlink:href=\"#glyph1-1\" y=\"54.5\"/>\n",
       "</g>\n",
       "<path d=\"M 444.214844 320 L 444.046875 297.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 444.015625 293.898438 L 444.046875 297.898438 M 442.546875 297.910156 L 444.015625 293.898438 L 445.546875 297.886719 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 300.027344 375.914062 C 300.011719 369.347656 305.320312 364.015625 311.886719 364 C 311.894531 364 311.90625 364 311.914062 364 L 432.09375 364 C 438.683594 364 444.039062 358.683594 444.09375 352.09375 L 444.171875 341.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 444.203125 337.898438 L 444.171875 341.898438 M 442.671875 341.886719 L 444.203125 337.898438 L 445.671875 341.910156 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 305.417969 251.738281 L 310.222656 251.855469 C 313.449219 251.9375 316.03125 254.550781 316.074219 257.777344 L 316.472656 288.683594 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 316.527344 292.683594 L 316.472656 288.683594 M 317.972656 288.664062 L 316.527344 292.683594 L 314.972656 288.703125 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"128.9659\" xlink:href=\"#glyph5-1\" y=\"168\"/>\n",
       "  <use x=\"131.0989\" xlink:href=\"#glyph5-2\" y=\"168\"/>\n",
       "  <use x=\"136.1299\" xlink:href=\"#glyph5-3\" y=\"168\"/>\n",
       "  <use x=\"141.4039\" xlink:href=\"#glyph5-4\" y=\"168\"/>\n",
       "  <use x=\"146.4439\" xlink:href=\"#glyph5-5\" y=\"168\"/>\n",
       "  <use x=\"149.6389\" xlink:href=\"#glyph5-6\" y=\"168\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"152.6359\" xlink:href=\"#glyph3-3\" y=\"168\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"158.6389\" xlink:href=\"#glyph4-1\" y=\"172\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"54.2336\" xlink:href=\"#glyph2-14\" y=\"16\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"60.7334\" xlink:href=\"#glyph2-15\" y=\"16\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"62.7332\" xlink:href=\"#glyph2-11\" y=\"16\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"67.739\" xlink:href=\"#glyph2-11\" y=\"16\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"72.7448\" xlink:href=\"#glyph2-4\" y=\"16\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"77.7506\" xlink:href=\"#glyph2-12\" y=\"16\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"85.2566\" xlink:href=\"#glyph2-5\" y=\"16\"/>\n",
       "  <use x=\"89.7566\" xlink:href=\"#glyph2-6\" y=\"16\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"92.2568\" xlink:href=\"#glyph2-8\" y=\"16\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"97.2626\" xlink:href=\"#glyph2-6\" y=\"16\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"99.7628\" xlink:href=\"#glyph2-4\" y=\"16\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"70.9988\" xlink:href=\"#glyph3-4\" y=\"26.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"77.4983\" xlink:href=\"#glyph4-1\" y=\"30.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"79.9985\" xlink:href=\"#glyph4-2\" y=\"30.2944\"/>\n",
       "  <use x=\"82.9955\" xlink:href=\"#glyph4-3\" y=\"30.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"346\" xlink:href=\"#glyph3-4\" y=\"21.6894\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"352.4995\" xlink:href=\"#glyph4-1\" y=\"25.6894\"/>\n",
       "</g>\n",
       "<path d=\"M 156 416 L 184 416 L 184 432 L 156 432 Z M 156 416 \" style=\"fill-rule:nonzero;fill:rgb(39.99939%,74.902344%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"12.2864\" xlink:href=\"#glyph0-1\" y=\"195.5\"/>\n",
       "</g>\n",
       "<path d=\"M 476 420 L 498.101562 420 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 502.101562 420 L 498.101562 420 M 498.101562 418.5 L 502.101562 420 L 498.101562 421.5 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 485 432 L 485 426 C 485 422.6875 487.6875 420 491 420 L 501.789062 420 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 396 431 L 418.101562 431 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 422.101562 431 L 418.101562 431 M 418.101562 429.5 L 422.101562 431 L 418.101562 432.5 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 396 431 L 402 431 C 405.3125 431 408 428.3125 408 425 L 408 420.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 408 416.898438 L 408 420.898438 M 406.5 420.898438 L 408 416.898438 L 409.5 420.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 305.65625 418.34375 C 308.78125 421.46875 308.78125 426.53125 305.65625 429.65625 C 302.53125 432.78125 297.46875 432.78125 294.34375 429.65625 C 291.21875 426.53125 291.21875 421.46875 294.34375 418.34375 C 297.46875 415.21875 302.53125 415.21875 305.65625 418.34375 \" style=\"fill-rule:nonzero;fill:rgb(69.804382%,85.098267%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"142.0029\" xlink:href=\"#glyph1-1\" y=\"194.5\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"161.4912\" xlink:href=\"#glyph2-16\" y=\"190\"/>\n",
       "  <use x=\"167.4942\" xlink:href=\"#glyph2-17\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"169.494\" xlink:href=\"#glyph2-4\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"174.4998\" xlink:href=\"#glyph2-18\" y=\"190\"/>\n",
       "  <use x=\"181.9968\" xlink:href=\"#glyph2-4\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"187.0026\" xlink:href=\"#glyph2-12\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"192.0084\" xlink:href=\"#glyph2-6\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"194.5086\" xlink:href=\"#glyph2-2\" y=\"190\"/>\n",
       "  <use x=\"197.5056\" xlink:href=\"#glyph2-19\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"204.0054\" xlink:href=\"#glyph2-15\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"206.0052\" xlink:href=\"#glyph2-5\" y=\"190\"/>\n",
       "  <use x=\"210.5052\" xlink:href=\"#glyph2-4\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"170.7417\" xlink:href=\"#glyph2-20\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"177.7419\" xlink:href=\"#glyph2-10\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"182.7477\" xlink:href=\"#glyph2-4\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"187.7535\" xlink:href=\"#glyph2-21\" y=\"200.2944\"/>\n",
       "  <use x=\"190.7505\" xlink:href=\"#glyph2-8\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"195.7563\" xlink:href=\"#glyph2-6\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"198.2565\" xlink:href=\"#glyph2-22\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"203.2623\" xlink:href=\"#glyph2-21\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<path d=\"M 391.949219 320 L 391.996094 265.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 392 261.898438 L 391.996094 265.898438 M 390.496094 265.898438 L 392 261.898438 L 393.496094 265.902344 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 424 284 L 430.101562 284 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 434.101562 284 L 430.101562 284 M 430.101562 282.5 L 434.101562 284 L 430.101562 285.5 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"340.4841\" xlink:href=\"#glyph2-23\" y=\"84.6667\"/>\n",
       "  <use x=\"346.9839\" xlink:href=\"#glyph2-8\" y=\"84.6667\"/>\n",
       "  <use x=\"351.9897\" xlink:href=\"#glyph2-12\" y=\"84.6667\"/>\n",
       "  <use x=\"356.9955\" xlink:href=\"#glyph2-11\" y=\"84.6667\"/>\n",
       "  <use x=\"362.0013\" xlink:href=\"#glyph2-15\" y=\"84.6667\"/>\n",
       "  <use x=\"364.0011\" xlink:href=\"#glyph2-11\" y=\"84.6667\"/>\n",
       "  <use x=\"369.0069\" xlink:href=\"#glyph2-8\" y=\"84.6667\"/>\n",
       "  <use x=\"374.0127\" xlink:href=\"#glyph2-6\" y=\"84.6667\"/>\n",
       "  <use x=\"376.5165\" xlink:href=\"#glyph2-4\" y=\"84.6667\"/>\n",
       "  <use x=\"381.5223\" xlink:href=\"#glyph2-24\" y=\"84.6667\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"335.7336\" xlink:href=\"#glyph2-14\" y=\"94.9611\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"342.2334\" xlink:href=\"#glyph2-15\" y=\"94.9611\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"344.2332\" xlink:href=\"#glyph2-11\" y=\"94.9611\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"349.239\" xlink:href=\"#glyph2-11\" y=\"94.9611\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"354.2448\" xlink:href=\"#glyph2-4\" y=\"94.9611\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"359.2506\" xlink:href=\"#glyph2-12\" y=\"94.9611\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"364.2564\" xlink:href=\"#glyph2-24\" y=\"94.9611\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"366.7566\" xlink:href=\"#glyph2-5\" y=\"94.9611\"/>\n",
       "  <use x=\"371.2566\" xlink:href=\"#glyph2-6\" y=\"94.9611\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"373.7568\" xlink:href=\"#glyph2-8\" y=\"94.9611\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"378.7626\" xlink:href=\"#glyph2-6\" y=\"94.9611\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"381.2628\" xlink:href=\"#glyph2-4\" y=\"94.9611\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"356.5\" xlink:href=\"#glyph3-4\" y=\"110.2555\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"362.9995\" xlink:href=\"#glyph4-1\" y=\"114.2555\"/>\n",
       "</g>\n",
       "<path d=\"M 458.277344 327.933594 L 484 327.816406 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-dasharray:1,4;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"358.3721\" xlink:href=\"#glyph2-25\" y=\"104.6667\"/>\n",
       "</g>\n",
       "<path d=\"M 391.972656 295.105469 L 392.203125 289.742188 C 392.339844 286.53125 394.984375 284 398.195312 284 L 402.101562 284 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 406.101562 284 L 402.101562 284 M 402.101562 282.5 L 406.101562 284 L 402.101562 285.5 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 449.65625 246.34375 C 452.78125 249.46875 452.78125 254.53125 449.65625 257.65625 C 446.53125 260.78125 441.46875 260.78125 438.34375 257.65625 C 435.21875 254.53125 435.21875 249.46875 438.34375 246.34375 C 441.46875 243.21875 446.53125 243.21875 449.65625 246.34375 \" style=\"fill-rule:nonzero;fill:rgb(69.804382%,85.098267%,100%);fill-opacity:1;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"286.3721\" xlink:href=\"#glyph2-26\" y=\"23.5\"/>\n",
       "</g>\n",
       "<path d=\"M 444 276 L 444 265.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 444 261.898438 L 444 265.898438 M 442.5 265.898438 L 444 261.898438 L 445.5 265.898438 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 400 252 L 430.101562 252 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 434.101562 252 L 430.101562 252 M 430.101562 250.5 L 434.101562 252 L 430.101562 253.5 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 452 252 L 490.101562 252.136719 \" style=\"fill:none;stroke-width:1;stroke-linecap:round;stroke-linejoin:round;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<path d=\"M 494.101562 252.148438 L 490.101562 252.136719 M 490.105469 250.636719 L 494.101562 252.148438 L 490.09375 253.636719 \" style=\"fill:none;stroke-width:1;stroke-linecap:butt;stroke-linejoin:miter;stroke:rgb(0%,0%,0%);stroke-opacity:1;stroke-miterlimit:10;\" transform=\"matrix(1,0,0,1,-155,-231)\"/>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"49.7449\" xlink:href=\"#glyph2-27\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"55.2421\" xlink:href=\"#glyph2-23\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"64.2421\" xlink:href=\"#glyph2-17\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"66.2419\" xlink:href=\"#glyph2-8\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"71.2477\" xlink:href=\"#glyph2-28\" y=\"190\"/>\n",
       "  <use x=\"75.7477\" xlink:href=\"#glyph2-4\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"80.7535\" xlink:href=\"#glyph2-21\" y=\"190\"/>\n",
       "  <use x=\"83.7505\" xlink:href=\"#glyph2-24\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"86.2507\" xlink:href=\"#glyph2-19\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"92.7505\" xlink:href=\"#glyph2-15\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"94.7503\" xlink:href=\"#glyph2-6\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"97.2505\" xlink:href=\"#glyph2-13\" y=\"190\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"42.4807\" xlink:href=\"#glyph2-8\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"47.4865\" xlink:href=\"#glyph2-29\" y=\"200.2944\"/>\n",
       "  <use x=\"51.9865\" xlink:href=\"#glyph2-6\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"54.4867\" xlink:href=\"#glyph2-15\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"56.4865\" xlink:href=\"#glyph2-30\" y=\"200.2944\"/>\n",
       "  <use x=\"60.9865\" xlink:href=\"#glyph2-8\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"65.9923\" xlink:href=\"#glyph2-6\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"68.4925\" xlink:href=\"#glyph2-15\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"70.4923\" xlink:href=\"#glyph2-22\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"75.4981\" xlink:href=\"#glyph2-12\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"80.5039\" xlink:href=\"#glyph2-24\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"83.0041\" xlink:href=\"#glyph2-31\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"85.5043\" xlink:href=\"#glyph2-32\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"90.5101\" xlink:href=\"#glyph2-29\" y=\"200.2944\"/>\n",
       "  <use x=\"95.0101\" xlink:href=\"#glyph2-6\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"97.5103\" xlink:href=\"#glyph2-15\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"99.5101\" xlink:href=\"#glyph2-22\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"104.5159\" xlink:href=\"#glyph2-12\" y=\"200.2944\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"357.481\" xlink:href=\"#glyph2-23\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"363.9808\" xlink:href=\"#glyph2-22\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"368.9866\" xlink:href=\"#glyph2-12\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"373.9924\" xlink:href=\"#glyph2-29\" y=\"194\"/>\n",
       "  <use x=\"378.4924\" xlink:href=\"#glyph2-8\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"383.4982\" xlink:href=\"#glyph2-6\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"385.9984\" xlink:href=\"#glyph2-4\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"391.0042\" xlink:href=\"#glyph2-12\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"396.01\" xlink:href=\"#glyph2-8\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"401.0158\" xlink:href=\"#glyph2-6\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"403.516\" xlink:href=\"#glyph2-4\" y=\"194\"/>\n",
       "</g>\n",
       "<g style=\"fill:rgb(0%,0%,0%);fill-opacity:1;\">\n",
       "  <use x=\"278.4949\" xlink:href=\"#glyph2-23\" y=\"194\"/>\n",
       "  <use x=\"284.9947\" xlink:href=\"#glyph2-22\" y=\"194\"/>\n",
       "  <use x=\"290.0005\" xlink:href=\"#glyph2-10\" y=\"194\"/>\n",
       "  <use x=\"295.0063\" xlink:href=\"#glyph2-28\" y=\"194\"/>\n",
       "</g>\n",
       "</g>\n",
       "</svg>"
      ],
      "text/plain": [
       "<IPython.core.display.SVG object>"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "SVG(filename= '../img/gru_3.svg')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Fig. 10.8.3: Hidden state computation in a GRU. As before, the multiplication is carried out elementwise."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Initialize Model Parameters\n",
    "\n",
    "The next step is to initialize the model parameters. We draw the weights from a Gaussian with variance 0.01 and set the\n",
    "bias to 0. The hyper-parameter *num_hiddens* defines the number of hidden units. We instantiate all terms relating to\n",
    "update and reset gate and the candidate hidden state itself. Subsequently we attach gradients to all parameters."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Using cuda:0\n"
     ]
    }
   ],
   "source": [
    "num_inputs, num_hiddens, num_outputs = len(vocab), 256, len(vocab)\n",
    "device = d2l.try_gpu()\n",
    "print('Using', device)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "def get_params():\n",
    "    def _one(shape):\n",
    "        return torch.randn(shape, device=device).normal_(std=0.01)\n",
    "    \n",
    "    def _three():\n",
    "        return (_one((num_inputs, num_hiddens)),\n",
    "                _one((num_hiddens, num_hiddens)),\n",
    "                torch.zeros(num_hiddens, device=device))\n",
    "\n",
    "    W_xz, W_hz, b_z = _three() # Update gate parameter\n",
    "    W_xr, W_hr, b_r = _three() # Reset gate parameter\n",
    "    W_xh, W_hh, b_h = _three() # Candidate hidden state parameter\n",
    "    # Output layer parameters\n",
    "    W_hq = _one((num_hiddens, num_outputs))\n",
    "    b_q = torch.zeros(num_outputs, device=device)\n",
    "    # Create gradient\n",
    "    params = [W_xz, W_hz, b_z, W_xr, W_hr, b_r, W_xh, W_hh, b_h, W_hq, b_q]\n",
    "    for param in params:\n",
    "        param.requires_grad_(True)\n",
    "    return params"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Define the Model\n",
    "\n",
    "Now we will define the hidden state initialization function *init_gru_state*. Just *like the init_rnn_state*\n",
    "function defined in Section 10.5, this function returns a tuple composed of an tesor with a shape (batch size, number\n",
    "of hidden units) and with all values set to 0."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "def init_gru_state(batch_size, num_hiddens, device):\n",
    "    return (torch.zeros(size=(batch_size, num_hiddens), device=device), )"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we are ready to define the actual model. Its structure is the same as the basic RNN cell, just that the update equations\n",
    "are more complex."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "def gru(inputs, state, params):\n",
    "    W_xz, W_hz, b_z, W_xr, W_hr, b_r, W_xh, W_hh, b_h, W_hq, b_q = params\n",
    "    H, = state\n",
    "    outputs = []\n",
    "    for X in inputs:\n",
    "        m = nn.Sigmoid()\n",
    "        Z = m(torch.matmul(X.float(), W_xz) + torch.matmul(H.float(), W_hz) + b_z)\n",
    "        R = m(torch.matmul(X.float(), W_xr) + torch.matmul(H.float(), W_hr) + b_r)\n",
    "        h = nn.Tanh()\n",
    "        H_tilda = h(torch.matmul(X.float(), W_xh) + torch.matmul(R * H.float(), W_hh) + b_h)\n",
    "        H = Z * H.float() + (1 - Z) * H_tilda\n",
    "        Y = torch.matmul(H.float(), W_hq) + b_q\n",
    "        outputs.append(Y)\n",
    "    return outputs, (H,)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Training and Prediction\n",
    "\n",
    "Training and prediction work in exactly the same manner as before. That is, we need to define a number of epochs,\n",
    "a number of steps for truncation, the minibatch size, a learning rate and how aggressively we should be clipping the\n",
    "gradients. Lastly we create a string of 50 characters based on the prefixes *traveller* and *time traveller*."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "epoch 50, perplexity 11.854904, time 14.74 sec\n",
      "epoch 100, perplexity 9.288425, time 15.87 sec\n",
      " - travellere the the the the the the the the the the the the \n",
      " - time travellere the the the the the the the the the the the the \n"
     ]
    }
   ],
   "source": [
    "num_epochs, num_steps, batch_size, lr, clipping_theta = 100, 35, 32, 1, 1\n",
    "prefixes = ['traveller', 'time traveller']\n",
    "train_and_predict_rnn(gru, get_params, init_gru_state, num_hiddens,\n",
    "                      corpus_indices, vocab, device, False, num_epochs,\n",
    "                      num_steps, lr, clipping_theta, batch_size, prefixes)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Concise Implementation\n",
    "\n",
    "In nn module, we can directly call the $GRU$ class in the $rnn$ module. This encapsulates all the configuration details that we\n",
    "made explicit above. The code is significantly faster as it uses compiled operators rather than Python for many details that\n",
    "we spelled out in detail before."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "epoch 125, perplexity 6.661607, time 39.45 sec\n",
      "epoch 250, perplexity 1.347627, time 38.69 sec\n",
      " - traveller smiled round at us. then, still smich, which are \n",
      " - time traveller smiled round at us. then, still smich, which are \n",
      "epoch 375, perplexity 1.066841, time 39.30 sec\n",
      "epoch 500, perplexity 1.040950, time 39.49 sec\n",
      " - traveller smiled. 'are you sure we can move freely in space\n",
      " - time traveller smiled. 'are you sure we can move freely in space\n"
     ]
    }
   ],
   "source": [
    "gru_layer = nn.GRU(input_size=num_inputs, hidden_size=num_hiddens)\n",
    "model = RNNModel(gru_layer, num_hiddens, len(vocab))\n",
    "model.to(device)\n",
    "train_and_predict_rnn_nn(model, num_hiddens, init_gru_state, corpus_indices, vocab,\n",
    "                            device, num_epochs*5, num_steps, lr,\n",
    "                            clipping_theta, batch_size, prefixes)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Summary\n",
    "\n",
    "* Gated recurrent neural networks are better at capturing dependencies for time series with large time step distances.\n",
    "* Reset gates help capture short-term dependencies in time series.\n",
    "* Update gates help capture long-term dependencies in time series.\n",
    "* GRUs contain basic RNNs as their extreme case whenever the reset gate is switched on. They can ignore sequences\n",
    "as needed."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Exercises\n",
    "\n",
    "1) Compare runtimes, perplexity and the extracted strings for rnn.RNN and rnn.GRU implementations with each other.\n",
    "\n",
    "2) Assume that we only want to use the input for time step t ′ to predict the output at time step t > t ′ . What are the best values for reset and update gates for each time step?\n",
    "\n",
    "3) Adjust the hyper-parameters and observe and analyze the impact on running time, perplexity, and the written lyrics.\n",
    "\n",
    "4) What happens if you implement only parts of a GRU? That is, implement a recurrent cell that only has a reset gate. Likewise, implement a recurrent cell only with an update gate."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# References\n",
    "\n",
    "[1] Cho, K., Van Merriënboer, B., Bahdanau, D., & Bengio, Y. (2014). On the properties of neural machine translation:\n",
    "Encoder-decoder approaches. arXiv preprint arXiv:1409.1259.\n",
    "\n",
    "[2] Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on\n",
    "sequence modeling. arXiv preprint arXiv:1412.3555."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.8"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}