advanced-search.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "__version__ = '20201120'"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# [NOIRLab](https://nationalastro.org/) - [Astro Data Archive](https://astroarchive.noao.edu/): [Advanced Search](https://astroarchive.noao.edu/api/docs/)\n",
    "\n",
    "\n",
    "[Community Science and Data Center](https://nationalastro.org/programs/csdc/)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Table Of Contents:\n",
    "* [Goals & notebook summary](#goals)\n",
    "* [Summary of this API (list of web services)](#summary)\n",
    "* [Imports and setup](#init)\n",
    "* [Details](#details); Example of every service. Special cases. Error Handling\n",
    "  * [Verify API Version](#version)\n",
    "\n",
    "  * [Get Core File fields](#core_file)\n",
    "  * [Get Aux File fields](#aux_file)\n",
    "  * [Search Files](#file_search)\n",
    "    * [Find files that are downloadable by guest (not proprietary)](#find_downloadable)\n",
    "    * [Get a URL that can be used to retrieve a FITS file](#get_retrieve_url)\n",
    "    * [Examples of Search Constraints](#constraint_examples)\n",
    "  * [Find public data](#get_public) \n",
    "  * [Get Core HDU fields](#core_hdu)\n",
    "  * [Get Aux HDU fields](#aux_hdu)\n",
    "  * [Search HDUs](#hdu_search)\n",
    "  \n",
    "* [What if something goes wrong](#errors) (errors)\n",
    "\n",
    "* [Resources and references](#doc)\n",
    "* [Glossary](#glos)\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a class=\"anchor\" id=\"goals\"></a>\n",
    "# Goals\n",
    "Instructions and examples for using Advanced Search API for accessing OIRLab Archive metadata.\n",
    "\n",
    "# Notebook Summary\n",
    "We show you how to use the API to search the Archive for FITS files by **any** field in the FITS headers.\n",
    "\n",
    "Note that the Archive maintains separate metadata tables for the Primary FITS HDUs (referred to as FitsFiles throughout) and the HDU extensions (referred to as HDUs throughout), and thus there are separate services for each.  When constructing a query, the user should first consider whether the information needed is something that would apply to the entire focal plane of the instrument (and so would want to use the FitsFile services), or whether searching the HDU extensions is needed (requiring use of the HDU services).  In addition, both the FitsFile and HDU tables have sets of \"Core\" and \"Auxiliary\" header fields, where the Core fields are optimized for fast searches. \n",
    "\n",
    "Because the data volume is orders of magnitude smaller, the FitsFile services are considerably faster.  Using only Core fields in a search will also substantially increase speed.  For an example that uses both FitsFile and HDU searches, as well as a mix of Core and Aux fields, see the exposure-map.ipynb notebook in this repository.\n",
    "\n",
    "The _find_ service call usesa _limit_ parameter which reduces the amount of output and may speed up the search.  If you don't think you are getting all your results, increase the limit parameter!  The limit defaults to something low to avoid accidentaly running very long searches. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Summary of this API (list of web services) <a id=\"summary\">\n",
    "For full list, see: [/api/docs/#/api](https://astroarchive1.dm.noao.edu/api/docs/#/api)\n",
    "\n",
    "1. [GET] `{ADS}/aux_file_fields/{instrument}/{proctype}/`\n",
    "   Get fieldnames available from FitsFiles.\n",
    "3. [GET] `{ADS}/aux_hdu_fields/{instrument}/{proctype}/`\n",
    "   Get fieldnames available from HDUs.\n",
    "5. [GET] `{ADS}/core_file_fields/`\n",
    "7. [GET] `{ADS}/core_hdu_fields/`\n",
    "9. [POST] `{ADS}/find/`\n",
    "\n",
    "Services of form `core_<type>_fields` (where <type> is one of: \"file\",\"hdu\") return the list of optimized fields you can search against. \n",
    "\n",
    "Services of form `aux_<type>_fields` (where <type> is one of: \"file\",\"hdu\") are used to return ALL of the FITS header field names that are not alreay included in the \"core\" lists.  These services require a specific Instrument and Proc_type [define!!!] be given. These fields have no search optimizations so using any of these will slow down your searches.\n",
    "\n",
    "The `find` Service (File/Hdu Advanced SEARCH) performs a search against full FITS files or individual HDUs within a FITS files. They are accessed via a  HTTP POST (link) that takes a search specification in its JSON payload.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Imports and setup <a id=\"init\">\n",
    "Some of this is just for presentation in the juypter notebook.  You may not need it all."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Using Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0]\n",
      "\n",
      "This Jupyter Notebook uses (some of) these packages:\n",
      "\n",
      "# jupyter-lab --ip=0.0.0.0\n",
      "# jupyterlab # =3.1.17\n",
      "\n",
      "#pandas==1.1.4\n",
      "pandas==2.0.1\n",
      "#matplotlib==3.3.3\n",
      "matplotlib==3.7.1\n",
      "jupyter==1.0.0\n",
      "#requests==2.25.0\n",
      "requests==2.29.0\n",
      "#astropy==4.1\n",
      "astropy==5.2.2\n",
      "#pytest==6.1.2\n",
      "pytest==7.3.1\n",
      "#healpy==1.14.0\n",
      "healpy==1.16.1\n",
      "\n"
     ]
    }
   ],
   "source": [
    "import sys\n",
    "import pandas as pd\n",
    "import matplotlib.pyplot as plt\n",
    "import matplotlib\n",
    "import numpy as np\n",
    "import astropy.io.fits as pyfits\n",
    "import astropy.utils as autils\n",
    "import requests\n",
    "import json\n",
    "from pprint import pprint as pp  # pretty print\n",
    "\n",
    "print(f'Using Python version: {sys.version}\\n')\n",
    "with open (\"requirements.txt\", \"r\") as f:\n",
    "    data=f.readlines()\n",
    "print(f'This Jupyter Notebook uses (some of) these packages:\\n\\n{\"\".join(data)}')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Using server on https://astroarchive.noirlab.edu\n",
      "About NSF's OIR Lab Astro Data Archive: https://astroarchive.noirlab.edu/about/\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "'https://astroarchive.noirlab.edu/api/adv_search'"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# UTILS are settings for HOST etc. that you won't need to use the API\n",
    "# but are used here to make this notebook more portable.\n",
    "%run utils.ipynb\n",
    "tic() # start tracking time of Notebook load\n",
    "\n",
    "adsurl = f'{natroot}/api/adv_search'\n",
    "adsurl"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Details <a id=\"details\">\n",
    "    \n",
    "* [Verify API Version](#version)\n",
    "    \n",
    "* [Get Core File fields](#core_file)    \n",
    "* [Get Aux File fields](#aux_file)\n",
    "* [Search Files](#file_search)\n",
    "  \n",
    "* [Get Core HDU fields](#core_hdu)\n",
    "* [Get Aux HDU fields](#aux_hdu)\n",
    "* [Search HDUs](#hdu_search)\n",
    "  \n",
    "* [What if something goes wrong](#errors) (errors)\n",
    "\n",
    "Notes: \n",
    "- `File` fields and searches refer to the Primary HDU of a FITS file. (the field names may be a little different from how they appear in the FITS header since not all FITS headers use the same keywords for the same thing.)  \n",
    "\n",
    "- `HDU` fields and searches refer to the non-primary HDUs of a FITS file. There are up to 70 times more HDU records as File records (depending on the source of the FITS file).\n",
    "\n",
    "- All of these web services accept a `format` parameter in the HTTP query string.  This defines the format of the output. It can be one of: json (the default), csv, xml\n",
    "\n",
    "- For the sake readability in this notebook, output is often stored in a Pandas DataFrame for display.\n",
    "\n",
    "- Searches in this notebook use a `limit` parameter to reduce the number of records returned.\n",
    "\n",
    "- Strings accept search modifiers: _exact, iexact, startswith, istartswith, endswith, iendswith, contains, icontains, regex, iregex_ (as described in [Django QuerySet API](https://docs.djangoproject.com/en/2.2/ref/models/querysets/)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Verify API Version  <a id=\"version\" />"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Current server API version (6.0) is good for this notebook.\n"
     ]
    }
   ],
   "source": [
    "actual_api = float(requests.get(f'{natroot}/api/version').content)\n",
    "expected_api = 6.0\n",
    "if int(actual_api) > int(expected_api):\n",
    "    msg = f'This notebook needs to be updated to work with API Version {actual_api}'\n",
    "    print(msg)\n",
    "    raise Exception(msg)\n",
    "else:\n",
    "    print(f'Current server API version ({actual_api}) is good for this notebook.')\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get Core and Aux fields for Files and HDUs\n",
    "Retrieve list of fields (with data-types) to use later in specifying which fields to filter and which ones to return in the filtered results.\n",
    "### Get Core File field names and types <a id=\"core_file\" />\n",
    "These occur once per FITS file and are optimized for fast search. Output is field-name, data-type pairs.  The data-types are intended to be used with Pandas. Note that \"catagory\" types refer to relatively small sets of acceptable values.  These sets have values added to them occasionally."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "      <th>...</th>\n",
       "      <th>20</th>\n",
       "      <th>21</th>\n",
       "      <th>22</th>\n",
       "      <th>23</th>\n",
       "      <th>24</th>\n",
       "      <th>25</th>\n",
       "      <th>26</th>\n",
       "      <th>27</th>\n",
       "      <th>28</th>\n",
       "      <th>29</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>Field</th>\n",
       "      <td>archive_filename</td>\n",
       "      <td>caldat</td>\n",
       "      <td>dateobs_center</td>\n",
       "      <td>dateobs_max</td>\n",
       "      <td>dateobs_min</td>\n",
       "      <td>dec_center</td>\n",
       "      <td>dec_max</td>\n",
       "      <td>dec_min</td>\n",
       "      <td>depth</td>\n",
       "      <td>exposure</td>\n",
       "      <td>...</td>\n",
       "      <td>ra_center</td>\n",
       "      <td>ra_max</td>\n",
       "      <td>ra_min</td>\n",
       "      <td>release_date</td>\n",
       "      <td>seeing</td>\n",
       "      <td>site</td>\n",
       "      <td>survey</td>\n",
       "      <td>telescope</td>\n",
       "      <td>updated</td>\n",
       "      <td>url</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Type</th>\n",
       "      <td>str</td>\n",
       "      <td>datetime64</td>\n",
       "      <td>datetime64</td>\n",
       "      <td>datetime64</td>\n",
       "      <td>datetime64</td>\n",
       "      <td>np.float64</td>\n",
       "      <td>str</td>\n",
       "      <td>str</td>\n",
       "      <td>np.float64</td>\n",
       "      <td>np.float64</td>\n",
       "      <td>...</td>\n",
       "      <td>np.float64</td>\n",
       "      <td>str</td>\n",
       "      <td>str</td>\n",
       "      <td>datetime64</td>\n",
       "      <td>np.float64</td>\n",
       "      <td>category</td>\n",
       "      <td>category</td>\n",
       "      <td>category</td>\n",
       "      <td>datetime64</td>\n",
       "      <td>str</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Desc</th>\n",
       "      <td>Filename assigned by the Archive</td>\n",
       "      <td>The local calendar date of the telescope, at t...</td>\n",
       "      <td>DATE-OBS midpoint of range</td>\n",
       "      <td>DATE-OBS min,max</td>\n",
       "      <td>DATE-OBS min,max</td>\n",
       "      <td>DEC center from pipeline processing</td>\n",
       "      <td>DEC min,max range of HDU</td>\n",
       "      <td>DEC min,max range of HDU</td>\n",
       "      <td>from hdr=PHOTDPTH</td>\n",
       "      <td>from hdr=EXPTIME</td>\n",
       "      <td>...</td>\n",
       "      <td>RA center from pipeline processing</td>\n",
       "      <td>RA min,max range of HDU</td>\n",
       "      <td>RA min,max range of HDU</td>\n",
       "      <td>Calculated</td>\n",
       "      <td>from hdr=SEEING</td>\n",
       "      <td>Telescope / observatory locale from which orig...</td>\n",
       "      <td></td>\n",
       "      <td>Name of the telescope from which original raw ...</td>\n",
       "      <td>When Hdu created/updated</td>\n",
       "      <td>Access URL. Used to retrieve image</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>3 rows × 30 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                     0    \n",
       "Field                  archive_filename  \\\n",
       "Type                                str   \n",
       "Desc   Filename assigned by the Archive   \n",
       "\n",
       "                                                      1    \n",
       "Field                                             caldat  \\\n",
       "Type                                          datetime64   \n",
       "Desc   The local calendar date of the telescope, at t...   \n",
       "\n",
       "                               2                 3                 4    \n",
       "Field              dateobs_center       dateobs_max       dateobs_min  \\\n",
       "Type                   datetime64        datetime64        datetime64   \n",
       "Desc   DATE-OBS midpoint of range  DATE-OBS min,max  DATE-OBS min,max   \n",
       "\n",
       "                                        5                         6    \n",
       "Field                           dec_center                   dec_max  \\\n",
       "Type                            np.float64                       str   \n",
       "Desc   DEC center from pipeline processing  DEC min,max range of HDU   \n",
       "\n",
       "                             7                  8                 9   ...   \n",
       "Field                   dec_min              depth          exposure  ...  \\\n",
       "Type                        str         np.float64        np.float64  ...   \n",
       "Desc   DEC min,max range of HDU  from hdr=PHOTDPTH  from hdr=EXPTIME  ...   \n",
       "\n",
       "                                       20                       21   \n",
       "Field                           ra_center                   ra_max  \\\n",
       "Type                           np.float64                      str   \n",
       "Desc   RA center from pipeline processing  RA min,max range of HDU   \n",
       "\n",
       "                            22            23               24   \n",
       "Field                   ra_min  release_date           seeing  \\\n",
       "Type                       str    datetime64       np.float64   \n",
       "Desc   RA min,max range of HDU    Calculated  from hdr=SEEING   \n",
       "\n",
       "                                                      25        26   \n",
       "Field                                               site    survey  \\\n",
       "Type                                            category  category   \n",
       "Desc   Telescope / observatory locale from which orig...             \n",
       "\n",
       "                                                      27   \n",
       "Field                                          telescope  \\\n",
       "Type                                            category   \n",
       "Desc   Name of the telescope from which original raw ...   \n",
       "\n",
       "                             28                                  29  \n",
       "Field                   updated                                 url  \n",
       "Type                 datetime64                                 str  \n",
       "Desc   When Hdu created/updated  Access URL. Used to retrieve image  \n",
       "\n",
       "[3 rows x 30 columns]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pd.DataFrame(requests.get(f'{adsurl}/core_file_fields').json()).transpose()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Get allowable values for all Categories (see above for fields that are categories)\n",
    "Fields that are Categories have a fixed number of valid values, and have Type=category. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'instruments': ['(p)odi',\n",
       "  '90prime',\n",
       "  'andicam',\n",
       "  'arcoiris',\n",
       "  'arcon',\n",
       "  'bench',\n",
       "  'ccd_imager',\n",
       "  'ccd_spec',\n",
       "  'chiron',\n",
       "  'cosmos',\n",
       "  'cpapir',\n",
       "  'decam',\n",
       "  'echelle',\n",
       "  'falmingos',\n",
       "  'flamingos',\n",
       "  'ghts_blue',\n",
       "  'ghts_blue_imager',\n",
       "  'ghts_red',\n",
       "  'ghts_red_imager',\n",
       "  'goodman',\n",
       "  'goodman spectrograph',\n",
       "  'gtcam',\n",
       "  'hdi',\n",
       "  'hlsp_ir_imager',\n",
       "  'hlsp_mosaic',\n",
       "  'hlsp_mosaic_2',\n",
       "  'ice',\n",
       "  'ir_imager',\n",
       "  'ispi',\n",
       "  'kosmos',\n",
       "  'minimo/ice',\n",
       "  'mop/ice',\n",
       "  'mosaic',\n",
       "  'mosaic3',\n",
       "  'mosaic_1',\n",
       "  'mosaic_1_1',\n",
       "  'mosaic_2',\n",
       "  'newfirm',\n",
       "  'osiris',\n",
       "  'pfccd',\n",
       "  'sami',\n",
       "  'soi',\n",
       "  'spartan',\n",
       "  'spartan ir camera',\n",
       "  'triplespec',\n",
       "  'wfc',\n",
       "  'whirc',\n",
       "  'wildfire',\n",
       "  'y4kcam'],\n",
       " 'obsmodes': ['acq', 'imaging', 'sos_slit', 'spec', 'stare'],\n",
       " 'obstypes': ['acq',\n",
       "  'acquire',\n",
       "  'arc',\n",
       "  'bias',\n",
       "  'calibration',\n",
       "  'calibration or comparison',\n",
       "  'comp',\n",
       "  'comparison',\n",
       "  'dark',\n",
       "  'dflat',\n",
       "  'dome flat',\n",
       "  'dome or projector flat',\n",
       "  'domeflat',\n",
       "  'flat',\n",
       "  'focus',\n",
       "  'fringe',\n",
       "  'fringecor',\n",
       "  'guider',\n",
       "  'illum',\n",
       "  'illumcor',\n",
       "  'illumination calibration',\n",
       "  'junk',\n",
       "  'lampflat',\n",
       "  'none',\n",
       "  'nota',\n",
       "  'obj',\n",
       "  'object',\n",
       "  'phot flat',\n",
       "  'photometric standard',\n",
       "  'projector',\n",
       "  'projector flat',\n",
       "  'pupil',\n",
       "  'red',\n",
       "  'remap',\n",
       "  'sflat',\n",
       "  'sky',\n",
       "  'sky flat',\n",
       "  'skyflat',\n",
       "  'standard',\n",
       "  'std',\n",
       "  'test',\n",
       "  'unknown',\n",
       "  'zero'],\n",
       " 'proctypes': ['instcal',\n",
       "  'mastercal',\n",
       "  'nota',\n",
       "  'projected',\n",
       "  'raw',\n",
       "  'resampled',\n",
       "  'skysub',\n",
       "  'stacked'],\n",
       " 'prodtypes': ['dqmask',\n",
       "  'expmap',\n",
       "  'flag',\n",
       "  'graphics (size)',\n",
       "  'image',\n",
       "  'image 2nd version 1',\n",
       "  'image1',\n",
       "  'ncomb',\n",
       "  'nota',\n",
       "  'nrej',\n",
       "  'resampled',\n",
       "  'rms',\n",
       "  'sigma',\n",
       "  'weight',\n",
       "  'wtmap'],\n",
       " 'sites': ['cp', 'ct', 'kp', 'lp'],\n",
       " 'surveys': [],\n",
       " 'telescopes': ['bok23m',\n",
       "  'ct09m',\n",
       "  'ct13m',\n",
       "  'ct15m',\n",
       "  'ct1m',\n",
       "  'ct4m',\n",
       "  'ctlab',\n",
       "  'kp09m',\n",
       "  'kp21m',\n",
       "  'kp35m',\n",
       "  'kp4m',\n",
       "  'kpcf',\n",
       "  'lp25m',\n",
       "  'soar',\n",
       "  'wiyn']}"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "requests.get(f'{adsurl}/cat_lists/?format=json').json()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Get Aux File field names and types <a id=\"aux_file\" />\n",
    "These occur once per FITS file but will be slower to search.  All keywords from the Primary HDU (except those in Core File Fields) are included. All types default to \"str\", but will refine these in future."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'Field': 'AIRMASS', 'Type': 'str', 'Desc': 'Airmass'},\n",
       " {'Field': 'AOS', 'Type': 'str', 'Desc': 'AOS data available if true'},\n",
       " {'Field': 'ASTIG1', 'Type': 'str', 'Desc': '4MAPS correction 1'},\n",
       " {'Field': 'ASTIG2', 'Type': 'str', 'Desc': '4MAPS correction 2'},\n",
       " {'Field': 'ASTRMREF', 'Type': 'str', 'Desc': 'Astrometric ref. catalog'},\n",
       " {'Field': 'ATTNUM', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'AVSIG', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'AVSKY', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'AZ', 'Type': 'str', 'Desc': 'Telescope azimuth'},\n",
       " {'Field': 'BAND', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'BCAM', 'Type': 'str', 'Desc': 'BCAM data available if true'},\n",
       " {'Field': 'BCAMAX', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'BCAMAY', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'BCAMAZ', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'BCAMDX', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'BCAMDY', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'BFCFIL', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'BUNIT', 'Type': 'str', 'Desc': 'photoelectrons per second'},\n",
       " {'Field': 'CAMSHUT',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Camera shutter at exposure start'},\n",
       " {'Field': 'CAMSYM', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CCDBIN1', 'Type': 'str', 'Desc': 'Binning factor along axis 1'},\n",
       " {'Field': 'CCDBIN2', 'Type': 'str', 'Desc': 'Binning factor along axis 2'},\n",
       " {'Field': 'CCDSEC', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CENTDEC', 'Type': 'str', 'Desc': '[deg] DEC center of exposure'},\n",
       " {'Field': 'CENTRA', 'Type': 'str', 'Desc': '[deg] RA center of exposure'},\n",
       " {'Field': 'CONSTVER', 'Type': 'str', 'Desc': 'SISPI constants version'},\n",
       " {'Field': 'CORN1DEC', 'Type': 'str', 'Desc': '[deg] DEC corner of exposure'},\n",
       " {'Field': 'CORN1RA', 'Type': 'str', 'Desc': '[deg] RA corner of exposure'},\n",
       " {'Field': 'CORN2DEC', 'Type': 'str', 'Desc': '[deg] DEC corner of exposure'},\n",
       " {'Field': 'CORN2RA', 'Type': 'str', 'Desc': '[deg] RA corner of exposure'},\n",
       " {'Field': 'CORN3DEC', 'Type': 'str', 'Desc': '[deg] DEC corner of exposure'},\n",
       " {'Field': 'CORN3RA', 'Type': 'str', 'Desc': '[deg] RA corner of exposure'},\n",
       " {'Field': 'CORN4DEC', 'Type': 'str', 'Desc': '[deg] DEC corner of exposure'},\n",
       " {'Field': 'CORN4RA', 'Type': 'str', 'Desc': '[deg] RA corner of exposure'},\n",
       " {'Field': 'CORNDEC1', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CORNDEC2', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CORNDEC3', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CORNDEC4', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CORNRA1', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CORNRA2', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CORNRA3', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CORNRA4', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CROSSRA0', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DARKTIME', 'Type': 'str', 'Desc': 'Total elapsed time in secs'},\n",
       " {'Field': 'DATASEC', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DATE', 'Type': 'str', 'Desc': 'Date FITS file was generated'},\n",
       " {'Field': 'DATE-OBS',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Date of observation start (UTC approximate)'},\n",
       " {'Field': 'DEC', 'Type': 'str', 'Desc': 'DEC of observation (deg)'},\n",
       " {'Field': 'DES_EXT', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DESNSTRK', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DESREL', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DETSIZE', 'Type': 'str', 'Desc': 'Detector size for DETSEC'},\n",
       " {'Field': 'DHEFIRM', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DHEINF', 'Type': 'str', 'Desc': 'controller info'},\n",
       " {'Field': 'DIMM2SEE', 'Type': 'str', 'Desc': '[arcsec] DIMM2 Seeing'},\n",
       " {'Field': 'DIMMSEE', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DODX',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[um] X-decenter from donut analysis'},\n",
       " {'Field': 'DODY',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[um] Y-decenter from donut analysis'},\n",
       " {'Field': 'DODZ', 'Type': 'str', 'Desc': '[um] Delta-Z from donut analysis'},\n",
       " {'Field': 'DOMEAZ', 'Type': 'str', 'Desc': 'Dome azimuth'},\n",
       " {'Field': 'DOMEFLOR',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Dome floor temperature'},\n",
       " {'Field': 'DOMEHIGH', 'Type': 'str', 'Desc': '[deg C] High dome temperature'},\n",
       " {'Field': 'DOMELOW', 'Type': 'str', 'Desc': '[deg C] Low dome temperature'},\n",
       " {'Field': 'DONUTFN1', 'Type': 'str', 'Desc': 'Mean Wavefron'},\n",
       " {'Field': 'DONUTFN2', 'Type': 'str', 'Desc': 'Mean Wavefront'},\n",
       " {'Field': 'DONUTFN3', 'Type': 'str', 'Desc': 'Mean Wavefront f'},\n",
       " {'Field': 'DONUTFN4', 'Type': 'str', 'Desc': 'Mean Wavefront'},\n",
       " {'Field': 'DONUTFS1', 'Type': 'str', 'Desc': 'Mean Wavefront for'},\n",
       " {'Field': 'DONUTFS2', 'Type': 'str', 'Desc': 'Mean Wavefront'},\n",
       " {'Field': 'DONUTFS3', 'Type': 'str', 'Desc': 'Mean Wavefront f'},\n",
       " {'Field': 'DONUTFS4', 'Type': 'str', 'Desc': 'Mean Wavefron'},\n",
       " {'Field': 'DOXT',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[arcsec] X-theta from donut analysis'},\n",
       " {'Field': 'DOYT',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[arcsec] Y-theta from donut analysis'},\n",
       " {'Field': 'DTACCOUN', 'Type': 'str', 'Desc': 'observing account name'},\n",
       " {'Field': 'DTACQNAM', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DTACQUIS',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'host name of data acquisition computer'},\n",
       " {'Field': 'DTCALDAT', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DTCOPYRI', 'Type': 'str', 'Desc': 'copyright holder of data'},\n",
       " {'Field': 'DTINSTRU', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DTNSANAM', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DTOBSERV', 'Type': 'str', 'Desc': 'scheduling institution'},\n",
       " {'Field': 'DTPI', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DTPIAFFL', 'Type': 'str', 'Desc': 'PI affiliation'},\n",
       " {'Field': 'DTPROPID',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Proposal ID validated by Archive'},\n",
       " {'Field': 'DTQUEUE', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DT_RTNAM', 'Type': 'str', 'Desc': 'NSA root name'},\n",
       " {'Field': 'DTSITE',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Telescope / observatory locale from which original raw data was taken'},\n",
       " {'Field': 'DTSTATUS', 'Type': 'str', 'Desc': 'data transport status'},\n",
       " {'Field': 'DTTELESC', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DTTITLE', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DTUTC', 'Type': 'str', 'Desc': 'post exposure UTC epoch from DTS'},\n",
       " {'Field': 'ELLIPTIC', 'Type': 'str', 'Desc': 'Median ELLIPTICITY'},\n",
       " {'Field': 'EQUINOX', 'Type': 'str', 'Desc': 'Equinox of coordinate system'},\n",
       " {'Field': 'ERRORS', 'Type': 'str', 'Desc': 'SISPI readout errors'},\n",
       " {'Field': 'EUPSPROD', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'EUPSVER', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'EXCLUDED',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'DECam components not used for this frame'},\n",
       " {'Field': 'EXPDUR', 'Type': 'str', 'Desc': '[s] Exposure duration'},\n",
       " {'Field': 'EXPNUM', 'Type': 'str', 'Desc': 'Exposure sequence number'},\n",
       " {'Field': 'EXPREQ', 'Type': 'str', 'Desc': '[sec] Exposure time requested'},\n",
       " {'Field': 'EXPTIME', 'Type': 'str', 'Desc': 'Exposure time in secs'},\n",
       " {'Field': 'EXTVER', 'Type': 'str', 'Desc': 'Extension version'},\n",
       " {'Field': 'FADX', 'Type': 'str', 'Desc': '[um] FA Delta X.'},\n",
       " {'Field': 'FADY', 'Type': 'str', 'Desc': '[um] FA Delta Y.'},\n",
       " {'Field': 'FADZ', 'Type': 'str', 'Desc': '[um] FA Delta focus.'},\n",
       " {'Field': 'FAXT', 'Type': 'str', 'Desc': '[arcsec] FA Delta X-theta.'},\n",
       " {'Field': 'FAYT', 'Type': 'str', 'Desc': '[arcsec] FA Delta Y-theta.'},\n",
       " {'Field': 'FILENAME', 'Type': 'str', 'Desc': 'Original host filename'},\n",
       " {'Field': 'FILTER', 'Type': 'str', 'Desc': 'Filter name(s)'},\n",
       " {'Field': 'FILTPOS', 'Type': 'str', 'Desc': 'Instrument filter position'},\n",
       " {'Field': 'FWHM', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'FZALGOR', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'FZDTHRSD', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'FZQMETHD', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'FZQVALUE', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'G-CCDNUM',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Number of guide CCDs that remained active'},\n",
       " {'Field': 'G-FEEDBK', 'Type': 'str', 'Desc': '[%] Guider feedback (HA, dec)'},\n",
       " {'Field': 'G-FLXVAR',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[arcsec] Guider mean guide star flux variances'},\n",
       " {'Field': 'G-LATENC',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[s] Guider avg. latency between exposures'},\n",
       " {'Field': 'G-MAXX',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[arcsec] Guider x-axis maximum offset'},\n",
       " {'Field': 'G-MAXY',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[arcsec] Guider y-axis maximum offset'},\n",
       " {'Field': 'G-MEANX',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[arcsec] Guider x-axis mean offset'},\n",
       " {'Field': 'G-MEANX2',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[arcsec2] Guider (x) 2nd moment mean offset'},\n",
       " {'Field': 'G-MEANXY',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[arcsec2] Guider (xy) 2nd moment mean offset'},\n",
       " {'Field': 'G-MEANY',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[arcsec] Guider y-axis mean offset'},\n",
       " {'Field': 'G-MEANY2',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[arcsec2] Guider (y) 2nd moment mean offset'},\n",
       " {'Field': 'G-MODE', 'Type': 'str', 'Desc': 'Guider operation mode'},\n",
       " {'Field': 'G-SEEING',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[arcsec] Guider average seeing'},\n",
       " {'Field': 'GSKYHOT',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'RASICAM global sky fraction above threshold'},\n",
       " {'Field': 'GSKYPHOT', 'Type': 'str', 'Desc': 'RASICAM global sky clear flag'},\n",
       " {'Field': 'GSKYVAR',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'RASICAM global sky standard deviation'},\n",
       " {'Field': 'G-TRANSP',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Guider average sky transparency'},\n",
       " {'Field': 'GUIDER',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Guider (0-absent,1-ok,2-lost star,3-los'},\n",
       " {'Field': 'HA', 'Type': 'str', 'Desc': 'hour angle (H:M:S)'},\n",
       " {'Field': 'HDRVER', 'Type': 'str', 'Desc': 'Header data revision'},\n",
       " {'Field': 'HEX', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'HUMIDITY',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Ambient relative humidity (percent)'},\n",
       " {'Field': 'INSTANCE', 'Type': 'str', 'Desc': 'SISPI instance name'},\n",
       " {'Field': 'INSTRUME', 'Type': 'str', 'Desc': 'Instrument name'},\n",
       " {'Field': 'IRAF-TLM', 'Type': 'str', 'Desc': 'Time of last modification'},\n",
       " {'Field': 'LINCFIL', 'Type': 'str', 'Desc': 'Nonlinearity correction file'},\n",
       " {'Field': 'LSKYHOT',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'RASICAM local sky fraction above threshold'},\n",
       " {'Field': 'LSKYPHOT', 'Type': 'str', 'Desc': 'RASICAM local sky clear flag'},\n",
       " {'Field': 'LSKYPOW',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'RASICAM local sky normalized power'},\n",
       " {'Field': 'LSKYVAR',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'RASICAM local sky standard deviation'},\n",
       " {'Field': 'LST',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Siderial Time at start of observation'},\n",
       " {'Field': 'LUTVER', 'Type': 'str', 'Desc': 'Hexapod Lookup Table version'},\n",
       " {'Field': 'LWTRTEMP',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Lower truss average temperature'},\n",
       " {'Field': 'MAGZERO', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'MAGZP', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'MAGZPT',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[mag] Magnitude zero point per sec'},\n",
       " {'Field': 'MAGZUNC', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'MAIRTEMP',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Mirror temperature above surface'},\n",
       " {'Field': 'MANIFEST', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'MASS2', 'Type': 'str', 'Desc': 'MASS(2) FSEE'},\n",
       " {'Field': 'MJD-END', 'Type': 'str', 'Desc': 'Exposure end'},\n",
       " {'Field': 'MJD-OBS', 'Type': 'str', 'Desc': 'MJD of observation start'},\n",
       " {'Field': 'MSURTEMP',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Mirror surface average temperature'},\n",
       " {'Field': 'MULTIEXP',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Frame contains multiple exposures if true'},\n",
       " {'Field': 'NBLEED', 'Type': 'str', 'Desc': 'Number of bleed trail pixels.'},\n",
       " {'Field': 'NDONUTS',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'AOS number of donuts analyzed for this CCD'},\n",
       " {'Field': 'NEXTEND', 'Type': 'str', 'Desc': 'Number of extensions'},\n",
       " {'Field': 'NITE', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'NOTE', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'NPHTMTCH', 'Type': 'str', 'Desc': 'Number of phot. stars matched'},\n",
       " {'Field': 'OBJECT', 'Type': 'str', 'Desc': 'Name of the object observed'},\n",
       " {'Field': 'OBJECT.TILEID', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'OBS-ELEV', 'Type': 'str', 'Desc': '[km] Observatory elevation'},\n",
       " {'Field': 'OBSERVAT', 'Type': 'str', 'Desc': 'Observatory'},\n",
       " {'Field': 'OBSERVER', 'Type': 'str', 'Desc': 'Observer(s)'},\n",
       " {'Field': 'OBSID', 'Type': 'str', 'Desc': 'Observation ID'},\n",
       " {'Field': 'OBS-LAT', 'Type': 'str', 'Desc': '[deg] Observatory latitude'},\n",
       " {'Field': 'OBS-LONG', 'Type': 'str', 'Desc': '[deg] Observatory longitude'},\n",
       " {'Field': 'OBSTYPE',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Type of target observed (e.g. object, dark, dome flat...)'},\n",
       " {'Field': 'ODATEOBS', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'OPENSHUT',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Time when shutter opened (UTC)'},\n",
       " {'Field': 'ORIGIN', 'Type': 'str', 'Desc': 'FITS file originator'},\n",
       " {'Field': 'OUTTEMP', 'Type': 'str', 'Desc': 'outside temperature'},\n",
       " {'Field': 'PHOTDPTH',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[mag] 5 sig point source photometric depth'},\n",
       " {'Field': 'PHOTFLAG',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Night Photometric (1) or not (0)'},\n",
       " {'Field': 'PHOTREF',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Phototometric reference catalog'},\n",
       " {'Field': 'PIPELINE', 'Type': 'str', 'Desc': 'Name of calibration pipeline'},\n",
       " {'Field': 'PIXSCAL1',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Pixel scale for axis 1 (arcsec/pixel)'},\n",
       " {'Field': 'PIXSCAL2',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Pixel scale for axis 2 (arcsec/pixel)'},\n",
       " {'Field': 'PLARVER', 'Type': 'str', 'Desc': 'PL NSA archive version'},\n",
       " {'Field': 'PLDNAME', 'Type': 'str', 'Desc': 'PL Dataset'},\n",
       " {'Field': 'PLDSID', 'Type': 'str', 'Desc': 'PL NSA name'},\n",
       " {'Field': 'PLFNAME', 'Type': 'str', 'Desc': 'PL Filename'},\n",
       " {'Field': 'PLPROCID', 'Type': 'str', 'Desc': 'PL Processing ID'},\n",
       " {'Field': 'PLQNAME', 'Type': 'str', 'Desc': 'PL Dataset'},\n",
       " {'Field': 'PLQUEUE', 'Type': 'str', 'Desc': 'PL Queue'},\n",
       " {'Field': 'PLVER', 'Type': 'str', 'Desc': 'Pipeline version'},\n",
       " {'Field': 'PME-TEMP',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Mirror east edge temperature'},\n",
       " {'Field': 'PMN-TEMP',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Mirror north edge temperature'},\n",
       " {'Field': 'PMOSTEMP',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Mirror top surface temperature'},\n",
       " {'Field': 'PMS-TEMP',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Mirror south edge temperature'},\n",
       " {'Field': 'PMW-TEMP',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Mirror west edge temperature'},\n",
       " {'Field': 'PRESSURE',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Barometric pressure (millibars)'},\n",
       " {'Field': 'PROCTYPE',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Processing Type ( Raw | Instcal | Resampled | Stack | MasterCal )'},\n",
       " {'Field': 'PRODTYPE',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Product data description ( image | mask | expmap )'},\n",
       " {'Field': 'PROGRAM', 'Type': 'str', 'Desc': 'Current observing orog'},\n",
       " {'Field': 'PROPID', 'Type': 'str', 'Desc': 'Proposal identification'},\n",
       " {'Field': 'PROPOSER', 'Type': 'str', 'Desc': 'Proposer(s)'},\n",
       " {'Field': 'PUPILAMP', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PUPILFIL', 'Type': 'str', 'Desc': 'Pupil template'},\n",
       " {'Field': 'PUPILMAX', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PUPILSCL', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PUPILSKY', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PUPMAX', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'RA', 'Type': 'str', 'Desc': 'RA of observation (hr)'},\n",
       " {'Field': 'RADECSYS', 'Type': 'str', 'Desc': 'Default coordinate system'},\n",
       " {'Field': 'RADESYS',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'World coordinate reference frame'},\n",
       " {'Field': 'RADIUS', 'Type': 'str', 'Desc': '[pix] Average radius of stars'},\n",
       " {'Field': 'RADSTD',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[pix] Standard deviation of star radii'},\n",
       " {'Field': 'RECNO',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'NOAO Science Archive sequence number'},\n",
       " {'Field': 'REQNUM', 'Type': 'str', 'Desc': 'Requested ID from LCO'},\n",
       " {'Field': 'RESIDSCL', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'RMCOUNT', 'Type': 'str', 'Desc': 'remediation counter'},\n",
       " {'Field': 'SB_ACCOU', 'Type': 'str', 'Desc': 'iSTB client user account'},\n",
       " {'Field': 'SB_DIR1', 'Type': 'str', 'Desc': 'level 1 directory in NSA DS'},\n",
       " {'Field': 'SB_DIR2', 'Type': 'str', 'Desc': 'level 2 directory in NSA DS'},\n",
       " {'Field': 'SB_DIR3', 'Type': 'str', 'Desc': 'level 3 directory in NSA DS'},\n",
       " {'Field': 'SB_HOST', 'Type': 'str', 'Desc': 'iSTB client host'},\n",
       " {'Field': 'SB_ID', 'Type': 'str', 'Desc': 'unique iSTB identifier'},\n",
       " {'Field': 'SB_LOCAL', 'Type': 'str', 'Desc': 'locale of iSTB daemon'},\n",
       " {'Field': 'SB_NAME', 'Type': 'str', 'Desc': 'name assigned by iSTB'},\n",
       " {'Field': 'SB_RECNO', 'Type': 'str', 'Desc': 'iSTB sequence number'},\n",
       " {'Field': 'SB_RTNAM', 'Type': 'str', 'Desc': 'NSA root name'},\n",
       " {'Field': 'SB_SITE', 'Type': 'str', 'Desc': 'iSTB host site'},\n",
       " {'Field': 'SCAMPCHI', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SCAMPFLG', 'Type': 'str', 'Desc': 'WCS successful'},\n",
       " {'Field': 'SCAMPNUM', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SCAMPREF', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SEEING', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SEEINGP', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SEQID', 'Type': 'str', 'Desc': 'Sequence ID'},\n",
       " {'Field': 'SEQNUM', 'Type': 'str', 'Desc': 'Sequence Number'},\n",
       " {'Field': 'SEQTOT', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SISPIVER', 'Type': 'str', 'Desc': 'SISPI software version'},\n",
       " {'Field': 'SKYNOISE', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SKYORDER', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SKYPC00', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SKYPC01', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SKYPC02', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SKYPC03', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SKYSTAT',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Cloud camera (RASICAM) available if true'},\n",
       " {'Field': 'SKYSUB', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SKYSUB01', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SKYSUB10', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SKYSUBP', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SKYUPDAT',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Time of last RASICAM exposure (UTC)'},\n",
       " {'Field': 'SLOT01',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'dhe board: <type> <serial> <firmware>'},\n",
       " {'Field': 'SLOT03', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SURVEYID', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'TELDEC', 'Type': 'str', 'Desc': 'DEC of telescope (deg)'},\n",
       " {'Field': 'TELEQUIN', 'Type': 'str', 'Desc': 'Equinox of tel coords'},\n",
       " {'Field': 'TELESCOP', 'Type': 'str', 'Desc': 'Telescope'},\n",
       " {'Field': 'TELFOCUS', 'Type': 'str', 'Desc': 'Telescope focus'},\n",
       " {'Field': 'TELRA', 'Type': 'str', 'Desc': 'RA of telescope (hr)'},\n",
       " {'Field': 'TELSTAT', 'Type': 'str', 'Desc': 'Telescope tracking status'},\n",
       " {'Field': 'TILING', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'TIME-OBS', 'Type': 'str', 'Desc': 'Time of observation start'},\n",
       " {'Field': 'time_recorded', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'TIME_RECORDED', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'TIMESYS', 'Type': 'str', 'Desc': 'Time system'},\n",
       " {'Field': 'UNITNAME', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'UPTRTEMP',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Upper truss average temperature'},\n",
       " {'Field': 'UTE-TEMP',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Upper truss temperature east'},\n",
       " {'Field': 'UTN-TEMP',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Upper truss temperature north'},\n",
       " {'Field': 'UTS-TEMP',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Upper truss temperature south'},\n",
       " {'Field': 'UTW-TEMP',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[deg C] Upper truss temperature west'},\n",
       " {'Field': 'VALIDA', 'Type': 'str', 'Desc': 'Data from amp A is valid'},\n",
       " {'Field': 'VALIDB', 'Type': 'str', 'Desc': 'Data from amp B is valid'},\n",
       " {'Field': 'VSUB',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'True if CCD substrate voltage is on'},\n",
       " {'Field': 'WCSCAL', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'WINDDIR', 'Type': 'str', 'Desc': 'Wind direction (degrees)'},\n",
       " {'Field': 'WINDSPD', 'Type': 'str', 'Desc': 'Wind speed (mph)'},\n",
       " {'Field': 'XTALKFIL', 'Type': 'str', 'Desc': 'Crosstalk file'},\n",
       " {'Field': 'ZD', 'Type': 'str', 'Desc': 'Zenith distance'},\n",
       " {'Field': 'ZPDELDEC',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[arcsec] Telescope zeropoint adjustment (DEC)'},\n",
       " {'Field': 'ZPDELRA',\n",
       "  'Type': 'str',\n",
       "  'Desc': '[arcsec] Telescope zeropoint adjustment (RA)'}]"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "requests.get(f'{adsurl}/aux_file_fields/decam/instcal/').json()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Advanced File Search of Core and Aux fields, results into Pandas \n",
    "An Advanced Search is constructed in JSON format, and needs to specify what fields will be retrieved (\"outfields\") as well as what fields and constraints will be used to search the database (\"search\").  Fields of type Category need to be given exact values in Search, with multiple possible category values listed in sequence.  Fields of numeric or date types can be specified by a range of values.  For fields with string types, there are a number of modifiers that can be used to perform string expressions; see the section below on string constraints."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Search Files <a id=\"file_search\" />\n",
    "- Use Database derived field, \"ra_min\"\n",
    "- Use _AUX_ field in output and search\n",
    "- Limit maximum number of results (rows) returned\n",
    "- Load results into [Pandas DataFrame](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.html#pandas.DataFrame)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Using API url: https://astroarchive.noirlab.edu/api/adv_search/find/?limit=20\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>md5sum</th>\n",
       "      <th>obs_type</th>\n",
       "      <th>release_date</th>\n",
       "      <th>proc_type</th>\n",
       "      <th>proposal</th>\n",
       "      <th>caldat</th>\n",
       "      <th>archive_filename</th>\n",
       "      <th>instrument</th>\n",
       "      <th>ra_min</th>\n",
       "      <th>EXPNUM</th>\n",
       "      <th>AIRMASS</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>af672d5041f767cb946d5aece80eb704</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>raw</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/mtn/20170814/ct4m/2017B-0951/c4d_...</td>\n",
       "      <td>decam</td>\n",
       "      <td>323.362575</td>\n",
       "      <td>667101</td>\n",
       "      <td>1.19</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>df4a4b44b0eb285acfa35be3b737e3d8</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>323.367500</td>\n",
       "      <td>667104</td>\n",
       "      <td>1.20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3846ea919045f865553dfbe59983ab93</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>raw</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/mtn/20170814/ct4m/2017B-0951/c4d_...</td>\n",
       "      <td>decam</td>\n",
       "      <td>323.362575</td>\n",
       "      <td>667104</td>\n",
       "      <td>1.20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>dc3d18bd0850dbbb967856f681d097fe</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>raw</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/mtn/20170814/ct4m/2017B-0951/c4d_...</td>\n",
       "      <td>decam</td>\n",
       "      <td>322.493042</td>\n",
       "      <td>667097</td>\n",
       "      <td>1.40</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>17de05eb4d8e8d1cc889dcf923be1d9e</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>322.497250</td>\n",
       "      <td>667107</td>\n",
       "      <td>1.44</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>22f216f5042eafd79a956c9c8b514753</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>323.365917</td>\n",
       "      <td>667106</td>\n",
       "      <td>1.20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>0b234f7ea5d640e19212fb0a300c7c12</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>322.496458</td>\n",
       "      <td>667110</td>\n",
       "      <td>1.44</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>b7af4c4bf3d770ac92ce43817398f408</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>322.497875</td>\n",
       "      <td>667097</td>\n",
       "      <td>1.40</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>0ed4bc7af8c19e2f601f439c587a8bff</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>323.367500</td>\n",
       "      <td>667104</td>\n",
       "      <td>1.20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>12bceb730822dda3419864b879fca0c5</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>322.496833</td>\n",
       "      <td>667096</td>\n",
       "      <td>1.40</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>d394583b75d45cad463d3765a53e5586</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>322.496167</td>\n",
       "      <td>667111</td>\n",
       "      <td>1.44</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>79afbb057021159bd1c32f8de83ce038</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>323.367125</td>\n",
       "      <td>667103</td>\n",
       "      <td>1.19</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>335cc52c27080df5efe7d0903a34edc5</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>322.497875</td>\n",
       "      <td>667097</td>\n",
       "      <td>1.40</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>cae2b818005e7667dfebda8dd4789fb0</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>323.365917</td>\n",
       "      <td>667094</td>\n",
       "      <td>1.17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>a241d847f02ef71d9884173f0d33f851</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>raw</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/mtn/20170814/ct4m/2017B-0951/c4d_...</td>\n",
       "      <td>decam</td>\n",
       "      <td>322.493042</td>\n",
       "      <td>667109</td>\n",
       "      <td>1.44</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>d628fe3620e6adf1f8d51a3cf6de20b6</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>323.365542</td>\n",
       "      <td>667090</td>\n",
       "      <td>1.17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>9211876295831548912b0a89ff4fb388</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>323.367125</td>\n",
       "      <td>667103</td>\n",
       "      <td>1.19</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>37dc58d6e8bdcc8ea7129421df273443</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>323.366625</td>\n",
       "      <td>667091</td>\n",
       "      <td>1.17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>81c48fec1f431965de0057353ee3654e</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>323.368750</td>\n",
       "      <td>667101</td>\n",
       "      <td>1.19</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>958a6d3c71e7173be841445e18e9b341</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>323.366500</td>\n",
       "      <td>667092</td>\n",
       "      <td>1.17</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                              md5sum obs_type release_date proc_type   \n",
       "0   af672d5041f767cb946d5aece80eb704   object   2017-09-13       raw  \\\n",
       "1   df4a4b44b0eb285acfa35be3b737e3d8   object   2017-09-13   instcal   \n",
       "2   3846ea919045f865553dfbe59983ab93   object   2017-09-13       raw   \n",
       "3   dc3d18bd0850dbbb967856f681d097fe   object   2017-09-13       raw   \n",
       "4   17de05eb4d8e8d1cc889dcf923be1d9e   object   2017-09-13   instcal   \n",
       "5   22f216f5042eafd79a956c9c8b514753   object   2017-09-13   instcal   \n",
       "6   0b234f7ea5d640e19212fb0a300c7c12   object   2017-09-13   instcal   \n",
       "7   b7af4c4bf3d770ac92ce43817398f408   object   2017-09-13   instcal   \n",
       "8   0ed4bc7af8c19e2f601f439c587a8bff   object   2017-09-13   instcal   \n",
       "9   12bceb730822dda3419864b879fca0c5   object   2017-09-13   instcal   \n",
       "10  d394583b75d45cad463d3765a53e5586   object   2017-09-13   instcal   \n",
       "11  79afbb057021159bd1c32f8de83ce038   object   2017-09-13   instcal   \n",
       "12  335cc52c27080df5efe7d0903a34edc5   object   2017-09-13   instcal   \n",
       "13  cae2b818005e7667dfebda8dd4789fb0   object   2017-09-13   instcal   \n",
       "14  a241d847f02ef71d9884173f0d33f851   object   2017-09-13       raw   \n",
       "15  d628fe3620e6adf1f8d51a3cf6de20b6   object   2017-09-13   instcal   \n",
       "16  9211876295831548912b0a89ff4fb388   object   2017-09-13   instcal   \n",
       "17  37dc58d6e8bdcc8ea7129421df273443   object   2017-09-13   instcal   \n",
       "18  81c48fec1f431965de0057353ee3654e   object   2017-09-13   instcal   \n",
       "19  958a6d3c71e7173be841445e18e9b341   object   2017-09-13   instcal   \n",
       "\n",
       "      proposal      caldat                                   archive_filename   \n",
       "0   2017B-0951  2017-08-14  /net/archive/mtn/20170814/ct4m/2017B-0951/c4d_...  \\\n",
       "1   2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "2   2017B-0951  2017-08-14  /net/archive/mtn/20170814/ct4m/2017B-0951/c4d_...   \n",
       "3   2017B-0951  2017-08-14  /net/archive/mtn/20170814/ct4m/2017B-0951/c4d_...   \n",
       "4   2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "5   2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "6   2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "7   2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "8   2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "9   2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "10  2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "11  2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "12  2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "13  2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "14  2017B-0951  2017-08-14  /net/archive/mtn/20170814/ct4m/2017B-0951/c4d_...   \n",
       "15  2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "16  2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "17  2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "18  2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "19  2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "\n",
       "   instrument      ra_min  EXPNUM  AIRMASS  \n",
       "0       decam  323.362575  667101     1.19  \n",
       "1       decam  323.367500  667104     1.20  \n",
       "2       decam  323.362575  667104     1.20  \n",
       "3       decam  322.493042  667097     1.40  \n",
       "4       decam  322.497250  667107     1.44  \n",
       "5       decam  323.365917  667106     1.20  \n",
       "6       decam  322.496458  667110     1.44  \n",
       "7       decam  322.497875  667097     1.40  \n",
       "8       decam  323.367500  667104     1.20  \n",
       "9       decam  322.496833  667096     1.40  \n",
       "10      decam  322.496167  667111     1.44  \n",
       "11      decam  323.367125  667103     1.19  \n",
       "12      decam  322.497875  667097     1.40  \n",
       "13      decam  323.365917  667094     1.17  \n",
       "14      decam  322.493042  667109     1.44  \n",
       "15      decam  323.365542  667090     1.17  \n",
       "16      decam  323.367125  667103     1.19  \n",
       "17      decam  323.366625  667091     1.17  \n",
       "18      decam  323.368750  667101     1.19  \n",
       "19      decam  323.366500  667092     1.17  "
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "jj = {\n",
    "    \"outfields\" : [\n",
    "        \"md5sum\",\n",
    "        \"ra_min\",  # \"ra\" is a \"range_field\" in Postgres, access either part of range\n",
    "        \"archive_filename\",\n",
    "        \"instrument\",\n",
    "        \"proc_type\",\n",
    "        \"obs_type\",\n",
    "        \"release_date\",\n",
    "        \"proposal\",\n",
    "        \"caldat\",\n",
    "        \"EXPNUM\",    # AUX field. Slows search\n",
    "        \"AIRMASS\",\n",
    "    ],\n",
    "    \"search\" : [\n",
    "        [\"instrument\", \"decam\"],\n",
    "        [\"proc_type\", \"raw\", \"instcal\"],\n",
    "        [\"ra_min\",322,324],\n",
    "        [\"EXPNUM\", 667000, 669000],\n",
    "    ]\n",
    "}\n",
    "apiurl = f'{adsurl}/find/?limit=20'\n",
    "print(f'Using API url: {apiurl}')\n",
    "pd.DataFrame(requests.post(apiurl,json=jj).json()[1:])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Search for a range of dates."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Using API url: https://astroarchive.noirlab.edu/api/adv_search/find/?limit=10\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>md5sum</th>\n",
       "      <th>obs_type</th>\n",
       "      <th>release_date</th>\n",
       "      <th>proc_type</th>\n",
       "      <th>proposal</th>\n",
       "      <th>caldat</th>\n",
       "      <th>archive_filename</th>\n",
       "      <th>instrument</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>8638180b93868e64844c71de13993d88</td>\n",
       "      <td>object</td>\n",
       "      <td>2018-10-12</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2016B-0279</td>\n",
       "      <td>2017-04-20</td>\n",
       "      <td>/net/archive/pipe/20170420/ct4m/2016B-0279/c4d...</td>\n",
       "      <td>decam</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>87ddf4cdfe79954927668a3993f56991</td>\n",
       "      <td>object</td>\n",
       "      <td>2018-11-26</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017A-0260</td>\n",
       "      <td>2017-06-04</td>\n",
       "      <td>/net/archive/pipe/20170604/ct4m/2017A-0260/c4d...</td>\n",
       "      <td>decam</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>29ce7e03b1f65c08917585401db1a252</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-09-13</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2017B-0951</td>\n",
       "      <td>2017-08-14</td>\n",
       "      <td>/net/archive/pipe/20170814/ct4m/2017B-0951/c4d...</td>\n",
       "      <td>decam</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4ccec5827f56ad4587d486b338875ff5</td>\n",
       "      <td>object</td>\n",
       "      <td>2018-08-16</td>\n",
       "      <td>stacked</td>\n",
       "      <td>2016A-0366</td>\n",
       "      <td>2017-02-22</td>\n",
       "      <td>/net/archive/pipe/20170222/ct4m/2016A-0366/c4d...</td>\n",
       "      <td>decam</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>71bbd7896fdc51681349ee3f5a3f8ed5</td>\n",
       "      <td>object</td>\n",
       "      <td>2018-12-11</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2016A-0366</td>\n",
       "      <td>2017-06-19</td>\n",
       "      <td>/net/archive/pipe/20170619/ct4m/2016A-0366/c4d...</td>\n",
       "      <td>decam</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>03129b90a660b3d483fdd5dd70653dd0</td>\n",
       "      <td>object</td>\n",
       "      <td>2018-09-26</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2012B-0001</td>\n",
       "      <td>2017-10-01</td>\n",
       "      <td>/net/archive/pipe/20171001/ct4m/2012B-0001/c4d...</td>\n",
       "      <td>decam</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>f63e629dc8709ae8bd9d6142520bc5a0</td>\n",
       "      <td>object</td>\n",
       "      <td>2019-03-23</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2017B-0239</td>\n",
       "      <td>2017-09-29</td>\n",
       "      <td>/net/archive/pipe/20170929/ct4m/2017B-0239/c4d...</td>\n",
       "      <td>decam</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>fedc113b5806ae93d51ab17d5dd9009d</td>\n",
       "      <td>object</td>\n",
       "      <td>2018-09-28</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2017A-0388</td>\n",
       "      <td>2017-04-06</td>\n",
       "      <td>/net/archive/pipe/20170406/ct4m/2017A-0388/c4d...</td>\n",
       "      <td>decam</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>deaaeb74a0bbb09407a8ba50394b4586</td>\n",
       "      <td>object</td>\n",
       "      <td>2019-09-06</td>\n",
       "      <td>instcal</td>\n",
       "      <td>2014B-0404</td>\n",
       "      <td>2018-03-15</td>\n",
       "      <td>/net/archive/pipe/20180315/ct4m/2014B-0404/c4d...</td>\n",
       "      <td>decam</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>d6ba270da441060b54346f6444ff5c5c</td>\n",
       "      <td>object</td>\n",
       "      <td>2019-09-28</td>\n",
       "      <td>stacked</td>\n",
       "      <td>2018A-0913</td>\n",
       "      <td>2018-04-06</td>\n",
       "      <td>/net/archive/pipe/20180406/ct4m/2018A-0913/c4d...</td>\n",
       "      <td>decam</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                             md5sum obs_type release_date  proc_type   \n",
       "0  8638180b93868e64844c71de13993d88   object   2018-10-12    instcal  \\\n",
       "1  87ddf4cdfe79954927668a3993f56991   object   2018-11-26    instcal   \n",
       "2  29ce7e03b1f65c08917585401db1a252   object   2017-09-13    instcal   \n",
       "3  4ccec5827f56ad4587d486b338875ff5   object   2018-08-16    stacked   \n",
       "4  71bbd7896fdc51681349ee3f5a3f8ed5   object   2018-12-11    instcal   \n",
       "5  03129b90a660b3d483fdd5dd70653dd0   object   2018-09-26  resampled   \n",
       "6  f63e629dc8709ae8bd9d6142520bc5a0   object   2019-03-23  resampled   \n",
       "7  fedc113b5806ae93d51ab17d5dd9009d   object   2018-09-28  resampled   \n",
       "8  deaaeb74a0bbb09407a8ba50394b4586   object   2019-09-06    instcal   \n",
       "9  d6ba270da441060b54346f6444ff5c5c   object   2019-09-28    stacked   \n",
       "\n",
       "     proposal      caldat                                   archive_filename   \n",
       "0  2016B-0279  2017-04-20  /net/archive/pipe/20170420/ct4m/2016B-0279/c4d...  \\\n",
       "1  2017A-0260  2017-06-04  /net/archive/pipe/20170604/ct4m/2017A-0260/c4d...   \n",
       "2  2017B-0951  2017-08-14  /net/archive/pipe/20170814/ct4m/2017B-0951/c4d...   \n",
       "3  2016A-0366  2017-02-22  /net/archive/pipe/20170222/ct4m/2016A-0366/c4d...   \n",
       "4  2016A-0366  2017-06-19  /net/archive/pipe/20170619/ct4m/2016A-0366/c4d...   \n",
       "5  2012B-0001  2017-10-01  /net/archive/pipe/20171001/ct4m/2012B-0001/c4d...   \n",
       "6  2017B-0239  2017-09-29  /net/archive/pipe/20170929/ct4m/2017B-0239/c4d...   \n",
       "7  2017A-0388  2017-04-06  /net/archive/pipe/20170406/ct4m/2017A-0388/c4d...   \n",
       "8  2014B-0404  2018-03-15  /net/archive/pipe/20180315/ct4m/2014B-0404/c4d...   \n",
       "9  2018A-0913  2018-04-06  /net/archive/pipe/20180406/ct4m/2018A-0913/c4d...   \n",
       "\n",
       "  instrument  \n",
       "0      decam  \n",
       "1      decam  \n",
       "2      decam  \n",
       "3      decam  \n",
       "4      decam  \n",
       "5      decam  \n",
       "6      decam  \n",
       "7      decam  \n",
       "8      decam  \n",
       "9      decam  "
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "jj = {\n",
    "    \"outfields\" : [\n",
    "        \"md5sum\",\n",
    "        \"archive_filename\",\n",
    "        \"instrument\",\n",
    "        \"proc_type\",\n",
    "        \"obs_type\",\n",
    "        \"release_date\",\n",
    "        \"proposal\",\n",
    "        \"caldat\",\n",
    "    ],\n",
    "    \"search\" : [\n",
    "        [\"instrument\", \"decam\"],\n",
    "        [\"caldat\", \"2017-02-11\", \"2018-04-17\"],  # limit to date range\n",
    "    ]\n",
    "}\n",
    "apiurl = f'{adsurl}/find/?limit=10'\n",
    "print(f'Using API url: {apiurl}')\n",
    "pd.DataFrame(requests.post(apiurl,json=jj).json()[1:])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Find files available for download <a id=\"find_downloadable\" />\n",
    "You can comment one or the other of the \"release_date\" search lines to find either public files or proprietary files.\n",
    "You can retrieve the public files without authentication. But to retrieve the proprietary files you must be an authenticated PI of a proposal associated with the file. Metadata has no proprietary period."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Using API url: https://astroarchive.noirlab.edu/api/adv_search/find/?limit=50\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>md5sum</th>\n",
       "      <th>obs_type</th>\n",
       "      <th>release_date</th>\n",
       "      <th>proc_type</th>\n",
       "      <th>proposal</th>\n",
       "      <th>archive_filename</th>\n",
       "      <th>instrument</th>\n",
       "      <th>telescope</th>\n",
       "      <th>url</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>4c51a74cdc99844c848976be90da830a</td>\n",
       "      <td>object</td>\n",
       "      <td>2018-02-09</td>\n",
       "      <td>raw</td>\n",
       "      <td>2016B-0915</td>\n",
       "      <td>/net/archive/mtn/20160818/soar/2016B-0915/pss_...</td>\n",
       "      <td>spartan</td>\n",
       "      <td>soar</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>03129b90a660b3d483fdd5dd70653dd0</td>\n",
       "      <td>object</td>\n",
       "      <td>2018-09-26</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2012B-0001</td>\n",
       "      <td>/net/archive/pipe/20171001/ct4m/2012B-0001/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>ct4m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>690b6619c6a6ad3eb67a0f57b1f8d3fa</td>\n",
       "      <td>object</td>\n",
       "      <td>2011-04-18</td>\n",
       "      <td>raw</td>\n",
       "      <td>2009B-0051</td>\n",
       "      <td>/net/archive/mtn/20091025/wiyn/2009B-0051/kp10...</td>\n",
       "      <td>whirc</td>\n",
       "      <td>wiyn</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>b08fb82cfa8a5dbe0d68e026ac91f800</td>\n",
       "      <td>dome flat</td>\n",
       "      <td>2009-10-25</td>\n",
       "      <td>raw</td>\n",
       "      <td>2009B-0379</td>\n",
       "      <td>/net/archive/mtn/20091025/ct09m/2009B-0379/ct2...</td>\n",
       "      <td>ccd_imager</td>\n",
       "      <td>ct09m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>e6df14a8f058a7671f71ee94aaf6e7ae</td>\n",
       "      <td>object</td>\n",
       "      <td>2017-02-03</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2012B-0001</td>\n",
       "      <td>/net/archive/pipe/20160209/ct4m/2012B-0001/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>ct4m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>98703cd1235946490ba3c8e2d2e5b4a8</td>\n",
       "      <td>object</td>\n",
       "      <td>2011-04-18</td>\n",
       "      <td>raw</td>\n",
       "      <td>2009B-0379</td>\n",
       "      <td>/net/archive/mtn/20091025/ct09m/2009B-0379/ct2...</td>\n",
       "      <td>ccd_imager</td>\n",
       "      <td>ct09m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>08bead394f5115dbf7017f22ce5ecd26</td>\n",
       "      <td>bias</td>\n",
       "      <td>2015-09-30</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150930/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>41cac4f2910ab9b5a4cc6b02bc568b36</td>\n",
       "      <td>bias</td>\n",
       "      <td>2015-09-30</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150930/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>997d4a3b6bef3ecf30390ce53ba04281</td>\n",
       "      <td>dark</td>\n",
       "      <td>2015-10-01</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20151001/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>903342e092e17b6924a5e3da231ab529</td>\n",
       "      <td>dark</td>\n",
       "      <td>2015-09-29</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150929/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>1cb3b1090c09f89371bc9205cc0c5e62</td>\n",
       "      <td>dark</td>\n",
       "      <td>2015-09-29</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150929/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>e31d18b6a8670f1b150544e20e79e887</td>\n",
       "      <td>dark</td>\n",
       "      <td>2015-09-29</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150929/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>e7cc8c1eff4b094634fc134a77151924</td>\n",
       "      <td>dark</td>\n",
       "      <td>2015-09-29</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150929/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>83ed636e78ac9f5e2202e3e567b4079b</td>\n",
       "      <td>dark</td>\n",
       "      <td>2015-09-29</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150929/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>84743ff524ea0bb8771a292b7f7a2b8e</td>\n",
       "      <td>dark</td>\n",
       "      <td>2015-09-29</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150929/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>16377baa71761f7f0a91cd5bd5e9cc68</td>\n",
       "      <td>dark</td>\n",
       "      <td>2015-09-29</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150929/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>7d75d72908cdc809be6e1b2fa1ed1a7f</td>\n",
       "      <td>object</td>\n",
       "      <td>2018-07-23</td>\n",
       "      <td>raw</td>\n",
       "      <td>2016A-0453</td>\n",
       "      <td>/net/archive/mtn/20170129/kp4m/2016A-0453/k4m_...</td>\n",
       "      <td>mosaic3</td>\n",
       "      <td>kp4m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>24aad2e010621ae2324e924dfe5d5673</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2011-07-04</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20110704/ct15m/smarts/ct31968...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>d81c0aa4426696050fa0fcb6a72cf7c5</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2011-07-04</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20110704/ct15m/smarts/ct31968...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>eee74a5409ac8aa409eef257f4cbb399</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-23</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150923/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>f63e629dc8709ae8bd9d6142520bc5a0</td>\n",
       "      <td>object</td>\n",
       "      <td>2019-03-23</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2017B-0239</td>\n",
       "      <td>/net/archive/pipe/20170929/ct4m/2017B-0239/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>ct4m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>47b2a880f7273439fa25a922b94092bf</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-23</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150923/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>d2eef0fecd926b2bfa24c23f54213a84</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-23</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150923/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>f0bd78c3b662628d54c2b368d415481c</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-23</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150923/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>00e1f2d1811e3dc26725961e0b675ddd</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-23</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150923/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>50b781be94862bbcffdc8aae598bb6f9</td>\n",
       "      <td>object</td>\n",
       "      <td>2011-04-18</td>\n",
       "      <td>raw</td>\n",
       "      <td>2009B-0051</td>\n",
       "      <td>/net/archive/mtn/20091025/wiyn/2009B-0051/kp10...</td>\n",
       "      <td>whirc</td>\n",
       "      <td>wiyn</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>02678e182d53bff915ddc3bb9f44f88c</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2011-07-04</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20110704/ct15m/smarts/ct31968...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>32f892053c4471ef2138c3e0162d1700</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-23</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150923/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>606d9e6463f121ae99efe8ae520f28a5</td>\n",
       "      <td>object</td>\n",
       "      <td>2011-04-18</td>\n",
       "      <td>raw</td>\n",
       "      <td>2009B-0051</td>\n",
       "      <td>/net/archive/mtn/20091025/wiyn/2009B-0051/kp10...</td>\n",
       "      <td>whirc</td>\n",
       "      <td>wiyn</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>460ca16ae501e35587f0544be47ee182</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-23</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150923/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>47c2c82e6c93825eab68d79997acaa91</td>\n",
       "      <td>dark</td>\n",
       "      <td>2015-09-29</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150929/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>269afbb00805c5d3ba6ceb8e05dcad85</td>\n",
       "      <td>dome flat</td>\n",
       "      <td>2009-10-25</td>\n",
       "      <td>raw</td>\n",
       "      <td>2009B-0379</td>\n",
       "      <td>/net/archive/mtn/20091025/ct09m/2009B-0379/ct2...</td>\n",
       "      <td>ccd_imager</td>\n",
       "      <td>ct09m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>77d6b9729089e0ac4f880a25d8766b7b</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-30</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150930/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>203282ae2b16709c9490fce549629eac</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-30</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150930/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>98cd51ca72914609ce04f73d32f7d62e</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-30</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150930/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>776799a671bc114262f0bab1ef3e80e1</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-30</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150930/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>3a80fd418570571ebdc431fd953b5cd3</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-30</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150930/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>390bd20beee08e88269e1ee3f44efee1</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-30</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150930/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>5d79ae62ed254bf072220484b22c8021</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-09-30</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20150930/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>b5469b8f7ac1303f6ff6d5dd6dfb2093</td>\n",
       "      <td>projector flat</td>\n",
       "      <td>2009-10-25</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20091025/ct15m/smarts/ct22287...</td>\n",
       "      <td>ccd_spec</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>40</th>\n",
       "      <td>9e39cbfca3ac6a05581d0c2cd70fb0ac</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2011-07-04</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20110704/ct15m/smarts/ct31968...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>41</th>\n",
       "      <td>b49a2aeaa1f75aa2b730b74dad26b1d6</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2011-07-04</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20110704/ct15m/smarts/ct31968...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>42</th>\n",
       "      <td>d219e8c0b5cd986ed40b84ba18b001a5</td>\n",
       "      <td>object</td>\n",
       "      <td>2011-04-18</td>\n",
       "      <td>raw</td>\n",
       "      <td>2009B-0051</td>\n",
       "      <td>/net/archive/mtn/20091025/wiyn/2009B-0051/kp10...</td>\n",
       "      <td>whirc</td>\n",
       "      <td>wiyn</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>43</th>\n",
       "      <td>b998f0ee8b0caaf49b678ead6c614aab</td>\n",
       "      <td>object</td>\n",
       "      <td>2011-04-18</td>\n",
       "      <td>raw</td>\n",
       "      <td>2009B-0051</td>\n",
       "      <td>/net/archive/mtn/20091025/wiyn/2009B-0051/kp10...</td>\n",
       "      <td>whirc</td>\n",
       "      <td>wiyn</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>44</th>\n",
       "      <td>44fd49c8f832e4c7f674399c43d1d688</td>\n",
       "      <td>dome flat</td>\n",
       "      <td>2009-10-25</td>\n",
       "      <td>raw</td>\n",
       "      <td>2009B-0379</td>\n",
       "      <td>/net/archive/mtn/20091025/ct09m/2009B-0379/ct2...</td>\n",
       "      <td>ccd_imager</td>\n",
       "      <td>ct09m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>45</th>\n",
       "      <td>79403456b9b16442331ba4575832e08e</td>\n",
       "      <td>dome flat</td>\n",
       "      <td>2009-10-25</td>\n",
       "      <td>raw</td>\n",
       "      <td>2009B-0379</td>\n",
       "      <td>/net/archive/mtn/20091025/ct09m/2009B-0379/ct2...</td>\n",
       "      <td>ccd_imager</td>\n",
       "      <td>ct09m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46</th>\n",
       "      <td>526df2aaf2bf05f2899340e57d4d0c8d</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2011-07-04</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20110704/ct15m/smarts/ct31968...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>47</th>\n",
       "      <td>eb0651e4fc58c82c8816ad4a8ca4056a</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-10-14</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20151014/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>48</th>\n",
       "      <td>d03eaf58bcffd49bfdfbe1e4281c4267</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-10-14</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20151014/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>49</th>\n",
       "      <td>fc04d9d53aa287c93df3767fe095e1bb</td>\n",
       "      <td>calibration</td>\n",
       "      <td>2015-10-14</td>\n",
       "      <td>raw</td>\n",
       "      <td>smarts</td>\n",
       "      <td>/net/archive/mtn/20151014/ct15m/smarts/c15e_15...</td>\n",
       "      <td>echelle</td>\n",
       "      <td>ct15m</td>\n",
       "      <td>https://astroarchive.noirlab.edu/api/retrieve/...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                              md5sum        obs_type release_date  proc_type   \n",
       "0   4c51a74cdc99844c848976be90da830a          object   2018-02-09        raw  \\\n",
       "1   03129b90a660b3d483fdd5dd70653dd0          object   2018-09-26  resampled   \n",
       "2   690b6619c6a6ad3eb67a0f57b1f8d3fa          object   2011-04-18        raw   \n",
       "3   b08fb82cfa8a5dbe0d68e026ac91f800       dome flat   2009-10-25        raw   \n",
       "4   e6df14a8f058a7671f71ee94aaf6e7ae          object   2017-02-03  resampled   \n",
       "5   98703cd1235946490ba3c8e2d2e5b4a8          object   2011-04-18        raw   \n",
       "6   08bead394f5115dbf7017f22ce5ecd26            bias   2015-09-30        raw   \n",
       "7   41cac4f2910ab9b5a4cc6b02bc568b36            bias   2015-09-30        raw   \n",
       "8   997d4a3b6bef3ecf30390ce53ba04281            dark   2015-10-01        raw   \n",
       "9   903342e092e17b6924a5e3da231ab529            dark   2015-09-29        raw   \n",
       "10  1cb3b1090c09f89371bc9205cc0c5e62            dark   2015-09-29        raw   \n",
       "11  e31d18b6a8670f1b150544e20e79e887            dark   2015-09-29        raw   \n",
       "12  e7cc8c1eff4b094634fc134a77151924            dark   2015-09-29        raw   \n",
       "13  83ed636e78ac9f5e2202e3e567b4079b            dark   2015-09-29        raw   \n",
       "14  84743ff524ea0bb8771a292b7f7a2b8e            dark   2015-09-29        raw   \n",
       "15  16377baa71761f7f0a91cd5bd5e9cc68            dark   2015-09-29        raw   \n",
       "16  7d75d72908cdc809be6e1b2fa1ed1a7f          object   2018-07-23        raw   \n",
       "17  24aad2e010621ae2324e924dfe5d5673     calibration   2011-07-04        raw   \n",
       "18  d81c0aa4426696050fa0fcb6a72cf7c5     calibration   2011-07-04        raw   \n",
       "19  eee74a5409ac8aa409eef257f4cbb399     calibration   2015-09-23        raw   \n",
       "20  f63e629dc8709ae8bd9d6142520bc5a0          object   2019-03-23  resampled   \n",
       "21  47b2a880f7273439fa25a922b94092bf     calibration   2015-09-23        raw   \n",
       "22  d2eef0fecd926b2bfa24c23f54213a84     calibration   2015-09-23        raw   \n",
       "23  f0bd78c3b662628d54c2b368d415481c     calibration   2015-09-23        raw   \n",
       "24  00e1f2d1811e3dc26725961e0b675ddd     calibration   2015-09-23        raw   \n",
       "25  50b781be94862bbcffdc8aae598bb6f9          object   2011-04-18        raw   \n",
       "26  02678e182d53bff915ddc3bb9f44f88c     calibration   2011-07-04        raw   \n",
       "27  32f892053c4471ef2138c3e0162d1700     calibration   2015-09-23        raw   \n",
       "28  606d9e6463f121ae99efe8ae520f28a5          object   2011-04-18        raw   \n",
       "29  460ca16ae501e35587f0544be47ee182     calibration   2015-09-23        raw   \n",
       "30  47c2c82e6c93825eab68d79997acaa91            dark   2015-09-29        raw   \n",
       "31  269afbb00805c5d3ba6ceb8e05dcad85       dome flat   2009-10-25        raw   \n",
       "32  77d6b9729089e0ac4f880a25d8766b7b     calibration   2015-09-30        raw   \n",
       "33  203282ae2b16709c9490fce549629eac     calibration   2015-09-30        raw   \n",
       "34  98cd51ca72914609ce04f73d32f7d62e     calibration   2015-09-30        raw   \n",
       "35  776799a671bc114262f0bab1ef3e80e1     calibration   2015-09-30        raw   \n",
       "36  3a80fd418570571ebdc431fd953b5cd3     calibration   2015-09-30        raw   \n",
       "37  390bd20beee08e88269e1ee3f44efee1     calibration   2015-09-30        raw   \n",
       "38  5d79ae62ed254bf072220484b22c8021     calibration   2015-09-30        raw   \n",
       "39  b5469b8f7ac1303f6ff6d5dd6dfb2093  projector flat   2009-10-25        raw   \n",
       "40  9e39cbfca3ac6a05581d0c2cd70fb0ac     calibration   2011-07-04        raw   \n",
       "41  b49a2aeaa1f75aa2b730b74dad26b1d6     calibration   2011-07-04        raw   \n",
       "42  d219e8c0b5cd986ed40b84ba18b001a5          object   2011-04-18        raw   \n",
       "43  b998f0ee8b0caaf49b678ead6c614aab          object   2011-04-18        raw   \n",
       "44  44fd49c8f832e4c7f674399c43d1d688       dome flat   2009-10-25        raw   \n",
       "45  79403456b9b16442331ba4575832e08e       dome flat   2009-10-25        raw   \n",
       "46  526df2aaf2bf05f2899340e57d4d0c8d     calibration   2011-07-04        raw   \n",
       "47  eb0651e4fc58c82c8816ad4a8ca4056a     calibration   2015-10-14        raw   \n",
       "48  d03eaf58bcffd49bfdfbe1e4281c4267     calibration   2015-10-14        raw   \n",
       "49  fc04d9d53aa287c93df3767fe095e1bb     calibration   2015-10-14        raw   \n",
       "\n",
       "      proposal                                   archive_filename  instrument   \n",
       "0   2016B-0915  /net/archive/mtn/20160818/soar/2016B-0915/pss_...     spartan  \\\n",
       "1   2012B-0001  /net/archive/pipe/20171001/ct4m/2012B-0001/c4d...       decam   \n",
       "2   2009B-0051  /net/archive/mtn/20091025/wiyn/2009B-0051/kp10...       whirc   \n",
       "3   2009B-0379  /net/archive/mtn/20091025/ct09m/2009B-0379/ct2...  ccd_imager   \n",
       "4   2012B-0001  /net/archive/pipe/20160209/ct4m/2012B-0001/c4d...       decam   \n",
       "5   2009B-0379  /net/archive/mtn/20091025/ct09m/2009B-0379/ct2...  ccd_imager   \n",
       "6       smarts  /net/archive/mtn/20150930/ct15m/smarts/c15e_15...     echelle   \n",
       "7       smarts  /net/archive/mtn/20150930/ct15m/smarts/c15e_15...     echelle   \n",
       "8       smarts  /net/archive/mtn/20151001/ct15m/smarts/c15e_15...     echelle   \n",
       "9       smarts  /net/archive/mtn/20150929/ct15m/smarts/c15e_15...     echelle   \n",
       "10      smarts  /net/archive/mtn/20150929/ct15m/smarts/c15e_15...     echelle   \n",
       "11      smarts  /net/archive/mtn/20150929/ct15m/smarts/c15e_15...     echelle   \n",
       "12      smarts  /net/archive/mtn/20150929/ct15m/smarts/c15e_15...     echelle   \n",
       "13      smarts  /net/archive/mtn/20150929/ct15m/smarts/c15e_15...     echelle   \n",
       "14      smarts  /net/archive/mtn/20150929/ct15m/smarts/c15e_15...     echelle   \n",
       "15      smarts  /net/archive/mtn/20150929/ct15m/smarts/c15e_15...     echelle   \n",
       "16  2016A-0453  /net/archive/mtn/20170129/kp4m/2016A-0453/k4m_...     mosaic3   \n",
       "17      smarts  /net/archive/mtn/20110704/ct15m/smarts/ct31968...     echelle   \n",
       "18      smarts  /net/archive/mtn/20110704/ct15m/smarts/ct31968...     echelle   \n",
       "19      smarts  /net/archive/mtn/20150923/ct15m/smarts/c15e_15...     echelle   \n",
       "20  2017B-0239  /net/archive/pipe/20170929/ct4m/2017B-0239/c4d...       decam   \n",
       "21      smarts  /net/archive/mtn/20150923/ct15m/smarts/c15e_15...     echelle   \n",
       "22      smarts  /net/archive/mtn/20150923/ct15m/smarts/c15e_15...     echelle   \n",
       "23      smarts  /net/archive/mtn/20150923/ct15m/smarts/c15e_15...     echelle   \n",
       "24      smarts  /net/archive/mtn/20150923/ct15m/smarts/c15e_15...     echelle   \n",
       "25  2009B-0051  /net/archive/mtn/20091025/wiyn/2009B-0051/kp10...       whirc   \n",
       "26      smarts  /net/archive/mtn/20110704/ct15m/smarts/ct31968...     echelle   \n",
       "27      smarts  /net/archive/mtn/20150923/ct15m/smarts/c15e_15...     echelle   \n",
       "28  2009B-0051  /net/archive/mtn/20091025/wiyn/2009B-0051/kp10...       whirc   \n",
       "29      smarts  /net/archive/mtn/20150923/ct15m/smarts/c15e_15...     echelle   \n",
       "30      smarts  /net/archive/mtn/20150929/ct15m/smarts/c15e_15...     echelle   \n",
       "31  2009B-0379  /net/archive/mtn/20091025/ct09m/2009B-0379/ct2...  ccd_imager   \n",
       "32      smarts  /net/archive/mtn/20150930/ct15m/smarts/c15e_15...     echelle   \n",
       "33      smarts  /net/archive/mtn/20150930/ct15m/smarts/c15e_15...     echelle   \n",
       "34      smarts  /net/archive/mtn/20150930/ct15m/smarts/c15e_15...     echelle   \n",
       "35      smarts  /net/archive/mtn/20150930/ct15m/smarts/c15e_15...     echelle   \n",
       "36      smarts  /net/archive/mtn/20150930/ct15m/smarts/c15e_15...     echelle   \n",
       "37      smarts  /net/archive/mtn/20150930/ct15m/smarts/c15e_15...     echelle   \n",
       "38      smarts  /net/archive/mtn/20150930/ct15m/smarts/c15e_15...     echelle   \n",
       "39      smarts  /net/archive/mtn/20091025/ct15m/smarts/ct22287...    ccd_spec   \n",
       "40      smarts  /net/archive/mtn/20110704/ct15m/smarts/ct31968...     echelle   \n",
       "41      smarts  /net/archive/mtn/20110704/ct15m/smarts/ct31968...     echelle   \n",
       "42  2009B-0051  /net/archive/mtn/20091025/wiyn/2009B-0051/kp10...       whirc   \n",
       "43  2009B-0051  /net/archive/mtn/20091025/wiyn/2009B-0051/kp10...       whirc   \n",
       "44  2009B-0379  /net/archive/mtn/20091025/ct09m/2009B-0379/ct2...  ccd_imager   \n",
       "45  2009B-0379  /net/archive/mtn/20091025/ct09m/2009B-0379/ct2...  ccd_imager   \n",
       "46      smarts  /net/archive/mtn/20110704/ct15m/smarts/ct31968...     echelle   \n",
       "47      smarts  /net/archive/mtn/20151014/ct15m/smarts/c15e_15...     echelle   \n",
       "48      smarts  /net/archive/mtn/20151014/ct15m/smarts/c15e_15...     echelle   \n",
       "49      smarts  /net/archive/mtn/20151014/ct15m/smarts/c15e_15...     echelle   \n",
       "\n",
       "   telescope                                                url  \n",
       "0       soar  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "1       ct4m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "2       wiyn  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "3      ct09m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "4       ct4m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "5      ct09m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "6      ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "7      ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "8      ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "9      ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "10     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "11     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "12     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "13     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "14     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "15     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "16      kp4m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "17     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "18     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "19     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "20      ct4m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "21     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "22     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "23     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "24     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "25      wiyn  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "26     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "27     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "28      wiyn  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "29     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "30     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "31     ct09m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "32     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "33     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "34     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "35     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "36     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "37     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "38     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "39     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "40     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "41     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "42      wiyn  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "43      wiyn  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "44     ct09m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "45     ct09m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "46     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "47     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "48     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  \n",
       "49     ct15m  https://astroarchive.noirlab.edu/api/retrieve/...  "
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "jj = {\n",
    "    \"outfields\" : [\n",
    "        \"md5sum\",\n",
    "        \"archive_filename\",\n",
    "        \"instrument\",\n",
    "        \"telescope\",\n",
    "        \"proc_type\",\n",
    "        \"obs_type\",\n",
    "        \"release_date\",\n",
    "        \"proposal\",\n",
    "        \"url\",\n",
    "    ],\n",
    "    \"search\" : [\n",
    "        [\"release_date\", '2005-02-18','2020-01-20'], # public\n",
    "        #[\"release_date\", '2020-02-18','2020-11-18'], # proprietary\n",
    "    ]\n",
    "}\n",
    "apiurl = f'{adsurl}/find/?limit=50'\n",
    "print(f'Using API url: {apiurl}')\n",
    "\n",
    "ads_df = pd.DataFrame(requests.post(apiurl,json=jj).json()[1:])\n",
    "ads_df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Get a URL that can be used to retrieve a single public FITS file.   <a id=\"get_retrieve_url\" />\n",
    "Pasting this in your browser will result in dialog box that lets you save the file locally."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'https://astroarchive.noirlab.edu/api/retrieve/4c51a74cdc99844c848976be90da830a/'"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "selectedRow=0\n",
    "ads_df['url'][selectedRow]\n",
    "# https://marsnat1.stage.dm.noao.edu/api/adv_search/retrieve/0000004ab27d9e427bb93c640b358633/'\n",
    "ads_df['url'][selectedRow]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### This gets no results (no Archive filename ends with \"BADSUFFIX\")\n",
    "The \"archive_filename\" is a string type so there are many modifiers that can be used with it: \n",
    "_exact, iexact, startswith, istartswith, endswith, iendswith, contains, icontains, regex, iregex_\n",
    "\n",
    "This yields a Pandas DataFrame that has no rows. The names of all files in the archive are searched. (currently about 10 million files) Caching of results may cause your search time to be suspiciously short."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "Empty DataFrame\n",
       "Columns: []\n",
       "Index: []"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "jj = {\n",
    "    \"outfields\" : [\"archive_filename\", \"md5sum\"],\n",
    "    \"search\" : [\n",
    "        [\"archive_filename\", \"k4m_170308_045842_ori.fits.fz.BADSUFFIX\", 'endswith'],\n",
    "    ]\n",
    "}\n",
    "pd.DataFrame(requests.post(f'{adsurl}/find/?limit=9',json=jj).json()[1:])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Example of each type of search constraint <a id=\"constraint_examples\" />"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##### STRING constraints\n",
    "Allowable modifiers:\n",
    "- exact (default)\n",
    "- iexact\n",
    "- startswith\n",
    "- istartswith\n",
    "- endswith\n",
    "- iendswith\n",
    "- contains\n",
    "- icontains\n",
    "- regex\n",
    "- iregex"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##### Exact modifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>archive_filename</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>/net/archive/mtn/20180505/soar/soar/psg_180506...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                    archive_filename\n",
       "0  /net/archive/mtn/20180505/soar/soar/psg_180506..."
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "jj = {\n",
    "    \"outfields\" : [\"archive_filename\"],\n",
    "    \"search\" : [\n",
    "        [\"md5sum\", \"040b009c3e2ab75dc477d884a45fd10f\"], # modifier not given so \"exact\"\n",
    "    ]\n",
    "}\n",
    "pd.DataFrame(requests.post(f'{adsurl}/find/?limit=9',json=jj).json()[1:])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##### Startswith modifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>original_filename</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>/ua84/mosaic/050508/050508.001.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>/ua84/mosaic/050508/050508.001.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>/ua84/mosaic/050508/050508.002.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>/ua84/mosaic/050508/050508.003.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>/ua84/mosaic/050508/050508.004.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>/ua84/mosaic/050508/050508.005.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>/ua84/mosaic/050508/050508.006.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>/ua84/mosaic/050508/050508.007.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>/ua84/mosaic/050508/050508.008.fits</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                     original_filename\n",
       "0  /ua84/mosaic/050508/050508.001.fits\n",
       "1  /ua84/mosaic/050508/050508.001.fits\n",
       "2  /ua84/mosaic/050508/050508.002.fits\n",
       "3  /ua84/mosaic/050508/050508.003.fits\n",
       "4  /ua84/mosaic/050508/050508.004.fits\n",
       "5  /ua84/mosaic/050508/050508.005.fits\n",
       "6  /ua84/mosaic/050508/050508.006.fits\n",
       "7  /ua84/mosaic/050508/050508.007.fits\n",
       "8  /ua84/mosaic/050508/050508.008.fits"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "jj = {\n",
    "    \"outfields\" : [\"original_filename\"],\n",
    "    \"search\" : [\n",
    "        [\"original_filename\", \"/ua84\", 'startswith'],\n",
    "    ]\n",
    "}\n",
    "pd.DataFrame(requests.post(f'{adsurl}/find/?limit=9',json=jj).json()[1:])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##### Endswith modifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>original_filename</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>/ua82/mosaic/barkhouse/n2/obj2104.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>/ua82/mosaic/leslieh/05Feb05/obj2104.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>/ua84/mosaic/muzic/night2/obj2104.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>/ua84/mosaic/andrea/n2/obj2104.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>/ua90/bits/mosaic/20100709/obj2104.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>/ua90/bits/mosaic/20100709/obj2104.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>/ua84/mosaic/olimits/n2/obj2104.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>/ua84/mosaic/nidever/n2/obj2104.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>/ua84/mosaic/bramich/n2/obj2104.fits</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                           original_filename\n",
       "0     /ua82/mosaic/barkhouse/n2/obj2104.fits\n",
       "1  /ua82/mosaic/leslieh/05Feb05/obj2104.fits\n",
       "2     /ua84/mosaic/muzic/night2/obj2104.fits\n",
       "3        /ua84/mosaic/andrea/n2/obj2104.fits\n",
       "4    /ua90/bits/mosaic/20100709/obj2104.fits\n",
       "5    /ua90/bits/mosaic/20100709/obj2104.fits\n",
       "6       /ua84/mosaic/olimits/n2/obj2104.fits\n",
       "7       /ua84/mosaic/nidever/n2/obj2104.fits\n",
       "8       /ua84/mosaic/bramich/n2/obj2104.fits"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "jj = {\n",
    "    \"outfields\" : [\"original_filename\"],\n",
    "    \"search\" : [\n",
    "        [\"original_filename\", \"obj2104.fits\", 'endswith'],\n",
    "    ]\n",
    "}\n",
    "pd.DataFrame(requests.post(f'{adsurl}/find/?limit=9',json=jj).json()[1:])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##### icontains modifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>original_filename</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>/ua84/mosaic/nicole/n2/obj2043.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>/ua84/mosaic/nicole/n2/obj2115.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>/ua84/mosaic/nicole/n1/obj1102.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>/ua84/mosaic/nicole/n2/obj2066.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>/ua84/mosaic/nicole/n1/obj1101.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>/ua84/mosaic/nicole/n2/obj2034.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>/ua84/mosaic/nicole/n2/obj2064.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>/ua84/mosaic/nicole/n2/obj2037.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>/ua84/mosaic/nicole/n1/obj1064.fits</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                     original_filename\n",
       "0  /ua84/mosaic/nicole/n2/obj2043.fits\n",
       "1  /ua84/mosaic/nicole/n2/obj2115.fits\n",
       "2  /ua84/mosaic/nicole/n1/obj1102.fits\n",
       "3  /ua84/mosaic/nicole/n2/obj2066.fits\n",
       "4  /ua84/mosaic/nicole/n1/obj1101.fits\n",
       "5  /ua84/mosaic/nicole/n2/obj2034.fits\n",
       "6  /ua84/mosaic/nicole/n2/obj2064.fits\n",
       "7  /ua84/mosaic/nicole/n2/obj2037.fits\n",
       "8  /ua84/mosaic/nicole/n1/obj1064.fits"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "jj = {\n",
    "    \"outfields\" : [\"original_filename\"],\n",
    "    \"search\" : [\n",
    "        [\"original_filename\",\"Nicole\", 'icontains'],\n",
    "    ]\n",
    "}\n",
    "pd.DataFrame(requests.post(f'{adsurl}/find/?limit=9',json=jj).json()[1:])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##### iregex modifier  (regular expression)\n",
    "See https://docs.python.org/3/library/re.html?highlight=regex"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>original_filename</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>/ua84/mosaic/cole/n1/obj1082.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>/ua84/mosaic/cole/n1/obj1083.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>/ua84/mosaic/cole/n2/obj2078.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>/ua84/mosaic/cole/n2/obj2093.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>/ua83/mosaic/cole/n3/obj3074.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>/ua83/mosaic/cole/n4/test.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>/ua83/mosaic/cole/n4/obj4099.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>/ua83/mosaic/cole/n4/test.fits</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>/ua83/mosaic/cole/n4/obj4099.fits</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                   original_filename\n",
       "0  /ua84/mosaic/cole/n1/obj1082.fits\n",
       "1  /ua84/mosaic/cole/n1/obj1083.fits\n",
       "2  /ua84/mosaic/cole/n2/obj2078.fits\n",
       "3  /ua84/mosaic/cole/n2/obj2093.fits\n",
       "4  /ua83/mosaic/cole/n3/obj3074.fits\n",
       "5     /ua83/mosaic/cole/n4/test.fits\n",
       "6  /ua83/mosaic/cole/n4/obj4099.fits\n",
       "7     /ua83/mosaic/cole/n4/test.fits\n",
       "8  /ua83/mosaic/cole/n4/obj4099.fits"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "jj = {\n",
    "    \"outfields\" : [\"original_filename\"],\n",
    "    \"search\" : [\n",
    "        [\"original_filename\",r\"/(Cary|Cole)\", 'iregex'],\n",
    "    ]\n",
    "}\n",
    "pd.DataFrame(requests.post(f'{adsurl}/find/?limit=9',json=jj).json()[1:])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Public files<a id=\"get_public\" />\n",
    "List files that are available to the public today and are from observations on a specific night associated with given proposal."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Public as of 2023-04-27:\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>proposal</th>\n",
       "      <th>caldat</th>\n",
       "      <th>archive_filename</th>\n",
       "      <th>instrument</th>\n",
       "      <th>release_date</th>\n",
       "      <th>original_filename</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2012B-0001</td>\n",
       "      <td>2018-11-29</td>\n",
       "      <td>/net/archive/pipe/20181129/ct4m/2012B-0001/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>2019-11-24</td>\n",
       "      <td>/data_local/images/DTS/2012B-0001/DECam_007979...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2012B-0001</td>\n",
       "      <td>2018-11-29</td>\n",
       "      <td>/net/archive/pipe/20181129/ct4m/2012B-0001/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>2019-11-24</td>\n",
       "      <td>/data_local/images/DTS/2012B-0001/DECam_007979...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2012B-0001</td>\n",
       "      <td>2018-11-29</td>\n",
       "      <td>/net/archive/pipe/20181129/ct4m/2012B-0001/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>2019-11-24</td>\n",
       "      <td>/data_local/images/DTS/2012B-0001/DECam_007979...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2012B-0001</td>\n",
       "      <td>2018-11-29</td>\n",
       "      <td>/net/archive/pipe/20181129/ct4m/2012B-0001/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>2019-11-24</td>\n",
       "      <td>/data_local/images/DTS/2012B-0001/DECam_007979...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2012B-0001</td>\n",
       "      <td>2018-11-29</td>\n",
       "      <td>/net/archive/pipe/20181129/ct4m/2012B-0001/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>2019-11-24</td>\n",
       "      <td>/data_local/images/DTS/2012B-0001/DECam_007979...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>895</th>\n",
       "      <td>2012B-0001</td>\n",
       "      <td>2018-11-29</td>\n",
       "      <td>/net/archive/pipe/20181129/ct4m/2012B-0001/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>2019-11-24</td>\n",
       "      <td>/data_local/images/DTS/2012B-0001/DECam_007979...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>896</th>\n",
       "      <td>2012B-0001</td>\n",
       "      <td>2018-11-29</td>\n",
       "      <td>/net/archive/pipe/20181129/ct4m/2012B-0001/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>2019-11-24</td>\n",
       "      <td>/data_local/images/DTS/2012B-0001/DECam_007978...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>897</th>\n",
       "      <td>2012B-0001</td>\n",
       "      <td>2018-11-29</td>\n",
       "      <td>/net/archive/pipe/20181129/ct4m/2012B-0001/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>2019-11-24</td>\n",
       "      <td>/data_local/images/DTS/2012B-0001/DECam_007980...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>898</th>\n",
       "      <td>2012B-0001</td>\n",
       "      <td>2018-11-29</td>\n",
       "      <td>/net/archive/pipe/20181129/ct4m/2012B-0001/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>2019-11-24</td>\n",
       "      <td>/data_local/images/DTS/2012B-0001/DECam_007979...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>899</th>\n",
       "      <td>2012B-0001</td>\n",
       "      <td>2018-11-29</td>\n",
       "      <td>/net/archive/pipe/20181129/ct4m/2012B-0001/c4d...</td>\n",
       "      <td>decam</td>\n",
       "      <td>2019-11-24</td>\n",
       "      <td>/data_local/images/DTS/2012B-0001/DECam_007977...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>900 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       proposal      caldat   \n",
       "0    2012B-0001  2018-11-29  \\\n",
       "1    2012B-0001  2018-11-29   \n",
       "2    2012B-0001  2018-11-29   \n",
       "3    2012B-0001  2018-11-29   \n",
       "4    2012B-0001  2018-11-29   \n",
       "..          ...         ...   \n",
       "895  2012B-0001  2018-11-29   \n",
       "896  2012B-0001  2018-11-29   \n",
       "897  2012B-0001  2018-11-29   \n",
       "898  2012B-0001  2018-11-29   \n",
       "899  2012B-0001  2018-11-29   \n",
       "\n",
       "                                      archive_filename instrument   \n",
       "0    /net/archive/pipe/20181129/ct4m/2012B-0001/c4d...      decam  \\\n",
       "1    /net/archive/pipe/20181129/ct4m/2012B-0001/c4d...      decam   \n",
       "2    /net/archive/pipe/20181129/ct4m/2012B-0001/c4d...      decam   \n",
       "3    /net/archive/pipe/20181129/ct4m/2012B-0001/c4d...      decam   \n",
       "4    /net/archive/pipe/20181129/ct4m/2012B-0001/c4d...      decam   \n",
       "..                                                 ...        ...   \n",
       "895  /net/archive/pipe/20181129/ct4m/2012B-0001/c4d...      decam   \n",
       "896  /net/archive/pipe/20181129/ct4m/2012B-0001/c4d...      decam   \n",
       "897  /net/archive/pipe/20181129/ct4m/2012B-0001/c4d...      decam   \n",
       "898  /net/archive/pipe/20181129/ct4m/2012B-0001/c4d...      decam   \n",
       "899  /net/archive/pipe/20181129/ct4m/2012B-0001/c4d...      decam   \n",
       "\n",
       "    release_date                                  original_filename  \n",
       "0     2019-11-24  /data_local/images/DTS/2012B-0001/DECam_007979...  \n",
       "1     2019-11-24  /data_local/images/DTS/2012B-0001/DECam_007979...  \n",
       "2     2019-11-24  /data_local/images/DTS/2012B-0001/DECam_007979...  \n",
       "3     2019-11-24  /data_local/images/DTS/2012B-0001/DECam_007979...  \n",
       "4     2019-11-24  /data_local/images/DTS/2012B-0001/DECam_007979...  \n",
       "..           ...                                                ...  \n",
       "895   2019-11-24  /data_local/images/DTS/2012B-0001/DECam_007979...  \n",
       "896   2019-11-24  /data_local/images/DTS/2012B-0001/DECam_007978...  \n",
       "897   2019-11-24  /data_local/images/DTS/2012B-0001/DECam_007980...  \n",
       "898   2019-11-24  /data_local/images/DTS/2012B-0001/DECam_007979...  \n",
       "899   2019-11-24  /data_local/images/DTS/2012B-0001/DECam_007977...  \n",
       "\n",
       "[900 rows x 6 columns]"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# getnight(propid, caldat)\n",
    "import datetime\n",
    "\n",
    "propid = '2012B-0001'\n",
    "caldat = '2018-11-29'\n",
    "today = datetime.date.today().isoformat()\n",
    "print(f'Public as of {today}:')\n",
    "jj = {\n",
    "    \"outfields\" : ['archive_filename','original_filename', \n",
    "                   'release_date','caldat',\n",
    "                   'instrument',\n",
    "                   'proposal'],\n",
    "    \"search\" : [\n",
    "        [\"release_date\", '2005-02-18', today], # public as of today\n",
    "        [\"proposal\", propid],\n",
    "        [\"caldat\", caldat, caldat]\n",
    "    ]\n",
    "}\n",
    "pd.DataFrame(requests.post(f'{adsurl}/find/?limit=900',json=jj).json()[1:])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Get a night of data from a list of proposals."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>proposal</th>\n",
       "      <th>caldat</th>\n",
       "      <th>archive_filename</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2015B-0313</td>\n",
       "      <td>2016-11-29</td>\n",
       "      <td>/net/archive/mtn/20161129/kp4m/2015B-0313/k4k_...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2015B-0313</td>\n",
       "      <td>2016-11-29</td>\n",
       "      <td>/net/archive/mtn/20161129/kp4m/2015B-0313/k4k_...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2015B-0313</td>\n",
       "      <td>2016-11-29</td>\n",
       "      <td>/net/archive/mtn/20161129/kp4m/2015B-0313/k4k_...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2015B-0313</td>\n",
       "      <td>2016-11-29</td>\n",
       "      <td>/net/archive/mtn/20161129/kp4m/2015B-0313/k4k_...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2015B-0313</td>\n",
       "      <td>2016-11-29</td>\n",
       "      <td>/net/archive/mtn/20161129/kp4m/2015B-0313/k4k_...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>85</th>\n",
       "      <td>smarts</td>\n",
       "      <td>2016-11-29</td>\n",
       "      <td>/net/archive/mtn/20161129/ct13m/smarts/c13a_16...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>86</th>\n",
       "      <td>smarts</td>\n",
       "      <td>2016-11-29</td>\n",
       "      <td>/net/archive/mtn/20161129/ct13m/smarts/c13a_16...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>87</th>\n",
       "      <td>smarts</td>\n",
       "      <td>2016-11-29</td>\n",
       "      <td>/net/archive/mtn/20161129/ct13m/smarts/c13a_16...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>88</th>\n",
       "      <td>smarts</td>\n",
       "      <td>2016-11-29</td>\n",
       "      <td>/net/archive/mtn/20161129/ct13m/smarts/c13a_16...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>89</th>\n",
       "      <td>smarts</td>\n",
       "      <td>2016-11-29</td>\n",
       "      <td>/net/archive/mtn/20161129/ct13m/smarts/c13a_16...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>90 rows × 3 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "      proposal      caldat                                   archive_filename\n",
       "0   2015B-0313  2016-11-29  /net/archive/mtn/20161129/kp4m/2015B-0313/k4k_...\n",
       "1   2015B-0313  2016-11-29  /net/archive/mtn/20161129/kp4m/2015B-0313/k4k_...\n",
       "2   2015B-0313  2016-11-29  /net/archive/mtn/20161129/kp4m/2015B-0313/k4k_...\n",
       "3   2015B-0313  2016-11-29  /net/archive/mtn/20161129/kp4m/2015B-0313/k4k_...\n",
       "4   2015B-0313  2016-11-29  /net/archive/mtn/20161129/kp4m/2015B-0313/k4k_...\n",
       "..         ...         ...                                                ...\n",
       "85      smarts  2016-11-29  /net/archive/mtn/20161129/ct13m/smarts/c13a_16...\n",
       "86      smarts  2016-11-29  /net/archive/mtn/20161129/ct13m/smarts/c13a_16...\n",
       "87      smarts  2016-11-29  /net/archive/mtn/20161129/ct13m/smarts/c13a_16...\n",
       "88      smarts  2016-11-29  /net/archive/mtn/20161129/ct13m/smarts/c13a_16...\n",
       "89      smarts  2016-11-29  /net/archive/mtn/20161129/ct13m/smarts/c13a_16...\n",
       "\n",
       "[90 rows x 3 columns]"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "caldat = '2016-11-29'\n",
    "jj = {\n",
    "    \"outfields\" : ['archive_filename', 'caldat', 'proposal'],\n",
    "    \"search\" : [\n",
    "        [\"proposal\", \"smarts\",\"2015B-0313\"],\n",
    "        [\"caldat\", caldat, caldat]\n",
    "    ]\n",
    "}\n",
    "pd.DataFrame(requests.post(f'{adsurl}/find/?limit=90',json=jj).json()[1:])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### It is an error to search using AUX field without limiting to instrument\n",
    "An error is raised if an AUX field is in the search clause without also searching for and *instrument* and *proc_type*. Uncommenting the *instrument* line below will fix the problem."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'errorMessage': 'No \"instrument\" was provided when searching for AUX fields. For performance reasons you must also filter on \"instrument\" and \"proc_type\" that contain the AUX fields you are searching on (EXPNUM).',\n",
       " 'errorCode': 'MISINSTR'}"
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "jj = {\n",
    "    \"outfields\" : [\n",
    "        \"md5sum\",\n",
    "        \"archive_filename\",\n",
    "        \"instrument\",\n",
    "        \"proc_type\",\n",
    "        \"EXPNUM\",    # AUX field. Slows search\n",
    "    ],\n",
    "    \"search\" : [\n",
    "        #[\"instrument\", \"decam\"],  # uncomment this to eliminate error\n",
    "        [\"proc_type\", \"raw\"],\n",
    "        [\"EXPNUM\", 667000, 669000],\n",
    "    ]\n",
    "}\n",
    "requests.post(f'{adsurl}/find/?limit=9',json=jj).json()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'https://astroarchive.noirlab.edu/api/retrieve/4c51a74cdc99844c848976be90da830a'"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "fileid = ads_df['md5sum'][0]\n",
    "fileurl = f'{natroot}/api/retrieve/{fileid}'\n",
    "fileurl"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Attempt to get File\n",
    "There are several reasons attempt may fail, so check status!  Most reasons only apply to Proprietary files and include: \n",
    "1. There is no proposal associated with the File\n",
    "1. User is not authenticated\n",
    "1. User is not a PI or CoPI associated with the proposal\n",
    "\n",
    "For more details on retrieving proprietary files see the **api-authentication** notebook."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "HTTP-Status=200 File-size=2,833,920\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAvcAAALmCAYAAADG9buFAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjcuMSwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/bCgiHAAAACXBIWXMAAA9hAAAPYQGoP6dpAAB18ElEQVR4nO3df5QcdZ3v/3d3z/QkgcyEJGQms4QQYI38CCCocb5KlCU3Ieairuxd+SGENYKyA65EMZtdxID3mtxwD/5Edj2HH94jiHoO4F10WRIgRGX4FRxjguQAiwSXzMQFM00ImR9d9f0j2011paq7qrt+fD71eT7OmTMz3dXVn/r9qk996lM527ZtAQAAAKC9fNoFAAAAABANwj0AAACQEYR7AAAAICMI9wAAAEBGEO4BAACAjCDcAwAAABlBuAcAAAAygnAPAAAAZAThHgAAAMgIwj0AAACQEUqH+5tvvlmOOeYYmTRpkixcuFCefPLJtIsEAAAAKEvZcP+jH/1IVq1aJV/5ylfkmWeekVNPPVWWLl0qe/bsSbtoAAAAgJJytm3baRfCy8KFC+U973mPfOc73xEREcuyZM6cOXLVVVfJ3//936dcOgAAAEA9bWkXwMvY2Jhs3bpV1qxZU30tn8/L4sWLZWBgwPMzo6OjMjo6Wv3fsix5/fXXZcaMGZLL5WIvMwAAABA127bljTfekN7eXsnnGze6UTLc/+d//qeUy2Xp7u6ueb27u1uee+45z8+sW7dOrr/++iSKBwAAACTqlVdekaOOOqrhcEqG+2asWbNGVq1aVf1/ZGREjj76aNm5c6ccfvjh1dfdtfiV/3O5nNi2Xf3f+XcUKuP3+i43r/fcraeyejUi6vkOJMG5ffu9L3LwCmM+n5e2Nv9db7lclkKhEHkZ42Lbdt1pBwC05o033pB3vOMdMnXq1EDDKxnuZ86cKYVCQYaHh2teHx4elp6eHs/PdHR0SEdHxyGvH3744dLZ2Vn93xnmvcQdLJ3jDxpkwwR75wkEAHXk8/lMBmHdpol9Yzx0WgdE4l0PTK6k0m090E3Q9UrJ3nKKxaKcccYZ8tBDD1VfsyxLHnroIenr64vkO9JYAb2CfdhyNFqwuVwu9Z0KGzdwKMuy2DYQSuXESYcfkbePPzr8xCntY3Ca0l6uUa8LXsPosHyVrLkXEVm1apWsWLFC3v3ud8t73/te+cY3viFvvvmm/M3f/E1k3+FughP3gdc9/rBn93E1GYqaymVTlerLFMgKnU6wotonuPcvUe1v2G8lw8R1NklBypx2wA/7fcqG+0984hPyxz/+Ua677joZGhqS0047TR544IFDbrINymsnZFlWTWBOQuUkovI7zM6RJjfRUunApEo5gCwzdTuLK5joPD91CsxAWMr2c9+qUqkkXV1d8h//8R/S2dlZDXKNdnJJ7KzcVwkafacpN9PGIYkrMoDJnNuXSifMANCILvmgVCrJ7NmzZWRkpOY+Uj/K1tzHpd7BR/XLLBXuGnxq9P3psuECWcA+CIBOdNlnhS2nkjfUxqneDEqi1wd3TXLQ7/O6AYRQDwAAACdjwn3QO+TjCsrO8fr9XU+jEwICPlqlW5eGAADgUMY1y6lIOgxXQlMz4cnr5lvakgNAeDrtN6m0AdAMY8J9o9rytLqZDPJ97uY37uHDlpmb3uCFdQL1ZGW/ods06HIyott8BbLMmHBfEeSBBUmWwdk1Zr3h3Q8K8foNAHFhP5MO5juAsIxpc19P2k1cwnaFGff3AQAAQE9G1NwHqeGOO/D6nUAE6fHG60m6BHQ4ZX2dyPr0qSir89yyrLSLEEjQTiAAwM2IcC+STh/29Wrcw3Rj6feQmKwefBFe1tcD1vXoBN33ZLWr3axNDwC4GRPuk+YO9q0cKJ0nCu6/ARMkua4fOHBAJk2alNj3taKZk56gw+fz2Wy1yX4TQNYZEe5V2Jm7y9BK7Xsz00PNJ3Tmt+5alhV584WOjo7IxhU3FbbptO9ZAqAWXfYHKuw/42JEuPeT1IJ1tpN318AHbZbTalmzvBLDXHHULuu4rRw4cEDa2tqkrS36XTpXCgGEwb4ifZkP934rWdJ92Tt/O8sQJuBXPgMATnE2I2KfAwB6yWajSgev5jBpHqwq3x8mrHNwBaAqXS7BA4ApMh/unZIMyfXa2PvV5Pup1O6n2bZVl+7jACSLygcAUItR4T7JYOzVW04loIe9euDXW06SCPcAAADqMyrci6RzCdlZ6+6stQ9b4+X8vPv1uMVxo15YXP4HAACoz7hwr6t6T9k15bK4KdMJAADQLMJ9Avya6ARte++usSfk1spijX4WpwkAAMQv/bYWhnA2wwnbfj5Ml5kmyuJ8yeI0ASrQadvS6SQ/jvnKcU8/Oq2zWWZcuE9jR+H8TnZWAIAgknrIoarinC6dQqhOy5cnVqvBqHCf1gbi3Pm6V/wwZeJBVgDQGp2CR5Crto2OB1GH/3rj02Xepv28m7B0ma9QhzFt7tN+cJU70DfTHaZuO6RWsDMDgNaPXVEfM0w5BqlEp3lOWdVgVM19GrxqXtzt74M223HeiJvllRIA4sB+M17M33joVtnFepA+I8J90itamBtm/Z5k6zfOesNkidc0clIDoBWEpHjpNn8RPZ2O01leX40I90mvbF6B3R3Ow5SJtvaNl6FlWZLPG9PKDECT0rrhL+z36ri/17HMutApiOpU1qwyItynvcNx1+SneWary1l12BMagj2AoNLaBzbzVHJd6HBc0ZVO6wHUYES4T0u9mpowIdt5UlD5Pwx3bz060rXceBtXV7IrTK2088plEqHFfX8TQQlA1hkR7tOqrY66xr6V/vJ1qbGv0KmsOKjROkawz7awvX+F/UyrdK/ggBpoJgsdGBHuG4k7+Dprilr5rmZr4HXaCel2EoKDqA1FI/T2haxIev3VbXvheJA+I8J9ow1Dhw3HlMvJOiwLE4RtQsNyQyOq1JybsB9NQ9rLNSmmTGcrdJpHWd0fGBHu0+Js6+n1WrO95aRR80V7abNkdVlbliWWZUlbG7u+OHjVzrv/dnJWWgR90mqj/V+rT3QF0DzdwrIu+4Ow5TTiCJdGV5jOG2DdZQlbrlZvqI1CVsMezMO6HB+v2nm/v+u9FnTc9Ybzo1P40CV46EineeuXJ9AanVpEhC2nEeE+aUEWQtibYcN+BsChCPaAGYJc4UH0dMspupSXmnsfSQZkv4dWOf8POz4gLJpSATBV1o6bWZselehwokfNvY8kNwz3Qmgl2Fc+Ty8TCCufz0u5XJZCoZB2UQBlsA8F4JR0t+LNjCPs8MZU6zU660nqzK3Sdi5sGzp3W32/97z+Dzt+ZMf4+HjaRQAAGKjZXFH5XCu5xCszRZFzoqgcSKKCwZia+7TVq3kP27uDu4cJr/ebKR+yZ9KkSWkXAQBgoGZzRRTd5nrdyO+Xv3RAsxwfqvR179X2P2gXcE7NnCREiSZC4TC/AISlS/AQoYIIetJlveWGWkW1Eu6CtrePeiWt9526bBAqsG1bJiYmpL29Pe2iANAI+1kgXrqcQFNz7yPt7iTDPKxFFbqUU3W5XI5gDwCAYnTJOdxQW0eaC7FSC95KGaI+w+TBGNnCsoxP5cm2AACozphwn/QTar34ha8wD72K+q5v1c5aCahQUT6f55kBAdXbz/n9OD/X6MneQctQr4cxAMgyY5rlJMnrQOIM5832buN3E67KzX3C3mug4jToIs55p/I6hvS12h1vHAHf/RluaoeudDo5ZRtTA+E+Ya02y/H6fJQbU9QHQDb0bJiYmBAR8b13gOBkNt2Wfathyf3U8VY/4/deM9+TFp3KKqLfOqsLndYBnXBDrY80w4e7lr3Vvl+BpDW6ITjr6yYnL/WZdkCP+kGBrTTZjEuzJzCIHvMVdIUZA8uyQre3de4YK8Eg6I7Sa1hns4g4gwY7EQBhsd/IJpYroCfCfQDN3EjnDOBh2yvXu3TrNx5qFpGUcrksIiKFQiHlkiRHtW1rbGxM2trauMk343S6IqLaNgKYjHAfs2ZCdzOfyfKOlRMXtejWtjYJSa+jxWIxse9CetjvAWgG4T5G7p4f3DvqMDfI1uttJ+tMm17VUVsMN51O9txNG91l97tHymvfW++z7mG8HmQYdvwqYz8NqMOYcB/VTa1pieIhWKrQcf7jIFW7xEx7nVJtfqA+v26Fww4XZLnXG0cU41eJLicjus1XxEeXdZbecnw4D/5pbNhRP5nWHWbSDjcwg6rrmKrlMgXzH7qEJBGOl3ibLusBveX4iLuXGff3uHnVeIZ5eFXliYt+Jyi6rKAiepUVQLboFEJ12lfqVFagQpf9ATX3dSSx86n3IJJW2827TxzYmZqpcqJH23eoQpcDpAj7TQBv02V/QM29ooLeTFvv8/VuAoNZWP5QiS4HSABqi6qFhelNrwj3MQjSBKjZmvtWPt+KZh7khXjkcjmj+pgHAJPpVJnTajaJKtvoFOzjOBEh3MegUReYzS7ENM9EVdhQTD8T1wUngubRJXyw/4COWG+zLY7la0y4TzMYVr7bq4cbkXA31jrHlyQVdi4qlAGNEezNw7YJAOrgKBwjr64qo6jh4kAK1elSkwtAD+xTgOCMCvdp7BwaPbQkaFBPsuzsRNEqTkABRIl9ChCcMc1yRJLfOUQZkr16yWFnBwAAACdjau7TDsJR3gEepsa/2e+APizLSrsIMAxX9wBAXcaEe51VHlrk9bqqdCuvzjgZQ9JY5wBAXYT7GHk9uCqK8VTGFdUNunHwqk0mEMSD+SoyNjYm5XI57WIAAJA6o9rcJ839RFm/ENZM15aqBzoesoQkjY+P0wUnmtLM/jep7ohVrbzxovoxCTAJ4T5mQQ4CQXaKfsOwQwVEDjvssNjGHfZ5FNBLq08LjxPrHIBmZD7cq7BzbLWWxx0ueFIrkBy2NSB7uCqCLMt8uFdhA2bDBABAHRyXkWU0Uk1ApbebqG6oZaeELKErTwAAopP5mvsKd1OWJJq2OHuziaJZTuXvqMYLqIAbYYFsUOFKeRAcN5F1xoT7tES5E3HvONlBAdzwCqiCbRBQgzHhPqmmLc5ada8w3uoVg8pnVd6JcsMvksS6BiDruCqCMIwJ96r0S9xqsFc5OKtePgAAdMRxFWEY09hV5w0jl8spV36vkxhdahagllZuNgcAALUiD/fr1q2T97znPTJ16lSZNWuWfOxjH5OdO3fWDPOhD32oGlgrP5/97Gdrhtm1a5csX75cpkyZIrNmzZJrrrlGJiYmoi5u7Nw38Tar3mfTCEaqnWxAXyqevEaBExYAQBoib5bz6KOPSn9/v7znPe+RiYkJ+Yd/+AdZsmSJPPvsszVPkbzsssvkhhtuqP4/ZcqU6t/lclmWL18uPT098thjj8nu3bvlkksukfb2dvna177WVLnSaC7ibB/v/P4wZXHeLOj3uSwGI3ij2RNUpMuJDNsOABNEHu4feOCBmv/vuOMOmTVrlmzdulUWLVpUfX3KlCnS09PjOY4HH3xQnn32Wdm0aZN0d3fLaaedJl/96ldl9erVsnbtWikWi1EXOxbOYO48qIQ5wJj0VFoTprFVzB99mLSsTJpWAFBd7G3uR0ZGRERk+vTpNa/feeedMnPmTDn55JNlzZo1sn///up7AwMDsmDBAunu7q6+tnTpUimVSrJjxw7P7xkdHZVSqVTzo4ogD7EKWvOV5fbJBAQAAIDWxNpbjmVZ8vnPf17e//73y8knn1x9/cILL5S5c+dKb2+vbNu2TVavXi07d+6Ue+65R0REhoaGaoK9iFT/Hxoa8vyudevWyfXXXx/TlETH62FaIvWDrbNrzaQfxAVADxMTE5LP53koGAAYLtZw39/fL9u3b5df/vKXNa9ffvnl1b8XLFggs2fPlrPPPltefPFFOe6445r6rjVr1siqVauq/5dKJZkzZ07NMCqE4bDB3s1da+83TSpMK9TAumCGQqHAcgYC0ukKONs1woot3F955ZVy//33y5YtW+Soo46qO+zChQtFROSFF16Q4447Tnp6euTJJ5+sGWZ4eFhExLedfkdHh3R0dNT9nrQ3EOcDrirt8IPsYNyfq6gX2tKeVqiDdcEMLOdgCHXx0Gm+iug1b4GwIg/3tm3LVVddJffee69s3rxZ5s2b1/Azg4ODIiIye/ZsERHp6+uT//W//pfs2bNHZs2aJSIiGzdulM7OTjnxxBOjLnJivAJ6MzfXNvNZAAD7zbjoNl91ORnRbb5CDZGH+/7+frnrrrvkpz/9qUydOrXaRr6rq0smT54sL774otx1113y4Q9/WGbMmCHbtm2Tq6++WhYtWiSnnHKKiIgsWbJETjzxRLn44otlw4YNMjQ0JNdee6309/c3rJ1Xibtm3vl/M91hOv83qRcdIIxmmrsBMAv7B4joc5IXtpw5O+Ip89tgbr/9drn00kvllVdekU9+8pOyfft2efPNN2XOnDnyl3/5l3LttddKZ2dndfiXX35ZrrjiCtm8ebMcdthhsmLFClm/fr20tQU7HymVStLV1SW7d++ujjftjdkr7AdVCfGEeQAAgNbpEu5LpZL09PTIyMhITVb2E3m4V4Wq4b5Z3DibPSw7ZIVOhxG2OQC6KZVK0t3dHTjcx9pbjkrS2KE3cyNsPV61/hyo9JXL5aRcLkuhUEi7KEBLVN0P6d5Ei5MmAM0wJtwnvZN3B3tnoI+iDNT6ZgPLEIiP7tuX7uUHkA5jwr1IsjvKOGpcuIk2e3jgkLpMeSiUZVmZn0YAydHlilOWc5Qx4T7thej+/rABvV73mYR9IHr5fN6I7YpgD6hNl7As8vYzfHShy7wNW05jwn1FmkG4laY5jR5YRcDPLpZtOgi9AFTA/j8+uszbsOU0JtxXAlIaCzKK7270WV1WUB2odhOeKuVA9plwIqlLTZ2Ifts+8xZQgzHhPg3uGvVWDpyqBc4sYx7DVKz7aAXrD0T0OcnL8vpqTLhPeiG6n0YbVRlMqFkDAAB6IqOkz5hwnzT3matfn/dhRTWeLLNtW2zbNqrNNCd9QDBsJwCyzpz0k6B6N766H2bVzDh1uxs9abpcEgQAAIga4T4Gfk+l9arNDztONGZC3+RuqpzsWZaVdhEAADAazXJiFlXocjbHAVRl2kkVgLfpcoxSpTIEiAvhPkbOGvwo2kSzQ4oP9zHorbJ9ube5CpYrED+2M0ANhPuYuXvNaaUrTHac8WH+6s8Z5gn2ALIkqqsifq0AnJWQrXwX+1s1EO5jFsXGInLoBkMYjZaKNymzjIPxqrV3vofwRkdHpa2tTQqFQqDhdZnPbE/QVZTrbr1OP6L+LqTDmHDvDkpJBSd3LzfNcgcXNr5oqTg/VSxTFKK8f8RdQ++8cd358Dj392Z13kalo6Mj1PDMTwBQhzF3vzkP9EnWiDrDRhS197rUkAF+3OuwV09SUY1X5NDgSRAF4uO1PTezfUe1XwBMZEzNvVMaT6sVObRNcJhyNBqWJhz+mDetmZiYkLa2+HYVUT3Uzes195Uu1oN46BTCWAfi5TV/m5nnLCegecbU3Fck3RQnynI4Q2orfeabhnnTmriCfZTdxDp/6xQ08TZV9s0qCrpOh60x97oJne0H0J8RNfdp7NDdveRUuAN60LK5h9X1IAVUeAWRsOt1o89w1SYZUZ+ooVbQ+RK2CZrXMYVlAJPocjIbtpxGhPukb6KrtxBaCegEFXjJyk2io6OjMmnSpFCfaVRbr/s8gdl0CR4ibGvQky7rbdhyGhHu02hj7+yeL8oHWBHw4+G8yqLbU1azsj6EDfZOXvMgyZvnDxw40FL5dcS+KH7MXwDN0CvFNCmOu+5t25aJiYlDXncH+yj6T/fq3g/RqiynpIK9TjVyOnF3jZnU9tLe3p7I96iEfREAqMmImnuReA5EXjcautvZu4O+e9igN98SBrOFYBSPtOZr0Ic9ZZUu+ye2OwAmMCbcRy3MQSJI0A/yeQBQEaEZANRhTLhXpX1okJp8rz66w/Ysosr0AgCgGp0qzXQ7ljNv02dMuE9rAbqDuVd3Y0Ha5rtPCMJ0ceb8DiDrWNcBNMI+Ij7M2/QZcUNtGiph3V0L73VG69U3cZCNQ6ezYyApHFgAACYj3MfEq4ebVnrvqIyv3hMIg/avDwAAgGwyJtynWcsdNICHlWRXf8g2r25dAQCAfowJ90lxP4HW2Tyn2WBf+VylD3aexomoeXXrmoZyucyJBgCEFCRf1BsmTD6J49lBiJYx4T6p4OuupXc2zXG2uw+zYXi1yc+yuHYaqu2MLMtKuwjKKRQKypxoAIAugj4zp5XPO4fNeg7RHUfRBDmDftigGbSXnCyIaxpVm3dJPQ03KHqZgQlUO8mvh+0RFbqst6yzaiDcx8Qd4L1urg2L8IU4sW7BBKzn0BHrLcJQq+owZkme+TqDeKN2bo3KpcsZO+LDOgAA0A3HrnQYVXOf5pmv33eHaSfHmbu5WPYAAN1w7EqHMTX3aZ49BqnBh164GVZtbGsAAFMZE+7TOHv0anPv/p10eQg90VDtZljUorYIAGAqo5rlpMXdS069G20bjSPIsH4IPAAAANlGuE+Q1022YQM3AR0AAAB+aFuQENMeRAUAAIDkEe4j5hXa3b3dONvdh3lkNCcE4XGfAQAAMAnhPmJebePdAdMZ0oMET0J983hMNrLCtm16aQIANES4j5Gzxt2vRj9M8KQWGjCXZVkyMTGRdjEAAIrjhtqUhQn37mGdN+gCyJ7KCX0+n5dCoSCFQiHtIiFhulTo6HYs0mW+iug3b5E+wn0CogrhXuMh4APZVbm6x3ZuLpZ7PJivyDJjmuWkfZbubFLTTFm8mvCwc8qGtNdNqI9tHQAQlFE196rUfkVZBhWmB61hGUJ3Op2gsr0ByDpjwr0KO/RWyqDKiQkAuOmyb7JtW8rlctrFCCyf1+fiui7rAGACY8J9miptZp2aCesE/GhYlkUXmYCBcrlczU3J9fapKjxfRKcrIgDUYUS4T3Ln7Bfk3f+HvUmOIBodnWrDAMSn3n5VhX2uCmUAoB8jUk6StR9+3+XcSYd9iBUAAAAQhBHhXgXunnLCXPJtpZcdAAAAmINwnwCvWvswbb6dnwEAAAD8EO5j1OhGraCosVcXywYiolUPLACAbDMm3KcRwvxumA1bA1+5+dY5De7/kQ6upkBEanpgAQAgTUb0liOSXghzB3KnoGXyap9PqAQAAICbMeE+rT7i3V1jhu0C0/kZ+rkHACAaXsdmv//rCTJsmPE5PwM0w5hwn5aoHl4FAACi4z4WN/o/zLiaHQaIgjHhPu2NqpXvr3yWkG82rtwAAIBGjAn3aWu2vb3z8wQ7s7H8AahMp30UlWXIMsJ9zJppY+/m/jxBHwCgGgIzoAZjusJMi/Ppso12fGFu3kkaJxPp4inFAAAgCGPCfVqhqPIk2iBPpPV7332XPQHPPLZti2VZnGQhVex7AEB9xoT7NETxhFpV+rjnoH6oSuBOQj6fl3yezRXpCVJBAQBInzFpQaWDUrPda1F7H7+wJ17OcB827Ju8DE2edj8qzROVyoJksMyB7OCG2hh51bpXXg8T8CvDu2vv/caP5oWZl+7a9LA1myYvt7inXcdtQ6Ub5b3KQfjLtijWPV3WEVW2MyAuxoT7tJ9QG/S73U/Ic/72GjeQNhWDtEplCYpmV9CdjtsdkEXGhPu0hD2pYOcIHbHeAgCgBmOqitIMH/Xayge9jKnL5U6Yh2Dvj+0WAJA0Y8J9mgfZSvjxazvfiF/ZCQ6A2kZHR9MuAgDAMDTLSYBXqA+j0m7f3bY5iqff6s706YfaJk2alHYR4KJTpYhu+zZdyqvTOgA0w5hwn9ZOxxnM3TX4zYwryGsmqUy/ZVnckAigIdP3mXEiNANqiDwNrV279pCnsr7zne+svn/gwAHp7++XGTNmyOGHHy7nnXeeDA8P14xj165dsnz5cpkyZYrMmjVLrrnmGpmYmIi6qIlx1tq7Q76fcrlcM0zYrjNNY0KwN3G5AgCAcGKpuT/ppJNk06ZNb39J29tfc/XVV8vPfvYz+clPfiJdXV1y5ZVXysc//nH51a9+JSIHQ+3y5culp6dHHnvsMdm9e7dccskl0t7eLl/72tfiKG6snOG88neQZjqFQqH6Oee4goR81Wumgk6Hil0spon5gGZwVQsAzBJLuG9ra5Oenp5DXh8ZGZFbb71V7rrrLvmLv/gLERG5/fbb5YQTTpDHH39c3ve+98mDDz4ozz77rGzatEm6u7vltNNOk69+9auyevVqWbt2rRSLxabKpErbbGfID8N5YlAZj66Cll3naWyk0lSL0NU8VbZp1bGOAYA/Ha6Khy1jLHv9559/Xnp7e+XYY4+Viy66SHbt2iUiIlu3bpXx8XFZvHhxddh3vvOdcvTRR8vAwICIiAwMDMiCBQuku7u7OszSpUulVCrJjh074ihuJOo9aMpdax+W+zPu2nzoJ5fLEboAAEiZuym5qj9hRF5zv3DhQrnjjjtk/vz5snv3brn++uvlzDPPlO3bt8vQ0JAUi0WZNm1azWe6u7tlaGhIRESGhoZqgn3l/cp7fkZHR2u6nSuVSjXvJ/W4e6/X3QvGfYNtI3694nj1n09NJkzBug4AwKEiD/fLli2r/n3KKafIwoULZe7cufLjH/9YJk+eHPXXVa1bt06uv/762MYflFezG+f/rXSJ6RyXsztMr+8m+ADZwXbdPJpvATBN7O0Cpk2bJu94xzvkhRdekJ6eHhkbG5O9e/fWDDM8PFxto9/T03NI7zmV/73a8VesWbNGRkZGqj+vvPJKtBPSImcPOc6fIIK0t3eGfQ5kQLZkcbtOqklh1uYbADQSe7jft2+fvPjiizJ79mw544wzpL29XR566KHq+zt37pRdu3ZJX1+fiIj09fXJb3/7W9mzZ091mI0bN0pnZ6eceOKJvt/T0dEhnZ2dNT9p8DpgedWot3KwdjfHCXOiAABpsywrtX2Wu4JF5R8AaEbkzXK++MUvyrnnnitz586VV199Vb7yla9IoVCQCy64QLq6umTlypWyatUqmT59unR2dspVV10lfX198r73vU9ERJYsWSInnniiXHzxxbJhwwYZGhqSa6+9Vvr7+6WjoyPq4lYdOHBAOjo6Yqnl8Wob73cSEIRfzT2XnwGkIWwQzeVyqQT8LF4BAQC3yMP9H/7wB7ngggvktddekyOPPFI+8IEPyOOPPy5HHnmkiIh8/etfl3w+L+edd56Mjo7K0qVL5bvf/W7184VCQe6//3654oorpK+vTw477DBZsWKF3HDDDS2Vq1HwjeMx8e7291E8odbdV77X+xy8ACSplX0O+yugNRz34ZazM3rtr1QqSVdXl+zevVs6OztTX/H9vj/IRul+qm29EM9Gnh7mPUwV9DDi1S1wktsM2ycAHZVKJenu7paRkZFAzc5jeYgVvLmfVhv0EnGYXnA4eKWHeQ9ThVn3m3nqNhA1neo1uSqPsAj3CfFqd+9+P0hwT2qHxI4EQJzYv2SLTmFZRL/1T7fy6kCndTZsWY0I92lvFH41VY2a2Dg/4/ydRHOctOcZWkO/6Aij1f1HKwdJnQ6wSYtz++WYgbjosk3rtM6m/oRaHMpvJ+rsFrPVHa1OKynix/qAMFpdX1jf4hF3SIpy/KwDgDoyH+5VaavmbmPvLpO7fF7vqzAdME+5XJZCoZB2MQDjJNkUMwq6lJXjKLIu8+FeJN0N2W/nHObG2CwEe93Lb7Jml5tlWTI+Ph7r8ynQPLbJ1iQ1/3RaRjqVFfFhPUifEeE+TRxAD2I+6Cufb+5B1vl8Xtlgn+X1Mei0ZXX6G4mydjnummpTlxH0xhWc9GU+3Fce453WQnTWuns90CoMnW+SbDYgAnHQcRuKg877lGaZNK0AzJT5cJ829xlss20o6RsaQBDN9jnfCl1q6kQI90Dc2MbSR7hPUBQrfNDuM5EclgVMx/oPAOowJtwnGcD8muCEeSptvXE7fzdC8Iwf8xdAHLgiAqAZxoT7oPbv3y+TJ0+OdEflbNcaNGx7PezK+Tc3zQFAtrH/BtAMwr3LlClTWh6HX21LmFp0r64wG40/LGr1AQAAssWYcJ9mbzlO7kAdpgbeXYMfddkAIOt0a+qiS3k5ngDqMCbcp8GrWY17Bxi2Z4so2u0DAPTAvh5AWIT7GDXT1r7euCqhnuY0ANAc9p0Ass6YJwslcWnTq0Y9qjDOASldulwaBxANtnkAujKm5j6JcOyuqXe+Fsd3EfiTY9L8PnDggBQKBWlvb0+7KJHTqQ2zTnSap810agAAOjEm3CfJ3ce9bduRhUOTQqZK8nljLnJJW1tbZtcxnUKoTrK6vgBAVJLMb4T7mMXR7h6IU1sbuwUAAKKUZH4zpzoyJc52+PUWbJAaRedVgKCfAQAAgDmMqaJLq9bb+UTZCq9+7pt9uBUAAMgunY71VDqqwZhwnwZ3TXvlNfcwYdE8J12VZWpSO3wAQDoIzAjLmHCfVq19o9fDlIsNXA2qPUTMeV+HyTjpBQDAoHCvAnfb+2bDOgEGTqwPBzEfAAAg3CfG2VtO2Hb2ItTOAgDUptPVZY6lyDLCfYy8An0rOz+vnRFNEdLDvAeAt7E/BNRgzB2BadQoeH1ns+213T3suGvydaoxyQoOZAAAQDXU3CfA3S99s6HQ2ZzHHeYJmgCQPbpU3HAMAtRBuI+RV616s11fusfnDPjsVNND0xy9sfygOtZPAGEZ0ywnDY2azwStkXE35XH2usOOP13Mf72x/N6mSw0xAKA+wn1CnDWEzdS4j4+PS7lcburkIC22bcvo6GjaxQAyKertnxMdAMgGY5rlqHDgauVg3NZ2cFG5p0PlZgW5XE46OjrSLgYAAIAxjAn3KoTgVm6k9fp83F1jqjDPopKlaYkT8yk6cc9LllP2qX511on1EVBH5sO9+6mwSX2n+ybaVnfSQWvso5rOShOgyhWDJMR5gzAHnmCYT9GJcl6qftJFCI2HTmUFoI7Mh3sV+revV4aggbbeQ7DiCMWFQiGycQWV9IFM9cAE6ILtCADUkflwrwq/2vygtfpeveX4/Y9gmG/QASehAIAw6C0nIX5Pq3X+9lM5AdCppxyE416+Otu7d6+MjIykXQwAAIxkTM19WrVfUbS39xtvHCzLknyec76kjY6OyqRJk9IuRiS6urrSLkKmUGsPAAjDmBSX1gHS2R4+TBmCnBDEUdtLsE9HVoK9iB4PV7MsSyzLSrsYAABEzpgkl3aTh1aa1XjdoFvvybcwA8u8efl8nhNZAEAmcXRLQZBazSA30Dqb/KheU4roscwBAICbMW3uVVAvsIfh7nUHANKky1Uk9pcATGBMuFdhp+68qTfN7u1U6VpPlXIAaA3bMQCog2Y5EfO7mdD5mjvkV343qv3yG3fYWjNVDsSqlAMAACArjKm5T4pf0PZrShO0r/vKOMIMDwBx06VJTgX7TgBZR7iPkV8f942aozR6nyfUmoFmS7WYH2pqtovfes8AcT7BO+h43VdD/T6r08kI6zuAZhgT7pMKBkEeWhXkibROXl1ostPPPpZxLeaH/sJUTIRZ3mE6K2A9ApB1xoT7JLi7qAz6IKpmDjbUYnpjvgDJ06U2nH0DABNkPtyrtDNvdKNtM+MizNZiXiQnq+tekKtv9WR1vtRj2vQCgMoyH+6TPNA2CgSVskRZJg6qSEtW171Wa6GzOl8AAHowoivMuC8Ze3VR2agNqN+Nto2+x2t8ulwSB1THtgQA0J0R4T5uXu3r3f8HuZHMr8bP3QTHfYNtGjWFXjf5ZpVlWWkXAQmh1h0AoLvMN8tRQaOgH3ZcYXqGiIsKZUhKPs85MAAA0IMxqSXt2mW/p8s2M56KoD3ymKZcLsv4+HjaxQBiMT4+znYPAPBlTLhPunY5yu/zekBL5TtUrjX3CiATExOxf2+hUJD29vbYvwdIQ3t7u9LbPQAgXcaE+6S5Q3jltWZq3Or1sFMZn6o1ee5ytbXREixtqq4rAACgdSStGPnVtldE8bTZqLvWjJKKZQLLBQCALKPmPmJ+T6l1B/1KIA8StPx6yXF/JwAAAMxGzX1MvJo+eD35Mkitu9fn/D6jai0+AADIPl0ySJabqBLuI+a3sviF87AbQZATAQBIkk4HSfaR4VBhhLB02h9klTHhXqUdlLv3m6DlUqX8AOAU9b4pivuREA2WAaAfY8J9mjsov15uwrS5d/+t8o20ANAK9msA0Dwjwn2aT3F1d3/pLItlWTVPPw3b/p4DIAAAQHN0aUIUtpxGhPu0+PV17xX6ncO4uW+odQ9H2AcAAAhHl9wUtpxGhPu0mq84Q7lXO3tnrX097gdVucejy8oJAAhHl5pFjkOAOjIf7tPc4bgDvVOYh1m529fT1h7QE9suwmJ9QRjsYyDCQ6xi5dfm3q9ZTZjxOn8DKtOl5jEJbLMA4sQ+BiIG1Nx7NYtRTdjmORWqTg/gxD0hAAAkh5r7BLRaUw/oLJ/PE+w1VS6X0y4CACCkzIf7NJuw+N1M22h4L87ycxMtoIY4w68KlQBBryoCANSR+T13GgdIv+DtfgBV0M+5h/HqRhNA8uIMv/v3749t3EFRiQAA+sl8uFeF11NmCejZwbI0k1evV1E57LDDIh0fAMAMhPsYhGle02h4v3FTo6YWlgdYBwAAKog83B9zzDHVNuHOn/7+fhER+dCHPnTIe5/97GdrxrFr1y5Zvny5TJkyRWbNmiXXXHONTExMRF3UUCzLEpFoDuDuNvNBxskDqw6ihhyIBjfLAkA2Rd4V5lNPPVVz0Ni+fbv8t//23+R//I//UX3tsssukxtuuKH6/5QpU6p/l8tlWb58ufT09Mhjjz0mu3fvlksuuUTa29vla1/7WtTFDSxoLbu7PX29B0+FqYUPezIAAPUUCoW0iwAAiEHk4f7II4+s+X/9+vVy3HHHyQc/+MHqa1OmTJGenh7Pzz/44IPy7LPPyqZNm6S7u1tOO+00+epXvyqrV6+WtWvXSrFYDFWeqIJw2PE4b3yt9+RZhMM8S5ffzeCmYn4AAFQTa5v7sbEx+cEPfiCf+tSnakLZnXfeKTNnzpSTTz5Z1qxZU9MrxMDAgCxYsEC6u7urry1dulRKpZLs2LHD97tGR0elVCrV/Igk34zD62ZZ99/NlIkectQUZJmEXW4qL2eVy5YG5gcAQDWxPqH2vvvuk71798qll15afe3CCy+UuXPnSm9vr2zbtk1Wr14tO3fulHvuuUdERIaGhmqCvYhU/x8aGvL9rnXr1sn1119/yOtptFP3qs2Lqr99lZ+0K3KwfBMTE9Le3p52URIRtklVVONENqi+PQMA9BNruL/11ltl2bJl0tvbW33t8ssvr/69YMECmT17tpx99tny4osvynHHHdf0d61Zs0ZWrVpV/b9UKsmcOXNSqVkL+p1hDuyVEwYdgoAOZQTiEHYbZVsBAEQttmY5L7/8smzatEk+/elP1x1u4cKFIiLywgsviIhIT0+PDA8P1wxT+d+vnb6ISEdHh3R2dtb8iKR78HReNWi1b3tdLv/ncjlpa4v1nBFQFmEdAJC22ML97bffLrNmzZLly5fXHW5wcFBERGbPni0iIn19ffLb3/5W9uzZUx1m48aN0tnZKSeeeGJTZUk6GFdCvfOG2lYO+o2ebAsAAACIxNQsx7Isuf3222XFihU1tbgvvvii3HXXXfLhD39YZsyYIdu2bZOrr75aFi1aJKeccoqIiCxZskROPPFEufjii2XDhg0yNDQk1157rfT390tHR0fosjhrzJOqVfPqCtOrDGGa5LRaHmoUAQAAsi+WcL9p0ybZtWuXfOpTn6p5vVgsyqZNm+Qb3/iGvPnmmzJnzhw577zz5Nprr60OUygU5P7775crrrhC+vr65LDDDpMVK1bU9IuvG3d/9s2E7VYCOsEeAADADDk7o+08SqWSdHV1ye7du6vt70XSC7peD7dyN7epVzZq3wFUsD8wQ+XJ6DrgCepAfEqlknR3d8vIyEhNpvVjzJ2PKux03E10/N6LmmVZ7HiBDGFbNkM+H+ujaABklDF7jjQvUPjdCNtM0xyvvxvJ5/OEAVRl9GIdAAAQA8J9VA+PauX7owj27uEJ660xOeCy7gAAkF2ZD/dphzivbiz9etNpxN1nftwqXXlmEQEXAABkUebDfb0Ql1Q79HrdYVZea3Z8caKdPgAAgF4yf0Otu7a83k2tcfDqJcdrmEa8yg8AAAA4Zb7mviKNWnoR7z7uvd5vZtwAAACAkzHhPsl26mFeDxPYs9r+HQAAANEwJtyrUuvt1SwoaGivNPEh5AMAAMCLMeFelUDs1Syn0YmH+yRAp6cWAgAAIDnGhHuR9AN+pd2/sx1+M1cUCoVC1EUDAABABhgV7tNsmuMO9WE/W/mtSvMieEv7BBLxS/vBeAAA1GNUuE+Ts2lN2ABIYExP2CZQExMTMZUEKiDYhxN2f+ccttnPAYDpCPcpaCYYECbSMTo6Gio4tLe3x1gapIltMLywVxudwzb7OQAwXeYfYqUSd1/3HJDUN3ny5LSLUMV6U1+Qm9ObxTwHAOiCmvuEOIO988baoLXCzV52tizLuEvWWZpe99ONCZn+kg72WVrPAADZYUy4TzsUOYN8vd5yvAKD39Ntg8jn86lPe9KyNL1ZmpaoJRGukwr2nCgAAKJiTLhXQSXMez3IysnEA72J05wEv/lqWZaMj48nXJpotXri0+w6F8e6ykkcACAqtLlPmLNdsFcbYa+afBMO/CZMYxr85ms+n5d83uxze9Y5AEAWmX10T4j74VVhboykj3sEwZWPeHg9URoAAJUR7hNQaW/v1Ud23DfUQg1xL78snfiptq5Xtl/VygUAgJfMh/ukQ0+jhxg1aoYT9HNAVrGuAwDQvMyHe3dTmLi1tR16G0MzNfVeqDnUF4EVAAAkIfPhXgV+TXKaHRdgKsuy0i4CAABKy3xvOWHCdJQ90zhvoHWOu5WnjFL7C9PF0cOPe1tNUprfbSqd5jf7fADNyHy4b6ZnGr/xhD1RqIzT2TSo2Z21KV1iAibRKWhmBftRAFlHs5yAWgnlrY6j1c9CPTQviRYhGQCAgzIf7lUIxbSzh5vpD5CKUqtXtdi+AABZkvmE4W73nnYZkvxOQgtMoMIJfJzYjgEAYWQ+3Duf7Bp3CPAafxTfmfXwAsAf2z8AIIzMh/ska728vquV3nFa4TypAUxH7Xe0yuUy940AgKIy31uOSDo9zSQV6ulFB2iMbSRaVB7Aiy4n0Tquu7rMW93uJ9NlvoZlRLhPmt+OI44g7jU+Aj+AOOl2AEcyOO7ER5d5m9WwrJvMh/u0Nwjn9ydVlrSnGQAAAOnIfPVLWj3VOP+m5xqgOapsN6qUAwCARjIf7lXgrEkn6APBqXIVSpVyAADQCOE+Zs5uONPqOQcAAABmyHyb+yRUgrszwHu9TqiHKlgfAfXpdJWX/QmgDsJ9BCo7YL8dsfP9yg4wbLgijCFKrEswFYEZQNYR7mNQqal3H0Ra6TmHnTz8jI2NSbFYrDsMJ4fAQWwHALKONvcx8KoZ4oCCuARZt1j/AAAwQ+Zr7tMKNc7mN0Cc2tvb0y4CgJh43c+lIioQAHVkPtx7tXdP8nv9/hcJvzNMahosy+IJlACgAGePawAQRObDfUWaO0Z3P/fNliWpaYgi2FuWJblcjgNSQHSTCgAAomBMuE+D+8Zak8IuNf/hJH1VyZT1EMlQvcmIE+s+gKwzJtzHGWj82kN6Nc3hwNI85l80mIeIGusUAKjDmHAf58HHrz19va4wCarhMb8ANVFzDwDqyHy4T2tH7hXsnYFe1ZtpASAs9k0ARPTbF+hUMRFG5sN92guulQdX+Y0HAABANWlnLhzEXY8xc95Qy0qPtLDuAYga+xVATZmvuVeBu0lOEmjGAyeagQGImnsfoUvYZ9+GrMt8uE97I077CblpIBiGp9o8U6ksaI3z5v4gfzeDUAcR5i+gisyH+6QPOvUOkqoFuLiYMI1RY54hbl4383v97d5PBdmHsv4CgDpocx8z54Ex7AETAJrlF9aDfs79v0kP4QMAnRHuI+b3MCu/A2aS5bEsK5HvBJC+KCsQour1CwAQP2PCfRw15TpcrnZ+fz5vzOIG8F+cTQWdvXcBALIp823uK+II2UHGyYEUaTHlHg94c98w6/wNfehyDGHdAtRhTLhPEzs9pIH1zmxxhUJdwmZWsB0DCIt2GgngUjigrnK5LAcOHEi7GLGp7H/cP80ibAKA2jJfc5/2gajV/qObQXMMxCGr61WhUJBCoZB2MRLntV9yPnCPCgkA0FPma+7TOEA527e627wm9f2qXy1QuWymY9kkT5Xt1XnjLQBAT9Tcx/y9adWAqV7Dqnr5TOa3bJJaZs7+2U3B9gAAiErmw30aAcGvr3sRDuIAAACIT+ab5aTBK8BH+XTHcrkcyXgAL7Zty/j4eNrFAAAATTAm3CdZgx/3d/EwKsQpl8tJe3t7at+vSvtzAAB0REqMkbumPqrAQtMefViWlXYRAACAQYwJ93EHYuf4/W4IJJSrI6maYdWusrAOAgCQbZm/oTYpzrDo/LtemOImWyStUCiIbdtiWRZNXwAAyCC1qhVjlFQ73jBBPcqbbBGOifO9chUhn88b+dAmAABMYEy4T4q71p6HwkAV7nVThROcsbGxtIsAAECmEO4BQ9i2LRMTEzIxMSHlctk33FeGS0KxWEzke7LGvez8Tta8ml85H7DnNQ7nj9dwAAC10eY+Yn5PpHW+zsESaWrURM22bZrtKM6yrJr9iHvfUvnf64Zu99XEek/R9gr4XIUEALUR7mNQOVjatu3Ziw6gMtV6+FGVe/tOUr2rLlGOD8gqnU5S2T4RVuij+JYtW+Tcc8+V3t5eyeVyct9999W8b9u2XHfddTJ79myZPHmyLF68WJ5//vmaYV5//XW56KKLpLOzU6ZNmyYrV66Uffv21Qyzbds2OfPMM2XSpEkyZ84c2bBhQ/ipS4G7VlSnHQiA4LJywK3ss4J0OsD+DFnh1QxN1R8grNDh/s0335RTTz1Vbr75Zs/3N2zYIN/61rfkn/7pn+SJJ56Qww47TJYuXSoHDhyoDnPRRRfJjh07ZOPGjXL//ffLli1b5PLLL6++XyqVZMmSJTJ37lzZunWr3HjjjbJ27Vr53ve+18QkpqveJW+8jXkENM/ZfIYgAQBmy9ktpKpcLif33nuvfOxjHxORgwGtt7dXvvCFL8gXv/hFEREZGRmR7u5uueOOO+T888+X3/3ud3LiiSfKU089Je9+97tFROSBBx6QD3/4w/KHP/xBent75ZZbbpF//Md/lKGhoeoNd3//938v9913nzz33HOBylYqlaSrq0t2794tnZ2dNWWOi1eQ52AJICmVfVDc+x1OxgEgOaVSSbq7u2VkZKQm0/qJtHHtSy+9JENDQ7J48eLqa11dXbJw4UIZGBgQEZGBgQGZNm1aNdiLiCxevFjy+bw88cQT1WEWLVpU05PG0qVLZefOnfKnP/0pyiJHigMeYA4Vt3dnsI+zfNT2A4C6Ir2hdmhoSEREuru7a17v7u6uvjc0NCSzZs2qLURbm0yfPr1mmHnz5h0yjsp7RxxxxCHfPTo6KqOjo9X/S6VSzftJNY+hGQ5gBlVDrfuenyTKqeq88ML+GUDWZaZbjHXr1klXV1f1Z86cOTXvJ7VDd38PBxIAaWIfBABmiTTc9/T0iIjI8PBwzevDw8PV93p6emTPnj01709MTMjrr79eM4zXOJzf4bZmzRoZGRmp/rzyyiutT1ATvC5Xm3RwNWlaAV2wXQKAOSIN9/PmzZOenh556KGHqq+VSiV54oknpK+vT0RE+vr6ZO/evbJ169bqMA8//LBYliULFy6sDrNlyxYZHx+vDrNx40aZP3++Z5McEZGOjg7p7Oys+XELc+m42cvM7m7lTGuTatK0ArqIc7t07/NU/wGArAsd7vft2yeDg4MyODgoIgdvoh0cHJRdu3ZJLpeTz3/+8/I//+f/lP/3//6f/Pa3v5VLLrlEent7qz3qnHDCCXLOOefIZZddJk8++aT86le/kiuvvFLOP/986e3tFRGRCy+8UIrFoqxcuVJ27NghP/rRj+Sb3/ymrFq1qqWJDbNjj+IgENcB1euR8oCuOCGMX5I316r+AwBZF/qG2qefflrOOuus6v+VwL1ixQq544475Etf+pK8+eabcvnll8vevXvlAx/4gDzwwAMyadKk6mfuvPNOufLKK+Xss8+WfD4v5513nnzrW9+qvt/V1SUPPvig9Pf3yxlnnCEzZ86U6667rqYv/GYkuWOPs0s6niCKLOFE1VvU+480n6iL7NPpyggnesi6lvq5V5lXP/dp9XHPQRVAWHHtN6Iap649g+lYZgBmS7Wfe9UltVN330hLsAcQVpT7DecTbKMYjwghGQBUFWk/9ypqdPnN7z3ngctZQxV0XAR6mIYrVGqLIth7BXrdmjhwUgJAN2GbYxsf7ut9rt7/AKCLOE+8crkc9wEBQIwKhUKo4TMf7gEkgxNgtbXSTNDdQQBXaQBAXVS3AEAAWWnOEXY6vNrrE+wBQF2E+5CycoBHOPv372fZGy4rgdY9HZZlBR4WAKA+muWExMHOTFOmTEm7CEAs/NrLs68DAD1Rcw8khLAEnVQeSsQVKwDQCzX3DvRLj1bZti2WZXne2U5I8ldpGpJmryu6PpQpCfXmC/tLAFAL4d6BgxSiUC6XQ3dbZToVulKMKtirfpLg9yRtAEA2pH9ERSImJibSLoIRcrmcFIvFtIuBFKkc7L04m9/QDAcA9Ee4N0RbGxdpTEStLJrhDvh+wZ8TAQBQD4kPyDDCl7e4m86odP9Osw+c8ps/BHwAUBs19zFR4aAeFw7m0F3c67Bt28o0hXPui/ya3bBNA0B2EO5jkuWDpSqhxUuWT6qgj3w+L+3t7WkXoy5n0Ge7AYDsINxDRMId3FUOLVk+qQKa5a6xZzsBgOwi3ENEzDnYU0MJE1XWe6/13xn8nb9N2ScAQNYQ7mEUAgucJiYmjFon6k2r88bbXC5X/duk+QMAWUC4B1wsy6o+MbUVo6Oj1b9Vvk/BZPl83pirOZXAXq8W3+9zAAB9EO4Bl3w+H8kTU51PqQ3znAEVa0qzGvDSfDJulMu51XE5Qz8AQG+Ee2glihr1pDT74DAVQ1bcfcLv378/0nGqOA/d0ixj2Np7AIA+CPfQSpo1rYhHLpeTKVOmRDpOFa9+xKmVkE7AB4BsISkBAAAAGUG4BwAAADKCcK8o05oVAAAAoHWEe0XRDhZAGJZlUSkAAJDmuvMAACiFm80BACLU3AMAAACZQbgHAAAAMoJwD2PQHhloDtsOAOiDcA9jcJMy0DwCPgDogXBfBwezbCLkA+Hkcjm2GwDQBOG+Dg5m2cRJGxph2wcA6MrYcD8xMZF2EQAoihNAAICujA33hUIh7SJEijCCOLF+AQCgB2PDfdYuu2dteqAW1i8AAPRgbLj3Y1lW2kUAgEhVbojlJA0Asq8t7QKohke4A8iSXC5HsyoAMAhJFgAyjGAPAGYh3AMxaTZU2bZN8zAAANAUwj2gmFwul+nmYdQkAwAQn+wmCCBl3LzobWxsLO0iAACQWYR7AInq6OhIuwgAAGQW4R5ApGh2AwBAeowM92mHj7S/H/5YNq2jOVJ8WD8BAI0YGe7TDh9pfz/8sWwQJdu2pVwuRzY+1k8AQCNGhnugFVmvPc369CUpl8tJoVBIuxgAAIMQ7oGQsl57mvXpAwAgywj3AAAAQEYQ7gFAETSJAgC0inAPAIqgSRQAoFWEew1RuweYa2xsTCzLSrsYAABFEe41RO0eVMbJZ7za29sln2fXDQDwxhECQKQ4+YwX8xcAUA/hHgAAAMgIwj0AAACQEYR7AAAAICMI94AHeiMBAAA6Itwj85q5AZHeSIBguMEXANRCgkHm0TUjAAAwBeEeADSj0gmrSmUBABDuAQAAgMwg3AMRsyyL2kzESqV27iqVBQBAuAcil8vlCDwwBieyAKAWwj0QMYI9oqR6eGZ9BwC1EO4VQnMOAG6qh2f2WQCglra0C4C30bc6AAAAWkGaBAAAADKCcB8TLlUDAAAgaYT7mOzevds34OfzeSXDv4plAgAAQHCE+xbUC8O9vb2+N8JZliW5XE7K5XJcRWuK6jfuAVAP+w0AUEvmw71lWbGNu9WDWqFQiKgkSAOhBgAAqCbz4Z4eaBCXZpsx0fzJH/MGAIDWkHyBhFHj7495AwBAa0KH+y1btsi5555bbVN+3333Vd8bHx+X1atXy4IFC+Swww6T3t5eueSSS+TVV1+tGccxxxwjuVyu5mf9+vU1w2zbtk3OPPNMmTRpksyZM0c2bNjQ3BTCaIRFAABgktDh/s0335RTTz1Vbr755kPe279/vzzzzDPy5S9/WZ555hm55557ZOfOnfKRj3zkkGFvuOEG2b17d/Xnqquuqr5XKpVkyZIlMnfuXNm6davceOONsnbtWvne974XtrgIIMtNIbI8bQAAAG6hn1C7bNkyWbZsmed7XV1dsnHjxprXvvOd78h73/te2bVrlxx99NHV16dOnSo9PT2e47nzzjtlbGxMbrvtNikWi3LSSSfJ4OCg3HTTTXL55ZeHLXKVbdvU5HpgngBmsiyL+5IAIGNi36uPjIxILpeTadOm1by+fv16mTFjhrzrXe+SG2+8USYmJqrvDQwMyKJFi6RYLFZfW7p0qezcuVP+9Kc/eX7P6OiolEqlmh83QqyZKk2/EB3mZ/pauSpV+axlWVzdAoCMCV1zH8aBAwdk9erVcsEFF0hnZ2f19c997nNy+umny/Tp0+Wxxx6TNWvWyO7du+Wmm24SEZGhoSGZN29ezbi6u7ur7x1xxBGHfNe6devk+uuvD1W+ykGNoJJthJfoMU/T12i/VXmehtdwldfa2mI9BAAAUhDbnn18fFz++q//WmzblltuuaXmvVWrVlX/PuWUU6RYLMpnPvMZWbdunXR0dDT1fWvWrKkZb6lUkjlz5tT9DKEeQFbR3AYAzBRLuK8E+5dfflkefvjhmlp7LwsXLpSJiQn5/e9/L/Pnz5eenh4ZHh6uGabyv187/Y6OjqZPDFSRy+WoEQWgFfZZAKCWyKt2KsH++eefl02bNsmMGTMafmZwcFDy+bzMmjVLRET6+vpky5YtMj4+Xh1m48aNMn/+fM8mOVnBQTJ5o6OjaRcBAAAgMqFr7vft2ycvvPBC9f+XXnpJBgcHZfr06TJ79mz5q7/6K3nmmWfk/vvvl3K5LENDQyIiMn36dCkWizIwMCBPPPGEnHXWWTJ16lQZGBiQq6++Wj75yU9Wg/uFF14o119/vaxcuVJWr14t27dvl29+85vy9a9/PaLJBg7S/WoPAACAU84OWV28efNmOeussw55fcWKFbJ27dpDboSteOSRR+RDH/qQPPPMM/K3f/u38txzz8no6KjMmzdPLr74Ylm1alVN0Nq2bZv09/fLU089JTNnzpSrrrpKVq9eHbicpVJJurq6ZHh4uGGzIN2Z0J0d3ZgCasrn81IoFNIuBgBkVqlUkunTp8vIyEigTBs63OvCpHAPwDyq3KNDuAeAeIUN99mu7kUsVAgUgBfn8zKyju0QAOCFcN8E05uHmD79CCfJEEq/7QAA0xHum0CNGRAcJ4MAACSHcA9AKc2cPHMCAQDAQYR7AEppJqhzNQ0AgIMI9y0iVMBktm2zDQAAoBDCfYtoDgCT5XI5z21gYmIiU6Gf7dwf8wYA1EK4B4AGsnSiAgDINsI9WkLogZe2tjZqdDOKbR4A1Ea4b5HpBzoCHHRk+nbbCvc2z7wEALUQ7ltEuAX0w3YLAMgqwr3BLMtKuwgANMeJEgCohXBvsHxe78VPcwCYolwup10EX2yHAKAWvdOdYTiI1qLGEKYol8upbf+NvpftEADUQrjXCAdR9bGMEIdisZjausU6DQB6IdwDEVL96sr4+HigMhLoAADQE+FeQ3EHyDDj56ZcvbS3twcK7qqfpAAAAG+Eew3FXasaZvy5XE7bIGjbtkxMTKRdjCpVa8tVLRfUoOv2DwBZRbhHS8bGxmT//v1pF6MpuVxOCoVC2sWoUjEk6XzyhmRw8gcAaiHct4DQI9LR0SFTpkxJuxhNI5j4cwZ7XU/gAAAwDeG+SbZty/j4eNrFUEIul6PtfQY5T151PoFDvKjkAAC1EO6blMvlpFgspl0MZej+QCwAzeHqFwCohUQGAGgaNfcAoBbCPZRFaAAOFfRZBQAAM7WlXQDAD5f7gUO1t7enXQQAgMKoudeIbdvU2GlOpX71AQBA9hDuNUNttt7a2rhYBgAA4kO41wjBHgAAAPUQ7iEi3LwKAACQBYR7iEjrVwU4OQAAAEgf4R6RqHdyQHMiAACAZBDuETtq9dVkWRbLBi3j5B0A1EK4F5GxsbG0i4AUmB5s8/k8wQwtM307AgDVEO5FpFgspl0EpIBgCwAAsoZwb5i4H4RFYAYAAEgP4d4wuVwu1gCu8iV6lcsWhTDTZ1mWjI6OxlgaAACQBsI9kBFhTtry+bx0dHTEWBqYgqt1AKAWwj0yybZtsSyr5jVCCBC9rF8RAwDdEO6hvGbCQy6Xk3ye1RsAAJiF9APlqVzjTq0lKuK+WR0AgCDa0i4AoDOVTzyQLNYFAIAKqLnXGLWEzcvq01nDTlMW5wEAACaj5l5j1BQ2L6vt8cOuE6xDAABkSzYTDpRHjbEaWA4AAGQL4R6poMZYDSwHAACyhXDv4O4XHWohiAIAANRHuHcgPNZSrcmGauUBAABQDeHeQZdwn1TI1WV+AEgP+wkAUAvhPqQwwXp8fDyWMnAwVQtXFGAy1n8AUAvhPqQwwbq9vT3GksTHsiwpl8tpF0MbnGwFQwgMTqf7f1j/AUAt9HOPQ2S1D3ikixAYnE7bICdtAKAWfY4gkHK5rFWNHgAAAJJFzb1GCoVC2kUAgBpckQEAtWS+5t6yLHnrrbfSLgYAZBLNcgBALZkP9/l8XiZPnpx2MQA0kMvlqAUGAKBFmQ/3QByorYyeLsE+7LLP+pVDXZYbAJiCcA8tpR2uCTTRsywr9eUaRNhl39HREVNJ1KDDMgMAkxDuPdi2Ta80ERgbG4vtwE+4hi506tYSAKA/jjoecrkcB+QIFIvFTIZwaiqhMiomAMBsJFhELuvhl/AElVExAQBm4yiAyGWxtt6J5w0AAABVEe4Bh6xfdQAAANlGuM+AsbGxtIuQGeVyueVxcIIAAADSQrhXTDPBsK2tLYaSmCmKeZn1ZkkAAEBdRoV7HWpUmwmG3ECnx7IFAACIm1GpkBrV7GLZAgAAGBbuAcDP+Pg43ZwCALRHY20AEJH29va0iwAAQMuouQf+C+32AQCA7gj3MSEoqiHMcmi23X4U3WfCTLlcjvtFAACRItzHhAO2GpJYDjyxFs2iEgAAEDXCPQCkiIAPAIgS4T5DxsfHCQoOzAvoinUXANAswj0yi6ZR0BXrLgCgWaHD/ZYtW+Tcc8+V3t5eyeVyct9999W8f+mll1ZvEqv8nHPOOTXDvP7663LRRRdJZ2enTJs2TVauXCn79u2rGWbbtm1y5plnyqRJk2TOnDmyYcOG8FNnmPb29lChgAABU42Pj6ddBAAAYhE63L/55pty6qmnys033+w7zDnnnCO7d++u/vzwhz+sef+iiy6SHTt2yMaNG+X++++XLVu2yOWXX159v1QqyZIlS2Tu3LmydetWufHGG2Xt2rXyve99L2xxM6/ZnlqyHuzpwQYAAJgo9EOsli1bJsuWLas7TEdHh/T09Hi+97vf/U4eeOABeeqpp+Td7363iIh8+9vflg9/+MPyf/7P/5He3l658847ZWxsTG677TYpFoty0kknyeDgoNx00001JwGtsG07EwGXtrne6MEG9dR7YJVt22JZFusQAEBLsbS537x5s8yaNUvmz58vV1xxhbz22mvV9wYGBmTatGnVYC8isnjxYsnn8/LEE09Uh1m0aJEUi8XqMEuXLpWdO3fKn/70J8/vHB0dlVKpVPNTT1ZCcVtbcw8Ztm07Myc4QJRyuRzBHgCgrcjD/TnnnCP/9//+X3nooYfkf//v/y2PPvqoLFu2rNpMYmhoSGbNmlXzmba2Npk+fboMDQ1Vh+nu7q4ZpvJ/ZRi3devWSVdXV/Vnzpw5dcuZz/tPumVZ9ScyQ7JykgMAAIAmmuU0cv7551f/XrBggZxyyily3HHHyebNm+Xss8+O+uuq1qxZI6tWrar+XyqVfAN+oxprAi8AAAB0FHtXmMcee6zMnDlTXnjhBRER6enpkT179tQMMzExIa+//nq1nX5PT48MDw/XDFP5368tf0dHh3R2dtb8+GnUFIVL8gCiRqUBACAJsYf7P/zhD/Laa6/J7NmzRUSkr69P9u7dK1u3bq0O8/DDD4tlWbJw4cLqMFu2bKnprm7jxo0yf/58OeKII+IuMpAJhEm1cH8LACAJocP9vn37ZHBwUAYHB0VE5KWXXpLBwUHZtWuX7Nu3T6655hp5/PHH5fe//7089NBD8tGPflSOP/54Wbp0qYiInHDCCXLOOefIZZddJk8++aT86le/kiuvvFLOP/986e3tFRGRCy+8UIrFoqxcuVJ27NghP/rRj+Sb3/xmTbMbAPURJgEAME/ODlm9t3nzZjnrrLMOeX3FihVyyy23yMc+9jH59a9/LXv37pXe3l5ZsmSJfPWrX625Qfb111+XK6+8Uv7lX/5F8vm8nHfeefKtb31LDj/88Oow27Ztk/7+fnnqqadk5syZctVVV8nq1asDl7NUKklXV5cMDw/XbaIDAGhePp+nKSMAxKhUKsn06dNlZGQkUKYNHe51QbiPRi6Xo3kHtERXr8kg3ANAvMKG+9jb3ENv7mBP0IcuCPYAABMZE+4JpdEgMAHqsyzL84F/lafvAgCyy5hwr3Io1e3EQ7fyAqbJ5XIyefJkz9dF2IYBIMuMCfcqc594WJYl5XK54QE4rRMWlU+UABzcRidNmuT5Xj6fZxsGgAwj3Csol8sdcgD2CvrUviFJo6OjNOsAAEBxbWkXAIfyqlWjpg1pa29vl4mJier/+XywugEdeq3RoYwAAARBuIe2CGTJyufzgQO9U7lclrY2djUAACSBZjkITLVmQAR7PegQ7FVel3K5nNLlAwCohXCfcVEGcgKG0N4cibNtW7kTawCAugj3GUcgjxYhCwAAqIxwHxFCnxkKhULaRYCLKdtepQZ/bGws7aIAABRGuI8INeTwY0r4dEpymk3Z9io3JsdxD4OJ6ygAZBXhHoiZKeET8SoUCvLWW2/Fsj6xjgJAdhDugYAmJiZkdHQ07WJogbAYvVwuJ8ViUbl5q1p5AMB06vdRBygiriYRScrlcjTBQKRYnwBALdTcAwYhiAEAkG2E+5DGxsYa9nVOv9QA0pRkUxma5QCAWvRuY5CCYrHYcBgOdtli2zbLFFqJq3LBa1ugIgMA1ELNPWIxPj6edhEiQ7AHDmJbAAD1Ee4Ri/b29rSLACABBH4AUAvhHjAATScAADAD4R4wAOEecWHdAgC1EO6hNC75RyOfZ1NHPNhGAUAtHPGhNGoFAbWxjQKAWgj3gIYIVAAAwAvhHohZHEFc96YQPOjN2+joaNpFAABojnCP0Ahl4egexKNUebpzLpdjvngoFAppFyE0liMAqIVwj9A4mKNZ3NhbX1ubfg8N52QfANTCkdYwlZpTQFecXCYfqJnnAKAPwr1hqDmF7qgpTj5s15vnBH8AUAtJDwDQNE62AEAthHsAAAAgIwj3AAAAQEYQ7pEY2uYmo1wuS7lcTrsYAAAgBfr1uwZt0Ta3dZZlNbwpWse+0gEAQDSouUfLCO3JUbm3I67MAACQPnWTAgCtcJIHAED6CPdoGTW2AAAAaiDcIxXc8AkAABA9wj1SYVlW2kXQBs1dsof1HwAQF8I9UtHe3p52EbRBs6fsUfnGaACA3jjCAGgKJx3JYD4DAMIg3AOGa6XZD8EzfjTLAgCEQbgHDOEVEm3bbvrmZtu2CZ7gBA8AFEO4j5Bt2zIxMZF2MZAgncKtVwjL5XLS1tb8g6onJia0mgc6Yb4CAJpBuI9Qq0HJBFkLLKbXWhYKhUzPgzTXV13ma9a2aQDQHeEeidIlsOBQXs1wsr48eR6DP0I9AKiJcI+W0F+3OXK5XObDvBtX4vxV1gXT1gkAUB3hHi2hv27AbNTgA4BaSGZAhMbHx7maAQAAUkO4r4MaKYSVz+dppmAo9hcAABXQoBSIUKFQSLsISAkndQAAFVBzXwcHawAAAOiEcA9ohuYfAADAD+EeAAAAyAjCPaCJsbExEaG5GAAA8Ee4B0Iol8syPj6eyncXi8VEv48uPQEA0A/hHlqzbTvRNuiFQkHa29sT+74k7N+/P+0iICD3us79FwAAN8J9TCYmJmRiYiLtYgANTZ482fN1nj7c2MTERLW5VBLcTbJoogUAcKOf+5jQ3/mhLMuKPDASblrHPGxeWxu7UACAWoyqmkvyEnYulyM0udCEAAAAIF5GhXsVw7ZlWandoJk0rmYcRHMtAAAQF64ppyyfz9O22TA05QAAAHEhVSIV5XI57SIAIkJzMQBAthDukQquVkAVlmUZE/BpEgYA2Uf7AKRCxfsfYCaT7gUxaVoBwFRUnwKAIRqdVNu2Te0+AGiOcA8ADZjSbCeXy1G7DwCaI9wDUIZlWWkXwZNJzchMmlYAyCLCPQBlcKM1AACt4UgKAAAAZAThHgAMp2pzKABAeMaFe9u2OZABhmt2P5DVG2tpDgUA2RF6j75lyxY599xzpbe3V3K5nNx333017+dyOc+fG2+8sTrMMcccc8j769evrxnPtm3b5Mwzz5RJkybJnDlzZMOGDc1NIZCgrIa/rMnlck0FWq+bTStPW37rrbdaLhcAAK0KfXR788035dRTT5Wbb77Z8/3du3fX/Nx2222Sy+XkvPPOqxnuhhtuqBnuqquuqr5XKpVkyZIlMnfuXNm6davceOONsnbtWvne974XtriHaPagjlrlcllGR0fTLoZy6GnEPJVlPnny5MjGyUkiAKBZoZ9Qu2zZMlm2bJnv+z09PTX///SnP5WzzjpLjj322JrXp06desiwFXfeeaeMjY3JbbfdJsViUU466SQZHByUm266SS6//PKwRUYMCoUCJ0mAxNOkhZNEAECzYk1nw8PD8rOf/UxWrlx5yHvr16+XGTNmyLve9S658cYba56KODAwIIsWLZJisVh9benSpbJz507505/+FGeREQIBBAAAQC2ha+7D+P73vy9Tp06Vj3/84zWvf+5zn5PTTz9dpk+fLo899pisWbNGdu/eLTfddJOIiAwNDcm8efNqPtPd3V1974gjjjjku0ZHR2uaiZRKpagnBxln27aUy2Vpa4t1s4iVbducdAEAYLBYU8xtt90mF110kUyaNKnm9VWrVlX/PuWUU6RYLMpnPvMZWbdunXR0dDT1XevWrZPrr7++pfICurd1Jtgf7NaRJmMAAFPFdgT8xS9+ITt37pRPf/rTDYdduHChTExMyO9//3sROdhuf3h4uGaYyv9+7fTXrFkjIyMj1Z9XXnmltQmAEpIM27lcTtrb2xP7PsSDYA8AMFlsR8Fbb71VzjjjDDn11FMbDjs4OCj5fF5mzZolIiJ9fX2yZcsWGR8frw6zceNGmT9/vmeTHBGRjo4O6ezsrPmB/qKuieY5BwAAIMtCh/t9+/bJ4OCgDA4OiojISy+9JIODg7Jr167qMKVSSX7yk5941toPDAzIN77xDfnNb34j//7v/y533nmnXH311fLJT36yGtwvvPBCKRaLsnLlStmxY4f86Ec/km9+85s1zXmAZtAVKgAAyLLQbe6ffvppOeuss6r/VwL3ihUr5I477hARkbvvvlts25YLLrjgkM93dHTI3XffLWvXrpXR0VGZN2+eXH311TXBvaurSx588EHp7++XM844Q2bOnCnXXXcd3WCiKdxkioqk14VKszLWPwBAUnK27ncQ+iiVStLV1SXDw8M00UEgnARkXxo322Z9vcrn81IoFNIuBgBkVqlUkunTp8vIyEigTEv7BOC/ZDmA4aA0mmSxXgEAkkS4T1FGL5oAAAAgJYT7FBHuAQAAECXCfYrotQUAAABRIl0C0BpXwAAAeBvhHoDWuGEVAIC3Ee4zjBpNQD22bUu5XG44XC6Xq/kBACAIwn2GOQMBQR9QQy6Xo194AEBsCPeGoOZPX5yYmamy3Fn+AIAwjAj3tm37HiA5cEJ1nJiZi4APAAirLe0CJKFeOCI4AQAAICuMqLkHAAAATEC4B5Aqmpwcqpl5wnwEAIgQ7gGkjKZxh2pmntS7twgAYA7CPQDEKKnAnc/nOVECABDuASBOBG4AQJII95oKUxvIpXoAAAAzEO41FaY2kJpDAAAAMxDuASAltm3LW2+9lXYxAAAZYly4p0cJIHpsU83J5XIyefLktIsBAMgQI55Q60QTFQAAAGSVcTX3oJYV0Qt70lwul6VcLsdUGgAAzEW4N5DqVy8mJibSLgJils/nJZ9n9wMAQNSMa5YD9bW1sVpmneonmAAA6IqqMwCZR1M0AIApCPf/hYO/elgmaJa7VyyuFAAATEG4/y8c/NWTZLinnX+25HI5tmkAgJEI91BWkjdc0s4fJuGqGABklxHhvtkDWZIHQA62wNsqNe9J18Cbsh1yVQMAssuIcF85kNU7cHu9l+QBkINteKYEsTioPO/S3BbYDgEAujMi3FfkcjnfUOM8qFuW5TsOlUORaQhizVN53rlvhgUAAMEZEe7D9ppRb5g4QhFBBqil8skHAAAqy3y4dwfnIEE6SDOeqNi2XfdKAWCiSu09tfgAAIST+XBfuSHPKyQEaYMfd7DI5XJSKBRi/Q4kL+luPMvlcmLfl3W2bTM/AQDayny4r4Qs52V+92t+N9N69dQRJLRR24gkm5W0tbVxgtgC97ZKH/kAAJ0Z0bm3V8B3CnMgDzos4aCWbdvMEyjJa71M8hkLXtheAADNynzNvZO7Da/X385avGZr35s5KGf9Cam6BRWuvCBNum0vAAB1GBXuvQ6Ylde8mt84m+3EfXOfSc0qdGi2RLg6aHx8PO0iAACAEIwK936B0tlsx9kXfr22uI1u0A0bXk0Kk7RpBgAAiIdR4d6pUjPvrqEXOTRou98P0h42jfCqem24zsI+3Tgr2tvb0y5CqrK8bAEA2WRsuBfx7u7Sq929M/Q3029+M8M2g9rw+CT9YDMAAIBmGB3unYJ2cVlPvSY9lffDjG9sbKypB1xR25gu5n92uLdZy7KUf+icDve0AADiQ7hvUr3affcwfm3xG9X4FovFprrkU6km2cSQodL8R7Ty+bzyy5d7WgDAbEb0cx8nrwdhudvk+/1tAtOmF9nHOg0AUJmR4d6v20uv3nGaGafX5yq1+2k/HCcMHqSDrGGdBgBknT5JM0KNurH06h2nVTpeKtetvEkwsZmR6sIsE9ZpAEDWGVVz7xfavZrWOF+P+vuhL5ahelgmAAC8zaia+0Y3vlZeb1QTWK83ChNqdk2YxkZU7zEFzXGe+LOeAwB0ZFTNvVOr4dzk2kKTp71Cp3snEEyYnqwAAFCVseHezSvUez29ttE4CAWAnth2AQBZQPVjHc00v+FyPnTCugoAQLYQ7usIU5NXqbWn9g864d4BAACyhWY5EYiyy0wgSYVCIe0iAACACFFz3wS/nna83ocaOPECAAAmINw3IUhNPW3vgexi+wYAqIpwHwOvvvSRvKx2bUioTB/31wAAVEW4j0nlYVi0x08P4QsAAJjGmHCfVrgO8sRbJ5Uu96tUFryNkxYAAOCH3nJi0qjG3q/pjkrBTaWyAKbgYXgAgFYYU3Ov0sGSPvGTp/pVCJXLhuTRnA8A0Cxjwn1anCE+SBt8DubxiOJkKq5lk8+ntxmyviUryEmmc12lAgAAEBbhPmb1mt84D/KELPW5l2FUyyzNZhiEx2Rl4Yod+yoAUBvhPkGVA7vXwZ2aOv00ephZUISlaDE/48U+CgDURrhXgDuMEE6A5hE+AQAmI9wnwNnO3tnm1q+2nnDSnDRPinRdZrZti2VZaRfDWMx7AEDUMh/u3Tewed3QlkQobPSd1Na3TteAnaZcLhfrDb2s1/WxzgIAopb5cF/hrjEPEvrjFPdBnVClvyzU6jp7ioqLzus64R4AEDVjwr1TvV5q4g4K7m4xvXrTabUXHWfvKzr2yEOf9AcR/IJpdj61uhzDPnk67LjT2AZU3u4AAMEYGe4bifPA6hxvvQDu7hPf73/3j5vXVYqg5UtSHCchjcYTNpwlPW/i6nozDV4BPO3p8TspaLXpnte63MwJSBpXbtz7i7SXEQAgPMK9AtwH1FZqbL0Oyu6rAl4nA+7vrjdM3PL5fKh54FUur77j3dMT5jvcXZimEXqCljepsrVac91oepI8oXKvF2Fvcq+3XjWzDeVyOSkUCr7zoNl7eIKUpV5f/DpeCQQA0xDuU+T38KJ6QaiZQOUM7u4eeoKcUNQLGFEc4P3mQ7PjEgkX3Ju9qqFSuGn2pMX5+XqBMOyydg8btkzu+2Oa+U7n642mod6JYJCrZF4n0H7TE5Rf87p6wzvLU+9KnvPvetPqNU3U7AOA2gj3dSRx4AoaOJotS70DdOU7vIJLvQdu1QsvrdbmNjOcs4xeT/5tVPMZJEB5hTn35+rNgyDD1PvuRkEriqs9YYYNMh1Bao/9NHqSa71l7J4/ja7gBOFVk+93Y36Y7cayLCmXy74nDV415ZXv8NqW633Gb/v3+i6/MgAA1Jf5cO93UPMaxu/zaUnq5MIpaA2k12uthHWvcNYohDUK8X6B3K+WMkzzJfd3ev32C2OVsviN06vsfsP6nWB4jc/rvXqvueeLX3MVv/njd9Lk1/Sr0XJ3z88DBw7UjK9eWdzfXU+Y5eEczi9Iu7/bPY/cXZEG2R8FCfbOzzhP1t3z331yzI3cAKC3trQLkKQgwalRbWHWD3xhg3q9cTh5zbd6Ne5e46wM4w5zQZo2BZked+jyCj9eZQ0SrLzG6Qxdzs97nQw43/f7vnrrp9+N1X7zvV5IDhJ+vZaN38mN1+fd0+SeJ7ZtS0dHR808CXpC5B53M/zW8aAno37jaMQ9X+tNm9d31Vuvmi0TAEAtoWru161bJ+95z3tk6tSpMmvWLPnYxz4mO3furBnmwIED0t/fLzNmzJDDDz9czjvvPBkeHq4ZZteuXbJ8+XKZMmWKzJo1S6655hqZmJioGWbz5s1y+umnS0dHhxx//PFyxx13NDeFEfALeajVKNi4A4Y76Pqp1/wlTJvsMNxB2us95/9Bpt0dyrzaPPt9h9f46gXzRmWqTFuYeRdknO7h/MJ/kO0pzIlms0E5zOtRlqHe+hX0882EcsI7AGRfqHD/6KOPSn9/vzz++OOyceNGGR8flyVLlsibb75ZHebqq6+Wf/mXf5Gf/OQn8uijj8qrr74qH//4x6vvl8tlWb58uYyNjcljjz0m3//+9+WOO+6Q6667rjrMSy+9JMuXL5ezzjpLBgcH5fOf/7x8+tOfln/7t3+LYJLrCxrSggYdkwRt8uBVYx20fXWj91RbJs30nBI08DWqcXe+Vm/YJE9anc1Qwi4r1ZZtFJgHAICo5ewWjhZ//OMfZdasWfLoo4/KokWLZGRkRI488ki566675K/+6q9EROS5556TE044QQYGBuR973uf/Ou//qv89//+3+XVV1+V7u5uERH5p3/6J1m9erX88Y9/lGKxKKtXr5af/exnsn379up3nX/++bJ371554IEHApWtVCpJV1eXvPrqq9LZ2RlqusKEHWrzgeAq3Tuq8PTdoFcOUF+hUJBCoZB2MQAgs0qlkkyfPl1GRkYCZdqWbqgdGRkREZHp06eLiMjWrVtlfHxcFi9eXB3mne98pxx99NEyMDAgIiIDAwOyYMGCarAXEVm6dKmUSiXZsWNHdRjnOCrDVMbhZXR0VEqlUs2PSLCbMzmIA/GyLKvmx90ML22NbiTXic5lBwC0rulwb1mWfP7zn5f3v//9cvLJJ4uIyNDQkBSLRZk2bVrNsN3d3TI0NFQdxhnsK+9X3qs3TKlUkrfeesuzPOvWrZOurq7qz5w5czyHC3IDmrvNsN/Bnlr71jD/zOHuqaitTa17+QnEAICsaDrc9/f3y/bt2+Xuu++OsjxNW7NmjYyMjFR/XnnlFREJ1t2f83X3cIiPVw8reFvW5gdNN5IRx3qjQjMqAEAwTYX7K6+8Uu6//3555JFH5Kijjqq+3tPTI2NjY7J3796a4YeHh6Wnp6c6jLv3nMr/jYbp7OyUyZMne5apo6NDOjs7a36cwtyU2epweFuYUMD8rdXs/CiXyxGXpHW5XI6AqDF3X/wAAHWF2mPbti1XXnml3HvvvfLwww/LvHnzat4/44wzpL29XR566KHqazt37pRdu3ZJX1+fiIj09fXJb3/7W9mzZ091mI0bN0pnZ6eceOKJ1WGc46gMUxlHs9xNbOrV4Aet3Ud9hILkUUMeTNDehkzByRcAZEOohq/9/f1y1113yU9/+lOZOnVqtY18V1eXTJ48Wbq6umTlypWyatUqmT59unR2dspVV10lfX198r73vU9ERJYsWSInnniiXHzxxbJhwwYZGhqSa6+9Vvr7+6Wjo0NERD772c/Kd77zHfnSl74kn/rUp+Thhx+WH//4x/Kzn/0ssgkPenOtu0/1sN+RtaYVQFaZHOwBANkRqitMv6B6++23y6WXXioiBx9i9YUvfEF++MMfyujoqCxdulS++93vVpvciIi8/PLLcsUVV8jmzZvlsMMOkxUrVsj69etrbrLbvHmzXH311fLss8/KUUcdJV/+8per3xFEpSvMV155pW63QY2enOr1Oo9oB4CD6AoTAOIVtivMlvq5V5k73DsnM0h493vf+R4BH4DpCPcAEK9E+7nXQb3ecsL0jkOQh85oT60PlhUAoBVqdTYds3o30Dlr5f3ayrtfU7FNvYplQvqavbF5bGxMcrmctLe3R1yi7Gp1G+QmdABAKzIf7v16van8726KU3nNK/QDpikWi2kXQTtJ7S9s2xbLsmgSAwCoYUy4r9edpTvMB615UzH0q1gm6GliYkK5J8nibblcjlp+AMAhMn/krtRuBblv2B3sGwVl5wkBkDXlcplwrzj2PQAAt8xX+1iWVQ337h8R8XwtDhntlEgbzP/wKs+dQHNUX+eaLR83/AKA2oyolnO2m3e2rXfyC/dBasbcTXqC/G16jVvS88D0+Y3WONfXeutumCt/cfO7sujXRNGrvI3GkfY0AgAOlfma+3w+L/l8vto+tRL0K6873xfx7yYzCK+2/JXX3ScV7gNsvZ58/L7LffXB62/3uKK4QuF3g3K9Yd3qhaOkrqY4vw/Z1Ox27K6dDhLsncOF+f6k1nMnr44C6t2X5NzmnftLAIB6MltzXzkYvfHGG4EeTuU8wDpPALxq/YNy1tg3+rw7NDh77XGfGAS9mhA0kLjH3WytuldPQ36vOflNp/P9ZsoRdFi/cnmVwW95ei0/53Be/3vNa7/l7jUv3WWo972Npq+eVj7bzOf9hm+1HPDW6lW0QqHAvRkAEKNSqSQiwSusMrtHfu2110RE5JRTTkm5JAAAAEBr3njjDenq6mo4XGbD/fTp00VEZNeuXYFmBBorlUoyZ84ceeWVVwI9/hj1MT+jxzyNFvMzeszT6DFPo8X8jF6r89S2bXnjjTekt7c30PCZDfeV/p+7urpYOSPW2dnJPI0Q8zN6zNNoMT+jxzyNHvM0WszP6LUyT8NUVGf+hloAAADAFIR7AAAAICMyG+47OjrkK1/5Cg/iiRDzNFrMz+gxT6PF/Iwe8zR6zNNoMT+jl/Q8zdn0LQcAAABkQmZr7gEAAADTEO4BAACAjCDcAwAAABlBuAcAAAAyIrPh/uabb5ZjjjlGJk2aJAsXLpQnn3wy7SIpZ926dfKe97xHpk6dKrNmzZKPfexjsnPnzpphPvShD0kul6v5+exnP1szzK5du2T58uUyZcoUmTVrllxzzTUyMTGR5KQoY+3atYfMr3e+853V9w8cOCD9/f0yY8YMOfzww+W8886T4eHhmnEwP2sdc8wxh8zTXC4n/f39IsI62siWLVvk3HPPld7eXsnlcnLffffVvG/btlx33XUye/ZsmTx5sixevFief/75mmFef/11ueiii6Szs1OmTZsmK1eulH379tUMs23bNjnzzDNl0qRJMmfOHNmwYUPck5aaevN0fHxcVq9eLQsWLJDDDjtMent75ZJLLpFXX321Zhxe6/X69etrhmGevu3SSy89ZH6dc845NcOwnr6t0fz02qfmcjm58cYbq8Owjr4tSF6K6vi+efNmOf3006Wjo0OOP/54ueOOO8IX2M6gu+++2y4Wi/Ztt91m79ixw77sssvsadOm2cPDw2kXTSlLly61b7/9dnv79u324OCg/eEPf9g++uij7X379lWH+eAHP2hfdtll9u7du6s/IyMj1fcnJibsk08+2V68eLH961//2v75z39uz5w5016zZk0ak5S6r3zlK/ZJJ51UM7/++Mc/Vt//7Gc/a8+ZM8d+6KGH7Kefftp+3/veZ/9//9//V32f+XmoPXv21MzPjRs32iJiP/LII7Zts4428vOf/9z+x3/8R/uee+6xRcS+9957a95fv3693dXVZd933332b37zG/sjH/mIPW/ePPutt96qDnPOOefYp556qv3444/bv/jFL+zjjz/evuCCC6rvj4yM2N3d3fZFF11kb9++3f7hD39oT5482f7nf/7npCYzUfXm6d69e+3FixfbP/rRj+znnnvOHhgYsN/73vfaZ5xxRs045s6da99www01661z38s8vbfm/RUrVtjnnHNOzfx6/fXXa4ZhPX1bo/npnI+7d++2b7vtNjuXy9kvvvhidRjW0bcFyUtRHN///d//3Z4yZYq9atUq+9lnn7W//e1v24VCwX7ggQdClTeT4f69732v3d/fX/2/XC7bvb299rp161Islfr27Nlji4j96KOPVl/74Ac/aP/d3/2d72d+/vOf2/l83h4aGqq+dsstt9idnZ326OhonMVV0le+8hX71FNP9Xxv7969dnt7u/2Tn/yk+trvfvc7W0TsgYEB27aZn0H83d/9nX3cccfZlmXZts06Gob7IG9Zlt3T02PfeOON1df27t1rd3R02D/84Q9t27btZ5991hYR+6mnnqoO86//+q92Lpez/+M//sO2bdv+7ne/ax9xxBE183P16tX2/PnzY56i9HkFJ7cnn3zSFhH75Zdfrr42d+5c++tf/7rvZ5in99a8tmLFCvujH/2o72dYT/0FWUc/+tGP2n/xF39R8xrrqD93Xorq+P6lL33JPumkk2q+6xOf+IS9dOnSUOXLXLOcsbEx2bp1qyxevLj6Wj6fl8WLF8vAwECKJVPfyMiIiIhMnz695vU777xTZs6cKSeffLKsWbNG9u/fX31vYGBAFixYIN3d3dXXli5dKqVSSXbs2JFMwRXz/PPPS29vrxx77LFy0UUXya5du0REZOvWrTI+Pl6zbr7zne+Uo48+urpuMj/rGxsbkx/84AfyqU99SnK5XPV11tHmvPTSSzI0NFSzTnZ1dcnChQtr1slp06bJu9/97uowixcvlnw+L0888UR1mEWLFkmxWKwOs3TpUtm5c6f86U9/Smhq1DUyMiK5XE6mTZtW8/r69etlxowZ8q53vUtuvPHGmsvzzNNDbd68WWbNmiXz58+XK664Ql577bXqe6ynzRseHpaf/exnsnLlykPeYx315s5LUR3fBwYGasZRGSZsfm0LP0lq+8///E8pl8s1M09EpLu7W5577rmUSqU+y7Lk85//vLz//e+Xk08+ufr6hRdeKHPnzpXe3l7Ztm2brF69Wnbu3Cn33HOPiIgMDQ15zuvKe6ZZuHCh3HHHHTJ//nzZvXu3XH/99XLmmWfK9u3bZWhoSIrF4iEH+O7u7uq8Yn7Wd99998nevXvl0ksvrb7GOtq8yvR7zR/nOjlr1qya99va2mT69Ok1w8ybN++QcVTeO+KII2Ipvw4OHDggq1evlgsuuEA6Ozurr3/uc5+T008/XaZPny6PPfaYrFmzRnbv3i033XSTiDBP3c455xz5+Mc/LvPmzZMXX3xR/uEf/kGWLVsmAwMDUigUWE9b8P3vf1+mTp0qH//4x2teZx315pWXojq++w1TKpXkrbfeksmTJwcqY+bCPZrT398v27dvl1/+8pc1r19++eXVvxcsWCCzZ8+Ws88+W1588UU57rjjki6m8pYtW1b9+5RTTpGFCxfK3Llz5cc//nHgjRL+br31Vlm2bJn09vZWX2MdharGx8flr//6r8W2bbnllltq3lu1alX171NOOUWKxaJ85jOfkXXr1iX2iHqdnH/++dW/FyxYIKeccoocd9xxsnnzZjn77LNTLJn+brvtNrnoootk0qRJNa+zjnrzy0sqyVyznJkzZ0qhUDjkDuXh4WHp6elJqVRqu/LKK+X++++XRx55RI466qi6wy5cuFBERF544QUREenp6fGc15X3TDdt2jR5xzveIS+88IL09PTI2NiY7N27t2YY57rJ/PT38ssvy6ZNm+TTn/503eFYR4OrTH+9/WVPT4/s2bOn5v2JiQl5/fXXWW/rqAT7l19+WTZu3FhTa+9l4cKFMjExIb///e9FhHnayLHHHiszZ86s2c5ZT8P7xS9+ITt37my4XxVhHRXxz0tRHd/9huns7AxVQZi5cF8sFuWMM86Qhx56qPqaZVny0EMPSV9fX4olU49t23LllVfKvffeKw8//PAhl9e8DA4OiojI7NmzRUSkr69Pfvvb39bsVCsHshNPPDGWcutk37598uKLL8rs2bPljDPOkPb29pp1c+fOnbJr167qusn89Hf77bfLrFmzZPny5XWHYx0Nbt68edLT01OzTpZKJXniiSdq1sm9e/fK1q1bq8M8/PDDYllW9USqr69PtmzZIuPj49VhNm7cKPPnz8/spfl6KsH++eefl02bNsmMGTMafmZwcFDy+Xy1aQnztL4//OEP8tprr9Vs56yn4d16661yxhlnyKmnntpwWJPX0UZ5Karje19fX804KsOEzq/h7xFW39133213dHTYd9xxh/3ss8/al19+uT1t2rSaO5Rh21dccYXd1dVlb968uaarq/3799u2bdsvvPCCfcMNN9hPP/20/dJLL9k//elP7WOPPdZetGhRdRyVrp2WLFliDw4O2g888IB95JFHGtPNoNsXvvAFe/PmzfZLL71k/+pXv7IXL15sz5w5096zZ49t2we7yjr66KPthx9+2H766aftvr4+u6+vr/p55qe3crlsH3300fbq1atrXmcdbeyNN96wf/3rX9u//vWvbRGxb7rpJvvXv/51teeW9evX29OmTbN/+tOf2tu2bbM/+tGPenaF+a53vct+4okn7F/+8pf2n//5n9d0Mbh37167u7vbvvjii+3t27fbd999tz1lypRMdoln2/Xn6djYmP2Rj3zEPuqoo+zBwcGafWulR4zHHnvM/vrXv24PDg7aL774ov2DH/zAPvLII+1LLrmk+h3M07fn6RtvvGF/8YtftAcGBuyXXnrJ3rRpk3366afbf/7nf24fOHCgOg7W07c12u5t+2BXllOmTLFvueWWQz7POlqrUV6y7WiO75WuMK+55hr7d7/7nX3zzTfTFabTt7/9bfvoo4+2i8Wi/d73vtd+/PHH0y6SckTE8+f222+3bdu2d+3aZS9atMiePn263dHRYR9//PH2NddcU9OHuG3b9u9//3t72bJl9uTJk+2ZM2faX/jCF+zx8fEUpih9n/jEJ+zZs2fbxWLR/rM/+zP7E5/4hP3CCy9U33/rrbfsv/3bv7WPOOIIe8qUKfZf/uVf2rt3764ZB/PzUP/2b/9mi4i9c+fOmtdZRxt75JFHPLfzFStW2LZ9sDvML3/5y3Z3d7fd0dFhn3322YfM59dee82+4IIL7MMPP9zu7Oy0/+Zv/sZ+4403aob5zW9+Y3/gAx+wOzo67D/7sz+z169fn9QkJq7ePH3ppZd8962VZzNs3brVXrhwod3V1WVPmjTJPuGEE+yvfe1rNUHVtpmnlXm6f/9+e8mSJfaRRx5pt7e323PnzrUvu+yyQyrsWE/f1mi7t23b/ud//md78uTJ9t69ew/5POtorUZ5ybajO74/8sgj9mmnnWYXi0X72GOPrfmOoHL/VWgAAAAAmstcm3sAAADAVIR7AAAAICMI9wAAAEBGEO4BAACAjCDcAwAAABlBuAcAAAAygnAPAAAAZAThHgAAAMgIwj0AAACQEYR7AAAAICMI9wAAAEBGEO4BAACAjPj/ATCuflK38/npAAAAAElFTkSuQmCC",
      "text/plain": [
       "<Figure size 1600x900 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "response = requests.get(fileurl)\n",
    "if response.status_code == 200:\n",
    "    print(f'HTTP-Status={response.status_code} File-size={len(response.content):,}')    \n",
    "    zimage = pyfits.getdata(autils.data.download_file(fileurl,cache=True,show_progress=False,timeout=120))\n",
    "    plt.rcParams[\"figure.figsize\"] = [16,9]\n",
    "    plt.imshow(zimage,cmap=matplotlib.cm.gray_r)\n",
    "    zimage.shape\n",
    "else:\n",
    "    print(f'content={response.content}')\n",
    "    print(response.json()['errorMessage'])\n",
    "    print(response.json()['traceback'])  # for API developer use\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Get Core HDU field names and types <a id=\"core_hdu\" />\n",
    "These occur once per non-primary HDU and are optimized for fast search."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "      <th>5</th>\n",
       "      <th>6</th>\n",
       "      <th>7</th>\n",
       "      <th>8</th>\n",
       "      <th>9</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>Field</th>\n",
       "      <td>dec_center</td>\n",
       "      <td>dec_max</td>\n",
       "      <td>dec_min</td>\n",
       "      <td>fitsfile</td>\n",
       "      <td>hdu_idx</td>\n",
       "      <td>id</td>\n",
       "      <td>ra_center</td>\n",
       "      <td>ra_max</td>\n",
       "      <td>ra_min</td>\n",
       "      <td>updated</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Type</th>\n",
       "      <td>np.float64</td>\n",
       "      <td>np.float64</td>\n",
       "      <td>np.float64</td>\n",
       "      <td>str</td>\n",
       "      <td>np.int64</td>\n",
       "      <td>str</td>\n",
       "      <td>np.float64</td>\n",
       "      <td>np.float64</td>\n",
       "      <td>np.float64</td>\n",
       "      <td>datetime64</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Desc</th>\n",
       "      <td>DEC center from pipeline processing</td>\n",
       "      <td>DEC min,max range of HDU</td>\n",
       "      <td>DEC min,max range of HDU</td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>RA center from pipeline processing</td>\n",
       "      <td>RA min,max range of HDU</td>\n",
       "      <td>RA min,max range of HDU</td>\n",
       "      <td>When Hdu created/updated</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                         0                         1   \n",
       "Field                           dec_center                   dec_max  \\\n",
       "Type                            np.float64                np.float64   \n",
       "Desc   DEC center from pipeline processing  DEC min,max range of HDU   \n",
       "\n",
       "                              2         3         4    5   \n",
       "Field                   dec_min  fitsfile   hdu_idx   id  \\\n",
       "Type                 np.float64       str  np.int64  str   \n",
       "Desc   DEC min,max range of HDU                            \n",
       "\n",
       "                                        6                        7   \n",
       "Field                           ra_center                   ra_max  \\\n",
       "Type                           np.float64               np.float64   \n",
       "Desc   RA center from pipeline processing  RA min,max range of HDU   \n",
       "\n",
       "                             8                         9  \n",
       "Field                   ra_min                   updated  \n",
       "Type                np.float64                datetime64  \n",
       "Desc   RA min,max range of HDU  When Hdu created/updated  "
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pd.DataFrame(requests.get(f'{adsurl}/core_hdu_fields').json()).transpose()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Get Aux HDU field names and types <a id=\"aux_hdu\" />\n",
    "These occur once per non-primary HDU but will be slower to search.  All keywords from the non-primary HDUs (except those in Core HDU Fields) are included."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'Field': 'AMPSECA',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'CCD section in read order for amp A'},\n",
       " {'Field': 'AMPSECB',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'CCD section in read order for amp B'},\n",
       " {'Field': 'BIASSECA', 'Type': 'str', 'Desc': 'Overscan from amp A'},\n",
       " {'Field': 'BIASSECB', 'Type': 'str', 'Desc': 'Overscan from amp B'},\n",
       " {'Field': 'BSCALE', 'Type': 'str', 'Desc': 'PHYSICAL=INTEGER*BSCALE+BZERO'},\n",
       " {'Field': 'BUNIT', 'Type': 'str', 'Desc': 'photoelectrons per second'},\n",
       " {'Field': 'BZERO', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CCDBIN1', 'Type': 'str', 'Desc': 'Binning factor along axis 1'},\n",
       " {'Field': 'CCDBIN2', 'Type': 'str', 'Desc': 'Binning factor along axis 2'},\n",
       " {'Field': 'CCDNUM', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CCDSEC', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CCDSECA', 'Type': 'str', 'Desc': 'CCD section from amp A'},\n",
       " {'Field': 'CCDSECB', 'Type': 'str', 'Desc': 'CCD section from amp B'},\n",
       " {'Field': 'CD1_1', 'Type': 'str', 'Desc': 'Coordinate matrix'},\n",
       " {'Field': 'CD1_2', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CD2_1', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CD2_2', 'Type': 'str', 'Desc': 'Coordinate matrix'},\n",
       " {'Field': 'CHECKVER', 'Type': 'str', 'Desc': 'Checksum version'},\n",
       " {'Field': 'CRPIX1', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CRPIX2', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'CRVAL1', 'Type': 'str', 'Desc': 'Coordinate reference value'},\n",
       " {'Field': 'CRVAL2', 'Type': 'str', 'Desc': 'Coordinate reference value'},\n",
       " {'Field': 'CTYPE1', 'Type': 'str', 'Desc': 'Coordinate type'},\n",
       " {'Field': 'CTYPE2', 'Type': 'str', 'Desc': 'Coordinate type'},\n",
       " {'Field': 'CUNIT1', 'Type': 'str', 'Desc': 'Axis unit'},\n",
       " {'Field': 'CUNIT2', 'Type': 'str', 'Desc': 'Axis unit'},\n",
       " {'Field': 'DATASEC', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DATASECA', 'Type': 'str', 'Desc': 'Data section from amp A'},\n",
       " {'Field': 'DATASECB', 'Type': 'str', 'Desc': 'Data section from amp B'},\n",
       " {'Field': 'DETECTOR', 'Type': 'str', 'Desc': 'Detector'},\n",
       " {'Field': 'DETPOS', 'Type': 'str', 'Desc': 'detector position ID'},\n",
       " {'Field': 'DETSEC', 'Type': 'str', 'Desc': 'Detector data section'},\n",
       " {'Field': 'DETSECA',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Detector display tile for amp A'},\n",
       " {'Field': 'DETSECB',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Detector display tile for amp B'},\n",
       " {'Field': 'DETSIZE', 'Type': 'str', 'Desc': 'Detector size for DETSEC'},\n",
       " {'Field': 'DHEFIRM', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DHEINF', 'Type': 'str', 'Desc': 'controller info'},\n",
       " {'Field': 'DONUT10E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT10Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT11E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT11Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT12E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT12Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT13E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT13Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT14E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT14Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT15E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT15Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT16E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT16Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT17E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT17Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT18E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT18Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT1E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT1Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT2E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT2Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT3E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT3Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT4E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT4Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT5E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT5Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT6E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT6Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT7E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT7Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT8E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT8Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT9E', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'DONUT9Z', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'EQUINOX', 'Type': 'str', 'Desc': 'Equinox of coordinate system'},\n",
       " {'Field': 'EXTNAME', 'Type': 'str', 'Desc': 'Extension name'},\n",
       " {'Field': 'FPA', 'Type': 'str', 'Desc': 'focal plan array'},\n",
       " {'Field': 'GAINA', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'GAINB', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'GCOUNT',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'one data group (required keyword)'},\n",
       " {'Field': 'INHERIT', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'LTM1_1', 'Type': 'str', 'Desc': 'CCD to image transformation'},\n",
       " {'Field': 'LTM1_2',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Detector to image transformation'},\n",
       " {'Field': 'LTM2_1',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'Detector to image transformation'},\n",
       " {'Field': 'LTM2_2', 'Type': 'str', 'Desc': 'CCD to image transformation'},\n",
       " {'Field': 'LTV1', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'LTV2', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'NAXIS1', 'Type': 'str', 'Desc': 'Axis length'},\n",
       " {'Field': 'NAXIS2', 'Type': 'str', 'Desc': 'Axis length'},\n",
       " {'Field': 'NDONUTS',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'AOS number of donuts analyzed for this CCD'},\n",
       " {'Field': 'PCOUNT', 'Type': 'str', 'Desc': 'size of special data area'},\n",
       " {'Field': 'POSTSECA', 'Type': 'str', 'Desc': 'Postscan from amp A'},\n",
       " {'Field': 'POSTSECB', 'Type': 'str', 'Desc': 'Postscan from amp B'},\n",
       " {'Field': 'PRESECA', 'Type': 'str', 'Desc': 'Prescan from amp A'},\n",
       " {'Field': 'PRESECB', 'Type': 'str', 'Desc': 'Prescan from amp B'},\n",
       " {'Field': 'PV1_0', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV1_1', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV1_10', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV1_2', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV1_3', 'Type': 'str', 'Desc': 'PV distortion coefficient'},\n",
       " {'Field': 'PV1_4', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV1_5', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV1_6', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV1_7', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV1_8', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV1_9', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV2_0', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV2_1', 'Type': 'str', 'Desc': 'Projection parameter 1'},\n",
       " {'Field': 'PV2_10', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV2_2', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV2_3', 'Type': 'str', 'Desc': 'PV distortion coefficient'},\n",
       " {'Field': 'PV2_4', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV2_5', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV2_6', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV2_7', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV2_8', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'PV2_9', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'RADESYS',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'World coordinate reference frame'},\n",
       " {'Field': 'RDNOISEA', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'RDNOISEB', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SATURATA', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SATURATB', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SLOT00',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'dhe board: <type> <serial> <firmware>'},\n",
       " {'Field': 'SLOT01',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'dhe board: <type> <serial> <firmware>'},\n",
       " {'Field': 'SLOT02',\n",
       "  'Type': 'str',\n",
       "  'Desc': 'dhe board: <type> <serial> <firmware>'},\n",
       " {'Field': 'SLOT03', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SLOT04', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'SLOT05', 'Type': 'str', 'Desc': 'Monsoon module'},\n",
       " {'Field': 'TRIMSEC', 'Type': 'str', 'Desc': ''},\n",
       " {'Field': 'TRIMSECA', 'Type': 'str', 'Desc': 'Good section from amp A'},\n",
       " {'Field': 'TRIMSECB', 'Type': 'str', 'Desc': 'Good section from amp B'},\n",
       " {'Field': 'VALIDA', 'Type': 'str', 'Desc': 'Data from amp A is valid'},\n",
       " {'Field': 'VALIDB', 'Type': 'str', 'Desc': 'Data from amp B is valid'},\n",
       " {'Field': 'WCSAXES', 'Type': 'str', 'Desc': 'Number of WCS axes'},\n",
       " {'Field': 'XTENSION', 'Type': 'str', 'Desc': 'binary table extension'}]"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "requests.get(f'{adsurl}/aux_hdu_fields/decam/raw/').json()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Advanced HDU Search of Core and Aux fields, results into Pandas <a id=\"hdu_search\" />  "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/json": {
       "cell": {
        "!": "OSMagics",
        "HTML": "Other",
        "SVG": "Other",
        "bash": "Other",
        "capture": "ExecutionMagics",
        "debug": "ExecutionMagics",
        "file": "Other",
        "html": "DisplayMagics",
        "javascript": "DisplayMagics",
        "js": "DisplayMagics",
        "latex": "DisplayMagics",
        "markdown": "DisplayMagics",
        "perl": "Other",
        "prun": "ExecutionMagics",
        "pypy": "Other",
        "python": "Other",
        "python2": "Other",
        "python3": "Other",
        "ruby": "Other",
        "script": "ScriptMagics",
        "sh": "Other",
        "svg": "DisplayMagics",
        "sx": "OSMagics",
        "system": "OSMagics",
        "time": "ExecutionMagics",
        "timeit": "ExecutionMagics",
        "writefile": "OSMagics"
       },
       "line": {
        "alias": "OSMagics",
        "alias_magic": "BasicMagics",
        "autoawait": "AsyncMagics",
        "autocall": "AutoMagics",
        "automagic": "AutoMagics",
        "autosave": "KernelMagics",
        "bookmark": "OSMagics",
        "cat": "Other",
        "cd": "OSMagics",
        "clear": "KernelMagics",
        "colors": "BasicMagics",
        "conda": "PackagingMagics",
        "config": "ConfigMagics",
        "connect_info": "KernelMagics",
        "cp": "Other",
        "debug": "ExecutionMagics",
        "dhist": "OSMagics",
        "dirs": "OSMagics",
        "doctest_mode": "BasicMagics",
        "ed": "Other",
        "edit": "KernelMagics",
        "env": "OSMagics",
        "gui": "BasicMagics",
        "hist": "Other",
        "history": "HistoryMagics",
        "killbgscripts": "ScriptMagics",
        "ldir": "Other",
        "less": "KernelMagics",
        "lf": "Other",
        "lk": "Other",
        "ll": "Other",
        "load": "CodeMagics",
        "load_ext": "ExtensionMagics",
        "loadpy": "CodeMagics",
        "logoff": "LoggingMagics",
        "logon": "LoggingMagics",
        "logstart": "LoggingMagics",
        "logstate": "LoggingMagics",
        "logstop": "LoggingMagics",
        "ls": "Other",
        "lsmagic": "BasicMagics",
        "lx": "Other",
        "macro": "ExecutionMagics",
        "magic": "BasicMagics",
        "man": "KernelMagics",
        "matplotlib": "PylabMagics",
        "mkdir": "Other",
        "more": "KernelMagics",
        "mv": "Other",
        "notebook": "BasicMagics",
        "page": "BasicMagics",
        "pastebin": "CodeMagics",
        "pdb": "ExecutionMagics",
        "pdef": "NamespaceMagics",
        "pdoc": "NamespaceMagics",
        "pfile": "NamespaceMagics",
        "pinfo": "NamespaceMagics",
        "pinfo2": "NamespaceMagics",
        "pip": "PackagingMagics",
        "popd": "OSMagics",
        "pprint": "BasicMagics",
        "precision": "BasicMagics",
        "prun": "ExecutionMagics",
        "psearch": "NamespaceMagics",
        "psource": "NamespaceMagics",
        "pushd": "OSMagics",
        "pwd": "OSMagics",
        "pycat": "OSMagics",
        "pylab": "PylabMagics",
        "qtconsole": "KernelMagics",
        "quickref": "BasicMagics",
        "recall": "HistoryMagics",
        "rehashx": "OSMagics",
        "reload_ext": "ExtensionMagics",
        "rep": "Other",
        "rerun": "HistoryMagics",
        "reset": "NamespaceMagics",
        "reset_selective": "NamespaceMagics",
        "rm": "Other",
        "rmdir": "Other",
        "run": "ExecutionMagics",
        "save": "CodeMagics",
        "sc": "OSMagics",
        "set_env": "OSMagics",
        "store": "StoreMagics",
        "sx": "OSMagics",
        "system": "OSMagics",
        "tb": "ExecutionMagics",
        "time": "ExecutionMagics",
        "timeit": "ExecutionMagics",
        "unalias": "OSMagics",
        "unload_ext": "ExtensionMagics",
        "who": "NamespaceMagics",
        "who_ls": "NamespaceMagics",
        "whos": "NamespaceMagics",
        "xdel": "NamespaceMagics",
        "xmode": "BasicMagics"
       }
      },
      "text/plain": [
       "Available line magics:\n",
       "%alias  %alias_magic  %autoawait  %autocall  %automagic  %autosave  %bookmark  %cat  %cd  %clear  %colors  %conda  %config  %connect_info  %cp  %debug  %dhist  %dirs  %doctest_mode  %ed  %edit  %env  %gui  %hist  %history  %killbgscripts  %ldir  %less  %lf  %lk  %ll  %load  %load_ext  %loadpy  %logoff  %logon  %logstart  %logstate  %logstop  %ls  %lsmagic  %lx  %macro  %magic  %man  %matplotlib  %mkdir  %more  %mv  %notebook  %page  %pastebin  %pdb  %pdef  %pdoc  %pfile  %pinfo  %pinfo2  %pip  %popd  %pprint  %precision  %prun  %psearch  %psource  %pushd  %pwd  %pycat  %pylab  %qtconsole  %quickref  %recall  %rehashx  %reload_ext  %rep  %rerun  %reset  %reset_selective  %rm  %rmdir  %run  %save  %sc  %set_env  %store  %sx  %system  %tb  %time  %timeit  %unalias  %unload_ext  %who  %who_ls  %whos  %xdel  %xmode\n",
       "\n",
       "Available cell magics:\n",
       "%%!  %%HTML  %%SVG  %%bash  %%capture  %%debug  %%file  %%html  %%javascript  %%js  %%latex  %%markdown  %%perl  %%prun  %%pypy  %%python  %%python2  %%python3  %%ruby  %%script  %%sh  %%svg  %%sx  %%system  %%time  %%timeit  %%writefile\n",
       "\n",
       "Automagic is ON, % prefix IS NOT needed for line magics."
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%lsmagic"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CPU times: user 51 ms, sys: 4.5 ms, total: 55.5 ms\n",
      "Wall time: 348 ms\n"
     ]
    }
   ],
   "source": [
    "%%time\n",
    "jj = {\n",
    "    \"outfields\" : [\n",
    "        \"archive_filename\",\n",
    "        \"caldat\",\n",
    "        \"instrument\",\n",
    "        \"proc_type\",\n",
    "        \"hdu:ra_center\",\n",
    "        \"hdu:dec_center\",\n",
    "    ],\n",
    "    \"search\" : [\n",
    "        [\"caldat\", \"2019-06-07\", \"2019-06-07\"] ,\n",
    "        [\"instrument\", \"decam\"],\n",
    "        [\"proc_type\", \"resampled\"],\n",
    "    ]\n",
    "}\n",
    "df = None # Pandas DataFrame\n",
    "apiurl=f'{adsurl}/find/?rectype=hdu&limit=9'\n",
    "response = requests.post(apiurl,json=jj)\n",
    "\n",
    "if response.status_code == 200:\n",
    "    df = pd.DataFrame(response.json()[1:])\n",
    "else:\n",
    "    print(response.json()['errorMessage'])\n",
    "    print(response.json()['traceback'])  # for API developer use"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>hdu:dec_center</th>\n",
       "      <th>hdu:ra_center</th>\n",
       "      <th>instrument</th>\n",
       "      <th>proc_type</th>\n",
       "      <th>caldat</th>\n",
       "      <th>archive_filename</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>-17.678360</td>\n",
       "      <td>290.97055</td>\n",
       "      <td>decam</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2019-06-07</td>\n",
       "      <td>/net/archive/pipe/20190607/ct4m/2019A-0305/c4d...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>-17.841875</td>\n",
       "      <td>290.80645</td>\n",
       "      <td>decam</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2019-06-07</td>\n",
       "      <td>/net/archive/pipe/20190607/ct4m/2019A-0305/c4d...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>-17.840000</td>\n",
       "      <td>290.48045</td>\n",
       "      <td>decam</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2019-06-07</td>\n",
       "      <td>/net/archive/pipe/20190607/ct4m/2019A-0305/c4d...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>-16.528040</td>\n",
       "      <td>291.62265</td>\n",
       "      <td>decam</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2019-06-07</td>\n",
       "      <td>/net/archive/pipe/20190607/ct4m/2019A-0305/c4d...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>-16.692420</td>\n",
       "      <td>291.78485</td>\n",
       "      <td>decam</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2019-06-07</td>\n",
       "      <td>/net/archive/pipe/20190607/ct4m/2019A-0305/c4d...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>-16.856350</td>\n",
       "      <td>291.46105</td>\n",
       "      <td>decam</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2019-06-07</td>\n",
       "      <td>/net/archive/pipe/20190607/ct4m/2019A-0305/c4d...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>-16.527200</td>\n",
       "      <td>291.29865</td>\n",
       "      <td>decam</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2019-06-07</td>\n",
       "      <td>/net/archive/pipe/20190607/ct4m/2019A-0305/c4d...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>-16.525080</td>\n",
       "      <td>290.65035</td>\n",
       "      <td>decam</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2019-06-07</td>\n",
       "      <td>/net/archive/pipe/20190607/ct4m/2019A-0305/c4d...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>-16.854580</td>\n",
       "      <td>290.81075</td>\n",
       "      <td>decam</td>\n",
       "      <td>resampled</td>\n",
       "      <td>2019-06-07</td>\n",
       "      <td>/net/archive/pipe/20190607/ct4m/2019A-0305/c4d...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   hdu:dec_center  hdu:ra_center instrument  proc_type      caldat   \n",
       "0      -17.678360      290.97055      decam  resampled  2019-06-07  \\\n",
       "1      -17.841875      290.80645      decam  resampled  2019-06-07   \n",
       "2      -17.840000      290.48045      decam  resampled  2019-06-07   \n",
       "3      -16.528040      291.62265      decam  resampled  2019-06-07   \n",
       "4      -16.692420      291.78485      decam  resampled  2019-06-07   \n",
       "5      -16.856350      291.46105      decam  resampled  2019-06-07   \n",
       "6      -16.527200      291.29865      decam  resampled  2019-06-07   \n",
       "7      -16.525080      290.65035      decam  resampled  2019-06-07   \n",
       "8      -16.854580      290.81075      decam  resampled  2019-06-07   \n",
       "\n",
       "                                    archive_filename  \n",
       "0  /net/archive/pipe/20190607/ct4m/2019A-0305/c4d...  \n",
       "1  /net/archive/pipe/20190607/ct4m/2019A-0305/c4d...  \n",
       "2  /net/archive/pipe/20190607/ct4m/2019A-0305/c4d...  \n",
       "3  /net/archive/pipe/20190607/ct4m/2019A-0305/c4d...  \n",
       "4  /net/archive/pipe/20190607/ct4m/2019A-0305/c4d...  \n",
       "5  /net/archive/pipe/20190607/ct4m/2019A-0305/c4d...  \n",
       "6  /net/archive/pipe/20190607/ct4m/2019A-0305/c4d...  \n",
       "7  /net/archive/pipe/20190607/ct4m/2019A-0305/c4d...  \n",
       "8  /net/archive/pipe/20190607/ct4m/2019A-0305/c4d...  "
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Error Conditions <a id=\"errors\" />"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Examples of bad search specification\n",
    "#### Attempt to search unknown field name"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "No \"proc_type\" was provided when searching for AUX fields. For performance reasons you must also filter on \"instrument\" and \"proc_type\" that contain the AUX fields you are searching on (snafu).\n"
     ]
    }
   ],
   "source": [
    "jj={\n",
    "    \"outfields\" : [\n",
    "        \"ifilter\",\n",
    "        \"archive_filename\"\n",
    "    ],\n",
    "    \"search\" : [\n",
    "        [\"snafu\",\"wubba\"], # unknown field \"snafu\"\n",
    "        [\"instrument\", \"decam\"]\n",
    "    ]\n",
    "}\n",
    "df = None # Pandas DataFrame\n",
    "apiurl=f'{adsurl}/find/?limit=9'\n",
    "response = requests.post(apiurl,json=jj)\n",
    "\n",
    "if response.status_code == 200:\n",
    "    df = pd.DataFrame(response.json()[1:])\n",
    "else:\n",
    "    print(response.json()['errorMessage'])\n",
    "    #print(response.json()['traceback'])  # for API developer use\n",
    "df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Attempt to retrieve field name not in known list"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "No \"instrument\" was provided when searching for AUX fields. For performance reasons you must also filter on \"instrument\" and \"proc_type\" that contain the AUX fields you are searching on (baz, foo).\n"
     ]
    }
   ],
   "source": [
    "jj={\n",
    "    \"outfields\" : [\n",
    "        \"baz\",  # unknown field\n",
    "        \"foo\",  # unknown field\n",
    "        \"ifilter\",\n",
    "        \"archive_filename\"\n",
    "    ],\n",
    "    \"search\" : [\n",
    "        [\"ifilter\", \"GG395 kGG395\"],\n",
    "    ]\n",
    "}\n",
    "df = None # Pandas DataFrame\n",
    "apiurl=f'{adsurl}/find/?limit=9'\n",
    "response = requests.post(apiurl,json=jj)\n",
    "\n",
    "if response.status_code == 200:\n",
    "    df = pd.DataFrame(response.json()[1:])\n",
    "else:\n",
    "    print(response.json()['errorMessage'])\n",
    "    #print(response.json()['traceback'])  # for API developer use\n",
    "df\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Elapsed seconds=29.043631090004055 on https://astroarchive.noirlab.edu\n",
      "Completed on: 2023-04-27 05:33:50.199181\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "29.043631090004055"
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import datetime\n",
    "elapsed = toc()  # Seconds since start of Notebook load (assuming fresh run)\n",
    "print(f'Elapsed seconds={elapsed} on {natroot}')\n",
    "print(f'Completed on: {str(datetime.datetime.now())}')\n",
    "assert natroot == 'https://astroarchive.noirlab.edu', 'Notebook does NOT point to PRODUCTION'\n",
    "elapsed"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Resources and references <a id=\"doc\" />\n",
    "- [automically generated API sepecifications](https://astroarchive.noao.edu/api/docs/#/api)\n",
    "Generated using [swagger](https://drf-yasg.readthedocs.io/en/stable/readme.html) against annotated source code.\n",
    "\n",
    "- [NOAO Data Handbook](http://ast.noao.edu/sites/default/files/NOAO_DHB_v2.2.pdf) version 2.2, May 2015"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.6"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}