The Hyper SuprimeCam (HSC) data is currently from PDR2. We aim to use both the detection catalogues to merge with VISTA detections produced by the LSST stack and also to use these detection catalogues on the public deep co-added HSC warps.
The third release data is the data currently used. We created a list of tracts that are below +2 degrees declination in the notebooks here. Download scripts are in the slurm folder. The data is available to download with a login from here:
https://hsc-release.mtk.nao.ac.jp/archive/filetree/pdr3_dud/
https://hsc-release.mtk.nao.ac.jp/archive/filetree/pdr3_wide/
The folder structure uses the deprecated patch format with commas. To ingest the files these must be
The PDR2 data is no longer used. The following information is for archival purposes only.
The data is downloaded from the direct access filetree.
https://hsc-release.mtk.nao.ac.jp/archive/filetree/pdr2_dud/
https://hsc-release.mtk.nao.ac.jp/archive/filetree/pdr2_wide/
The file structure within those directories should mirror the policy file in the obs_subaru package at the time of creation. We are aiming to mirror this file structure policy with obs_vista data. The full wide data set is ~17TB.
You can get all the tracts below +2 degrees declination by downloading all tracts that begin with 8 or 9. Some of the VIKING tiles go to around +3 degrees. All tracts starting with 8, 9, or 10 will retrieve all data that overlaps with VISTA coverage.
We are currently experimenting with symlinks as the simplest way to 'ingest' these HSC images and detection catalogues into an obs_vista Butler repository. Note however that by linking the directories the obs_vista package can then modify files in the original repo which is dangerous. It may therefore be better to fully copy these files.
ln -s $HSC_DATA/hsc-release.mtk.nao.ac.jp/archive/filetree/pdr2_dud/deepCoadd-results/HSC-G data/rerun/coadd/deepCoadd-results/HSC-G ln -s $HSC_DATA/hsc-release.mtk.nao.ac.jp/archive/filetree/pdr2_dud/deepCoadd-results/HSC-R data/rerun/coadd/deepCoadd-results/HSC-R ln -s $HSC_DATA/hsc-release.mtk.nao.ac.jp/archive/filetree/pdr2_dud/deepCoadd-results/HSC-I data/rerun/coadd/deepCoadd-results/HSC-I ln -s $HSC_DATA/hsc-release.mtk.nao.ac.jp/archive/filetree/pdr2_dud/deepCoadd-results/HSC-Z data/rerun/coadd/deepCoadd-results/HSC-Z ln -s $HSC_DATA/hsc-release.mtk.nao.ac.jp/archive/filetree/pdr2_dud/deepCoadd-results/HSC-Y data/rerun/coadd/deepCoadd-results/HSC-Y