Hi,all.
I’m processing hsc data using the hscpipe8.5.3 in centos 7.9,and i have some questions,
first,when I processed skyCorrection.py,warning like:
raise RuntimeError("Failed to format %r with data %r: %s" % (template, transformedId, e))
RuntimeError: Failed to format '%(pointing)05d/%(filter)s/corr/CORR-%(visit)07d-%(ccd)03d.fits' with data DataId(initialdata={'field': 'VC13', 'ccd': '0', 'pointing': 2236, 'filter': 'HSC-G', 'visit': 141342, 'dateObs': '2018-02-14', 'taiObs': '2018-02-14', 'expTime': 40.0}, tag=set()): %d format: a number is required, not str
then I find in this topic occurs the same problem,and the solutions you give are that I should use meas_mosaic or tell coaddDriver.py to just use the original calibrations from singleFrameDriver.py,
But I wonder the fuctions of means of meas_mosaic,is it just ignore the output in Mosaicking?briefly say, the outputs like positional calibration and flux calibrations?For fearing the data ignore will have bad effect,I choose use the the first suggestion you give,and I follow the first suggestion,but when I scons,warning like:
In file included from include/lsst/meas/mosaic/fluxfit.h:6,
from include/lsst/meas/mosaic/FluxFitBoundedField.h:30,
from src/FluxFitBoundedField.cc:24:
include/lsst/meas/mosaic/mosaicfit.h:47:51: error: expected ')' before 'coord'
47 | Source(lsst::afw::coord::IcrsCoord coord, double flux=std::numeric_limits<double>::quiet_NaN()) :
| ~ ^~~~~~
| )
include/lsst/meas/mosaic/mosaicfit.h:74:35: error: 'IcrsCoord' in namespace 'lsst::afw::coord' does not name a type
74 | lsst::afw::coord::IcrsCoord getSky() const { return _sky; }
| ^~~~~~~~~
include/lsst/meas/mosaic/mosaicfit.h:94:35: error: 'IcrsCoord' in namespace 'lsst::afw::coord' does not name a type
94 | lsst::afw::coord::IcrsCoord _sky; // Sky coordinates
| ^~~~~~~~~
include/lsst/meas/mosaic/mosaicfit.h: In constructor 'lsst::meas::mosaic::Source::Source(const lsst::afw::table::SourceRecord&)':
include/lsst/meas/mosaic/mosaicfit.h:25:69: error: class 'lsst::meas::mosaic::Source' does not have any field named '_sky'
25 | _id(record.getId()), _chip(UNSET), _exp(UNSET), _sky(record.getRa(), record.getDec()),
| ^~~~
include/lsst/meas/mosaic/mosaicfit.h:26:73: error: 'const class lsst::afw::table::SourceRecord' has no member named 'getCalibFlux'; did you mean 'getCalibInstFlux'?
26 | _pixels(record.getX(), record.getY()), _flux(record.getCalibFlux()), _err(record.getCalibFluxErr()),
| ^~~~~~~~~~~~
| getCalibInstFlux
include/lsst/meas/mosaic/mosaicfit.h:26:102: error: 'const class lsst::afw::table::SourceRecord' has no member named 'getCalibFluxErr'; did you mean 'getCalibInstFluxErr'?
26 | X(), record.getY()), _flux(record.getCalibFlux()), _err(record.getCalibFluxErr()),
| ^~~~~~~~~~~~~~~
| getCalibInstFluxErr
include/lsst/meas/mosaic/mosaicfit.h: In constructor 'lsst::meas::mosaic::Source::Source(const lsst::afw::table::SimpleRecord&, const lsst::afw::geom::SkyWcs&)':
include/lsst/meas/mosaic/mosaicfit.h:30:69: error: class 'lsst::meas::mosaic::Source' does not have any field named '_sky'
30 | _id(record.getId()), _chip(UNSET), _exp(UNSET), _sky(record.getRa(), record.getDec()),
| ^~~~
include/lsst/meas/mosaic/mosaicfit.h:31:44: error: '_sky' was not declared in this scope
31 | _pixels(wcs.skyToPixel(_sky)),
| ^~~~
include/lsst/meas/mosaic/mosaicfit.h: In constructor 'lsst::meas::mosaic::Source::Source(lsst::meas::mosaic::Source::IdType, lsst::meas::mosaic::Source::ChipType, lsst::meas::mosaic::Source::ExpType, double, double, double, double, double, double, double, double, bool)':
include/lsst/meas/mosaic/mosaicfit.h:64:7: error: class 'lsst::meas::mosaic::Source' does not have any field named '_sky'
64 | _sky(lsst::afw::geom::Angle(ra, lsst::afw::geom::degrees), lsst::afw::geom::Angle(dec, lsst::afw::geom::degrees)),
| ^~~~
include/lsst/meas/mosaic/mosaicfit.h: In member function 'lsst::geom::Angle lsst::meas::mosaic::Source::getRa() const':
include/lsst/meas/mosaic/mosaicfit.h:75:63: error: 'getSky' was not declared in this scope
75 | lsst::afw::geom::Angle getRa() const { return getSky().getLongitude(); }
| ^~~~~~
include/lsst/meas/mosaic/mosaicfit.h: In member function 'lsst::geom::Angle lsst::meas::mosaic::Source::getDec() const':
include/lsst/meas/mosaic/mosaicfit.h:76:64: error: 'getSky' was not declared in this scope
76 | lsst::afw::geom::Angle getDec() const { return getSky().getLatitude(); }
| ^~~~~~
include/lsst/meas/mosaic/mosaicfit.h: At global scope:
include/lsst/meas/mosaic/mosaicfit.h:238:21: error: 'IcrsCoord' in namespace 'lsst::afw::coord' does not name a type
238 | lsst::afw::coord::IcrsCoord c;
| ^~~~~~~~~
include/lsst/meas/mosaic/mosaicfit.h:250:51: error: 'lsst::afw::coord::IcrsCoord' has not been declared
250 | ConstPtr search(lsst::afw::coord::IcrsCoord const& sky) const;
| ^~~~~~~~~
include/lsst/meas/mosaic/mosaicfit.h: In member function 'double lsst::meas::mosaic::KDTree::distance(const lsst::meas::mosaic::Source&) const':
include/lsst/meas/mosaic/mosaicfit.h:264:28: error: 'c' was not declared in this scope
264 | return c.angularSeparation(lsst::afw::coord::IcrsCoord(s.getRa(), s.getDec())).asDegrees();
| ^
include/lsst/meas/mosaic/mosaicfit.h:264:66: error: 'IcrsCoord' is not a member of 'lsst::afw::coord'
264 | return c.angularSeparation(lsst::afw::coord::IcrsCoord(s.getRa(), s.getDec())).asDegrees();
| ^~~~~~~~~
In file included from src/FluxFitBoundedField.cc:24:
include/lsst/meas/mosaic/FluxFitBoundedField.h: At global scope:
include/lsst/meas/mosaic/FluxFitBoundedField.h:63:10: error: looser exception specification on overriding virtual function 'virtual bool lsst::meas::mosaic::FluxFitBoundedField::isPersistable() const'
63 | bool isPersistable() const override { return true; }
| ^~~~~~~~~~~~~
In file included from /data/hscpipe/8.5.3/lsst_home/stack/miniconda3-4.7.10-4d7b902/Linux64/afw/8.1-hsc/include/lsst/afw/math/Function.h:39,
from /data/hscpipe/8.5.3/lsst_home/stack/miniconda3-4.7.10-4d7b902/Linux64/afw/8.1-hsc/include/lsst/afw/image/ImageBase.h:42,
from /data/hscpipe/8.5.3/lsst_home/stack/miniconda3-4.7.10-4d7b902/Linux64/afw/8.1-hsc/include/lsst/afw/image/Image.h:42,
from /data/hscpipe/8.5.3/lsst_home/stack/miniconda3-4.7.10-4d7b902/Linux64/afw/8.1-hsc/include/lsst/afw/math/BoundedField.h:32,
from include/lsst/meas/mosaic/FluxFitBoundedField.h:27,
from src/FluxFitBoundedField.cc:24:
/data/hscpipe/8.5.3/lsst_home/stack/miniconda3-4.7.10-4d7b902/Linux64/afw/8.1-hsc/include/lsst/afw/table/io/Persistable.h:102:18: note: overridden function is 'virtual bool lsst::afw::table::io::Persistable::isPersistable() const noexcept'
102 | virtual bool isPersistable() const noexcept { return false; }
| ^~~~~~~~~~~~~
scons: *** [src/FluxFitBoundedField.os] Error 1
scons: building terminated because of errors.
and a more question is when I processed singleFrameDriver.py,for some visits,I won’t get full images,for example:
ls 02235/HSC-G/corr/ | cut -d '-' -f 1,2 | uniq -c
103 BKGD-0140838
100 BKGD-0140870
66 BKGD-0140902
103 CORR-0140838
100 CORR-0140870
66 CORR-0140902
103 ICEXPBKGD-0140838
103 ICEXPBKGD-0140870
103 ICEXPBKGD-0140902
what cause this happen?It’s it normal?
I don’t konw how to deal with the errors,Has anyone encountered problems like these?
Thank you!