Using DC2PipeHowto as reference...

* setup dc2pipe

• Issue - I was sourcing /lsst/softstack/loadLSST.csh. This is deprecated. Instead source /share/stack/loadLSST.csh for the full DC2 experience.

* ensuressh2.sh

• ssh lsst8.ncsa.uiuc.edu works without a password. Check.

* ensurempdconf.sh

• [becker@lsst9 ~]$ more .mpd.conf
  MPD_SECRETWORD=XXXX

* DB authentication

• [becker@lsst9 ~]$ ls /tmp/lsst.db.auth
  
• Looks like this exists.

Running the Pipe

The runs are stored at /lsst/DC2root/. I presume that I launch the pipeline from my own directory? Yep says Ray.

mkdir -p /home/becker/pipeline_runs/acb0001

cd /home/becker/pipeline_runs/acb0001

cp -r $DC2PIPE_DIR/pipeline/{imageSubtractionDetection,association,movingobjects} .

cp $DC2PIPE_DIR/pipeline/{imageSubtractionDetection,association,movingobjects}.paf .

cp $DC2PIPE_DIR/pipeline/dc2pipe.paf .
 # leave at defaults for now

cp $DC2PIPE_DIR/exposureLists/short.data .
 # edit it so its really short, only 2 lines

cp $DC2PIPE_DIR/etc/setup.csh .
 # just in case some complicated setups have to be done
 # if i have to e.g. tweak the imageproc trunk, this is where i would tell things to use my own development copy

launchDC2.py -r . -e setup.csh dc2pipe.paf acb0001 short.data
 # dc2pipe: OSError: [Errno 17] File exists: '/share/DC2root'
 # THIS LOOKS LIKE AN ACTUAL BUG

Debugging python script

[becker@lsst9 acb0001]$ which launchDC2.py
  /share/stack/Linux/dc2pipe/svn4009/bin/launchDC2.py

[becker@lsst9 acb0001]$ grep DC2root /share/stack/Linux/dc2pipe/svn4009/bin/launchDC2.py
  home = pol.get("workingHome", "/share/DC2root")

Ah, it should be /lsst/DC2root. This is changed in dc2pipe.paf. Back to running stuff...

launchDC2.py -r . -e setup.csh dc2pipe.paf acb0001 short.data
 # returns my prompt; i presume its running.
 # look for it [http://dev.lsstcorp.org/cgi-bin/availableRuns.cgi here].  nothing yet.

In fact, all my /lsst/DC2root/acb0001/*/input directories are empty... Apparently its the wrong permissions on the .mpd.conf, they should be 0600. DO this on lsst4-lsst10.

Re-running.

[becker@lsst9 acb0001]$ launchDC2.py -r . -e setup.csh dc2pipe.paf acb0001 short.data
  dc2pipe: RuntimeError: Run ID already used (use -f to override)

[becker@lsst9 acb0001]$ launchDC2.py -f -r . -e setup.csh dc2pipe.paf acb0001 short.data
  ...
  ERROR 1007 (HY000) at line 1: Can't create database 'acb0001'; database exists
  dc2pipe: RuntimeError: Failed to create database for run acb0001

Turns out you can't re-run! Looks like database issue... OK.

launchDC2.py -r . -e setup.csh dc2pipe.paf acb0002 short.data

Yes! This shows up  here.