km3pipe.utils.qrunqaqc

Submits jobs which analyse a batch of runs with JQAQC.sh to retrieve the quality parameters. The obtained data is then optionally uploaded to the runsummarynumbers table of the KM3NeT database.

The submitted run IDs are logged in BLACKLIST_{DET_ID}.txt and skipped upon subsequential runs. The temporary quality parameters are stored in the folder qparams and the job logs can be found in qlogs.

To start from scratch, delete the above mentioned files. Runs which are were already processed and present in the runsummarynumbers table are always skipped.

Usage:

qrunqaqc [options] DET_ID qrunqaqc (-h | –help)

Options:

-b BATCH_SIZE

Number of runs to process in a single job.

-j MAX_JOBS

Maximum number of jobs to submit [default: 100].

-u

Upload summary data to the database automatically.

-q

Dryrun, don’t submit the jobs.

-h –help Show this screen.

Module Contents

Classes

QAQCAnalyser

Determines run quality parameters and uploads them to the DB

Functions

main()

Attributes

ESTIMATED_TIME_PER_RUN

km3pipe.utils.qrunqaqc.ESTIMATED_TIME_PER_RUN

class km3pipe.utils.qrunqaqc.QAQCAnalyser(det_id, should_upload_to_db, log_file='qrunqaqc.log')

Determines run quality parameters and uploads them to the DB

property blacklisted_run_ids

The blacklisted run_ids

property columns

Get the ordered columns for the quality parameter output

add_to_blacklist(run_id)

Put the run_id into a det_id specific blacklist

retrieve_available_runs()

run(batch_size, max_jobs, dryrun)

Walk through the runtable and submit batches of runs

print_stats()

Print a summary of the collected statistics

submit_batch(run_ids, dryrun)

Submit a QAQC.sh job for a given list of run IDs

retrieve_qparams()

Returns a list of quality parameters determined by JQAQC.sh

km3pipe.utils.qrunqaqc.main()