Monitoring Tasks: Difference between revisions
From Genecats
Jump to navigationJump to search
No edit summary |
(Adding column to monitoring jobs to allow for shuffling.) |
||
| Line 5: | Line 5: | ||
<th>frequency</th> | <th>frequency</th> | ||
<th>who NOW</th> | <th>who NOW</th> | ||
<th>who April '16 -March '17</th> | |||
<th>who Aug '14 - Aug '15-Apr'16</th> | <th>who Aug '14 - Aug '15-Apr'16</th> | ||
<th>who Aug '13 - Jul '14</th> | <th>who Aug '13 - Jul '14</th> | ||
| Line 11: | Line 12: | ||
<tr> | <tr> | ||
<td colspan=" | <td colspan="7" style="background-color:gray"><b>from [http://genomewiki.cse.ucsc.edu/genecats/index.php/Updating_QA_crontabs hgwdev] qateam cron</b></td> | ||
</tr> | </tr> | ||
| Line 17: | Line 18: | ||
<td>ask Galt/Jim about blat updates</td> | <td>ask Galt/Jim about blat updates</td> | ||
<td>3x per year</td> | <td>3x per year</td> | ||
<td></td> | |||
<td>Cath, Brian </td> | <td>Cath, Brian </td> | ||
<td>Steve, Jonathan</td> | <td>Steve, Jonathan</td> | ||
| Line 26: | Line 28: | ||
<td>Respond to items on the broken links report: Check to make sure that broken links reported are actually broken. If so, fix the link if it is clear what the new link should be and push to the RR. If not, contact the appropriate person at the web site in question to find out what the new link should be.</td> | <td>Respond to items on the broken links report: Check to make sure that broken links reported are actually broken. If so, fix the link if it is clear what the new link should be and push to the RR. If not, contact the appropriate person at the web site in question to find out what the new link should be.</td> | ||
<td>daily</td> | <td>daily</td> | ||
<td></td> | |||
<td>Cath, Matt</td> | <td>Cath, Matt</td> | ||
<td>Matt</td> | <td>Matt</td> | ||
| Line 35: | Line 38: | ||
<td>Respond to the trackDbGlobal report: Make public and request a push of trackDb and friends for any assemblies that show up as changed in the trackDbGlobal report.</td> | <td>Respond to the trackDbGlobal report: Make public and request a push of trackDb and friends for any assemblies that show up as changed in the trackDbGlobal report.</td> | ||
<td>weekly</td> | <td>weekly</td> | ||
<td></td> | |||
<td>Cath</td> | <td>Cath</td> | ||
<td>Matt</td> | <td>Matt</td> | ||
| Line 44: | Line 48: | ||
<td>receive output from hgTracksRandom cron; alert admins to problems</td> | <td>receive output from hgTracksRandom cron; alert admins to problems</td> | ||
<td>as needed</td> | <td>as needed</td> | ||
<td></td> | |||
<td>many: cath, christopher, kuhn, brianlee, braney, luvina, gary, ann,, jcasper, matt</td> | <td>many: cath, christopher, kuhn, brianlee, braney, luvina, gary, ann,, jcasper, matt</td> | ||
<td>many: kuhn, katrina, brianlee, braney, luvina, gary, ann, steve, jcasper, matt</td> | <td>many: kuhn, katrina, brianlee, braney, luvina, gary, ann, steve, jcasper, matt</td> | ||
| Line 53: | Line 58: | ||
<td>receive output from gbLoaded cron job and alert braney if anything seems very outdated</td> | <td>receive output from gbLoaded cron job and alert braney if anything seems very outdated</td> | ||
<td>daily, problems every 3-6 months</td> | <td>daily, problems every 3-6 months</td> | ||
<td></td> | |||
<td>Cath, Luvina</td> | <td>Cath, Luvina</td> | ||
<td>Steve, Jonathan</td> | <td>Steve, Jonathan</td> | ||
| Line 62: | Line 68: | ||
<td>receive output from showProcesslist.csh</td> | <td>receive output from showProcesslist.csh</td> | ||
<td>daily, no action</td> | <td>daily, no action</td> | ||
<td></td> | |||
<td>Jairo, Matt </td> | <td>Jairo, Matt </td> | ||
<td>Steve, Jonathan</td> | <td>Steve, Jonathan</td> | ||
| Line 71: | Line 78: | ||
<td>get output from checkTableStatus.csh on Mondays (this is a report on whether the genbank table dumps are up-to-date...if we could get rid of our dependence on those, we could get rid of this cron job)</td> | <td>get output from checkTableStatus.csh on Mondays (this is a report on whether the genbank table dumps are up-to-date...if we could get rid of our dependence on those, we could get rid of this cron job)</td> | ||
<td>weekly</td> | <td>weekly</td> | ||
<td></td> | |||
<td>Brian, Jonathan</td> | <td>Brian, Jonathan</td> | ||
<td>Steve, Jonathan</td> | <td>Steve, Jonathan</td> | ||
| Line 80: | Line 88: | ||
<td>get an email from backupCentral.csh each month that keeps a dump of hgcentral tables (there's a redmine ticket on whether we should change this one: http://redmine.soe.ucsc.edu/issues/7834)</td> | <td>get an email from backupCentral.csh each month that keeps a dump of hgcentral tables (there's a redmine ticket on whether we should change this one: http://redmine.soe.ucsc.edu/issues/7834)</td> | ||
<td>monthly</td> | <td>monthly</td> | ||
<td></td> | |||
<td>Matt, Brian </td> | <td>Matt, Brian </td> | ||
<td>Steve, Jonathan</td> | <td>Steve, Jonathan</td> | ||
| Line 89: | Line 98: | ||
<td>receive an email on additions and subtractions to files in /gbdb on hgnfs1</td> | <td>receive an email on additions and subtractions to files in /gbdb on hgnfs1</td> | ||
<td>daily</td> | <td>daily</td> | ||
<td></td> | |||
<td>Christopher, Luvina </td> | <td>Christopher, Luvina </td> | ||
<td>Steve, Jonathan</td> | <td>Steve, Jonathan</td> | ||
| Line 98: | Line 108: | ||
<td>receive an email from cron if qateam DailySandboxUpdate fails</td> | <td>receive an email from cron if qateam DailySandboxUpdate fails</td> | ||
<td>daily</td> | <td>daily</td> | ||
<td></td> | |||
<td>Matt, Brian</td> | <td>Matt, Brian</td> | ||
<td>Steve, Jonathan</td> | <td>Steve, Jonathan</td> | ||
| Line 107: | Line 118: | ||
<td>receive output from checkMetaAday.csh; alert; if anything is out of sync (compares hgcentralbeta to hgcentral for db of the day) [[CheckMetaADay.csh_monitoring_task | Instructions & Example]]</td> | <td>receive output from checkMetaAday.csh; alert; if anything is out of sync (compares hgcentralbeta to hgcentral for db of the day) [[CheckMetaADay.csh_monitoring_task | Instructions & Example]]</td> | ||
<td>daily</td> | <td>daily</td> | ||
<td></td> | |||
<td>Cath, Matt</td> | <td>Cath, Matt</td> | ||
<td>Matt</td> | <td>Matt</td> | ||
| Line 116: | Line 128: | ||
<td>receive output from syncAday.csh; alert; if anything is out of sync (checks that tables are in sync between beta and RR for database of the day) </td> | <td>receive output from syncAday.csh; alert; if anything is out of sync (checks that tables are in sync between beta and RR for database of the day) </td> | ||
<td>daily</td> | <td>daily</td> | ||
<td></td> | |||
<td>ChrisV</td> | <td>ChrisV</td> | ||
<td>Brian</td> | <td>Brian</td> | ||
| Line 126: | Line 139: | ||
<td> increment databaseAday, /cluster/bin/scripts/databaseAday.csh </td> | <td> increment databaseAday, /cluster/bin/scripts/databaseAday.csh </td> | ||
<td>problems only</td> | <td>problems only</td> | ||
<td></td> | |||
<td>Brian, Jonathan</td> | <td>Brian, Jonathan</td> | ||
<td>Steve, Jonathan</td> | <td>Steve, Jonathan</td> | ||
| Line 135: | Line 149: | ||
<td>checkHgFindSpec -checkTermRegex, /cluster/bin/scripts/runCheckHgFindSpec go</td> | <td>checkHgFindSpec -checkTermRegex, /cluster/bin/scripts/runCheckHgFindSpec go</td> | ||
<td>problems only</td> | <td>problems only</td> | ||
<td></td> | |||
<td>Brian, Jonathan</td> | <td>Brian, Jonathan</td> | ||
<td>Steve, Jonathan</td> | <td>Steve, Jonathan</td> | ||
| Line 144: | Line 159: | ||
<td>check to see if there are new files to go with the CGI push /cluster/home/qateam/bin/scripts/findCgiFiles.csh go</td> | <td>check to see if there are new files to go with the CGI push /cluster/home/qateam/bin/scripts/findCgiFiles.csh go</td> | ||
<td>problems only</td> | <td>problems only</td> | ||
<td></td> | |||
<td>Brian, Jonathan</td> | <td>Brian, Jonathan</td> | ||
<td>Steve, Jonathan</td> | <td>Steve, Jonathan</td> | ||
| Line 154: | Line 170: | ||
<td>get output from checkGenomeMysql</td> | <td>get output from checkGenomeMysql</td> | ||
<td>daily</td> | <td>daily</td> | ||
<td></td> | |||
<td>Christopher, Matt</td> | <td>Christopher, Matt</td> | ||
<td>Steve, Jonathan</td> | <td>Steve, Jonathan</td> | ||
| Line 163: | Line 180: | ||
<td>Check for unigene update for human SAGE track</td> | <td>Check for unigene update for human SAGE track</td> | ||
<td>daily</td> | <td>daily</td> | ||
<td></td> | |||
<td>Luvina, Braney</td> | <td>Luvina, Braney</td> | ||
<td>Steve, Braney</td> | <td>Steve, Braney</td> | ||
| Line 172: | Line 190: | ||
<td>look for broken symlinks in /gbdb:</td> | <td>look for broken symlinks in /gbdb:</td> | ||
<td>daily</td> | <td>daily</td> | ||
<td></td> | |||
<td>Browser Staff</td> | <td>Browser Staff</td> | ||
<td>Browser Staff</td> | <td>Browser Staff</td> | ||
| Line 181: | Line 200: | ||
<td>look for broken symlinks in in (very large) visiGene directory</td> | <td>look for broken symlinks in in (very large) visiGene directory</td> | ||
<td>twice yearly</td> | <td>twice yearly</td> | ||
<td></td> | |||
<td>Cath, Galt</td> | <td>Cath, Galt</td> | ||
<td>Steve, Galt</td> | <td>Steve, Galt</td> | ||
| Line 190: | Line 210: | ||
<td>look for broken symlinks in htdocs-hgdownload/goldenpath</td> | <td>look for broken symlinks in htdocs-hgdownload/goldenpath</td> | ||
<td>daily</td> | <td>daily</td> | ||
<td></td> | |||
<td>Browser Staff</td> | <td>Browser Staff</td> | ||
<td>Browser Staff</td> | <td>Browser Staff</td> | ||
| Line 199: | Line 220: | ||
<td>Check the source tree for duplicate case-independent filenames. These wreck havoc with git.</td> | <td>Check the source tree for duplicate case-independent filenames. These wreck havoc with git.</td> | ||
<td>daily</td> | <td>daily</td> | ||
<td></td> | |||
<td>Browser Staff</td> | <td>Browser Staff</td> | ||
<td>Browser Staff</td> | <td>Browser Staff</td> | ||
| Line 208: | Line 230: | ||
<td>Check to see what kind of browsers and o/s people are using to access the public website</td> | <td>Check to see what kind of browsers and o/s people are using to access the public website</td> | ||
<td>weekly</td> | <td>weekly</td> | ||
<td></td> | |||
<td>Ann, Christopher, Brian</td> | <td>Ann, Christopher, Brian</td> | ||
<td>Ann, Steve</td> | <td>Ann, Steve</td> | ||
| Line 217: | Line 240: | ||
<td>run /cluster/bin/scripts/sessionStats.csh</td> | <td>run /cluster/bin/scripts/sessionStats.csh</td> | ||
<td>monthly</td> | <td>monthly</td> | ||
<td></td> | |||
<td>Angie, Brian, Bob</td> | <td>Angie, Brian, Bob</td> | ||
<td>Angie, Brian, Bob, Steve</td> | <td>Angie, Brian, Bob, Steve</td> | ||
| Line 226: | Line 250: | ||
<td>check that the [https://genomicsandhealth.org/work-products-demonstration-projects/beacon-project-0 ga4gh] [http://genome.ucsc.edu/cgi-bin/hgBeacon beacon server] is running. Email Max if there is an issue. </td> | <td>check that the [https://genomicsandhealth.org/work-products-demonstration-projects/beacon-project-0 ga4gh] [http://genome.ucsc.edu/cgi-bin/hgBeacon beacon server] is running. Email Max if there is an issue. </td> | ||
<td>daily</td> | <td>daily</td> | ||
<td></td> | |||
<td>Cath</td> | <td>Cath</td> | ||
<td>Ann</td> | <td>Ann</td> | ||
| Line 235: | Line 260: | ||
<td>check that blat servers are running ok</td> | <td>check that blat servers are running ok</td> | ||
<td>ongoing</td> | <td>ongoing</td> | ||
<td></td> | |||
<td>Ann, Brian, Donna, Galt, Luvina, Matt, Gary,</td> | <td>Ann, Brian, Donna, Galt, Luvina, Matt, Gary,</td> | ||
<td>Ann, Brian, Donna, Galt, Luvina, Steve, Gary</td> | <td>Ann, Brian, Donna, Galt, Luvina, Steve, Gary</td> | ||
| Line 244: | Line 270: | ||
<td>check that beta builds alright</td> | <td>check that beta builds alright</td> | ||
<td>3x week</td> | <td>3x week</td> | ||
<td></td> | |||
<td>Brian, Christopher,Braney</td> | <td>Brian, Christopher,Braney</td> | ||
<td>Steve, Jonathan, Braney</td> | <td>Steve, Jonathan, Braney</td> | ||
| Line 253: | Line 280: | ||
<td>hubPublicCheck complains when the hubPublic table doesn't have the same strings as the actual hub.txt file. '' (NOTE: To run only on Beta hubs requires these declarations: '''export HGDB_CONF=$HOME/.hg.conf.beta''' and '''SHELL=/bin/sh''')''.</td> | <td>hubPublicCheck complains when the hubPublic table doesn't have the same strings as the actual hub.txt file. '' (NOTE: To run only on Beta hubs requires these declarations: '''export HGDB_CONF=$HOME/.hg.conf.beta''' and '''SHELL=/bin/sh''')''.</td> | ||
<td>runs daily, complains rarely</td> | <td>runs daily, complains rarely</td> | ||
<td></td> | |||
<td>Matt</td> | <td>Matt</td> | ||
<td>Brian</td> | <td>Brian</td> | ||
| Line 262: | Line 290: | ||
<td>email request to build [http://genomewiki.ucsc.edu/genecats/index.php/Public_Hub_QA#Push_to_the_RR doPublicCrawl] public.ix and public.ixx hub search files and push them.</td> | <td>email request to build [http://genomewiki.ucsc.edu/genecats/index.php/Public_Hub_QA#Push_to_the_RR doPublicCrawl] public.ix and public.ixx hub search files and push them.</td> | ||
<td>runs quarterly</td> | <td>runs quarterly</td> | ||
<td></td> | |||
<td>Christopher</td> | <td>Christopher</td> | ||
<td></td> | <td></td> | ||
| Line 270: | Line 299: | ||
<tr> | <tr> | ||
<td>Cronjob reports checkUrlsInTable hg38 wgEncodeCell and cv.ra (likely infrequent results) </td> | <td>Cronjob reports checkUrlsInTable hg38 wgEncodeCell and cv.ra (likely infrequent results) </td> | ||
<td>weekly</td> | <td>weekly</td> | ||
<td></td> | |||
<td>Christopher</td> | <td>Christopher</td> | ||
<td>Brian</td> | <td>Brian</td> | ||
| Line 281: | Line 311: | ||
<td>sends a reminder to check the list of folks who have mirror sites. This list is created by a script of Hiram's and located here: http://genome-test.cse.ucsc.edu/admin/tools/useCount.html. The information comes from the phoneHome program in the CGIs. Sometimes companies set up mirrors, which is not OK.</td> | <td>sends a reminder to check the list of folks who have mirror sites. This list is created by a script of Hiram's and located here: http://genome-test.cse.ucsc.edu/admin/tools/useCount.html. The information comes from the phoneHome program in the CGIs. Sometimes companies set up mirrors, which is not OK.</td> | ||
<td>monthly</td> | <td>monthly</td> | ||
<td></td> | |||
<td>Brian, Luvina</td> | <td>Brian, Luvina</td> | ||
<td>Matt</td> | <td>Matt</td> | ||
| Line 289: | Line 320: | ||
<tr> | <tr> | ||
<td>checkGbibMd5.sh compares the md5sum of gbibBeta.zip on dev with the sum for gbib.zip on genome-store, complaining if they don't match (and it's not during final build)</td> | <td>checkGbibMd5.sh compares the md5sum of gbibBeta.zip on dev with the sum for gbib.zip on genome-store, complaining if they don't match (and it's not during final build)</td> | ||
<td>runs weekly | <td>runs weekly</td> | ||
<td></td> | |||
<td>Brian, Cath, Jonathan</td> | <td>Brian, Cath, Jonathan</td> | ||
<td>Brian, Steve, Jonathan</td> | <td>Brian, Steve, Jonathan</td> | ||
| Line 299: | Line 331: | ||
<td>Curl of http://genomewiki.ucsc.edu/index.php/Assembly_Hubs to test Public Wiki is accessible, output only if no response.</td> | <td>Curl of http://genomewiki.ucsc.edu/index.php/Assembly_Hubs to test Public Wiki is accessible, output only if no response.</td> | ||
<td>hourly</td> | <td>hourly</td> | ||
<td></td> | |||
<td>Brian</td> | <td>Brian</td> | ||
<td>Brian</td> | <td>Brian</td> | ||
| Line 313: | Line 346: | ||
<td>receive cron output for tableDescriptions build errors</td> | <td>receive cron output for tableDescriptions build errors</td> | ||
<td>rare</td> | <td>rare</td> | ||
<td></td> | |||
<td>Luvina</td> | <td>Luvina</td> | ||
<td>Steve, Luvina</td> | <td>Steve, Luvina</td> | ||
| Line 326: | Line 360: | ||
<td>run ReleaseLog script (this requires a copy of the kent repository)</td> | <td>run ReleaseLog script (this requires a copy of the kent repository)</td> | ||
<td>daily</td> | <td>daily</td> | ||
<td></td> | |||
<td>Galt</td> | <td>Galt</td> | ||
<td>Galt</td> | <td>Galt</td> | ||
| Line 335: | Line 370: | ||
<td>back up the qapushq</td> | <td>back up the qapushq</td> | ||
<td>every 30 minutes M-F</td> | <td>every 30 minutes M-F</td> | ||
<td></td> | |||
<td>Galt</td> | <td>Galt</td> | ||
<td>Galt</td> | <td>Galt</td> | ||
| Line 348: | Line 384: | ||
<td>Check old forum (http://redmine.soe.ucsc.edu/forum/index.php) for MLQs that may have slipped through the cracks: Check to make sure that the last response for every ticket came from one of us. If not, look it up in redmine to ensure that A) there is indeed a redmine ticket for it, and B) it has been responded to. If not, notify the appropriate MLM with as much information about the MLQ as possible.</td> | <td>Check old forum (http://redmine.soe.ucsc.edu/forum/index.php) for MLQs that may have slipped through the cracks: Check to make sure that the last response for every ticket came from one of us. If not, look it up in redmine to ensure that A) there is indeed a redmine ticket for it, and B) it has been responded to. If not, notify the appropriate MLM with as much information about the MLQ as possible.</td> | ||
<td>weekly</td> | <td>weekly</td> | ||
<td></td> | |||
<td>Luvina</td> | <td>Luvina</td> | ||
<td>Luvina</td> | <td>Luvina</td> | ||
| Line 357: | Line 394: | ||
<td>update sla.html whenever we have RR downtime. [http://genomewiki.ucsc.edu/genecats/index.php/Static_Page_Protocol#Editing_SLA.html See wiki procedures]</td> | <td>update sla.html whenever we have RR downtime. [http://genomewiki.ucsc.edu/genecats/index.php/Static_Page_Protocol#Editing_SLA.html See wiki procedures]</td> | ||
<td>hopefully, not much!</td> | <td>hopefully, not much!</td> | ||
<td></td> | |||
<td>Cath, Luvina</td> | <td>Cath, Luvina</td> | ||
<td>Steve, Jonathan</td> | <td>Steve, Jonathan</td> | ||
| Line 366: | Line 404: | ||
<td>update crontab in genecats/qa/crontabs/*.crontab (and [http://genomewiki.cse.ucsc.edu/genecats/index.php/Updating_QA_crontabs log in as qateam and restart the qateam crontab] with updates)</td> | <td>update crontab in genecats/qa/crontabs/*.crontab (and [http://genomewiki.cse.ucsc.edu/genecats/index.php/Updating_QA_crontabs log in as qateam and restart the qateam crontab] with updates)</td> | ||
<td>as needed</td> | <td>as needed</td> | ||
<td></td> | |||
<td>Brian</td> | <td>Brian</td> | ||
<td>Jonathan</td> | <td>Jonathan</td> | ||
| Line 382: | Line 421: | ||
<tr> | <tr> | ||
<td>Check genome-preview machine is still running</td> | <td>Check genome-preview machine is still running</td> | ||
<td>biweekly</td> | <td>biweekly</td> | ||
<td></td> | |||
<td>Brian</td> | <td>Brian</td> | ||
<td>Brian</td> | <td>Brian</td> | ||
| Line 391: | Line 431: | ||
<tr> | <tr> | ||
<td>Updated Facebook with Announcements</td> | <td>Updated Facebook with Announcements</td> | ||
<td>As needed</td> | <td>As needed</td> | ||
<td></td> | |||
<td></td> | |||
<td>Brian</td> | <td>Brian</td> | ||
<td>Brian</td> | <td>Brian</td> | ||
| Line 400: | Line 442: | ||
<tr> | <tr> | ||
<td>Update Twitter with Announcements</td> | <td>Update Twitter with Announcements</td> | ||
<td>As needed</td> | <td>As needed</td> | ||
<td></td> | |||
<td>Brian</td> | <td>Brian</td> | ||
<td>Ann</td> | <td>Ann</td> | ||
| Line 414: | Line 457: | ||
<td>omimWrapper.sh checks for new OMIM data and downloads and loads it into hgwdev if so</td> | <td>omimWrapper.sh checks for new OMIM data and downloads and loads it into hgwdev if so</td> | ||
<td>runs daily, complains bi-weekly</td> | <td>runs daily, complains bi-weekly</td> | ||
<td></td> | |||
<td>jcasper</td> | <td>jcasper</td> | ||
<td>braney</td> | <td>braney</td> | ||
| Line 423: | Line 467: | ||
<td>omimUploadWrapper.sh uploads the OMIM tables to OMIM</td> | <td>omimUploadWrapper.sh uploads the OMIM tables to OMIM</td> | ||
<td>runs daily, complains rarely</td> | <td>runs daily, complains rarely</td> | ||
<td></td> | |||
<td>jcasper</td> | <td>jcasper</td> | ||
<td>braney</td> | <td>braney</td> | ||
| Line 432: | Line 477: | ||
<td>decipherWrapper.sh checks for new DECIPHER data and downloads and loads it into hgwdev if so</td> | <td>decipherWrapper.sh checks for new DECIPHER data and downloads and loads it into hgwdev if so</td> | ||
<td>runs daily, complains monthly</td> | <td>runs daily, complains monthly</td> | ||
<td></td> | |||
<td>jcasper</td> | <td>jcasper</td> | ||
<td>braney</td> | <td>braney</td> | ||
| Line 441: | Line 487: | ||
<td>iscaWrapper.sh checks for new ISCA data and downloads and loads it into hgwdev if so</td> | <td>iscaWrapper.sh checks for new ISCA data and downloads and loads it into hgwdev if so</td> | ||
<td>runs daily, complains monthly</td> | <td>runs daily, complains monthly</td> | ||
<td></td> | |||
<td>jcasper</td> | <td>jcasper</td> | ||
<td>braney</td> | <td>braney</td> | ||
| Line 450: | Line 497: | ||
<td>gwasWrapper.sh checks for new GWAS data and downloads and loads it into hgwdev if so</td> | <td>gwasWrapper.sh checks for new GWAS data and downloads and loads it into hgwdev if so</td> | ||
<td>runs weekly, complains quarterly</td> | <td>runs weekly, complains quarterly</td> | ||
<td></td> | |||
<td>jcasper</td> | <td>jcasper</td> | ||
<td>braney</td> | <td>braney</td> | ||
| Line 459: | Line 507: | ||
<td>geneReviewsWrapper.sh checks for new GeneReviews data and downloads and loads it into hgwdev if so</td> | <td>geneReviewsWrapper.sh checks for new GeneReviews data and downloads and loads it into hgwdev if so</td> | ||
<td>runs weekly, complains quarterly</td> | <td>runs weekly, complains quarterly</td> | ||
<td></td> | |||
<td>jcasper</td> | <td>jcasper</td> | ||
<td>braney</td> | <td>braney</td> | ||
| Line 470: | Line 519: | ||
<td>~jcasper/bin/scripts/updateHgConf.sh - checks for changes to hg.conf files and checks them in to the kent tree</td> | <td>~jcasper/bin/scripts/updateHgConf.sh - checks for changes to hg.conf files and checks them in to the kent tree</td> | ||
<td>runs weekly</td> | <td>runs weekly</td> | ||
<td></td> | |||
<td>jcasper</td> | <td>jcasper</td> | ||
<td>nobody</td> | <td>nobody</td> | ||
| Line 479: | Line 529: | ||
<td>~jcasper/bin/backup_hgconfprivate.sh - checks most recent versions of hg.conf.private files into a private repository (~jcasper/hgconf_private/)</td> | <td>~jcasper/bin/backup_hgconfprivate.sh - checks most recent versions of hg.conf.private files into a private repository (~jcasper/hgconf_private/)</td> | ||
<td>runs twice a week</td> | <td>runs twice a week</td> | ||
<td></td> | |||
<td>jcasper</td> | <td>jcasper</td> | ||
<td>nobody</td> | <td>nobody</td> | ||
Revision as of 19:11, 10 February 2017
| task | frequency | who NOW | who April '16 -March '17 | who Aug '14 - Aug '15-Apr'16 | who Aug '13 - Jul '14 | before | |
|---|---|---|---|---|---|---|---|
| from hgwdev qateam cron | |||||||
| ask Galt/Jim about blat updates | 3x per year | Cath, Brian | Steve, Jonathan | Pauline, Steve, Jonathan | Pauline, Steve, Jonathan | ||
| Respond to items on the broken links report: Check to make sure that broken links reported are actually broken. If so, fix the link if it is clear what the new link should be and push to the RR. If not, contact the appropriate person at the web site in question to find out what the new link should be. | daily | Cath, Matt | Matt | Matt | Steve | ||
| Respond to the trackDbGlobal report: Make public and request a push of trackDb and friends for any assemblies that show up as changed in the trackDbGlobal report. | weekly | Cath | Matt | Luvina | Steve | ||
| receive output from hgTracksRandom cron; alert admins to problems | as needed | many: cath, christopher, kuhn, brianlee, braney, luvina, gary, ann,, jcasper, matt | many: kuhn, katrina, brianlee, braney, luvina, gary, ann, steve, jcasper, matt | many: kuhn, pauline, katrina, brianlee, braney, luvina, gary, ann, steve, jcasper, matt | many: kuhn, rhead, pauline, katrina, brianlee, braney, luvina, gary, ann, steve, jcasper | ||
| receive output from gbLoaded cron job and alert braney if anything seems very outdated | daily, problems every 3-6 months | Cath, Luvina | Steve, Jonathan | Steve, Jonathan | Brooke, Steve, Jonathan | ||
| receive output from showProcesslist.csh | daily, no action | Jairo, Matt | Steve, Jonathan | Steve, Jonathan | Brooke, Steve, Jonathan | ||
| get output from checkTableStatus.csh on Mondays (this is a report on whether the genbank table dumps are up-to-date...if we could get rid of our dependence on those, we could get rid of this cron job) | weekly | Brian, Jonathan | Steve, Jonathan | Steve, Jonathan | Brooke, Steve, Jonathan | ||
| get an email from backupCentral.csh each month that keeps a dump of hgcentral tables (there's a redmine ticket on whether we should change this one: http://redmine.soe.ucsc.edu/issues/7834) | monthly | Matt, Brian | Steve, Jonathan | Steve, Jonathan | Brooke, Steve, Jonathan | ||
| receive an email on additions and subtractions to files in /gbdb on hgnfs1 | daily | Christopher, Luvina | Steve, Jonathan | Steve, Jonathan | Brooke, Steve, Jonathan | ||
| receive an email from cron if qateam DailySandboxUpdate fails | daily | Matt, Brian | Steve, Jonathan | Steve, Jonathan | Brooke, Steve, Jonathan | ||
| receive output from checkMetaAday.csh; alert; if anything is out of sync (compares hgcentralbeta to hgcentral for db of the day) Instructions & Example | daily | Cath, Matt | Matt | Matt | Luvina | ||
| receive output from syncAday.csh; alert; if anything is out of sync (checks that tables are in sync between beta and RR for database of the day) | daily | ChrisV | Brian | Brian | Luvina | ||
| increment databaseAday, /cluster/bin/scripts/databaseAday.csh | problems only | Brian, Jonathan | Steve, Jonathan | Steve, Jonathan | Brooke, Steve, Jonathan | ||
| checkHgFindSpec -checkTermRegex, /cluster/bin/scripts/runCheckHgFindSpec go | problems only | Brian, Jonathan | Steve, Jonathan | Steve, Jonathan | Brooke, Steve, Jonathan | ||
| check to see if there are new files to go with the CGI push /cluster/home/qateam/bin/scripts/findCgiFiles.csh go | problems only | Brian, Jonathan | Steve, Jonathan | Steve, Jonathan | Brooke, Steve, Jonathan | ||
| get output from checkGenomeMysql | daily | Christopher, Matt | Steve, Jonathan | Steve, Jonathan | Brooke, Steve, Jonathan | ||
| Check for unigene update for human SAGE track | daily | Luvina, Braney | Steve, Braney | ||||
| look for broken symlinks in /gbdb: | daily | Browser Staff | Browser Staff | ||||
| look for broken symlinks in in (very large) visiGene directory | twice yearly | Cath, Galt | Steve, Galt | ||||
| look for broken symlinks in htdocs-hgdownload/goldenpath | daily | Browser Staff | Browser Staff | ||||
| Check the source tree for duplicate case-independent filenames. These wreck havoc with git. | daily | Browser Staff | Browser Staff | ||||
| Check to see what kind of browsers and o/s people are using to access the public website | weekly | Ann, Christopher, Brian | Ann, Steve | ||||
| run /cluster/bin/scripts/sessionStats.csh | monthly | Angie, Brian, Bob | Angie, Brian, Bob, Steve | ||||
| check that the ga4gh beacon server is running. Email Max if there is an issue. | daily | Cath | Ann | Ann | |||
| check that blat servers are running ok | ongoing | Ann, Brian, Donna, Galt, Luvina, Matt, Gary, | Ann, Brian, Donna, Galt, Luvina, Steve, Gary | ||||
| check that beta builds alright | 3x week | Brian, Christopher,Braney | Steve, Jonathan, Braney | ||||
| hubPublicCheck complains when the hubPublic table doesn't have the same strings as the actual hub.txt file. (NOTE: To run only on Beta hubs requires these declarations: export HGDB_CONF=$HOME/.hg.conf.beta and SHELL=/bin/sh). | runs daily, complains rarely | Matt | Brian | Brian | braney | ||
| email request to build doPublicCrawl public.ix and public.ixx hub search files and push them. | runs quarterly | Christopher | |||||
| Cronjob reports checkUrlsInTable hg38 wgEncodeCell and cv.ra (likely infrequent results) | weekly | Christopher | Brian | Brian | Brian | ||
| sends a reminder to check the list of folks who have mirror sites. This list is created by a script of Hiram's and located here: http://genome-test.cse.ucsc.edu/admin/tools/useCount.html. The information comes from the phoneHome program in the CGIs. Sometimes companies set up mirrors, which is not OK. | monthly | Brian, Luvina | Matt | Pauline | Ann | ||
| checkGbibMd5.sh compares the md5sum of gbibBeta.zip on dev with the sum for gbib.zip on genome-store, complaining if they don't match (and it's not during final build) | runs weekly | Brian, Cath, Jonathan | Brian, Steve, Jonathan | - | - | ||
| Curl of http://genomewiki.ucsc.edu/index.php/Assembly_Hubs to test Public Wiki is accessible, output only if no response. | hourly | Brian | Brian | - | - | ||
| from build cron | |||||||
| receive cron output for tableDescriptions build errors | rare | Luvina | Steve, Luvina | Pauline, Matt | Brooke, Pauline | ||
| from galt's cron | |||||||
| run ReleaseLog script (this requires a copy of the kent repository) | daily | Galt | Galt | Galt | Galt | ||
| back up the qapushq | every 30 minutes M-F | Galt | Galt | Galt | Galt | ||
| non-cron jobs | |||||||
| Check old forum (http://redmine.soe.ucsc.edu/forum/index.php) for MLQs that may have slipped through the cracks: Check to make sure that the last response for every ticket came from one of us. If not, look it up in redmine to ensure that A) there is indeed a redmine ticket for it, and B) it has been responded to. If not, notify the appropriate MLM with as much information about the MLQ as possible. | weekly | Luvina | Luvina | Luvina | Steve | ||
| update sla.html whenever we have RR downtime. See wiki procedures | hopefully, not much! | Cath, Luvina | Steve, Jonathan | Steve, Jonathan | Brooke, Pauline | ||
| update crontab in genecats/qa/crontabs/*.crontab (and log in as qateam and restart the qateam crontab with updates) | as needed | Brian | Jonathan | Pauline, Jonathan | Brooke, Pauline | ||
| update UCSC Entrez LinkOut when necessary. Entrez LinkOut sends requests for changes (and statistics) to the browser-qa email address | rarely | Matt | Matt | Bob | Ann | ||
| Check genome-preview machine is still running | biweekly | Brian | Brian | Brian | Brian | ||
| Updated Facebook with Announcements | As needed | Brian | Brian | ||||
| Update Twitter with Announcements | As needed | Brian | Ann | ||||
| otto cron jobs (/hive/data/outside/otto) | |||||||
| omimWrapper.sh checks for new OMIM data and downloads and loads it into hgwdev if so | runs daily, complains bi-weekly | jcasper | braney | braney | braney | ||
| omimUploadWrapper.sh uploads the OMIM tables to OMIM | runs daily, complains rarely | jcasper | braney | braney | braney | ||
| decipherWrapper.sh checks for new DECIPHER data and downloads and loads it into hgwdev if so | runs daily, complains monthly | jcasper | braney | braney | braney | ||
| iscaWrapper.sh checks for new ISCA data and downloads and loads it into hgwdev if so | runs daily, complains monthly | jcasper | braney | braney | braney | ||
| gwasWrapper.sh checks for new GWAS data and downloads and loads it into hgwdev if so | runs weekly, complains quarterly | jcasper | braney | braney | braney | ||
| geneReviewsWrapper.sh checks for new GeneReviews data and downloads and loads it into hgwdev if so | runs weekly, complains quarterly | jcasper | braney | braney | braney | ||
| otto cron jobs (/hive/data/outside/otto) | |||||||
| ~jcasper/bin/scripts/updateHgConf.sh - checks for changes to hg.conf files and checks them in to the kent tree | runs weekly | jcasper | nobody | nobody | nobody | ||
| ~jcasper/bin/backup_hgconfprivate.sh - checks most recent versions of hg.conf.private files into a private repository (~jcasper/hgconf_private/) | runs twice a week | jcasper | nobody | nobody | nobody | ||
