Minimal Browser Installation: Difference between revisions

From genomewiki
Jump to navigationJump to search
(add information about other databases)
(add link to scripts)
Line 68: Line 68:


==Partial Mirrors==
==Partial Mirrors==
See this page: [[Browser Mirrors]] (they should probably be fused into one?)
 
The currently recommended UCSC browser mirror  procedures can be found in the source tree:
[http://genome-source.cse.ucsc.edu/gitweb/?p=kent.git;a=tree;f=src/product/scripts scripts] directory.
 
To fully utilize scripts such as these, you should be familiar with shell programming and you should
be able to understand what the scripts are doing so you can customize them to your particular installation.
They are not going to work blindly out of the box.<BR>
 
See also: [[Browser Mirrors]]


==See also==
==See also==

Revision as of 16:39, 13 September 2011

Minimal Browser Installation

Usually a browser installation wants to be a subset of genomes compared to the entire UCSC Genome Browser. Instead of the entire rsync of everything mentioned in the Mirror Instructions or on this wiki (Browser installation) , sometimes you want only a subset of data from one genome. This is more work but possible. We call this a "Minimal Browser" in the following. This page shows you a minimal browser that shows only the genome sequence and the gaps. This is not a useful genome browser at all, but will get you started.

A license is required for commercial download and/or installation of the Genome Browser binaries and source code. No license is needed for academic, nonprofit, and personal use. To purchase a license, see our License Instructions.

Please note the full discussion in the README.* files and scripts to assist with these browser installation procedures in the source tree directory: src/product/ and src/product/scripts/


A minimal browser database needs six tables:

  • grp
  • chromInfo
  • trackDb
  • hgFindSpec
  • gold
  • gap

The gateway page needs the hgcentral database to function. The hgcentral database can by copied directly from the MySQL data files from the ftp server ftp://hgdownload.cse.ucsc.edu/mysql/hgcentral or loaded from the SQL text file at http://hgdownload.cse.ucsc.edu/admin/hgcentral.sql

Enter a defaultGenome=<your species> specification in your /cgi-bin/hg.conf file. See notes in the src/product/ex.hg.conf file for this option.

For the /gbdb/ data area, at a minimum you will need the .2bit file or the nib files for the assembly. This is either:

/gbdb/<database>/<database>.2bit
or for older genome assemblies:
/gbdb/<database>/nib/*.nib

Various tracks use other files in this directory. If you don't care about all the tracks, you won't need other files here.

For the genbank sequences, you can check the gbExtFile table for your database to see exactly which files are used by that assembly in /gbdb/genbank/
Extract the "path" column from that table and use that list in a --files-from specification for your rsync.

Additional databases

To mirror a single genome, there are a few extra databases that are required to enable the full functions of that single genome database. These databases contain data that are not specific to a single genome assembly. Your particular genome may need one or more of the following databases:

  • go080130
  • hgFixed
  • proteins090821
  • sp090821

With symlinks in your MySQL data directory:

  • go -> go080130
  • proteome -> proteins090821
  • uniProt -> sp090821

The specific selection of the go, proteins, and uniProt databases can be found in the hgcentral gdbPdb table:

 hgsql -e "select * from gdbPdb;" hgcentral

The symlinks remain as indicated above, other genomes will reference a specific protein, go, or uniProt database explicitly.


Partial Mirrors

The currently recommended UCSC browser mirror procedures can be found in the source tree: scripts directory.

To fully utilize scripts such as these, you should be familiar with shell programming and you should be able to understand what the scripts are doing so you can customize them to your particular installation. They are not going to work blindly out of the box.

See also: Browser Mirrors

See also

Building a new genome database

Browser Installation

Browser Mirrors

User notes

I made hgBlat work on my local browser installation by putting the full hostnames into hgcentral.blatservers, e.g. 'blat4' was replaced by the output of `blat4.cse.ucsc.edu`. I wonder if it wouldn't be a good idea to mention this in the mirroring instructions somewhere. --- max


Before you start using our blat servers, you need to verify with us that you have permission. We can't have everyone with a mirror site simply use our blat servers, the load would take them down for everyone. See also: Kent Informatics for a commercial blat license.


A nice command from Paul McKenna: UPDATE blatServers SET host=concat(host,'.cse.ucsc.edu'); Max 15:11, 3 February 2007 (PST)