Gene id conversion: Difference between revisions

From genomewiki
Jump to navigationJump to search
Line 8: Line 8:


Merge/download data from the Table browser http://genome.ucsc.edu/cgi-bin/hgTables
Merge/download data from the Table browser http://genome.ucsc.edu/cgi-bin/hgTables
# set the clade, genome, assembly
* set the clade, genome, assembly
# set the group to Genes and Gene Prediction Tracks,
* set the group to Genes and Gene Prediction Tracks,
# for the first query use UCSC Genes
* for the first query use UCSC Genes default table is knownGene. Click on "View table schema" to see field contents/order.
# default table is knownGene. Click on "View table schema" to see field  
* set region: genomic for entire dataset or filter by region or identifiers. You can upload a list of Entrez Gene names at this point to limit the output, but t is not necessary, you can filter the file later. This primary table (knownGene) does not contain alternate gene names. To link those in:
contents/order.
** set output format: selected fields from primary table and related tables
# set region: genomic for entire dataset or filter by region or  
** name output file so that it will download
identifiers. You can upload a list of Entrez Gene names at this point to  
** add in the linked table kgXref and check columns to download, then submit
limit the output, but it is not necessary, you can filter the file later.
This primary table (knownGene) does not contain alternate gene names. To  
link those in:
# set output format: selected fields from primary table and related tables
# name output file so that it will download
# add in the linked table kgXref and check columns to download, then submit


Starting again at step c, do the same for the Ensembl Genes track. Do  
Starting again at step c, do the same for the Ensembl Genes track. Do  

Revision as of 10:43, 24 March 2010

With the UCSC Browser

(from the mailing list)

There are three options for extracting the data.

  1. merge/download data from the Table browser
  2. query the public mySQL database
  3. ftp text files

Merge/download data from the Table browser http://genome.ucsc.edu/cgi-bin/hgTables

  • set the clade, genome, assembly
  • set the group to Genes and Gene Prediction Tracks,
  • for the first query use UCSC Genes default table is knownGene. Click on "View table schema" to see field contents/order.
  • set region: genomic for entire dataset or filter by region or identifiers. You can upload a list of Entrez Gene names at this point to limit the output, but t is not necessary, you can filter the file later. This primary table (knownGene) does not contain alternate gene names. To link those in:
    • set output format: selected fields from primary table and related tables
    • name output file so that it will download
    • add in the linked table kgXref and check columns to download, then submit

Starting again at step c, do the same for the Ensembl Genes track. Do the same steps until step g, where you will first need link in the table knownToEnsembl, then the table kgXref.

Table Browser Help/FAQ: http://genome.ucsc.edu/cgi-bin/hgTables#Help http://genome.ucsc.edu/goldenPath/help/hgTablesHelp.html

Query the public mySQL database:

  • Using the Table Browser to help you understand the database and table

names/format, write your own SQL query to extract data.

  • Public mySQL FAQ:

http://genome.ucsc.edu/FAQ/FAQdownloads#download29

FTP text files

  • Use ftp to get the complete tables in text file format and perform data

merges to link the aligned transcripts in the primary tables to the gene names (such as Entrez)

  • You would need to use your own shell, perl, or

other tools to do the merges. Again, first use the Table Browser navigation tools to help you understand the database and table names/format.

  • Download ftp FAQ:

http://genome.ucsc.edu/FAQ/FAQdownloads#download1

All annotation tracks are mapped using the same coordinate system to the genomic assembly and so are directly comparable. Be aware that we use a zero-based start coordinate and a 1-based stop coordinate. We also record all alignments with respect to the positive strand, so if an alignment is on the negative strand, the start and stop will be reversed if compared to the file/table headers. These links describe in detail our file format conventions: http://genome.ucsc.edu/FAQ/FAQformat http://genome.ucsc.edu/FAQ/FAQtracks#tracks1 http://genome.ucsc.edu/FAQ/FAQtracks#tracks17

A final option is to send the data to Galaxy (from the Table Browser or uploaded text files). The functions for Interval format data are very useful and could aid in grouping the various mapped transcripts together into genes/clusters. It may be worth comparing which transcripts the Interval functions will group versus which the Entrez gene name will group. Link to Galaxy FAQ: http://g2.trac.bx.psu.edu/wiki/GopsDesc

With external tools

List of some external tools and comparison

  • David and Matchminer were the best ones when compared with 100 random identifiers

With Biomart

Biomart http://www.biomart.org is probably the best solution if your source ids are from Ensembl:

Click-Path:

    1. martview (top-right of screen)
    2. ensembl56 genes
    3. (select your species)
    4. "filters"
    5. "gene"
    6. paste your ids into "id list limit"
    7. "attributes"
    8. "GENE"
    9. uncheck "ensembl transcript id"
    10. uncheck "ensembl gene id" if you want to get rid of it
    11. "EXTERNAL"
    12. check "HGNC symbol" (or "HGNC automatic gene name" if not human)
    13. "results"