The schema browser is the dashboard
for browsing all the database data in a LabKey Server folder. It also provides access to key schema-related functionality
. (A schema is a named collection of tables and queries.) Using the schema browser, users with sufficient permissions can:
- Browse the tables and queries
- Add new SQL queries
- Discover table relationships to help write queries
- Define external schemas to access new data
- Generate scripts for bulk insertion of data into a new schema
Browse and Navigate the Data Model
Authorized users can open the Query Schema Browser via of these pathways:
- (Admin) > Developer Links > Schema Browser
- (Admin) > Go To Module > Query
The browser displays a list of the available schemas, including external schemas and data sources you have added. Each schema contains a collection of queries and tables. User-defined queries are grouped together separately from the built-in queries. Your permissions within the folder determine which tables and queries you can see here.
Schemas live in a particular container (project or folder) on LabKey Server, but can be marked as inheritable
, in which case they are accessible in child folders. (For more information on controlling schema heritability in child folders, see Query Metadata
You can browse column names by clicking on a particular table or query. The image below shows how to discover the column names of the Comments
Show All Columns vs. Columns in the Default Grid View
For a particular table or query, the browser shows two separate lists.
- All columns in this table: the top section shows all of the columns in the table/query.
- Columns in your default view of this query: Your default grid view of the table/query may not contain all of the columns present in the table. It also may contain additional "columns" when there are lookups (or foreign keys) defined in the default view. See Step 1: Customize Your Grid View to learn about changing the contents of the "default" view.
Below these lists, the Indices
of the table are listed.
When you upgrade to a new version of LabKey, change hardware, or database software, you may want to validate your SQL queries. You can perform a validation check of your SQL queries by pressing the Validate Queries
button, on the top row of buttons in the Query Schema Browser. Validation runs against all queries in the current folder and checks to see if the SQL queries parse and execute without errors.
Generate Schema Export / Migrate Data to Another Schema
If you wish to move data from one LabKey Server schema to another LabKey Server schema, you can do so by generating a migration script. The system will read the source schema and generate:
- a set of tab-separated value (TSV) files, one for each table in the source. (Each TSV file is packaged as a .tsv.gz file)
- a script for importing these tables into a target schema.
Note that the script only copies data, it does not create the target schema itself. The target schema must already exist for the import script to work. Also, the script must be used as an update script
included in a module.
To generate the TSV files and the associated script:
- Go the Schema Browser: (Admin) > Developer Links > Schema Browser.
- Click Generate Schema Export.
- Select the data source and schema name.
- Enter a directory path where the script and TSV files will be written, for example: C:\temp\exports. This directory must already exist on your machine for the export to succeed.
- Click Export.
- The file artifacts will be written to the path you specified.
|Source Data Source||The data source where the data to export resides.|
|Source Schema||The schema you want to export.|
|Target Schema||The schema where you want to import the data.|
|Path in Script||Optional. If you intend to place the import script and the data files in separate directories, specify a path so that the import script can find the data.|
|Output Directory||Directory on your local machine where the import script and the data files will be written. This directory must already exist on your machine, it will not be created for you.|
The generated script consists of a series of bulkImport calls that open the .tsv.gz data files and insert them into the target schema, in this case the target schema is 'assaydata'.
SELECT core.bulkImport('assaydata', 'c17d97_pcr_data_fields', 'dbscripts/assaydata/c17d97_pcr_data_fields.tsv.gz');
SELECT core.bulkImport('assaydata', 'c15d80_rna_data_fields', 'dbscripts/assaydata/c15d80_rna_data_fields.tsv.gz');
SELECT core.bulkImport('assaydata', 'c2d326_test_data_fields', 'dbscripts/assaydata/c2d326_test_data_fields.tsv.gz');
SELECT core.bulkImport('assaydata', 'c15d77_pcr_data_fields', 'dbscripts/assaydata/c15d77_pcr_data_fields.tsv.gz');
Now you can re-import the data by adding the generated .sql script and .tsv.gz files to a module as a SQL upgrade script. For details on adding SQL scripts to modules, see Modules: SQL Scripts
Trace Query Dependencies
Query dependencies are traced and noted in the schema browser in a Dependency Report
, below the lists of columns and indices. Particularly for user defined queries derived from built in queries and tables it can be helpful to track the sources and dependents when you make any query changes. Shown below, the "Physical Exam + AverageTemp" query depends on both the table "Physical Exam" and the other query "AverageTempPerParticipant". Notice the different icon indicators. In turn, this query was used to base another query "Physical Exam + TempDelta" shown under Dependents.
If there are no dependencies for the query, this section will not be shown.