Problems loading assay data to a dataset

General Server Forum (Inactive)
Problems loading assay data to a dataset Mya Warren  2017-10-16 17:27
Status: Closed
 
I'm assessing LabKey for our institution, and I'm having difficulty with fairly simple (I think) tasks.

First, I'm following the tutorials to load assay data. My assays have

- ParticipantId
- Visit ID
- Date

as primary key. I have managed to load the assay data with no trouble, and the data looks correct. The problem arises when I try to copy the data to a study. From the assay batch page, I select my assay run, and click copy to study. The data passes validation, and there are no errors when I then select copy to study again. However, the study has no data. The column headers are:

- Container   
- Label   
- Description   
- Description Renderer Type

which is not correct. If I try to reimport the data, it says that my rows have already been loaded. The study navigator also seems to know about the dates in my data. I have loaded a separate dataset (different assay) in exactly the same way, without these difficulties. Any idea what might be the problem?

Second, our data is managed by an external database. I need to have a way to periodically reload the data from file, preferably without losing all of the reports I've already set up. I have two different types of data: a regular dataset (added through manage datasets), and several assays. These aren't really assays per se, but they require 3 primary keys. I need to replace this data, rather than add to it.

It seems that I need to set up a data pipeline: https://www.labkey.org/Documentation/wiki-page.view?name=pipelineSetup
The directions say to do the following:

- Go to Admin > Go to Module > Pipeline.
- Now click Setup.

However, I can't find Setup anywhere on the page!

Additionally, I tried to export/reimport a study, and my assay dataset was not repopulated correctly.

Am I using assays incorrectly?
 
 
Mya Warren responded:  2017-10-17 10:32
I have checked the assay data itself, and the Copied to Clinical Study says "copied" for every row.
 
Mya Warren responded:  2017-10-17 10:37
I check the Details of the Copy to Study History, and found this error:

Copy-to-Study History Details
 
RECALL ROWS
Ignoring filter/sort on column 'SourceLSID' because it does not exist.

I have no column called SourceLSID.
 
Jon (LabKey DevOps) responded:  2017-10-19 23:45
Hi Mya,

Is this post the same issue as https://www.labkey.org/home/Support/Support%20Forum/announcements-thread.view?rowId=16319 that you reported?

I'm seeing the same information being asked in both posts. If it is the same issue, we should work within one post rather than two.

Regards,

Jon
 
Mya Warren responded:  2017-10-23 13:05
Hi Jon,
Yes it is, sorry. I worried that I had asked too many questions in this post (assays + pipelines) and I thought I'd have better luck if I separated them into separate posts. You can close this one, and we can continue discussing my assay issue in the other post.
Mya