List with timestamps unsorted

LabKey Support Forum
List with timestamps unsorted eva pujadas  2020-06-18 09:23
Status: Active
 

Dear Labkey team,

We are having a strange issue when creating a new list imported from CSV file. The source CSV file is sorted by one of the columns representing the date and time, but that in the created list in some of the rows this sorting is not preserved after import. I attach an screenshot to visualize what I mean.

I attach also the example of CSV file (with about 85'000 lines). The file contain some "?" instead of numbers, which we are marking as "missing value indicators".

Do you know about some similar issue and what could cause it?

Thanks a lot,
Eva

 
 
chetc (LabKey Support) responded:  2020-07-14 16:29

Hello Eva,

Thank you for providing that csv to test with, unfortunately I wasn't able to reproduce the issue nor have I heard of something similar before. When I tried it that record seemed to be in place (see screenshot). You can set a default sort order (to date/time) in the default view definitions of the table. This will make it so the grid will default to using the date column when ordering as opposed to the primary key.

  1. What version of Labkey are you running?
  2. Were you hoping that the order of the primary key would also represent the order of the date/time column? As the primary key increases so does the date/time.

Thanks,
Chet

 
eva pujadas responded:  2020-08-06 08:43
Hello Chet,

Thank you very much for checking this issue.

> What version of Labkey are you running?
This happens in both versions 19.3.7 and 19.3.10

> Were you hoping that the order of the primary key would also represent the order of the date/time column? As the primary key increases so does the date/time.
Exactly, that was a requirement

I've seen in your screenshot that the number columns were probably imported as text, since some of the records contain a "?" as value. To reproduce the error, a missing value indicator with value "?" needs to be created first. Afterwards, import the data file with following column data types: DateTime, Double, Integer, Integer, Integer (default behavior) (see screenshot).
Depending on the instance of LabKey server used, the error can appear for a key value of 24735, or 82061 and 19897 and 21340 (see screenshots). It seems to be somehow variable, although I do not know on what it depends.

Thanks once more and best regards,
Eva
 
chetc (LabKey Support) responded:  2020-08-21 10:15
Status: Closed
Hello Eva,

I created a missing value indicator for "?" and then I imported the file using the column types from your screenshot. But I'm getting different results (im running 19.3.6). For the first 3 keys you listed I didn't see the issue but I did see it on the last one. I have created a bug for this that you can follow at
https://www.labkey.org/home/Developer/issues/issues-details.view?issueId=41213

Thank you for helping me repro this!

Best,
Chet