RLabkey - Upload Taking a Long Time

LabKey Support Forum (Inactive)
RLabkey - Upload Taking a Long Time Jon (LabKey DevOps)  2018-02-10 00:15
Status: Closed
 
Hi Marcia,

Fifty million records is a lot of data to insert into any database in a single go, so your database and server should be setup to have a lot of RAM, CPU power, and memory to handle that.

If you are using the Rlabkey API, you should remember to use the labkey.importRows() function rather than the labkey.insertRows() function since you want the system to try and have it do a bulk import of the data rather than individual rows one at a time. See https://cran.r-project.org/web/packages/Rlabkey/Rlabkey.pdf for more details on the two functions.

Regards,

Jon