RLabkey - Upload Taking a Long Time | Jon (LabKey DevOps) | 2018-02-10 00:15 |
Status: Closed | ||
Hi Marcia, Fifty million records is a lot of data to insert into any database in a single go, so your database and server should be setup to have a lot of RAM, CPU power, and memory to handle that. If you are using the Rlabkey API, you should remember to use the labkey.importRows() function rather than the labkey.insertRows() function since you want the system to try and have it do a bulk import of the data rather than individual rows one at a time. See https://cran.r-project.org/web/packages/Rlabkey/Rlabkey.pdf for more details on the two functions. Regards, Jon |
||