Problems with Python transformation script | zromer | 2018-02-14 12:31 | |||||||||
Status: Closed | |||||||||||
Hello, I have a Python engine set up on my Atlas instance with $(runInfo) configured as the Program Command (screenshot of engine configuration attached). I also have a python transformation script added to a particular assay module. I'd like this transformation script to take the assay data being uploaded by the user before Atlas tries to match its columns to the assay data result set definition, do some preprocessing on it, then write the file out to be received by the assay module. I'm having two issues with this. 1) How do I ensure my transformation script is getting called? I'm currently trying to have my script send and email and write out a test file to the local execution directory but neither seems to be happening upon upload to the Assay Module my transformation script is a part of. 2) If I understand correctly, the Program Command with $(runInfo) will pass a runProperties.tsv file to my python script as a command-line parameter which I will then need to read in order to get the runDataUploaded property which contains the file path of the data uploaded by the user. Then I will do my transformation on the data after I've read it in. Then... outputting the transformation gets fuzzy to me. Do I then write the transformed file out and replace the runDataUploadedFile attribute with the transformed file path, then write out the runProperties.tsv file to... where? Or do I replace the transformedRunPropertiesFile attribute with runProperties.tsv after I've updated the runDataUploadedFile attribute with the transformed file path? Or something else? It is generally unclear to me how the program picks up the output of a transformation script. |
|||||||||||
| |||||||||||