AlexsLemonade / refinebio

Refine.bio harmonizes petabytes of publicly available biological data into ready-to-use datasets for cancer researchers and AI/ML scientists.
https://www.refine.bio/
Other
125 stars 18 forks source link

Test no-op job is failing: Illumina file won't process #3436

Closed arkid15r closed 8 months ago

arkid15r commented 8 months ago

Context

After separating downloaders and no-op test jobs the latter one keeps failing

Problem or idea

The test no-op job is failing with We found an Illumina file to NO_OP that we're not set up to process yet error message.

Solution or next step

Find out how to set up the file processing and implement it.

arkid15r commented 8 months ago

Presumably related e2e test job (circleci_staging_NO_OP_2048_290063) error:

2023-10-24 19:52:00,243 i-0fb9189c45a799243 data_refinery_workers.processors.no_op ERROR [job_id: 290063] [platform: yeast2]: Missing gene index file for platform!
--
2023-10-24 19:52:00,526 i-0fb9189c45a799243 data_refinery_workers.processors.utils ERROR [failure_reason: Missing gene index for yeast2] [processor_job: 290063]: Processor function _convert_genes failed. Terminating pipeline.