Closed jeff-cohere closed 1 month ago
PR Preview Action v1.4.7
:---:
:rocket: Deployed preview to https://kbase.github.io/dts/pr-preview/pr-72/
on branch gh-pages
at 2024-07-31 16:37 UTC
Okay, things are in. We'll have to think about how we want to test the machinery involved in actual transfers, because everything takes so long compared to a typical CI cycle. In any case, I'd like to limit any further growth to this PR.
@ialarmedalien , I'm super sorry for the mammoth PR here. If you want, I can do some surgery and break this up into several smaller ones. And/or I'm happy to be available to you for Q+A when it's a convenient time to review. Let me know what works best for ya. This has been quite the sprint!
Okay @ialarmedalien . Ready for your re-review.
With the changes in this PR, we've been able to transfer over 10k IMG files from the JGI Data Portal to the KBase CDM object store.
Here's a rundown of the changes:
'staged'
or'unstaged'
).frictionless
package has been updated with some changes to conform to the Frictionless I/O specs, with more appropriateDataResource
name
fields./databases/{db}/search-parameters
) that allows a client to query the set of all possible search parameters specific to a given database.NOTE: I had to update Huma to get the database-specific parameters to work. This update is actually responsible for most of the update files in this PR.
Update (7/24/2024)
This PR is now a bit long on the tooth and now contains more goodness:
dts-{task-id}
instead of{task-id}
With the above features, the DTS now supports the transfer of private data from the JGI data portal.
Closes #1 Closes #18