mikeaintworkin commented 1 year ago

To get this done:

[X] modify the code that fetches project state so that it can easily read any project.
[X] dump the current snapshot of the project "Funded Deliverables'
[X] review the data in a spreadsheet
[X] Create an input file
[ ] run the script to delete each issue or pr

mikeaintworkin commented 1 year ago

main: /home/perftest/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin/project- add_or_remove_issues_or_prs.sh Calls: /home/perftest/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/api/bin/project-add_or_remove_issues_or_prs.sh Input looks like:

'ISSUE' 8639    'IQSS/dataverse'
'ISSUE' 8740    'IQSS/dataverse'
'PULL_REQUEST'  8744    'IQSS/dataverse'
'ISSUE' 8759    'IQSS/dataverse'
'ISSUE' 8754    'IQSS/dataverse'
'PULL_REQUEST'  8792    'IQSS/dataverse'
'PULL_REQUEST'  8812    'IQSS/dataverse'
'PULL_REQUEST'  8793    'IQSS/dataverse'
'PULL_REQUEST'  8755    'IQSS/dataverse'

mikeaintworkin commented 1 year ago

Ran into a problem on the last step. It looks like I cannot use gh to reference the projectV2 type. This means that I cannot delete issues from the project using gh.

I found this helpful starting point in the graphqldocs

Deleting an item from a project

The following example will delete an item from a project. Replace PROJECT_ID with the node ID of your project. Replace ITEM_ID with the node ID of the item you want to delete.

gh api graphql -f query='
  mutation {
    deleteProjectV2Item(
      input: {
        projectId: "PROJECT_ID"
        itemId: "ITEM_ID"
      }
    ) {
      deletedItemId
    }
  }'

mikeaintworkin commented 1 year ago

I used obsidian to break down the example. I think I understand what I need.

I need the ID of the project and the Issue to remove from the project. I think these are not the "numbers", but the actual IDs. I already have the ID for the issues. I have added the ID for the project to the query.

mikeaintworkin commented 1 year ago

The next step is to create a new XSL that extracts the project name, project ID, Type, Number, Title, repo for each item I return from the project. This should not be difficult.

mikeaintworkin commented 1 year ago

Once, extracted, I can use the list to power a mutation to remove issues/prs from a project.

mikeaintworkin commented 1 year ago

Today I spent the bulk of my time working in shell script and then GraphQL. I was making good progress on just using the shell scripts and scripting until I ran into a problem where I could not use the GitHub command line GH to remove an issue from a project. It just quietly fails. I did a quick look around and found other people complaining of similar things and an explanation that they don't yet support it. This led to an interesting research of how mutations work in GraphQL. The example given on the GitHub website directly applies to what I want to do. I believe I've identified the input parameters I need in order to delete one issue from a project. I modified the GraphQL quarry that I've been using so that it includes the project ID, not the project number, and it already included the issue ID, as opposed to the issue number.

The next step will be to create an XSL file that retrieves just the basic information I need to do the removal and a little bit of extra information to make it human readable. This piece won't be too hard, but it will probably still take me 4 to 5 hours.

mikeaintworkin commented 1 year ago

I just resized what is left to a 10 based on the time estimate

mikeaintworkin commented 1 year ago

It was easy to modify the graphql query to return the additonal field. It was easy to modify the xslt file to return the extra fields in a tabular format

ProjectTitle    ProjectNumber   ProjectID   Status  AssignedSize    Type    IssueNumber Title   Repository  Comments    LabelString closingIssuesReferences OG Queue    Closed  ClosedAt    RUNLABEL    LabelsCount NoneMDEyOk9yZ2FuaXphdGlvbjY3NTIzNw==IQSSFalseNone2022-10-05T20:20:01ZmreekiePVT_kwDOAApNpc4AG11JFalseNoneNIH OTA: 1.5.1Size: 10pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t02475dataverse.harvard.eduSpike: finalize the plan for transition to Make Data Count, how to display the metrics, how to handle legacy countshttps://github.com/IQSS/dataverse.harvard.edu/issues/75NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cQEISSUETrue2023-03-11T20:43:49ZType: SuggestionFeature: MetadataUser Role: CuratorUser Role: DepositorNIH OTA: 1.5.1bklog: NeedsDiscussionD: 5 Core PIDsSize: NoSprintCostpm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t02107285dataverseSupport for Crossref Funder Registry IDhttps://github.com/IQSS/dataverse/issues/7285NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cTkISSUEFalseNonesz.MediumNIH OTA: 1.5.1pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t0243dataverse.harvard.eduOperationalize MDC: Create Cron Jobs, Acquire, Configure Prod Web Token, Handle Logs https://github.com/IQSS/dataverse.harvard.edu/issues/3NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cQQISSUEFalseNoneFeature: MetadataNIH OTA: 1.5.1pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t0245998dataverseAs a curator, I want depositors to be able to add structured information about the relationships between datasetshttps://github.com/IQSS/dataverse/issues/5998NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cTwISSUEFalseNoneStatus: UX & UIType: SuggestionFeature: MetadataUser Role: CuratorNIH OTA: 1.5.1pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t0273074dataverseAdd Support for Organizational and Funder Identifiershttps://github.com/IQSS/dataverse/issues/3074NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cUAISSUEFalseNoneFeature: HarvestingNIH OTA: 1.5.1pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t0244859dataverseRemove the Contributor type "Funder" in Dataverse's citation metadatablockhttps://github.com/IQSS/dataverse/issues/4859NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cT8ISSUEFalseNoneFeature: MetadataFeature: HarvestingNIH OTA: 1.5.1pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t0255889dataverseAlign (or merge) DataCite metadata exportshttps://github.com/IQSS/dataverse/issues/5889NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cT0ISSUEFalseNoneType: SuggestionFeature: MetadataUser Role: CuratorUser Role: DepositorNIH OTA: 1.5.1pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t0276640dataverseSupport Research Organization Registry (ROR) IDshttps://github.com/IQSS/dataverse/issues/6640NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cToISSUEFalseNoneNIH OTA: 1.1.1pm.f01-d-y01-a01-t0129123dataverseEnhance Globus support for remote endpoints and tape storeshttps://github.com/IQSS/dataverse/issues/9123NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgD7HQUISSUETrue2022-09-19T17:19:16ZNIH OTA: 1.1.1pm.f01-d-y01-a01-t0127740dataverseGlobus: DatasetVersion in dataset level externaltoolhttps://github.com/IQSS/dataverse/issues/7740NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2Kk0ISSUETrue2022-09-19T17:19:16ZNIH OTA: 1.1.1pm.f01-d-y01-a01-t0127626dataverseGlobus: Identify and add configurable button(s) for Upload and Download actions on Dataset pagehttps://github.com/IQSS/dataverse/issues/7626NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2KkwISSUETrue2022-09-19T17:19:17ZNIH OTA: 1.1.1pm.f01-d-y01-a01-t0127524dataverseLarge file download supporthttps://github.com/IQSS/dataverse/issues/7524NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2KksISSUETrue2022-09-19T17:19:17ZNIH OTA: 1.1.1pm.f01-d-y01-a01-t0125994dataverseExternal data support: Globus endpoints (deposit and indexing)https://github.com/IQSS/dataverse/issues/5994NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2KkoISSUETrue2022-09-19T17:19:15Z59947524762677404hdc1NIH OTA: 1.1.1pm.f01-d-y01-a01-t0148891dataverseGDCC/Globus and Big Data Supporthttps://github.com/IQSS/dataverse/pull/8891NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2KDIPULL_REQUESTTrue2022-08-18T13:57:03Z73241hdc1NIH OTA: 1.1.1pm.f01-d-y01-a01-t0147325dataverseSimple support for remote web storeshttps://github.com/IQSS/dataverse/pull/7325NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2KDMPULL_REQUESTTrue2022-09-19T19:07:29Z86111hdc3a3b1NIH OTA: 1.1.1pm.f01-d-y01-a01-t0168894dataverseRelease Notes related to HDC 1 and 3A/3Bhttps://github.com/IQSS/dataverse/pull/8894NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2KDEPULL_REQUESTFalseNoneNIH OTA: 1.2.2pm.f01-d-y01-a02-t0229159dataverseAs a user I would like to be able to export my dataset metadata via DDI-CDIhttps://github.com/IQSS/dataverse/issues/9159NIH OTA: 1.2.2PVTI_lADOAApNpc4AG11JzgDXylMISSUEFalseNoneNIH OTA: 1.2.2pm.f01-d-y01-a02-t0229160dataverseAs a user I would like to be able to include DDI-CDI meta data with a dataset that I import, and be able to export my dataset with the metadata intact.https://github.com/IQSS/dataverse/issues/9160NIH OTA: 1.2.2PVTI_lADOAApNpc4AG11JzgDXywEISSUEFalseNoneNIH OTA: 1.2.2pm.f01-d-y01-a02-t0229161dataverseCreate a white paper that summarizes what we know and what we don't know about the state of DDI-CDI currentlyhttps://github.com/IQSS/dataverse/issues/9161NIH OTA: 1.2.2PVTI_lADOAApNpc4AG11JzgDXzBAISSUEFalseNone025dataverse-pmCollection: Keep track of list of issues that we want to address as part of 1.4.1https://github.com/IQSS/dataverse-pm/issues/25NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDRrMsISSUEFalseNoneNIH OTA: 1.2.1pm.f01-d-y01-a02-t0129043dataverse1.2.1 Deliverable Backlog Working Noteshttps://github.com/IQSS/dataverse/issues/9043NIH OTA: 1.2.1PVTI_lADOAApNpc4AG11JzgC4emkISSUEFalseNoneNIH OTA: 1.2.1Size: 80D: 5 Core PIDspm.f01-d-y01-a02-t0149150dataverseCreate a javascript for the frontend that supports Fundrefhttps://github.com/IQSS/dataverse/issues/9150NIH OTA: 1.2.1PVTI_lADOAApNpc4AG11JzgDVCkMISSUEFalseNoneNIH OTA: 1.2.1Size: 80D: 5 Core PIDspm.f01-d-y01-a02-t0149151dataverseGet the existing ROR plug-in working on the dataverse demohttps://github.com/IQSS/dataverse/issues/9151NIH OTA: 1.2.1PVTI_lADOAApNpc4AG11JzgDVCokISSUETrue2022-12-01T19:50:19ZNIH OTA: 1.2.1Size: 3pm.f01-d-y01-a02-t0139114dataverseCreate a whitepaper for external vocabulary work 1.2.1https://github.com/IQSS/dataverse/issues/9114NIH OTA: 1.2.1PVTI_lADOAApNpc4AG11JzgDuR2IISSUETrue2022-10-18T21:31:30ZNIH OTA DCspikeFeature: Controlled VocabularyNIH OTA: 1.2.1pm.f01-d-y01-a02-t0158681dataverseSpike: Discovery about integrating biomedical vocabularies into dataversehttps://github.com/IQSS/dataverse/issues/8681NIH OTA: 1.2.1PVTI_lADOAApNpc4AG11JzgC2L8kISSUETrue2022-05-06T16:12:19ZNIH OTA DCFeature: Controlled VocabularyNIH OTA: 1.2.1pm.f01-d-y01-a02-t0148571dataverseSpike: What work has already been done towards support for controlled vocabularies for metadata fieldshttps://github.com/IQSS/dataverse/issues/8571NIH OTA: 1.2.1PVTI_lADOAApNpc4AG11JzgC0cTgISSUEFalseNoneFeature: MetadataNIH OTA: 1.5.1pm.f01-d-y01-a05-t0135277dataverseAs a curator, I want to more easily add metadata about related resources so that it's more discoverablehttps://github.com/IQSS/dataverse/issues/5277NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cT4ISSUEFalseNonepm.f02NIH: NetCDF222dataverse-pmNIH ODSS supplement (NetCDF)https://github.com/IQSS/dataverse-pm/issues/22NonePVTI_lADOAApNpc4AG11JzgDRcKwISSUEFalseNoneNIH OTA DCNIH OTA: 1.6.2pm.f01-d-y01-a06-t0238737dataverseSpike: Identify Existing Repositories that specialize in handling Sensitive Datahttps://github.com/IQSS/dataverse/issues/8737NIH OTA: 1.6.2PVTI_lADOAApNpc4AG11JzgDTWIoISSUETrue2023-01-25T20:17:07Zpm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t02224dataverse-pmSpike: Inventory and prioritize all existing Harvesting related issueshttps://github.com/IQSS/dataverse-pm/issues/24NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDRjTQISSUEFalseNoneFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1Size: 33pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0278289dataverseThe "ListSets" command fails during the creation of a harvesting client for Zenodo https://github.com/IQSS/dataverse/issues/8289NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDN0QIISSUEFalseNoneFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1Size: 10pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0277736dataverseFix handling of storageidentifiers in dataverse_json harvestshttps://github.com/IQSS/dataverse/issues/7736NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNy6cISSUEFalseNoneFeature: HarvestingNIH OTA: 1.4.1Size: Queuedpm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0258842dataverseRefactor the OAI code, Step 2https://github.com/IQSS/dataverse/issues/8842NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNyigISSUEFalseNoneFeature: Harvestingpm.epic.nih_harvesting_frameworkNIH OTA: 1.4.1Size: 10pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0268629dataverseRevisit/reimplement the concept of a "Harvested file". https://github.com/IQSS/dataverse/issues/8629NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNzWIISSUEFalseNoneType: BugFeature: HarvestingUser Role: SuperuserNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0283437dataverseHarvest: Set export can temporarily be adversely affected by full (clean) reindex.https://github.com/IQSS/dataverse/issues/3437NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDwd1kISSUEFalseNoneType: BugFeature: HarvestingUser Role: SuperuserNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0283322dataverseHarvest: Do not list a set as available in ListSets until it has been successfully exported at least once.https://github.com/IQSS/dataverse/issues/3322NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDwdxUISSUEFalseNoneFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0268243dataverseFeature Request/Idea: Sanitize languages controlled vocabulary valueshttps://github.com/IQSS/dataverse/issues/8243NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDweU0ISSUEFalseNoneFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0268005dataverseHarvesting: OAI sets are not updated when datasets are deleted.https://github.com/IQSS/dataverse/issues/8005NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDwd5sISSUEFalseNoneFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0268578dataverseRemaining mapping problems when harvesting from a repository using ISO 639-3 language codeshttps://github.com/IQSS/dataverse/issues/8578NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDweVwISSUETrue2022-12-15T18:45:07ZFeature: HarvestingNIH OTA: 1.4.1Testing: APISize: 80pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0268843dataverseExpand the suite of automated tests of the Harvesting functionalityhttps://github.com/IQSS/dataverse/issues/8843NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNybEISSUETrue2023-01-10T20:44:45ZType: SuggestionFeature: HarvestingUser Role: SuperuserNIH OTA: 1.4.1Size: 3pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0275112dataverseExclude deaccessioned dataset from being harvestedhttps://github.com/IQSS/dataverse/issues/5112NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNzGEISSUETrue2022-12-07T21:42:11ZFeature: HarvestingUser Role: SysadminNIH OTA: 1.4.1Size: 10pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0263621dataverseinvalid schema and metadataNamespace fields in OAI-PMH ListMetadataFormats responsehttps://github.com/IQSS/dataverse/issues/3621NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNydIISSUETrue2022-12-12T18:57:02ZFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0267940dataverse[feature request] stop an harvest job in progresshttps://github.com/IQSS/dataverse/issues/7940NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNyykISSUETrue2022-12-01T19:46:01ZFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0268290dataverseTrying to set up or complete a harvesting client through the API crashes Dataversehttps://github.com/IQSS/dataverse/issues/8290NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDjp7wISSUETrue2022-11-28T18:57:16ZType: BugFeature: HarvestingUser Role: SysadminNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0263741dataverseOAI server: metadataPrefix unknown: Internal server errorhttps://github.com/IQSS/dataverse/issues/3741NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNypgISSUETrue2022-12-01T19:46:00ZFeature: HarvestingFeature: API GuideNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0258267dataverseFeature Request/Idea: Documentation for the API to create and edit harvesting clientshttps://github.com/IQSS/dataverse/issues/8267NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNzhYISSUETrue2022-11-28T18:55:02ZType: BugFeature: HarvestingUser Role: SysadminNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0263797dataverseOAI-PMH responses indicating errors should be processable by OAI-PMH clientshttps://github.com/IQSS/dataverse/issues/3797NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNyuMISSUETrue2022-07-22T14:46:35ZFeature: MetadataFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0278484dataverseFailure to export dataset not detected, dataset marked as exportedhttps://github.com/IQSS/dataverse/issues/8484NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDRjhMISSUETrue2022-05-23T20:48:02ZFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t0158139dataverseCan't harvest when Dublin core field language is sethttps://github.com/IQSS/dataverse/issues/8139NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDRjhsISSUETrue2022-10-13T18:59:23ZFeature: Code InfrastructureFeature: HarvestingUser Role: SysadminNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t0178372dataverseUpdate and reorganize the XOAI dependencies under local_libhttps://github.com/IQSS/dataverse/issues/8372NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDwdh4ISSUETrue2023-03-15T18:22:04ZFeature: File Upload & HandlingNIH: NetCDFSize: 3339147dataverseDraft design doc for NetCDF/HDF5/geospatialhttps://github.com/IQSS/dataverse/issues/9147NonePVTI_lADOAApNpc4AG11JzgDU0XEISSUETrue2023-01-20T16:03:42ZNIH: NetCDFSize: 8029153dataverseExtract metadata from NetCDF and HDF5 files as XML in NcML formathttps://github.com/IQSS/dataverse/issues/9153NonePVTI_lADOAApNpc4AG11JzgDWYM8ISSUETrue2022-11-22T19:35:04ZNIH: NetCDF19117dataverseImprove file type detection of NetCDF and HDF5https://github.com/IQSS/dataverse/issues/9117NonePVTI_lADOAApNpc4AG11JzgDRcH0ISSUETrue2022-11-22T16:59:21ZNIH: NetCDF19110dataverseNetCDF/HDF5/geospatial discoveryhttps://github.com/IQSS/dataverse/issues/9110NonePVTI_lADOAApNpc4AG11JzgDRcJMISSUEFalseNonepm.f01121dataverse-pmNIH GREI Working Groupshttps://github.com/IQSS/dataverse-pm/issues/21NonePVTI_lADOAApNpc4AG11JzgDRfL0ISSUEFalseNoneD: Dev120dataverse-pmDeliverable: Address Email Operationshttps://github.com/IQSS/dataverse-pm/issues/20NonePVTI_lADOAApNpc4AG11JzgDTUqEISSUEFalseNoneops: Email Issue149dataverse-securitySPF message on Harvard Dataverse Emailshttps://github.com/IQSS/dataverse-security/issues/49NonePVTI_lADOAApNpc4AG11JzgDTVkMISSUEFalseNoneFeature: Metadata17727dataverseAdd import for oai_datacite ("OpenAire") format (this will allow Dataverse to harvest this format too)https://github.com/IQSS/dataverse/issues/7727NonePVTI_lADOAApNpc4AG11JzgDNzzYISSUEFalseNoneNIH OTA: 1.6.1D: OpenDP Integrationpm.f01-d-y01-a06-t0139099dataverseDP Creator Analyst Modehttps://github.com/IQSS/dataverse/issues/9099NIH OTA: 1.6.1PVTI_lADOAApNpc4AG11JzgEJhaoISSUETrue2022-11-30T19:56:42ZNIH OTA: 1.6.1pm.f01-d-y01-a06-t0127715dataverseInclude Signed-urls in the External Tools Frameworkhttps://github.com/IQSS/dataverse/issues/7715NIH OTA: 1.6.1PVTI_lADOAApNpc4AG11JzgDwq4oISSUETrue2023-01-30T19:07:06ZNIH OTA: 1.1.1pm.f01-d-y01-a01-t0129189dataverseWeird property key modification in Bundle.properties file v5.12https://github.com/IQSS/dataverse/issues/9189NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgD7HW0ISSUETrue2022-12-21T17:22:13Z78441Feature: MetadataWorking Group: SWCHERMESNIH OTA: 1.3.1Size: 10pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0277877dataverse7844 codemeta schemahttps://github.com/IQSS/dataverse/pull/7877NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7SE4PULL_REQUESTTrue2022-07-29T14:02:23Zhdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258639dataverseFeature Request/Idea: Add Computational Workflow Metadata and Related Docshttps://github.com/IQSS/dataverse/issues/8639NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0UISSUETrue2022-07-22T19:51:06Zhdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258740dataverseFeature Request/Idea: File type recognition based on filenamehttps://github.com/IQSS/dataverse/issues/8740NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0YISSUETrue2022-07-22T19:51:05Z87401hdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258744dataverseFile Recognition - Add support for files without extensionshttps://github.com/IQSS/dataverse/pull/8744NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0cPULL_REQUESTTrue2022-07-15T20:39:33Zhdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258759dataverseFeature Request/Idea: File type recognition - Add computational workflow file typeshttps://github.com/IQSS/dataverse/issues/8759NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0oISSUETrue2022-07-18T18:13:27Zhdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258754dataverseFeature Request/Idea: Improve ignored files for BagIt handlerhttps://github.com/IQSS/dataverse/issues/8754NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0gISSUETrue2022-07-22T20:48:32Z87871hdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258792dataverseBagIt Support - Improve error messages for BagIt handlerhttps://github.com/IQSS/dataverse/pull/8792NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S00PULL_REQUESTTrue2022-07-29T14:02:23Z86391hdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258812dataverseAdded Computational Workflow metadata and related documentationhttps://github.com/IQSS/dataverse/pull/8812NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S08PULL_REQUESTTrue2022-08-18T19:48:42Z85361hdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258793dataverseAdded new static facet to show metadata blocks with valueshttps://github.com/IQSS/dataverse/pull/8793NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S04PULL_REQUESTTrue2022-07-18T18:13:27Z87541hdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258755dataverseBagIt Support - Improved ignored files for BagIt handlerhttps://github.com/IQSS/dataverse/pull/8755NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0kPULL_REQUESTTrue2022-07-15T20:39:33Z87591hdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258761dataverseFile Recognition - Added computational workflow file typeshttps://github.com/IQSS/dataverse/pull/8761NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0sPULL_REQUESTTrue2022-07-22T20:48:33Zhdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258787dataverseFeature Request/Idea: Improve error messages for BagIt handlerhttps://github.com/IQSS/dataverse/issues/8787NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0wISSUETrue2023-01-09T16:10:49Z92281Feature: Account & User InfoNIH OTA: 1.7.1 (reArchitecture)Size: 3pm.f01-d-y01-a07-t01pm.f01-d-y01-a07-t0259234dataverse9228 - add OIDC development setup for OIDC login feature testinghttps://github.com/IQSS/dataverse/pull/9234NIH OTA: 1.7.1 & 1.7.2 (reArchitecture)PVTI_lADOAApNpc4AG11JzgEJiyAPULL_REQUESTTrue2023-01-26T20:17:32ZSize: 80pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0239231dataverseFeature request: Add the ability to configure a Harvesting Client to add a custom header to OAI callshttps://github.com/IQSS/dataverse/issues/9231NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgEQ8jgISSUETrue2023-03-09T16:35:52ZDevOps: Problem19355dataverseSpike: Discover Root cause of GitHub actions stoppage in January (Before the end of February!)https://github.com/IQSS/dataverse/issues/9355NonePVTI_lADOAApNpc4AG11JzgEo4fcISSUEFalseNonepm.f01pm.f01-d-y02-a05-t0124dataverse-pmNIH AIM:5 YR:2 TASK:1 | 2.5.1 | Design and implement usage reports and data citation metrics based on Make Data Counthttps://github.com/IQSS/dataverse-pm/issues/4NonePVTI_lADOAApNpc4AG11JzgFPtw4ISSUEFalseNonepm.f01pm.f01-d-y02-a03-t02215dataverse-pmNIH AIM:3 YR:2 TASK:2 | 2.3.2 | Research and discovery phase for containers and research objects supporthttps://github.com/IQSS/dataverse-pm/issues/15NonePVTI_lADOAApNpc4AG11JzgFioWEISSUEFalseNonepm.f01pm.f01-d-y02-a03-t01216dataverse-pmNIH AIM:3 YR:2 TASK:1  | 2.3.1 | Support biomedical workflowshttps://github.com/IQSS/dataverse-pm/issues/16NonePVTI_lADOAApNpc4AG11JzgFioWIISSUEFalseNonepm.f01pm.f01-d-y01-a06-t0125dataverse-pm6 | 1.6.1 | Integrate with OpenDP tools to support differentially private statistical releases of de-identified data deposited in the repository (in collaboration with the OpenDP.org project, currently partially funded with the Sloan Foundation) | 10https://github.com/IQSS/dataverse-pm/issues/5NonePVTI_lADOAApNpc4AG11JzgFioWoISSUEFalseNonepm.f01pm.f01-d-y01-a02-t0226dataverse-pm2 | 1.2.2 | Define use cases for DDI-CDI support | 5https://github.com/IQSS/dataverse-pm/issues/6NonePVTI_lADOAApNpc4AG11JzgFioWwISSUEFalseNonepm.f01pm.f01-d-y01-a02-t0127dataverse-pm2 | 1.2.1 | Design and implement integration with controlled vocabularies | 5 |https://github.com/IQSS/dataverse-pm/issues/7NonePVTI_lADOAApNpc4AG11JzgFioW8ISSUEFalseNonepm.f01pm.f01-d-y01-a05-t0128dataverse-pm5 | 1.5.1 | Standardize download metrics for the Harvard Dataverse repository following Make Data Counthttps://github.com/IQSS/dataverse-pm/issues/8NonePVTI_lADOAApNpc4AG11JzgFioXAISSUEFalseNonepm.f01pm.f01-d-y01-a06-t0229dataverse-pm6 | 1.6.2 | Discovery phase to support DataTags | 10https://github.com/IQSS/dataverse-pm/issues/9NonePVTI_lADOAApNpc4AG11JzgFioXEISSUEFalseNonepm.f01pm.f01-d-y01-a04-t01210dataverse-pm4 | 1.4.1 | Resolve OAI-PMH harvesting issues | 5https://github.com/IQSS/dataverse-pm/issues/10NonePVTI_lADOAApNpc4AG11JzgFioXQISSUEFalseNonepm.f01pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t02311dataverse-pm3 | 1.3.1 & 1.3.2 | Support software metadata | 5https://github.com/IQSS/dataverse-pm/issues/11NonePVTI_lADOAApNpc4AG11JzgFioXgISSUEFalseNonepm.f01pm.f01-d-y01-a04-t02212dataverse-pm4 | 1.4.2 | Create working group on packaging standards to share metadata and data across repositories | 5https://github.com/IQSS/dataverse-pm/issues/12NonePVTI_lADOAApNpc4AG11JzgFioXoISSUEFalseNonepm.f01pm.f01-d-y01-a01-t01213dataverse-pm1 | 1.1.1 | Minimum Viable Product (MVP) for registering metadata in the repository and connecting the metadata to the data in the research computing remote storage (NESE), including Globus endpoints | 15https://github.com/IQSS/dataverse-pm/issues/13NonePVTI_lADOAApNpc4AG11JzgFioXwISSUEFalseNonepm.f01pm.f01-d-y01-a07-t01pm.f01-d-y01-a07-t02314dataverse-pm7 | 1.7.1 | & 1.7.2 Re Architecture Effortshttps://github.com/IQSS/dataverse-pm/issues/14NonePVTI_lADOAApNpc4AG11JzgFioX0ISSUEODkFalseFalseMQ32FundedDeliverables2023-03-20T17:43:49Zhttps://github.com/orgs/IQSS/projects/32https://github.com/orgs/IQSS/projectsNIH OTA: 1.5.1  Size: 10    pm.f01-d-y01-a05-t01    pm.f01-d-y01-a05-t02    Type: Suggestion    Feature: Metadata   User Role: Curator  User Role: Depositor    bklog: NeedsDiscussion  D: 5 Core PIDs  Size: NoSprintCost  sz.Medium   Status: UX & UI Feature: Harvesting NIH OTA: 1.1.1  pm.f01-d-y01-a01-t01    hdc 1   3a  3b  NIH OTA: 1.2.2  pm.f01-d-y01-a02-t02    NIH OTA: 1.2.1  pm.f01-d-y01-a02-t01    Size: 80    Size: 3 NIH OTA DC  spike   Feature: Controlled Vocabulary  pm.f02  NIH: NetCDF NIH OTA: 1.6.2  pm.f01-d-y01-a06-t02    pm.f01-d-y01-a04-t01    pm.f01-d-y01-a04-t02    pm.epic.nih_harvesting  NIH OTA: 1.4.1  Size: 33    Size: Queued    pm.epic.nih_harvesting_framework    Type: Bug   User Role: Superuser    Testing: API    User Role: Sysadmin Feature: API Guide  Feature: Code Infrastructure    Feature: File Upload & Handling pm.f01  D: Dev  ops: Email Issue    NIH OTA: 1.6.1  D: OpenDP Integration   pm.f01-d-y01-a06-t01    Working Group: SWC  HERMES  NIH OTA: 1.3.1  pm.f01-d-y01-a03-t01    pm.f01-d-y01-a03-t02    Feature: Account & User Info    NIH OTA: 1.7.1 (reArchitecture) pm.f01-d-y01-a07-t01    pm.f01-d-y01-a07-t02    DevOps: Problem pm.f01-d-y02-a05-t01    pm.f01-d-y02-a03-t02    pm.f01-d-y02-a03-t01    
'FundedDeliverables'    32  'PVT_kwDOAApNpc4AG11J'  'NIH OTA: 1.5.1 & 1.5.2'    10  'ISSUE' 75  'Spike: finalize the plan for transition to Make Data Count, how to display the metrics, how to handle legacy counts'   'dataverse.harvard.edu'     'NIH OTA: 1.5.1','Size: 10','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'       'NIH OTA: 1.5.1 & 1.5.2'    False   'None'  'TEST'  4   1   1   1   1                                                                                                                                                                                                                                                           
'FundedDeliverables'    32  'PVT_kwDOAApNpc4AG11J'  'NIH OTA: 1.5.1 & 1.5.2'    NoSprintCost    'ISSUE' 7285    'Support for Crossref Funder Registry ID'   'dataverse'     'Type: Suggestion','Feature: Metadata','User Role: Curator','User Role: Depositor','NIH OTA: 1.5.1','bklog: NeedsDiscussion','D: 5 Core PIDs','Size: NoSprintCost','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'        'NIH OTA: 1.5.1 & 1.5.2'    True    '2023-03-11T20:43:49Z'  'TEST'  10  1       1   1   1   1   1   1   1   1   1                                                                                                                                                                                                                               
'FundedDeliverables'    32  'PVT_kwDOAApNpc4AG11J'  'NIH OTA: 1.5.1 & 1.5.2'        'ISSUE' 3   'Operationalize MDC: Create Cron Jobs, Acquire, Configure Prod Web Token, Handle Logs ' 'dataverse.harvard.edu'     'sz.Medium','NIH OTA: 1.5.1','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'      'NIH OTA: 1.5.1 & 1.5.2'    False   'None'  'TEST'  4   1       1   1                               1                                                                                                                                                                                                                           
'FundedDeliverables'    32  'PVT_kwDOAApNpc4AG11J'  'NIH OTA: 1.5.1 & 1.5.2'        'ISSUE' 5998    'As a curator, I want depositors to be able to add structured information about the relationships between datasets' 'dataverse'     'Feature: Metadata','NIH OTA: 1.5.1','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'      'NIH OTA: 1.5.1 & 1.5.2'    False   'None'  'TEST'  4   1       1   1       1                                                                                                                                                                                                                                                   
'FundedDeliverables'    32  'PVT_kwDOAApNpc4AG11J'  'NIH OTA: 1.5.1 & 1.5.2'        'ISSUE' 3074    'Add Support for Organizational and Funder Identifiers' 'dataverse'     'Status: UX & UI','Type: Suggestion','Feature: Metadata','User Role: Curator','NIH OTA: 1.5.1','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'        'NIH OTA: 1.5.1 & 1.5.2'    False   'None'  'TEST'  7   1       1   1   1   1   1                       1                                                                                                                                                                                                                       
'FundedDeliverables'    32  'PVT_kwDOAApNpc4AG11J'  'NIH OTA: 1.5.1 & 1.5.2'        'ISSUE' 4859    'Remove the Contributor type "Funder" in Dataverse's citation metadatablock'    'dataverse'     'Feature: Harvesting','NIH OTA: 1.5.1','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'        'NIH OTA: 1.5.1 & 1.5.2'    False   'None'  'TEST'  4   1       1   1                                       1                                                                                                                                                                                                                   
'Fun

mikeaintworkin commented 1 year ago

Looking at the output data I think I have a problem in my query or my xslt.

NoneMDEyOk9yZ2FuaXphdGlvbjY3NTIzNw==IQSSFalseNone2022-10-05T20:20:01ZmreekiePVT_kwDOAApNpc4AG11JFalseNoneNIH OTA: 1.5.1Size: 10pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t02475dataverse.harvard.eduSpike: finalize the plan for transition to Make Data Count, how to display the metrics, how to handle legacy countshttps://github.com/IQSS/dataverse.harvard.edu/issues/75NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cQEISSUETrue2023-03-11T20:43:49ZType: SuggestionFeature: MetadataUser Role: CuratorUser Role: DepositorNIH OTA: 1.5.1bklog: NeedsDiscussionD: 5 Core PIDsSize: NoSprintCostpm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t02107285dataverseSupport for Crossref Funder Registry IDhttps://github.com/IQSS/dataverse/issues/7285NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cTkISSUEFalseNonesz.MediumNIH OTA: 1.5.1pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t0243dataverse.harvard.eduOperationalize MDC: Create Cron Jobs, Acquire, Configure Prod Web Token, Handle Logs https://github.com/IQSS/dataverse.harvard.edu/issues/3NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cQQISSUEFalseNoneFeature: MetadataNIH OTA: 1.5.1pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t0245998dataverseAs a curator, I want depositors to be able to add structured information about the relationships between datasetshttps://github.com/IQSS/dataverse/issues/5998NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cTwISSUEFalseNoneStatus: UX & UIType: SuggestionFeature: MetadataUser Role: CuratorNIH OTA: 1.5.1pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t0273074dataverseAdd Support for Organizational and Funder Identifiershttps://github.com/IQSS/dataverse/issues/3074NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cUAISSUEFalseNoneFeature: HarvestingNIH OTA: 1.5.1pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t0244859dataverseRemove the Contributor type "Funder" in Dataverse's citation metadatablockhttps://github.com/IQSS/dataverse/issues/4859NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cT8ISSUEFalseNoneFeature: MetadataFeature: HarvestingNIH OTA: 1.5.1pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t0255889dataverseAlign (or merge) DataCite metadata exportshttps://github.com/IQSS/dataverse/issues/5889NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cT0ISSUEFalseNoneType: SuggestionFeature: MetadataUser Role: CuratorUser Role: DepositorNIH OTA: 1.5.1pm.f01-d-y01-a05-t01pm.f01-d-y01-a05-t0276640dataverseSupport Research Organization Registry (ROR) IDshttps://github.com/IQSS/dataverse/issues/6640NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cToISSUEFalseNoneNIH OTA: 1.1.1pm.f01-d-y01-a01-t0129123dataverseEnhance Globus support for remote endpoints and tape storeshttps://github.com/IQSS/dataverse/issues/9123NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgD7HQUISSUETrue2022-09-19T17:19:16ZNIH OTA: 1.1.1pm.f01-d-y01-a01-t0127740dataverseGlobus: DatasetVersion in dataset level externaltoolhttps://github.com/IQSS/dataverse/issues/7740NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2Kk0ISSUETrue2022-09-19T17:19:16ZNIH OTA: 1.1.1pm.f01-d-y01-a01-t0127626dataverseGlobus: Identify and add configurable button(s) for Upload and Download actions on Dataset pagehttps://github.com/IQSS/dataverse/issues/7626NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2KkwISSUETrue2022-09-19T17:19:17ZNIH OTA: 1.1.1pm.f01-d-y01-a01-t0127524dataverseLarge file download supporthttps://github.com/IQSS/dataverse/issues/7524NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2KksISSUETrue2022-09-19T17:19:17ZNIH OTA: 1.1.1pm.f01-d-y01-a01-t0125994dataverseExternal data support: Globus endpoints (deposit and indexing)https://github.com/IQSS/dataverse/issues/5994NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2KkoISSUETrue2022-09-19T17:19:15Z59947524762677404hdc1NIH OTA: 1.1.1pm.f01-d-y01-a01-t0148891dataverseGDCC/Globus and Big Data Supporthttps://github.com/IQSS/dataverse/pull/8891NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2KDIPULL_REQUESTTrue2022-08-18T13:57:03Z73241hdc1NIH OTA: 1.1.1pm.f01-d-y01-a01-t0147325dataverseSimple support for remote web storeshttps://github.com/IQSS/dataverse/pull/7325NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2KDMPULL_REQUESTTrue2022-09-19T19:07:29Z86111hdc3a3b1NIH OTA: 1.1.1pm.f01-d-y01-a01-t0168894dataverseRelease Notes related to HDC 1 and 3A/3Bhttps://github.com/IQSS/dataverse/pull/8894NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgC2KDEPULL_REQUESTFalseNoneNIH OTA: 1.2.2pm.f01-d-y01-a02-t0229159dataverseAs a user I would like to be able to export my dataset metadata via DDI-CDIhttps://github.com/IQSS/dataverse/issues/9159NIH OTA: 1.2.2PVTI_lADOAApNpc4AG11JzgDXylMISSUEFalseNoneNIH OTA: 1.2.2pm.f01-d-y01-a02-t0229160dataverseAs a user I would like to be able to include DDI-CDI meta data with a dataset that I import, and be able to export my dataset with the metadata intact.https://github.com/IQSS/dataverse/issues/9160NIH OTA: 1.2.2PVTI_lADOAApNpc4AG11JzgDXywEISSUEFalseNoneNIH OTA: 1.2.2pm.f01-d-y01-a02-t0229161dataverseCreate a white paper that summarizes what we know and what we don't know about the state of DDI-CDI currentlyhttps://github.com/IQSS/dataverse/issues/9161NIH OTA: 1.2.2PVTI_lADOAApNpc4AG11JzgDXzBAISSUEFalseNone025dataverse-pmCollection: Keep track of list of issues that we want to address as part of 1.4.1https://github.com/IQSS/dataverse-pm/issues/25NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDRrMsISSUEFalseNoneNIH OTA: 1.2.1pm.f01-d-y01-a02-t0129043dataverse1.2.1 Deliverable Backlog Working Noteshttps://github.com/IQSS/dataverse/issues/9043NIH OTA: 1.2.1PVTI_lADOAApNpc4AG11JzgC4emkISSUEFalseNoneNIH OTA: 1.2.1Size: 80D: 5 Core PIDspm.f01-d-y01-a02-t0149150dataverseCreate a javascript for the frontend that supports Fundrefhttps://github.com/IQSS/dataverse/issues/9150NIH OTA: 1.2.1PVTI_lADOAApNpc4AG11JzgDVCkMISSUEFalseNoneNIH OTA: 1.2.1Size: 80D: 5 Core PIDspm.f01-d-y01-a02-t0149151dataverseGet the existing ROR plug-in working on the dataverse demohttps://github.com/IQSS/dataverse/issues/9151NIH OTA: 1.2.1PVTI_lADOAApNpc4AG11JzgDVCokISSUETrue2022-12-01T19:50:19ZNIH OTA: 1.2.1Size: 3pm.f01-d-y01-a02-t0139114dataverseCreate a whitepaper for external vocabulary work 1.2.1https://github.com/IQSS/dataverse/issues/9114NIH OTA: 1.2.1PVTI_lADOAApNpc4AG11JzgDuR2IISSUETrue2022-10-18T21:31:30ZNIH OTA DCspikeFeature: Controlled VocabularyNIH OTA: 1.2.1pm.f01-d-y01-a02-t0158681dataverseSpike: Discovery about integrating biomedical vocabularies into dataversehttps://github.com/IQSS/dataverse/issues/8681NIH OTA: 1.2.1PVTI_lADOAApNpc4AG11JzgC2L8kISSUETrue2022-05-06T16:12:19ZNIH OTA DCFeature: Controlled VocabularyNIH OTA: 1.2.1pm.f01-d-y01-a02-t0148571dataverseSpike: What work has already been done towards support for controlled vocabularies for metadata fieldshttps://github.com/IQSS/dataverse/issues/8571NIH OTA: 1.2.1PVTI_lADOAApNpc4AG11JzgC0cTgISSUEFalseNoneFeature: MetadataNIH OTA: 1.5.1pm.f01-d-y01-a05-t0135277dataverseAs a curator, I want to more easily add metadata about related resources so that it's more discoverablehttps://github.com/IQSS/dataverse/issues/5277NIH OTA: 1.5.1 & 1.5.2PVTI_lADOAApNpc4AG11JzgC0cT4ISSUEFalseNonepm.f02NIH: NetCDF222dataverse-pmNIH ODSS supplement (NetCDF)https://github.com/IQSS/dataverse-pm/issues/22NonePVTI_lADOAApNpc4AG11JzgDRcKwISSUEFalseNoneNIH OTA DCNIH OTA: 1.6.2pm.f01-d-y01-a06-t0238737dataverseSpike: Identify Existing Repositories that specialize in handling Sensitive Datahttps://github.com/IQSS/dataverse/issues/8737NIH OTA: 1.6.2PVTI_lADOAApNpc4AG11JzgDTWIoISSUETrue2023-01-25T20:17:07Zpm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t02224dataverse-pmSpike: Inventory and prioritize all existing Harvesting related issueshttps://github.com/IQSS/dataverse-pm/issues/24NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDRjTQISSUEFalseNoneFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1Size: 33pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0278289dataverseThe "ListSets" command fails during the creation of a harvesting client for Zenodo https://github.com/IQSS/dataverse/issues/8289NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDN0QIISSUEFalseNoneFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1Size: 10pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0277736dataverseFix handling of storageidentifiers in dataverse_json harvestshttps://github.com/IQSS/dataverse/issues/7736NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNy6cISSUEFalseNoneFeature: HarvestingNIH OTA: 1.4.1Size: Queuedpm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0258842dataverseRefactor the OAI code, Step 2https://github.com/IQSS/dataverse/issues/8842NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNyigISSUEFalseNoneFeature: Harvestingpm.epic.nih_harvesting_frameworkNIH OTA: 1.4.1Size: 10pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0268629dataverseRevisit/reimplement the concept of a "Harvested file". https://github.com/IQSS/dataverse/issues/8629NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNzWIISSUEFalseNoneType: BugFeature: HarvestingUser Role: SuperuserNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0283437dataverseHarvest: Set export can temporarily be adversely affected by full (clean) reindex.https://github.com/IQSS/dataverse/issues/3437NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDwd1kISSUEFalseNoneType: BugFeature: HarvestingUser Role: SuperuserNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0283322dataverseHarvest: Do not list a set as available in ListSets until it has been successfully exported at least once.https://github.com/IQSS/dataverse/issues/3322NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDwdxUISSUEFalseNoneFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0268243dataverseFeature Request/Idea: Sanitize languages controlled vocabulary valueshttps://github.com/IQSS/dataverse/issues/8243NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDweU0ISSUEFalseNoneFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0268005dataverseHarvesting: OAI sets are not updated when datasets are deleted.https://github.com/IQSS/dataverse/issues/8005NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDwd5sISSUEFalseNoneFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0268578dataverseRemaining mapping problems when harvesting from a repository using ISO 639-3 language codeshttps://github.com/IQSS/dataverse/issues/8578NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDweVwISSUETrue2022-12-15T18:45:07ZFeature: HarvestingNIH OTA: 1.4.1Testing: APISize: 80pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0268843dataverseExpand the suite of automated tests of the Harvesting functionalityhttps://github.com/IQSS/dataverse/issues/8843NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNybEISSUETrue2023-01-10T20:44:45ZType: SuggestionFeature: HarvestingUser Role: SuperuserNIH OTA: 1.4.1Size: 3pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0275112dataverseExclude deaccessioned dataset from being harvestedhttps://github.com/IQSS/dataverse/issues/5112NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNzGEISSUETrue2022-12-07T21:42:11ZFeature: HarvestingUser Role: SysadminNIH OTA: 1.4.1Size: 10pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0263621dataverseinvalid schema and metadataNamespace fields in OAI-PMH ListMetadataFormats responsehttps://github.com/IQSS/dataverse/issues/3621NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNydIISSUETrue2022-12-12T18:57:02ZFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0267940dataverse[feature request] stop an harvest job in progresshttps://github.com/IQSS/dataverse/issues/7940NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNyykISSUETrue2022-12-01T19:46:01ZFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0268290dataverseTrying to set up or complete a harvesting client through the API crashes Dataversehttps://github.com/IQSS/dataverse/issues/8290NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDjp7wISSUETrue2022-11-28T18:57:16ZType: BugFeature: HarvestingUser Role: SysadminNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0263741dataverseOAI server: metadataPrefix unknown: Internal server errorhttps://github.com/IQSS/dataverse/issues/3741NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNypgISSUETrue2022-12-01T19:46:00ZFeature: HarvestingFeature: API GuideNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0258267dataverseFeature Request/Idea: Documentation for the API to create and edit harvesting clientshttps://github.com/IQSS/dataverse/issues/8267NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNzhYISSUETrue2022-11-28T18:55:02ZType: BugFeature: HarvestingUser Role: SysadminNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0263797dataverseOAI-PMH responses indicating errors should be processable by OAI-PMH clientshttps://github.com/IQSS/dataverse/issues/3797NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDNyuMISSUETrue2022-07-22T14:46:35ZFeature: MetadataFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0278484dataverseFailure to export dataset not detected, dataset marked as exportedhttps://github.com/IQSS/dataverse/issues/8484NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDRjhMISSUETrue2022-05-23T20:48:02ZFeature: HarvestingNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t0158139dataverseCan't harvest when Dublin core field language is sethttps://github.com/IQSS/dataverse/issues/8139NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDRjhsISSUETrue2022-10-13T18:59:23ZFeature: Code InfrastructureFeature: HarvestingUser Role: SysadminNIH OTA DCpm.epic.nih_harvestingNIH OTA: 1.4.1pm.f01-d-y01-a04-t0178372dataverseUpdate and reorganize the XOAI dependencies under local_libhttps://github.com/IQSS/dataverse/issues/8372NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgDwdh4ISSUETrue2023-03-15T18:22:04ZFeature: File Upload & HandlingNIH: NetCDFSize: 3339147dataverseDraft design doc for NetCDF/HDF5/geospatialhttps://github.com/IQSS/dataverse/issues/9147NonePVTI_lADOAApNpc4AG11JzgDU0XEISSUETrue2023-01-20T16:03:42ZNIH: NetCDFSize: 8029153dataverseExtract metadata from NetCDF and HDF5 files as XML in NcML formathttps://github.com/IQSS/dataverse/issues/9153NonePVTI_lADOAApNpc4AG11JzgDWYM8ISSUETrue2022-11-22T19:35:04ZNIH: NetCDF19117dataverseImprove file type detection of NetCDF and HDF5https://github.com/IQSS/dataverse/issues/9117NonePVTI_lADOAApNpc4AG11JzgDRcH0ISSUETrue2022-11-22T16:59:21ZNIH: NetCDF19110dataverseNetCDF/HDF5/geospatial discoveryhttps://github.com/IQSS/dataverse/issues/9110NonePVTI_lADOAApNpc4AG11JzgDRcJMISSUEFalseNonepm.f01121dataverse-pmNIH GREI Working Groupshttps://github.com/IQSS/dataverse-pm/issues/21NonePVTI_lADOAApNpc4AG11JzgDRfL0ISSUEFalseNoneD: Dev120dataverse-pmDeliverable: Address Email Operationshttps://github.com/IQSS/dataverse-pm/issues/20NonePVTI_lADOAApNpc4AG11JzgDTUqEISSUEFalseNoneops: Email Issue149dataverse-securitySPF message on Harvard Dataverse Emailshttps://github.com/IQSS/dataverse-security/issues/49NonePVTI_lADOAApNpc4AG11JzgDTVkMISSUEFalseNoneFeature: Metadata17727dataverseAdd import for oai_datacite ("OpenAire") format (this will allow Dataverse to harvest this format too)https://github.com/IQSS/dataverse/issues/7727NonePVTI_lADOAApNpc4AG11JzgDNzzYISSUEFalseNoneNIH OTA: 1.6.1D: OpenDP Integrationpm.f01-d-y01-a06-t0139099dataverseDP Creator Analyst Modehttps://github.com/IQSS/dataverse/issues/9099NIH OTA: 1.6.1PVTI_lADOAApNpc4AG11JzgEJhaoISSUETrue2022-11-30T19:56:42ZNIH OTA: 1.6.1pm.f01-d-y01-a06-t0127715dataverseInclude Signed-urls in the External Tools Frameworkhttps://github.com/IQSS/dataverse/issues/7715NIH OTA: 1.6.1PVTI_lADOAApNpc4AG11JzgDwq4oISSUETrue2023-01-30T19:07:06ZNIH OTA: 1.1.1pm.f01-d-y01-a01-t0129189dataverseWeird property key modification in Bundle.properties file v5.12https://github.com/IQSS/dataverse/issues/9189NIH OTA: 1.1.1PVTI_lADOAApNpc4AG11JzgD7HW0ISSUETrue2022-12-21T17:22:13Z78441Feature: MetadataWorking Group: SWCHERMESNIH OTA: 1.3.1Size: 10pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0277877dataverse7844 codemeta schemahttps://github.com/IQSS/dataverse/pull/7877NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7SE4PULL_REQUESTTrue2022-07-29T14:02:23Zhdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258639dataverseFeature Request/Idea: Add Computational Workflow Metadata and Related Docshttps://github.com/IQSS/dataverse/issues/8639NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0UISSUETrue2022-07-22T19:51:06Zhdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258740dataverseFeature Request/Idea: File type recognition based on filenamehttps://github.com/IQSS/dataverse/issues/8740NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0YISSUETrue2022-07-22T19:51:05Z87401hdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258744dataverseFile Recognition - Add support for files without extensionshttps://github.com/IQSS/dataverse/pull/8744NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0cPULL_REQUESTTrue2022-07-15T20:39:33Zhdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258759dataverseFeature Request/Idea: File type recognition - Add computational workflow file typeshttps://github.com/IQSS/dataverse/issues/8759NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0oISSUETrue2022-07-18T18:13:27Zhdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258754dataverseFeature Request/Idea: Improve ignored files for BagIt handlerhttps://github.com/IQSS/dataverse/issues/8754NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0gISSUETrue2022-07-22T20:48:32Z87871hdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258792dataverseBagIt Support - Improve error messages for BagIt handlerhttps://github.com/IQSS/dataverse/pull/8792NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S00PULL_REQUESTTrue2022-07-29T14:02:23Z86391hdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258812dataverseAdded Computational Workflow metadata and related documentationhttps://github.com/IQSS/dataverse/pull/8812NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S08PULL_REQUESTTrue2022-08-18T19:48:42Z85361hdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258793dataverseAdded new static facet to show metadata blocks with valueshttps://github.com/IQSS/dataverse/pull/8793NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S04PULL_REQUESTTrue2022-07-18T18:13:27Z87541hdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258755dataverseBagIt Support - Improved ignored files for BagIt handlerhttps://github.com/IQSS/dataverse/pull/8755NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0kPULL_REQUESTTrue2022-07-15T20:39:33Z87591hdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258761dataverseFile Recognition - Added computational workflow file typeshttps://github.com/IQSS/dataverse/pull/8761NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0sPULL_REQUESTTrue2022-07-22T20:48:33Zhdc2NIH OTA: 1.3.1pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t0258787dataverseFeature Request/Idea: Improve error messages for BagIt handlerhttps://github.com/IQSS/dataverse/issues/8787NIH OTA: 1.3.1 & : 1.3.2PVTI_lADOAApNpc4AG11JzgD7S0wISSUETrue2023-01-09T16:10:49Z92281Feature: Account & User InfoNIH OTA: 1.7.1 (reArchitecture)Size: 3pm.f01-d-y01-a07-t01pm.f01-d-y01-a07-t0259234dataverse9228 - add OIDC development setup for OIDC login feature testinghttps://github.com/IQSS/dataverse/pull/9234NIH OTA: 1.7.1 & 1.7.2 (reArchitecture)PVTI_lADOAApNpc4AG11JzgEJiyAPULL_REQUESTTrue2023-01-26T20:17:32ZSize: 80pm.f01-d-y01-a04-t01pm.f01-d-y01-a04-t0239231dataverseFeature request: Add the ability to configure a Harvesting Client to add a custom header to OAI callshttps://github.com/IQSS/dataverse/issues/9231NIH OTA: 1.4.1 & 1.4.2PVTI_lADOAApNpc4AG11JzgEQ8jgISSUETrue2023-03-09T16:35:52ZDevOps: Problem19355dataverseSpike: Discover Root cause of GitHub actions stoppage in January (Before the end of February!)https://github.com/IQSS/dataverse/issues/9355NonePVTI_lADOAApNpc4AG11JzgEo4fcISSUEFalseNonepm.f01pm.f01-d-y02-a05-t0124dataverse-pmNIH AIM:5 YR:2 TASK:1 | 2.5.1 | Design and implement usage reports and data citation metrics based on Make Data Counthttps://github.com/IQSS/dataverse-pm/issues/4NonePVTI_lADOAApNpc4AG11JzgFPtw4ISSUEFalseNonepm.f01pm.f01-d-y02-a03-t02215dataverse-pmNIH AIM:3 YR:2 TASK:2 | 2.3.2 | Research and discovery phase for containers and research objects supporthttps://github.com/IQSS/dataverse-pm/issues/15NonePVTI_lADOAApNpc4AG11JzgFioWEISSUEFalseNonepm.f01pm.f01-d-y02-a03-t01216dataverse-pmNIH AIM:3 YR:2 TASK:1  | 2.3.1 | Support biomedical workflowshttps://github.com/IQSS/dataverse-pm/issues/16NonePVTI_lADOAApNpc4AG11JzgFioWIISSUEFalseNonepm.f01pm.f01-d-y01-a06-t0125dataverse-pm6 | 1.6.1 | Integrate with OpenDP tools to support differentially private statistical releases of de-identified data deposited in the repository (in collaboration with the OpenDP.org project, currently partially funded with the Sloan Foundation) | 10https://github.com/IQSS/dataverse-pm/issues/5NonePVTI_lADOAApNpc4AG11JzgFioWoISSUEFalseNonepm.f01pm.f01-d-y01-a02-t0226dataverse-pm2 | 1.2.2 | Define use cases for DDI-CDI support | 5https://github.com/IQSS/dataverse-pm/issues/6NonePVTI_lADOAApNpc4AG11JzgFioWwISSUEFalseNonepm.f01pm.f01-d-y01-a02-t0127dataverse-pm2 | 1.2.1 | Design and implement integration with controlled vocabularies | 5 |https://github.com/IQSS/dataverse-pm/issues/7NonePVTI_lADOAApNpc4AG11JzgFioW8ISSUEFalseNonepm.f01pm.f01-d-y01-a05-t0128dataverse-pm5 | 1.5.1 | Standardize download metrics for the Harvard Dataverse repository following Make Data Counthttps://github.com/IQSS/dataverse-pm/issues/8NonePVTI_lADOAApNpc4AG11JzgFioXAISSUEFalseNonepm.f01pm.f01-d-y01-a06-t0229dataverse-pm6 | 1.6.2 | Discovery phase to support DataTags | 10https://github.com/IQSS/dataverse-pm/issues/9NonePVTI_lADOAApNpc4AG11JzgFioXEISSUEFalseNonepm.f01pm.f01-d-y01-a04-t01210dataverse-pm4 | 1.4.1 | Resolve OAI-PMH harvesting issues | 5https://github.com/IQSS/dataverse-pm/issues/10NonePVTI_lADOAApNpc4AG11JzgFioXQISSUEFalseNonepm.f01pm.f01-d-y01-a03-t01pm.f01-d-y01-a03-t02311dataverse-pm3 | 1.3.1 & 1.3.2 | Support software metadata | 5https://github.com/IQSS/dataverse-pm/issues/11NonePVTI_lADOAApNpc4AG11JzgFioXgISSUEFalseNonepm.f01pm.f01-d-y01-a04-t02212dataverse-pm4 | 1.4.2 | Create working group on packaging standards to share metadata and data across repositories | 5https://github.com/IQSS/dataverse-pm/issues/12NonePVTI_lADOAApNpc4AG11JzgFioXoISSUEFalseNonepm.f01pm.f01-d-y01-a01-t01213dataverse-pm1 | 1.1.1 | Minimum Viable Product (MVP) for registering metadata in the repository and connecting the metadata to the data in the research computing remote storage (NESE), including Globus endpoints | 15https://github.com/IQSS/dataverse-pm/issues/13NonePVTI_lADOAApNpc4AG11JzgFioXwISSUEFalseNonepm.f01pm.f01-d-y01-a07-t01pm.f01-d-y01-a07-t02314dataverse-pm7 | 1.7.1 | & 1.7.2 Re Architecture Effortshttps://github.com/IQSS/dataverse-pm/issues/14NonePVTI_lADOAApNpc4AG11JzgFioX0ISSUEODkFalseFalseMQ32FundedDeliverables2023-03-20T17:43:49Zhttps://github.com/orgs/IQSS/projects/32https://github.com/orgs/IQSS/projectsNIH OTA: 1.5.1

mikeaintworkin commented 1 year ago

I don't know why but there was a random select statement in there.

mikeaintworkin commented 1 year ago

next step - test deletion from the project with sample data by hand.

mikeaintworkin commented 1 year ago

A better example using gh with the graphql api and variables.

list releases with GraphQL

$ gh api graphql -F owner='{owner}' -F name='{repo}' -f query=' query($name: String!, $owner: String!) { repository(owner: $owner, name: $name) { releases(last: 3) { nodes { tagName } } } }

mikeaintworkin commented 1 year ago

The following is the same command run from within the shell scripts using gh and running the same command from the command line.

I chased this for too long.

I'm moving from gh back to using python.f

The IDs in the mutation are for removing: https://github.com/IQSS/dataverse.harvard.edu/issues/75 from the project: FundedDeliverables.

perftest@ubuntu:~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin$ ./project-add_or_remove_issues_or_prs.sh 

# ###########################################################
# /home/perftest/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin
# Begin: ./project-add_or_remove_issues_or_prs.sh
# -----------------------------------------------------------
# ###########################################################
# Begin: ./environment-initialize.sh
RUNLABEL=20230321-200622

RUNDIR=../../run/20230321-200622
RUNINPUTDIR=../../run/20230321-200622/input
RUNOUTPUTDIR=../../run/20230321-200622/output
RUNWRKDIR=../../run/20230321-200622/wrk

WRKINGFILE='datafile'

RELINPUTDIR=../input
RELOUTPUTDIR=../output
RELWRKDIR=../wrk
RELBINDIR=../bin
RELLIBDIR=../lib

LATESTINPUTDIR=../../run/latest/input
LATESTOUTPUTDIR=../../run/latest/output
LATESTWRKDIR=../../run/latest/wrk
# -----------------------------------------------------------
mkdir: created directory '../../run/20230321-200622'
mkdir: created directory '../../run/20230321-200622/input'
mkdir: created directory '../../run/20230321-200622/output'
mkdir: created directory '../../run/20230321-200622/wrk'

# ###########################################################
# Begin: ../lib/clean_local_run_environment.sh
# -----------------------------------------------------------
~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/api/bin ~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin
~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin
# End: ../lib/clean_local_run_environment.sh
#---------------------------
'environment.sh' -> '../../api/bin/environment.sh'
'../wrk/datafile.txt' -> '../../api/bin/../input/datafile.txt'
'../../api/bin/../lib/input_query.graphql' -> '../../api/bin/../input/input_query.graphql'
'../../api/bin/../lib/input_query-mutation.graphql' -> '../../api/bin/../input/input_query-mutation.graphql'
~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/api/bin ~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin

# ###########################################################
# Announcement
# -----------------------------------------------------------
# https://cli.github.com/manual/index
# /home/perftest/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/api/bin
# Begin: ./project-add_or_remove_issues_or_prs.sh
COUNTER: 1
    CMD: gh api graphql -F projectId='PVT_kwDOAApNpc4AG11J' -F itemID='PVTI_lADOAApNpc4AG11JzgC0cQE' -f query='mutation($projectId: ID!, $itemID: ID!) { deleteProjectV2Item( input: { projectId: $projectId itemId: $itemID } ) { deletedItemId } }' 
{
  "errors": [
    {
      "message": "Parse error on \"\\xEF\" (error) at [1, 1]",
      "locations": [
        {
          "line": 1,
          "column": 1
        }
      ]
    }
  ]
}
gh: Parse error on "\xEF" (error) at [1, 1]
perftest@ubuntu:~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin$ gh api graphql -F projectId='PVT_kwDOAApNpc4AG11J' -F itemID='PVTI_lADOAApNpc4AG11JzgC0cQE' -f query='mutation($projectId: ID!, $itemID: ID!) { deleteProjectV2Item( input: { projectId: $projectId itemId: $itemID } ) { deletedItemId } }'
{
  "errors": [
    {
      "type": "INSUFFICIENT_SCOPES",
      "locations": [
        {
          "line": 1,
          "column": 43
        }
      ],
      "message": "Your token has not been granted the required scopes to execute this query. The 'deleteProjectV2Item' field requires one of the following scopes: ['project'], but your token has only been granted the: ['gist', 'read:org', 'read:packages', 'read:project', 'read:user', 'repo', 'workflow', 'write:discussion'] scopes. Please modify your token's scopes at: https://github.com/settings/tokens."
    }
  ]
}
gh: Your token has not been granted the required scopes to execute this query. The 'deleteProjectV2Item' field requires one of the following scopes: ['project'], but your token has only been granted the: ['gist', 'read:org', 'read:packages', 'read:project', 'read:user', 'repo', 'workflow', 'write:discussion'] scopes. Please modify your token's scopes at: https://github.com/settings/tokens.
perftest@ubuntu:~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin$

mikeaintworkin commented 1 year ago

Next step:

Get an expanded token issued.
Test the command line again.
Get this running in python.

I was really excited at first at getting the structure in place with the 2 layer shell script framework. It provided me with some familiar ground to work from. Now I'm at the point where the overhead is getting to be a headache and the cost of staying with what I know versus diving deeper into python seems worth the dive.

mikeaintworkin commented 1 year ago

Looking real quick I found this. https://medium.com/@deboralewis007/a-guide-to-filter-xml-using-xslt-in-python-e8fae05e35fe

mikeaintworkin commented 1 year ago

Resizing this to a 33. This is bigger than I thought.

mikeaintworkin commented 1 year ago

perftest@ubuntu:~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin$ ./project-refresh_flatfile_data.sh 

# ###########################################################
# Begin: ./project-refresh_flatfile_data.sh
# -----------------------------------------------------------
# ###########################################################
# Begin: ./environment-initialize.sh
RUNLABEL=20230322-083601

RUNDIR=../../run/20230322-083601
RUNINPUTDIR=../../run/20230322-083601/input
RUNOUTPUTDIR=../../run/20230322-083601/output
RUNWRKDIR=../../run/20230322-083601/wrk

WRKINGFILE='datafile'

RELINPUTDIR=../input
RELOUTPUTDIR=../output
RELWRKDIR=../wrk
RELBINDIR=../bin
RELLIBDIR=../lib

LATESTINPUTDIR=../../run/latest/input
LATESTOUTPUTDIR=../../run/latest/output
LATESTWRKDIR=../../run/latest/wrk
# -----------------------------------------------------------
mkdir: created directory '../../run/20230322-083601'
mkdir: created directory '../../run/20230322-083601/input'
mkdir: created directory '../../run/20230322-083601/output'
mkdir: created directory '../../run/20230322-083601/wrk'

# ###########################################################
# Begin: ../lib/clean_local_run_environment.sh
# -----------------------------------------------------------
~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/api/bin ~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin
~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin
# End: ../lib/clean_local_run_environment.sh
#---------------------------
'environment.sh' -> '../../api/bin/environment.sh'
~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/api/bin ~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin

# ###########################################################
# Announcement
# -----------------------------------------------------------
# https://cli.github.com/manual/index
# Begin: ./project-fetch_snapshot.sh

# ###########################################################
# Announcement
# -----------------------------------------------------------
# Begin: ./project-fetch_snapshot.sh
# End: ./project-fetch_snapshot.sh
#---------------------------
'../input/empty.txt' -> '../../run/20230322-083601/input/empty.txt'
'../input/input_query.graphql' -> '../../run/20230322-083601/input/input_query.graphql'
'../output/datafile.xml' -> '../../run/20230322-083601/wrk/datafile.xml'
'../output/empty.txt' -> '../../run/20230322-083601/wrk/empty.txt'
~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin

# ###########################################################
# Begin: ../lib/clean_local_run_environment.sh
# -----------------------------------------------------------
~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/transform/bin ~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin
~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin
# End: ../lib/clean_local_run_environment.sh
#---------------------------
'environment.sh' -> '../../transform/bin/environment.sh'
~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/transform/bin ~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin
'../../run/20230322-083601/wrk/datafile.xml' -> '../input/datafile.xml'

# ###########################################################
# Announcement
# -----------------------------------------------------------
# Begin: ./xform_xml_to_flat_file.sh
SaxonJ-HE 11.5 from Saxonica
Java version 20
Stylesheet compilation time: 561.531736ms
Processing file:/home/perftest/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/transform/bin/../input/datafile.xml
Using parser com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser
Building tree for file:/home/perftest/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/transform/bin/../input/datafile.xml using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 98.351167ms
Tree size: 1937 nodes, 20919 characters, 0 attributes
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 1.694105ms
Tree size: 3 nodes, 45 characters, 0 attributes

            WARNING: Unmatched element: root
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.14195ms
Tree size: 3 nodes, 46 characters, 0 attributes

            WARNING: Unmatched element: pages
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.078236ms
Tree size: 3 nodes, 53 characters, 0 attributes

            WARNING: Unmatched element: organization
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.073022ms
Tree size: 3 nodes, 46 characters, 0 attributes

            WARNING: Unmatched element: email
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.144352ms
Tree size: 3 nodes, 43 characters, 0 attributes

            WARNING: Unmatched element: id
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.137422ms
Tree size: 3 nodes, 46 characters, 0 attributes

            WARNING: Unmatched element: login
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.07555ms
Tree size: 3 nodes, 50 characters, 0 attributes

            WARNING: Unmatched element: projectV2
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.259032ms
Tree size: 3 nodes, 47 characters, 0 attributes

            WARNING: Unmatched element: closed
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.076664ms
Tree size: 3 nodes, 49 characters, 0 attributes

            WARNING: Unmatched element: closedAt
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.079395ms
Tree size: 3 nodes, 50 characters, 0 attributes

            WARNING: Unmatched element: createdAt
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.080137ms
Tree size: 3 nodes, 48 characters, 0 attributes

            WARNING: Unmatched element: creator
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.069661ms
Tree size: 3 nodes, 46 characters, 0 attributes

            WARNING: Unmatched element: login
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.071979ms
Tree size: 3 nodes, 43 characters, 0 attributes

            WARNING: Unmatched element: id
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.080904ms
Tree size: 3 nodes, 46 characters, 0 attributes

            WARNING: Unmatched element: items
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.124151ms
Tree size: 3 nodes, 49 characters, 0 attributes

            WARNING: Unmatched element: pageInfo
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.059046ms
Tree size: 3 nodes, 50 characters, 0 attributes

            WARNING: Unmatched element: endCursor
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.060684ms
Tree size: 3 nodes, 52 characters, 0 attributes

            WARNING: Unmatched element: hasNextPage
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.059211ms
Tree size: 3 nodes, 56 characters, 0 attributes

            WARNING: Unmatched element: hasPreviousPage
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.13786ms
Tree size: 3 nodes, 52 characters, 0 attributes

            WARNING: Unmatched element: startCursor
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.060389ms
Tree size: 3 nodes, 47 characters, 0 attributes

            WARNING: Unmatched element: number
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.101063ms
Tree size: 3 nodes, 46 characters, 0 attributes

            WARNING: Unmatched element: title
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.309832ms
Tree size: 3 nodes, 50 characters, 0 attributes

            WARNING: Unmatched element: updatedAt
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.065055ms
Tree size: 3 nodes, 44 characters, 0 attributes

            WARNING: Unmatched element: url
Building tree for (unknown systemId) using class net.sf.saxon.tree.tiny.TinyBuilder
Tree built in 0.05877ms
Tree size: 3 nodes, 52 characters, 0 attributes

            WARNING: Unmatched element: projectsUrl
Execution time: 537.331701ms
Memory used: 11Mb
---
ProjectTitle    ProjectNumber   ProjectID       Status  AssignedSize    Type    IssueNumber     IssueID Title   Repository      Comments        LabelString     closingIssuesReferences OG Queue        Closed  ClosedAt        RUNLABEL        LabelsCount     Type: SuggestionFeature: Metadata        User Role: Curator      User Role: Depositor    NIH OTA: 1.5.1  bklog: NeedsDiscussion  D: 5 Core PIDs  Size: NoSprintCost      pm.f01-d-y01-a05-t01    pm.f01-d-y01-a05-t02    Feature: Harvesting     NIH OTA: 1.1.1  pm.f01-d-y01-a01-t01    hdc     13a      3b      NIH OTA: 1.2.2  pm.f01-d-y01-a02-t02    NIH OTA: 1.2.1  pm.f01-d-y01-a02-t01    Size: 80        Size: 3 NIH OTA DC      spike   Feature: Controlled Vocabulary  pm.f02  NIH: NetCDF     NIH OTA: 1.6.2  pm.f01-d-y01-a06-t02    pm.f01-d-y01-a04-t01    pm.f01-d-y01-a04-t02     pm.epic.nih_harvesting  NIH OTA: 1.4.1  Size: 33        Size: 10        Size: Queued    pm.epic.nih_harvesting_framework        Type: Bug       User Role: Superuser    Testing: API    User Role: Sysadmin     Feature: API Guide      Feature: Code Infrastructure     Feature: File Upload & Handling pm.f01  D: Dev  ops: Email Issue        NIH OTA: 1.6.1  D: OpenDP Integration   pm.f01-d-y01-a06-t01    Working Group: SWC      HERMES  NIH OTA: 1.3.1  pm.f01-d-y01-a03-t01    pm.f01-d-y01-a03-t02    Feature: Account & User Info    NIH OTA: 1.7.1 (reArchitecture)  pm.f01-d-y01-a07-t01    pm.f01-d-y01-a07-t02    DevOps: Problem pm.f01-d-y02-a05-t01    pm.f01-d-y02-a03-t02    pm.f01-d-y02-a03-t01
'FundedDeliverables'    32      'PVT_kwDOAApNpc4AG11J'  ''      NoSprintCost    'ISSUE' 7285    'PVTI_lADOAApNpc4AG11JzgC0cTk'  'Support for Crossref Funder Registry ID'       'dataverse'             'Type: Suggestion','Feature: Metadata','User Role: Curator','User Role: Depositor','NIH OTA: 1.5.1','bklog: NeedsDiscussion','D: 5 Core PIDs','Size: NoSprintCost','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'         ''      True    '2023-03-11T20:43:49Z'  20230322-083601 10      1       1       1       1       1       1       1       1       11
'FundedDeliverables'    32      'PVT_kwDOAApNpc4AG11J'  ''              'ISSUE' 4859    'PVTI_lADOAApNpc4AG11JzgC0cT8'  'Remove the Contributor type "Funder" in Dataverse's citation metadatablock, move that metadata to the Funder Information Agency field' 'dataverse'     'Feature: Harvesting','NIH OTA: 1.5.1','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'             ''      False   'None'  20230322-083601 4                                       1                               1       1       1
'FundedDeliverables'    32      'PVT_kwDOAApNpc4AG11J'  ''              'ISSUE' 5889    'PVTI_lADOAApNpc4AG11JzgC0cT0'  'Align (or merge) DataCite metadata exports'    'dataverse'             'Feature: Metadata','Feature: Harvesting','NIH OTA: 1.5.1','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'         ''      False   'None'  20230322-083601 5               1                       1                               1       1       1
'FundedDeliverables'    32      'PVT_kwDOAApNpc4AG11J'  ''              'ISSUE' 6640    'PVTI_lADOAApNpc4AG11JzgC0cTo'  'Support Research Organization Registry (ROR) IDs'      'dataverse'             'Type: Suggestion','Feature: Metadata','User Role: Curator','User Role: Depositor','NIH OTA: 1.5.1','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'                ''      False   'None'  20230322-083601 7       1       1       1       1       1                               1       1
'FundedDeliverables'    32      'PVT_kwDOAApNpc4AG11J'  ''              'ISSUE' 9123    'PVTI_lADOAApNpc4AG11JzgD7HQU'  'Enhance Globus support for remote endpoints and tape stores'   'dataverse'             'NIH OTA: 1.1.1','pm.f01-d-y01-a01-t01'         ''      False   'None'   20230322-083601 2                                                                                               1       1
'FundedDeliverables'    32      'PVT_kwDOAApNpc4AG11J'  ''              'ISSUE' 7740    'PVTI_lADOAApNpc4AG11JzgC2Kk0'  'Globus: DatasetVersion in dataset level externaltool'  'dataverse'             'NIH OTA: 1.1.1','pm.f01-d-y01-a01-t01'         ''      True    '2022-09-19T17:19:16Z'   20230322-083601 2                                                                                               1       1
'FundedDeliverables'    32      'PVT_kwDOAApNpc4AG11J'  ''              'ISSUE' 7626    'PVTI_lADOAApNpc4AG11JzgC2Kkw'  'Globus: Identify and add configurable button(s) for Upload and Download actions on Dataset page'       'dataverse'             'NIH OTA: 1.1.1','pm.f01-d-y01-a01-t01'          ''      True    '2022-09-19T17:19:16Z'  20230322-083601 2                                                                                               1       1
'FundedDeliverables'    32      'PVT_kwDOAApNpc4AG11J'  ''              'ISSUE' 7524    'PVTI_lADOAApNpc4AG11JzgC2Kks'  'Large file download support'   'dataverse'             'NIH OTA: 1.1.1','pm.f01-d-y01-a01-t01'         ''      True    '2022-09-19T17:19:17Z'  20230322-083601  2                                                                                               1       1
'FundedDeliverables'    32      'PVT_kwDOAApNpc4AG11J'  ''              'ISSUE' 5994    'PVTI_lADOAApNpc4AG11JzgC2Kko'  'External data support: Globus endpoints (deposit and indexing)'        'dataverse'             'NIH OTA: 1.1.1','pm.f01-d-y01-a01-t01'         ''      True     '2022-09-19T17:19:17Z'  20230322-083601 2                                                                                               1       1
---

# End: ./xform_xml_to_flat_file.sh
#---------------------------
'../input/datafile.xml' -> '../../run/20230322-083601/input/datafile.xml'
'../input/empty.txt' -> '../../run/20230322-083601/input/empty.txt'
'../input/xml_to_flat_file-ids.xsl' -> '../../run/20230322-083601/input/xml_to_flat_file-ids.xsl'
'../output/datafile.txt' -> '../../run/20230322-083601/wrk/datafile.txt'
'../output/empty.txt' -> '../../run/20230322-083601/wrk/empty.txt'
'../output/datafile.txt' -> '../../run/20230322-083601/output/datafile.txt'
'../output/empty.txt' -> '../../run/20230322-083601/output/empty.txt'
~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin
# ###########################################################
# Begin: ../lib/latest_run-update.sh
# -----------------------------------------------------------
'../../run/20230322-083601/input/datafile.xml' -> '../../run/latest/input/datafile.xml'
'../../run/20230322-083601/input/empty-20230322-083601.txt' -> '../../run/latest/input/empty-20230322-083601.txt'
'../../run/20230322-083601/input/empty.txt' -> '../../run/latest/input/empty.txt'
'../../run/20230322-083601/input/environment.sh' -> '../../run/latest/input/environment.sh'
'../../run/20230322-083601/input/input_query.graphql' -> '../../run/latest/input/input_query.graphql'
'../../run/20230322-083601/input/xml_to_flat_file-ids.xsl' -> '../../run/latest/input/xml_to_flat_file-ids.xsl'
'../../run/20230322-083601/output/datafile.txt' -> '../../run/latest/output/datafile.txt'
'../../run/20230322-083601/output/empty-20230322-083601.txt' -> '../../run/latest/output/empty-20230322-083601.txt'
'../../run/20230322-083601/output/empty.txt' -> '../../run/latest/output/empty.txt'
'../../run/20230322-083601/wrk/datafile.txt' -> '../../run/latest/wrk/datafile.txt'
'../../run/20230322-083601/wrk/datafile.xml' -> '../../run/latest/wrk/datafile.xml'
'../../run/20230322-083601/wrk/empty-20230322-083601.txt' -> '../../run/latest/wrk/empty-20230322-083601.txt'
'../../run/20230322-083601/wrk/empty.txt' -> '../../run/latest/wrk/empty.txt'
# End: ./project-refresh_flatfile_data.sh
#---------------------------
perftest@ubuntu:~/DevCode/github-com-mreekie/GitHubProjects/experimentsWithGithub/main/bin$

mikeaintworkin commented 1 year ago

Now copy the xml file into a text editor. I don't know why but I need to do this. Paste into libreoffice calc.

mikeaintworkin commented 1 year ago

Cut down the data. Eliminate anything with labels using autofilter:

f.01
f.02
D:...
pm.epic

This cuts down the input from 87 to 53 Paste these into the input file.

project_snapshot-FundedDeliverables-timestamp.txt

Looks like this:

Status  AssignedSize    Type    IssueNumber Title   Repository  Comments    LabelString closingIssuesReferences OG Queue    Closed  ClosedAt    RUNLABEL    LabelsCount Type: Suggestion    Feature: Metadata   User Role: Curator  User Role: Depositor    NIH OTA: 1.5.1  bklog: NeedsDiscussion  D: 5 Core PIDs  Size: NoSprintCost  pm.f01-d-y01-a05-t01    pm.f01-d-y01-a05-t02    Feature: Harvesting NIH OTA: 1.1.1  pm.f01-d-y01-a01-t01    hdc 1   3a  3b  NIH OTA: 1.2.2  pm.f01-d-y01-a02-t02    NIH OTA: 1.2.1  pm.f01-d-y01-a02-t01    Size: 80    Size: 3 NIH OTA DC  spike   Feature: Controlled Vocabulary  pm.f02  NIH: NetCDF NIH OTA: 1.6.2  pm.f01-d-y01-a06-t02    pm.f01-d-y01-a04-t01    pm.f01-d-y01-a04-t02    pm.epic.nih_harvesting  NIH OTA: 1.4.1  Size: 33    Size: 10    Size: Queued    pm.epic.nih_harvesting_framework    Type: Bug   User Role: Superuser    Testing: API    User Role: Sysadmin Feature: API Guide  Feature: Code Infrastructure    Feature: File Upload & Handling pm.f01  D: Dev  ops: Email Issue    NIH OTA: 1.6.1  D: OpenDP Integration   pm.f01-d-y01-a06-t01    Working Group: SWC  HERMES  NIH OTA: 1.3.1  pm.f01-d-y01-a03-t01    pm.f01-d-y01-a03-t02    Feature: Account & User Info    NIH OTA: 1.7.1 (reArchitecture) pm.f01-d-y01-a07-t01    pm.f01-d-y01-a07-t02    DevOps: Problem pm.f01-d-y02-a05-t01    pm.f01-d-y02-a03-t02    pm.f01-d-y02-a03-t01
''      'ISSUE' 4859    'Remove the Contributor type "Funder" in Dataverse's citation metadatablock, move that metadata to the Funder Information Agency field' 'dataverse'     'Feature: Harvesting','NIH OTA: 1.5.1','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'        ''  False   'None'  20230322-074748 4                   1               1   1   1
''      'ISSUE' 5889    'Align (or merge) DataCite metadata exports'    'dataverse'     'Feature: Metadata','Feature: Harvesting','NIH OTA: 1.5.1','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'        ''  False   'None'  20230322-074748 5       1           1               1   1   1
''      'ISSUE' 6640    'Support Research Organization Registry (ROR) IDs'  'dataverse'     'Type: Suggestion','Feature: Metadata','User Role: Curator','User Role: Depositor','NIH OTA: 1.5.1','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'       ''  False   'None'  20230322-074748 7   1   1   1   1   1               1   1

mikeaintworkin commented 1 year ago

Left off:

I am working through parsing the input file correctly in where each line is a list, and each entry on the line is a dictonary using the labels for the input file as keys. I know I'm working up to using a python library but I need to get through this.

I started with chatgpt but I need to understand what it wrote.

project_snapshot-FundedDeliverables-timestamp.tsv github-mutation_via_graphql.py

mikeaintworkin commented 1 year ago

DONE! It worked awesome!

Sample input file:

ProjectTitle    ProjectNumber   ProjectID   Status  AssignedSize    Type    IssueNumber IssueID Title   Repository  Comments    LabelString closingIssuesReferences OG Queue    Closed  ClosedAt    RUNLABEL    LabelsCount Type: Suggestion    Feature: Metadata   User Role: Curator  User Role: Depositor    NIH OTA: 1.5.1  bklog: NeedsDiscussion  D: 5 Core PIDs  Size: NoSprintCost  pm.f01-d-y01-a05-t01    pm.f01-d-y01-a05-t02    Feature: Harvesting NIH OTA: 1.1.1  pm.f01-d-y01-a01-t01    hdc 1   3a  3b  NIH OTA: 1.2.2  pm.f01-d-y01-a02-t02    NIH OTA: 1.2.1  pm.f01-d-y01-a02-t01    Size: 80    Size: 3 NIH OTA DC  spike   Feature: Controlled Vocabulary  pm.f02  NIH: NetCDF NIH OTA: 1.6.2  pm.f01-d-y01-a06-t02    pm.f01-d-y01-a04-t01    pm.f01-d-y01-a04-t02    pm.epic.nih_harvesting  NIH OTA: 1.4.1  Size: 33    Size: 10    Size: Queued    pm.epic.nih_harvesting_framework    Type: Bug   User Role: Superuser    Testing: API    User Role: Sysadmin Feature: API Guide  Feature: Code Infrastructure    Feature: File Upload & Handling pm.f01  D: Dev  ops: Email Issue    NIH OTA: 1.6.1  D: OpenDP Integration   pm.f01-d-y01-a06-t01    Working Group: SWC  HERMES  NIH OTA: 1.3.1  pm.f01-d-y01-a03-t01    pm.f01-d-y01-a03-t02    Feature: Account & User Info    NIH OTA: 1.7.1 (reArchitecture) pm.f01-d-y01-a07-t01    pm.f01-d-y01-a07-t02    DevOps: Problem pm.f01-d-y02-a05-t01    pm.f01-d-y02-a03-t02    pm.f01-d-y02-a03-t01
'FundedDeliverables'    32  'PVT_kwDOAApNpc4AG11J'  ''      'ISSUE' 4859    'PVTI_lADOAApNpc4AG11JzgC0cT8'  'Remove the Contributor type "Funder" in Dataverse's citation metadatablock, move that metadata to the Funder Information Agency field' 'dataverse'     'Feature: Harvesting','NIH OTA: 1.5.1','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'        ''  False   'None'  'TEST'  4   0   0   0   0   1   0   0   0   1   1   1   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
'FundedDeliverables'    32  'PVT_kwDOAApNpc4AG11J'  ''      'ISSUE' 5889    'PVTI_lADOAApNpc4AG11JzgC0cT0'  'Align (or merge) DataCite metadata exports'    'dataverse'     'Feature: Metadata','Feature: Harvesting','NIH OTA: 1.5.1','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'        ''  False   'None'  'TEST'  5   0   1   0   0   1   0   0   0   1   1   1   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0
'FundedDeliverables'    32  'PVT_kwDOAApNpc4AG11J'  ''      'ISSUE' 6640    'PVTI_lADOAApNpc4AG11JzgC0cTo'  'Support Research Organization Registry (ROR) IDs'  'dataverse'     'Type: Suggestion','Feature: Metadata','User Role: Curator','User Role: Depositor','NIH OTA: 1.5.1','pm.f01-d-y01-a05-t01','pm.f01-d-y01-a05-t02'       ''  False   'None'  'TEST'  7   1   1   1   1   1   0   0   0   1   1   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0   0

For output I just printed out the returned information

-------------
  'PVT_kwDOAApNpc4AG11J', 'PVTI_lADOAApNpc4AG11JzgDNyuM'
<pages>
  <deleteProjectV2Item>
    <deletedItemId>PVTI_lADOAApNpc4AG11JzgDNyuM</deletedItemId>
  </deleteProjectV2Item>
</pages>
-------------

thisaintwork / experimentsWithGithub

Retrieve a list of all issues in the funded planning project, then remove all from the project that are not labelled with pm.f01 or pm.f02 #26

list releases with GraphQL