[NEW PROJECT]: Unify and speed up testing framework

[alejoe91]

Project title: Unify and speed up testing

Key Investigators

• Alessio Buccino
• Chris Halcrow @chrishalcrow
• Ramon Mayorquin @h-mayorquin

Project Description

SpikeInterface implements a large and diverse set of tests at the module level. While testing routines have been growing steadily as the package developed, there are certain behaviors that require some refactoring. As an example, many test functions use custom cache folders for saving temporary files, other use pytest fixtures.

With this project, we aim to use the latest testing tools to clean up and speed up testing and CI.

Objectives

The goal of this project is to review and modify the SpikeInterface tests to be more consistent and lightweight.

Approach and Plan

• [ ] Review existing test functions and identify old patterns that needs to be updated
• [ ] Identify and move fixtures that can be used at the package level and shared across modules

Progress

• [ ] Make PR to SpikeInterface

[paulrignanese]

upvote ! I'd be happy to help with that :)

[h-mayorquin]

Maybe finally add windows and the mac runners to the CI? Or should this be a project of their own?

[h-mayorquin]

Also, @chrishalcrow , mentioned that he had some difficultes just getting to run the tests to beging with. We should address those so running tests locally is more straighforward. I believe that the main culprit is probably datalad but @chrishalcrow

[Ashkees]

This project sounds great and I would love to help. My understanding is that it would be good for someone like me who is mostly an end-user and has spent little time with the core code - is that the case?

[zm711]

Maybe finally add windows and the mac runners to the CI? Or should this be a project of their own?

I haven't got datalad+git-annex working on my Mac. So if you figure out a mac runner I would be eternally grateful. Will have my mac at the conference so we can test things locally first if needed and I think @chrishalcrow also has a mac.

[chrishalcrow]

This project sounds great and I would love to help. My understanding is that it would be good for someone like me who is mostly an end-user and has spent little time with the core code - is that the case?

Hello! Yes, you're right - examining and improving tests is a great way to get to know the code better, especially when you're not too familiar with it :) Come join us!

[chrishalcrow]

Maybe finally add windows and the mac runners to the CI? Or should this be a project of their own?

I haven't got datalad+git-annex working on my Mac. So if you figure out a mac runner I would be eternally grateful. Will have my mac at the conference so we can test things locally first if needed and I think @chrishalcrow also has a mac.

I'm currently on Mac, but will hopefully have all the OSs by the conference! I'll try and figure out what my problems are before the hackathon!