Repository cleanup

[yfukai]

• Removing unused files and lines.
• enabling isort autoflake again and organizing imports.

[tdmorello]

Can we remove asv config since we are not using it at the moment?

[yfukai]

I think I already removed it for this PR. If we need the config, we can come back and check it out again. How does it sound for you?