search

codewars / runner

Issue tracker for Code Runner
34 stars 8 forks source link

Add libraries for Data Driven Testing #47

Open suic86 opened 8 years ago

suic86 commented 8 years ago

Feature

Add libraries for data driven testing e. g. ddt in Python.

Rationale

  1. More diversified testing environment supporting multiple types/styles of testing.
  2. IMO: Simplifying kata craeation and translation: One can create/convert a data structure without writing/copying a lot of boilerplate code.
jhoffner commented 8 years ago

I'm not 100% sure yet what this is yet, but this may be a feature for the CLI

the-zebulan commented 8 years ago

@suic86 ,

That seems like a neat library, thanks for the link.

I've been playing around with Hypothesis on a few personal projects. I keep thinking how it could be useful for Codewars Python tests too. Adding a decorator to a test.assert_equals for random tests might help one get rid of one of the classic Codewars beta issues... "needs random tests".

suic86 commented 8 years ago

@jhoffner

You're right it's for cli :) Can I migrate this to the CLI issue list? If not, I'm going to close this and re-raise the feature request there.

@the-zebulan

Nice one! This reminds me of QuickCheck in Haskell which is supported on Codewars. However, I've had hard times with it. :) I agree that something like hypotheses could help with random tests. There would be nice to have some random test functionality in the standard codewars test framework as random tests involve too much boilerplate code.

the-zebulan commented 8 years ago

@suic86 ,

You are absolutely right, I believe it is based on Haskell's QuickCheck.

_This is often called property based testing, and was popularised by the Haskell library Quickcheck._

I have only recently started to use it on some small projects so you probably have much more experience with property based testing. I'll have to try using ddt soon to compare the two for my own understanding.