Closed danfowler closed 7 years ago
Install the pre-release version of Good Tables: pip install --pre goodtables
pip install --pre goodtables
Then run:
goodtables datapackage https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/datapackage.json
By default, this tests the first 1000 lines of the dataset.
DATASET ======= {'error-count': 0, 'table-count': 10, 'time': 9.036, 'valid': True} TABLE [1] ========= {'datapackage': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/datapackage.json', 'error-count': 0, 'headers': ['Time', 'Unix', 'Aggregate', 'Appliance1', 'Appliance2', 'Appliance3', 'Appliance4', 'Appliance5', 'Appliance6', 'Appliance7', 'Appliance8', 'Appliance9'], 'row-count': 1000, 'source': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/data/House_1.csv', 'time': 7.219, 'valid': True} TABLE [2] ========= {'datapackage': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/datapackage.json', 'error-count': 0, 'headers': ['Time', 'Unix', 'Aggregate', 'Appliance1', 'Appliance2', 'Appliance3', 'Appliance4', 'Appliance5', 'Appliance6', 'Appliance7', 'Appliance8', 'Appliance9'], 'row-count': 1000, 'source': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/data/House_10.csv', 'time': 7.293, 'valid': True} TABLE [3] ========= {'datapackage': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/datapackage.json', 'error-count': 0, 'headers': ['Time', 'Unix', 'Aggregate', 'Appliance1', 'Appliance2', 'Appliance3', 'Appliance4', 'Appliance5', 'Appliance6', 'Appliance7', 'Appliance8', 'Appliance9'], 'row-count': 1000, 'source': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/data/House_11.csv', 'time': 7.375, 'valid': True} TABLE [4] ========= {'datapackage': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/datapackage.json', 'error-count': 0, 'headers': ['Time', 'Unix', 'Aggregate', 'Appliance1', 'Appliance2', 'Appliance3', 'Appliance4', 'Appliance5', 'Appliance6', 'Appliance7', 'Appliance8', 'Appliance9'], 'row-count': 1000, 'source': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/data/House_12.csv', 'time': 7.379, 'valid': True} TABLE [5] ========= {'datapackage': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/datapackage.json', 'error-count': 0, 'headers': ['Time', 'Unix', 'Aggregate', 'Appliance1', 'Appliance2', 'Appliance3', 'Appliance4', 'Appliance5', 'Appliance6', 'Appliance7', 'Appliance8', 'Appliance9'], 'row-count': 1000, 'source': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/data/House_13.csv', 'time': 7.202, 'valid': True} TABLE [6] ========= {'datapackage': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/datapackage.json', 'error-count': 0, 'headers': ['Time', 'Unix', 'Aggregate', 'Appliance1', 'Appliance2', 'Appliance3', 'Appliance4', 'Appliance5', 'Appliance6', 'Appliance7', 'Appliance8', 'Appliance9'], 'row-count': 1000, 'source': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/data/House_15.csv', 'time': 7.324, 'valid': True} TABLE [7] ========= {'datapackage': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/datapackage.json', 'error-count': 0, 'headers': ['Time', 'Unix', 'Aggregate', 'Appliance1', 'Appliance2', 'Appliance3', 'Appliance4', 'Appliance5', 'Appliance6', 'Appliance7', 'Appliance8', 'Appliance9'], 'row-count': 1000, 'source': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/data/House_16.csv', 'time': 7.268, 'valid': True} TABLE [8] ========= {'datapackage': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/datapackage.json', 'error-count': 0, 'headers': ['Time', 'Unix', 'Aggregate', 'Appliance1', 'Appliance2', 'Appliance3', 'Appliance4', 'Appliance5', 'Appliance6', 'Appliance7', 'Appliance8', 'Appliance9'], 'row-count': 1000, 'source': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/data/House_17.csv', 'time': 7.365, 'valid': True} TABLE [9] ========= {'datapackage': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/datapackage.json', 'error-count': 0, 'headers': ['Time', 'Unix', 'Aggregate', 'Appliance1', 'Appliance2', 'Appliance3', 'Appliance4', 'Appliance5', 'Appliance6', 'Appliance7', 'Appliance8', 'Appliance9'], 'row-count': 1000, 'source': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/data/House_18.csv', 'time': 7.29, 'valid': True} TABLE [10] ========= {'datapackage': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/datapackage.json', 'error-count': 0, 'headers': ['Time', 'Unix', 'Aggregate', 'Appliance1', 'Appliance2', 'Appliance3', 'Appliance4', 'Appliance5', 'Appliance6', 'Appliance7', 'Appliance8', 'Appliance9'], 'row-count': 1000, 'source': 'https://s3-eu-west-1.amazonaws.com/frictionlessdata.io/pilots/pilot-dm4t/data/House_19.csv', 'time': 7.327, 'valid': True}
It's valid! :+1:
🎉
Install the pre-release version of Good Tables:
pip install --pre goodtables
Then run:
By default, this tests the first 1000 lines of the dataset.