cair / tmu

Implements the Tsetlin Machine, Coalesced Tsetlin Machine, Convolutional Tsetlin Machine, Regression Tsetlin Machine, and Weighted Tsetlin Machine, with support for continuous features, drop clause, Type III Feedback, focused negative sampling, multi-task classifier, autoencoder, literal budget, and one-vs-one multi-class classifier. TMU is written in Python with wrappers for C and CUDA-based clause evaluation and updating.
https://pypi.org/project/tmu/
MIT License
126 stars 13 forks source link

AutoEncoder has stopped learning #54

Closed olegranmo closed 10 months ago

olegranmo commented 10 months ago

Here is the incorrect output after one epoch:

awful: brilliant(0.93) scary(0.92) horrifying(0.91) witty(0.91) car(0.90) superb(0.90) crap(0.90) abysmal(0.90) funny(0.90) magnificent(0.90) hilarious(0.90) frightening(0.89) lousy(0.89) outstanding(0.89) terrible(0.89) marvellous(0.89) comic(0.88) cars(0.88) plane(0.88) truck(0.87) terrifying(0.87) excellent(0.86) motorcycle(0.85)
terrible: comic(0.93) horrifying(0.93) marvellous(0.92) truck(0.92) magnificent(0.92) superb(0.92) abysmal(0.91) excellent(0.91) brilliant(0.90) funny(0.90) terrifying(0.90) outstanding(0.90) hilarious(0.90) witty(0.90) car(0.89) frightening(0.89) lousy(0.89) cars(0.89) plane(0.89) awful(0.89) motorcycle(0.88) scary(0.88) crap(0.86)
lousy: comic(0.94) horrifying(0.93) hilarious(0.92) magnificent(0.92) cars(0.92) brilliant(0.92) frightening(0.91) funny(0.91) outstanding(0.91) excellent(0.91) abysmal(0.91) superb(0.91) truck(0.90) scary(0.90) plane(0.89) car(0.89) awful(0.89) terrible(0.89) marvellous(0.89) crap(0.88) witty(0.88) terrifying(0.88) motorcycle(0.87)
abysmal: comic(0.93) frightening(0.93) horrifying(0.92) witty(0.92) outstanding(0.92) plane(0.92) truck(0.91) cars(0.91) terrible(0.91) excellent(0.91) lousy(0.91) funny(0.90) car(0.90) magnificent(0.90) brilliant(0.90) hilarious(0.90) marvellous(0.90) superb(0.90) awful(0.90) crap(0.89) motorcycle(0.89) terrifying(0.89) scary(0.87)
crap: excellent(0.92) hilarious(0.91) witty(0.91) comic(0.90) brilliant(0.90) awful(0.90) funny(0.90) abysmal(0.89) frightening(0.89) cars(0.89) plane(0.89) outstanding(0.89) scary(0.89) magnificent(0.88) lousy(0.88) horrifying(0.88) car(0.87) superb(0.87) terrible(0.86) truck(0.85) terrifying(0.84) marvellous(0.84) motorcycle(0.84)
outstanding: comic(0.95) magnificent(0.94) excellent(0.94) brilliant(0.92) superb(0.92) witty(0.92) horrifying(0.92) terrifying(0.92) truck(0.92) plane(0.92) abysmal(0.92) funny(0.92) marvellous(0.91) lousy(0.91) hilarious(0.90) scary(0.90) terrible(0.90) frightening(0.90) cars(0.89) crap(0.89) awful(0.89) car(0.88) motorcycle(0.87)
brilliant: witty(0.94) excellent(0.94) awful(0.93) cars(0.93) motorcycle(0.92) outstanding(0.92) scary(0.92) horrifying(0.92) magnificent(0.92) comic(0.92) lousy(0.92) superb(0.91) car(0.91) marvellous(0.91) funny(0.90) hilarious(0.90) crap(0.90) terrible(0.90) abysmal(0.90) truck(0.90) plane(0.90) terrifying(0.89) frightening(0.89)
excellent: outstanding(0.94) brilliant(0.94) comic(0.94) truck(0.93) magnificent(0.93) plane(0.93) horrifying(0.93) witty(0.93) crap(0.92) marvellous(0.92) superb(0.92) cars(0.91) funny(0.91) motorcycle(0.91) scary(0.91) hilarious(0.91) abysmal(0.91) lousy(0.91) terrible(0.91) terrifying(0.90) frightening(0.90) car(0.89) awful(0.86)
superb: magnificent(0.95) marvellous(0.94) horrifying(0.93) outstanding(0.92) comic(0.92) funny(0.92) witty(0.92) excellent(0.92) cars(0.92) truck(0.92) terrible(0.92) plane(0.91) hilarious(0.91) brilliant(0.91) scary(0.91) lousy(0.91) terrifying(0.91) awful(0.90) abysmal(0.90) frightening(0.89) motorcycle(0.89) crap(0.87) car(0.86)
magnificent: comic(0.95) superb(0.95) horrifying(0.95) outstanding(0.94) funny(0.94) terrifying(0.94) witty(0.93) excellent(0.93) scary(0.92) lousy(0.92) brilliant(0.92) truck(0.92) terrible(0.92) marvellous(0.91) cars(0.91) plane(0.91) abysmal(0.90) frightening(0.90) awful(0.90) hilarious(0.89) car(0.89) crap(0.88) motorcycle(0.86)
marvellous: truck(0.94) superb(0.94) horrifying(0.93) scary(0.93) comic(0.92) plane(0.92) funny(0.92) excellent(0.92) terrible(0.92) cars(0.91) magnificent(0.91) outstanding(0.91) motorcycle(0.91) witty(0.91) brilliant(0.91) car(0.91) abysmal(0.90) frightening(0.90) terrifying(0.89) hilarious(0.89) lousy(0.89) awful(0.89) crap(0.84)
truck: marvellous(0.94) comic(0.93) excellent(0.93) scary(0.93) witty(0.93) plane(0.92) car(0.92) horrifying(0.92) funny(0.92) magnificent(0.92) outstanding(0.92) terrible(0.92) superb(0.92) abysmal(0.91) cars(0.91) lousy(0.90) frightening(0.90) brilliant(0.90) terrifying(0.90) motorcycle(0.88) awful(0.87) hilarious(0.86) crap(0.85)
plane: horrifying(0.93) excellent(0.93) truck(0.92) frightening(0.92) marvellous(0.92) outstanding(0.92) abysmal(0.92) superb(0.91) witty(0.91) magnificent(0.91) comic(0.91) funny(0.90) brilliant(0.90) scary(0.89) lousy(0.89) cars(0.89) car(0.89) crap(0.89) hilarious(0.89) terrible(0.89) motorcycle(0.89) terrifying(0.88) awful(0.88)
car: funny(0.93) truck(0.92) comic(0.92) witty(0.92) brilliant(0.91) scary(0.91) marvellous(0.91) abysmal(0.90) cars(0.90) horrifying(0.90) awful(0.90) frightening(0.89) lousy(0.89) plane(0.89) terrible(0.89) magnificent(0.89) excellent(0.89) hilarious(0.89) outstanding(0.88) motorcycle(0.88) terrifying(0.87) crap(0.87) superb(0.86)
cars: comic(0.93) brilliant(0.93) funny(0.92) lousy(0.92) superb(0.92) witty(0.92) excellent(0.91) abysmal(0.91) marvellous(0.91) magnificent(0.91) truck(0.91) horrifying(0.90) car(0.90) scary(0.89) outstanding(0.89) plane(0.89) motorcycle(0.89) crap(0.89) frightening(0.89) terrible(0.89) hilarious(0.88) awful(0.88) terrifying(0.86)
motorcycle: brilliant(0.92) excellent(0.91) marvellous(0.91) horrifying(0.90) frightening(0.89) terrifying(0.89) abysmal(0.89) cars(0.89) superb(0.89) plane(0.89) comic(0.88) terrible(0.88) truck(0.88) hilarious(0.88) witty(0.88) car(0.88) outstanding(0.87) funny(0.87) lousy(0.87) magnificent(0.86) scary(0.85) awful(0.85) crap(0.84)
scary: funny(0.93) marvellous(0.93) truck(0.93) witty(0.92) awful(0.92) brilliant(0.92) magnificent(0.92) horrifying(0.91) excellent(0.91) car(0.91) superb(0.91) frightening(0.91) comic(0.91) lousy(0.90) outstanding(0.90) terrifying(0.90) cars(0.89) plane(0.89) crap(0.89) terrible(0.88) hilarious(0.87) abysmal(0.87) motorcycle(0.85)
frightening: abysmal(0.93) horrifying(0.93) plane(0.92) terrifying(0.91) lousy(0.91) comic(0.91) witty(0.91) scary(0.91) truck(0.90) marvellous(0.90) excellent(0.90) outstanding(0.90) magnificent(0.90) motorcycle(0.89) hilarious(0.89) car(0.89) awful(0.89) crap(0.89) superb(0.89) cars(0.89) terrible(0.89) funny(0.89) brilliant(0.89)
terrifying: magnificent(0.94) outstanding(0.92) comic(0.92) frightening(0.91) superb(0.91) excellent(0.90) terrible(0.90) truck(0.90) scary(0.90) marvellous(0.89) motorcycle(0.89) abysmal(0.89) brilliant(0.89) horrifying(0.89) witty(0.89) lousy(0.88) plane(0.88) funny(0.88) car(0.87) awful(0.87) hilarious(0.86) cars(0.86) crap(0.84)
horrifying: magnificent(0.95) marvellous(0.93) plane(0.93) frightening(0.93) excellent(0.93) superb(0.93) lousy(0.93) terrible(0.93) comic(0.92) truck(0.92) brilliant(0.92) abysmal(0.92) funny(0.92) witty(0.92) outstanding(0.92) scary(0.91) hilarious(0.91) awful(0.91) cars(0.90) motorcycle(0.90) car(0.90) terrifying(0.89) crap(0.88)
funny: comic(0.95) magnificent(0.94) car(0.93) scary(0.93) truck(0.92) marvellous(0.92) superb(0.92) cars(0.92) horrifying(0.92) witty(0.92) outstanding(0.92) excellent(0.91) lousy(0.91) hilarious(0.91) brilliant(0.90) abysmal(0.90) plane(0.90) terrible(0.90) crap(0.90) awful(0.90) frightening(0.89) terrifying(0.88) motorcycle(0.87)
comic: outstanding(0.95) funny(0.95) magnificent(0.95) lousy(0.94) excellent(0.94) abysmal(0.93) truck(0.93) cars(0.93) terrible(0.93) witty(0.92) horrifying(0.92) marvellous(0.92) car(0.92) brilliant(0.92) superb(0.92) terrifying(0.92) hilarious(0.91) frightening(0.91) plane(0.91) scary(0.91) crap(0.90) motorcycle(0.88) awful(0.88)
hilarious: lousy(0.92) witty(0.92) superb(0.91) comic(0.91) excellent(0.91) crap(0.91) horrifying(0.91) funny(0.91) brilliant(0.90) outstanding(0.90) abysmal(0.90) awful(0.90) terrible(0.90) magnificent(0.89) frightening(0.89) marvellous(0.89) plane(0.89) car(0.89) cars(0.88) motorcycle(0.88) scary(0.87) truck(0.86) terrifying(0.86)
witty: brilliant(0.94) magnificent(0.93) truck(0.93) excellent(0.93) comic(0.92) scary(0.92) outstanding(0.92) superb(0.92) abysmal(0.92) horrifying(0.92) cars(0.92) car(0.92) hilarious(0.92) funny(0.92) frightening(0.91) plane(0.91) marvellous(0.91) crap(0.91) awful(0.91) terrible(0.90) terrifying(0.89) lousy(0.88) motorcycle(0.88)