LargeFishPKU / Joint-KG-Vision-Project

0 stars 0 forks source link

Facet Method #5

Open LargeFishPKU opened 4 years ago

LargeFishPKU commented 4 years ago

Experiment Results of Different Vectors

method backbone text_vector 5-way 5-shot
ProtoNet ResNet_10 None 73.24% +-0.63%
ProtoNet_facet ResNet_10 FastText 73.52% +- 0.62%
ProtoNet_facet ResNet_10 Glove 74.10% +- 0.67%
ProtoNet_facet ResNet_10 Google 73.86% +- 0.52%
ProtoNet_facet ResNet_10 BERT_16_mask 74.43% +- 0.68%
ProtoNet_facet ResNet_10 BERT_32_mask 74.46% +- 0.67%
ProtoNet_facet ResNet_10 BERT_64_mask 75.24% +- 0.62%
ProtoNet_facet ResNet_10 BERT_100_mask 74.81% +- 0.68%
LargeFishPKU commented 4 years ago

Comparison with Other Methods

Method Backbone Type 5-way 1-shot 5-way 5-shot
MAML Conv-64 Meta 48.70+- 1.75 63.15+-0.91
LEO WAR-28 Meta 61.76+-0.08 77.59+-0.12
MTL ResNet12 Meta 61.20+-1.80 75.50+-0.80
MetaOptNet-SVM ResNet12 Meta 62.64+-0.61 78.63+-0.46
Matching Net Conv-64 Metric 43.56+-0.84 55.31+-0.73
ProtoNet Conv-64 Metric 49.42+-0.78 68.20+-0.66
RelationNet Conv-64 Metric 50.44+-0.82 65.32+-0.70
ProtoNet ResNet12 Metric 56.52+-0.45 74.28+-0.20
TADAM ResNet12 Metric 58.50+-0.30 76.70+-0.38
CMT ResNet18 Metric 64.12+-0.82 80.51+-0.13
TapNet ResNet12 Metric 61.65+-0.15 76.36+-0.10
AM3(ProtoNet) ResNet12 Metric 62.11+-0.39 74.72+-0.64
AM3(ProtoNet++) ResNet12 Metric 65.21+-0.49 75.20+-0.36
TRAML(ProtoNet) ResNet12 Metric 60.31+-0.48 77.94+-0.57
FEAT ResNet12 Metric 66.78 82.05
ours(ProtoNet) ResNet12 Metric 63.06+-0.46 77.82+-0.67
ours(ProtoNet) ResNet18 Metric 64.27+-0.62 80.42+-0.68