8 Ways to Prevent Ageism in Artificial Intelligence
a. Include older consumers in the design of A.I. technologies.
b. Hire age-diverse individuals for data science teams.
c. Conduct age-inclusive data collection.
d. Invest in digital infrastructure and digital literacy.
e. Give older consumers the right to consent and contest.
f. Work alongside governance frameworks and regulations.
g. Stay up to date on the new uses of A.I. and how to avoid bias.
h. Create robust ethics processes.
averaging the weights of multiple models fine-tined with different hyperparameter configurations often improves accuracy and robustness (so-called model soup)
Models trained from pre-trained weights make similar mistakes on target domain, have similar features and are surprisingly close in l2-distance in parameter space (same basin of the loss landscape), whereas models from random initialization don’t.
Weight averaging along a single training trajectory has previously shown to improve the performance of the model trained from random initialization
model soup composed of ViT-G became new SOTA, while requiring 25% fewer FLOPs at inference time
Amongst uniform, greedy, learned model soup, the greedy soup is the central method.