Remove configuration reference from variant feature flag

[zhiyuanliang-ms]

Before stablizing variant feature flag, we want to drop configuration_reference because it doesn't work well with language like python and JS.