[Build Embeddings] Save index config, md5 and add test to check integrity

[shifucun]

• Removed old preindex/duplicate files and keep all input files simply under 'input' directory.
• Re-built all indexes to generate the index_config.yaml and md5sum.txt in the embeddings output gcs folder.