[HUDI-8520] DROP INDEX & SHOW INDEX should work with index name instead of index partition name

[lokeshj1703]

Change Logs

spark-sql (default)> drop index idx_rider on hudi_table;
24/11/13 16:14:25 ERROR SparkSQLDriver: Failed in [drop index idx_rider on hudi_table]
org.apache.hudi.exception.HoodieSecondaryIndexException: Secondary index not exists: idx_rider
    at org.apache.hudi.index.secondary.SecondaryIndexManager.drop(SecondaryIndexManager.java:145)
    at org.apache.spark.sql.hudi.command.DropIndexCommand.run(IndexCommands.scala:83)
    at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:75)

Drop index is not working using index name currently. It requires full name with prefix in order to drop the index. This PR aims to fix it so that index can be dropped using the index name itself. Also the PR adds a fix so that show index works for both secondary and functional index.

Impact

NA

Risk level (write none, low medium or high below)

low

Documentation Update

NA

Contributor's checklist

• [ ] Read through contributor's guide
• [ ] Change Logs and Impact were stated clearly
• [ ] Adequate tests were added if applicable
• [ ] CI passed

[lokeshj1703]

@vinothchandar I have restored the old secondary index files. Could not think of a good package to move them to. These are the only files in location hudi-common/src/main/java/org/apache/hudi/index/secondary though.

[hudi-bot]

CI report:

• 8dc68ce21dacf18f28c51ac6b894c3fb85301d83 Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build

[codope]

The failing test Test Secondary Index With Updates Compaction Clustering Deletes is flaky on master. It is tracked in HUDI-8549. Going to merge this PR.