Introducing FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models.
Support three distinct scenarios: Heterogeneous, Homogeneous and One-to-One
Support LLM to SLM one-way knowledge transfer
Introducing InferDPT: Privacy-preserving Inference for Black-box Large Language Models. InferDPT leverages differential privacy (DP) to facilitate privacy-preserving inference for large language models.
Introducing FATE-LLM Evaluate: to evaluate FATE-LLM models in few lines with Python SDK or simple CLI commands, built-in cases included.
Major Features and Improvements