Reorg the package dependency

[hixichen]

Change the dependency package to minimum size. Please add less dependencies as you can in the future.