-
Impressive work on the innovative data selection method!
I recently finished reading your paper. I'm particularly curious about the computation of the gradient projection. In your paper, you mention…
-
After skimming through the code, I cannot find the relevant part of gradient projection as Eq. 1 in the paper.
If it's my carelessness, could you please help me figure it out?
-
Hi, I've read your latest journal work `Gradient Projection For Continual Parameter-Efficient Tuning` and confused about your deduction.
How to get the equation
$$
y_t=W_t^d x_t=W_{t+1}^d x_…
-
Hi there,
I am trying to calculate the gradient of a DG solution I obtained from example 14.
My initial thought was to project the gradient using a `GradientGridFunctionCoefficient` onto an RT spa…
-
https://github.com/JingyangQiao/prompt-gradient-projection/blob/c566b81f1abb19f8350da3fb71149ca9b8061a13/dualprompt-pgp/prompt.py#L120-L123
I want to know if directly performing a reshape here is i…
-
I was wondering if there are any plans to support gradient flow back to biases that are added to the score function. For instance, if I add a scalar to the: score + b where b is coming from a learnabl…
-
Feature request for the Gradient Low-Rank Projection (GaLore) optimizer.
The GaLore optimizer computes low-rank gradients way to dramatically reduce memory. The ArXiv paper is [here](https://arxiv.…
-
Thank you for your work!
I wonder, are there any advantages to using FlatQuant in W4A16(perchannel+symmetric) compared to GPTQ(w. act_order)/AWQ, is FlatQuant still SOTA? For down_proj's quantization…
-
### October 2024 >
- [ ] short term
- [x] look into gradients again
- [ ] publish notebooks (field projection + photonic crystal)
- [x] Update Readme including how to use jax / pyto…
-
Hello, I found that 2DGS may reconstruct some very cluttered areas poorly. If you observe the distribution pattern of the point cloud, the point cloud in these areas is very sparse. The original 3DGS …