Integration support

[gopi77]

Hi

I would like to integrate the NRS module into latest video codec like MPEG5 EVC for exploration. Do you have any guidelines / integration methods available?

Best Gopi. J

[IVC-Projects]

Hi Gopi, Our NRS was originally implemented in HM. I actually know little about EVC. But if EVC adopts similar in-loop filtering structure of HM, it will not be too difficult.

Thanks, DandanDing

@.***

From: Gopi Jayaraman Date: 2022-11-07 14:33 To: IVC-Projects/NRS CC: Subscribed Subject: [IVC-Projects/NRS] Integration support (Issue #1) Hi I would like to integrate the NRS module into latest video codec like MPEG5 EVC for exploration. Do you have any guidelines / integration methods available? Best Gopi. J — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you are subscribed to this thread.Message ID: @.***>

[gopi77]

Hi DandanDing

Thanks for your response. HM is also a good starting point for me. Please let me know if you have the HM integrated workspace available for exploration.

Best Gopi. J

[IVC-Projects]

Hi Gopi, The Hm workspace is not released currently. I think it is not difficult to incorporate the CNN model into HM in the in-loop filtering and referece frame part, the key of which is to call the python model in HM. The model training is a little sophisticated. For example, for the EnhNet, progressive training is required.

Best, Dandan

@.***

From: Gopi Jayaraman Date: 2022-11-07 15:57 To: IVC-Projects/NRS CC: Dandan Ding; Comment Subject: Re: [IVC-Projects/NRS] Integration support (Issue #1) Hi DandanDing Thanks for your response. HM is also a good starting point for me. Please let me know if you have the HM integrated workspace available for exploration. Best Gopi. J — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

[iacrob]

Dear Dandan Ding I chair the MPAI-EVC group that aims to improve video codecs with deep learning. Currently, as Gopi told you, we are working on MPEG's Essential Video Coding. We have read your approach and think there is a lot of potential to improve Essential Video Coding as well. We would like to invite you to a meeting to present your approach and, if possible, we would like to ask the HM implementation and support for further integration and exploration, to speed up the porting of the EVC codec. Please let us know.

[IVC-Projects]

Hi Iacrob and Gopi, Thanks again for your interest in our work. I also noticed that MPAI is developping many interesting tools on top of EVC for higher coding efficiency. On my side, it is my pleasure to introduce our approach in detail; but for the HM implementation, I cannot release the code without the allowance of my supervisor Prof. Ma, who is one of the authors of NRS. BTW, we have also published lots of work on AI-based in-loop filters and end-to-end AI coding, which I think is very suitable for AI-based coding.
But before sharing the details, I would like to know how you deal with the parents involved in these techniques.

Best, Dandan

@.***

From: iacrob Date: 2022-11-30 19:29 To: IVC-Projects/NRS CC: Dandan Ding; Comment Subject: Re: [IVC-Projects/NRS] Integration support (Issue #1) Dear Dandan Ding I chair the MPAI-EVC group that aims to improve video codecs with deep learning. Currently, as Gopi told you, we are working on MPEG's Essential Video Coding. We have read your approach and think there is a lot of potential to improve Essential Video Coding as well. We would like to invite you to a meeting to present your approach and, if possible, we would like to ask the HM implementation and support for further integration and exploration, to speed up the porting of the EVC codec. Please let us know. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

[iacrob]

Dear Dandan Ding thank you for your reply! Thank you for your willingness to present your approach in detail. If you agree, it would be a pleasure to have you and your supervisor at our next MPAI meeting on 14 December at 14UTC (I will circulate the Zoom link). It would be very nice if you would also present your other work on AI-based in-loop filters and end-to-end AI coding. Also, we could discuss the patents involved in the process. Best regards rob

[IVC-Projects]

Hi Iacrob, I will invite Prof. Ma to see whether he is free then. May I ask the exact time on Dec. 14 because we have time difference then. Also, I can prepare my slide in advance to introduce the detailed NRS.

Best, Dandan

@.***

From: iacrob Date: 2022-11-30 21:31 To: IVC-Projects/NRS CC: Dandan Ding; Comment Subject: Re: [IVC-Projects/NRS] Integration support (Issue #1) Dear Dandan Ding thank you for your reply! Thank you for your willingness to present your approach in detail. If you agree, it would be a pleasure to have you and your supervisor at our next MPAI meeting on 14 December at 14UTC (I will circulate the Zoom link). It would be very nice if you would also present your other work on AI-based in-loop filters and end-to-end AI coding. Also, we could discuss the patents involved in the process. Best regards rob — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

[iacrob]

Dear Dandan the meeting will be held at 14 UTC (Universal Time). Unfortunately I cannot publicly share the link to the Zoom meeting, cloud I get your email? Best Regards, rob

[IVC-Projects]

Dear Iacrob, My email is @.***

Thanks Dandan

@.***

From: iacrob Date: 2022-12-01 21:20 To: IVC-Projects/NRS CC: Dandan Ding; Comment Subject: Re: [IVC-Projects/NRS] Integration support (Issue #1) Dear Dandan the meeting will be held at 14 UTC (Universal Time). Unfortunately I cannot publicly share the link to the Zoom meeting, cloud I get your email? Best Regards, rob — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

[iacrob]

Dear Dandan github has masked your e-mail and so I cannot read it. I don't know how to exchange our emails. This is my linkedin: https://www.linkedin.com/in/roberto-iacoviello-8117913/ Best Regards, rob

[iacrob]

Dear Dandan, my mail is roberto punto iacoviello chicciola rai punto it Could you please send me your mail so I can send you the link for the meeting? Th meeting is planned for the 14th of December. rob

[IVC-Projects]

Hi Rob, It seems that there is some probem iwth the git because I sent you my email address days ago, apparently, you didn't receive it. Hope this time we can get in touch with each other.

Best, Dandan

@.***

From: iacrob Date: 2022-12-12 23:47 To: IVC-Projects/NRS CC: Dandan Ding; Comment Subject: Re: [IVC-Projects/NRS] Integration support (Issue #1) Dear Dandan, my mail is roberto punto iacoviello chicciola rai punto it Could you please send me your mail so I can send you the link for the meeting? Th meeting is planned for the 14th of December. rob — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>