kevmo314 / codec-from-scratch

Build a simple video encoder from scratch
Apache License 2.0
282 stars 11 forks source link

Now I would love to learn more about H.264 frames! #1

Open oliverpool opened 1 year ago

oliverpool commented 1 year ago

Thank you for this great didactic exercise!!!

If you are looking for other video-related experiments, I would suggest digging into H.264 frames: I had some struggles myself with them: https://github.com/oliverpool/tello-webrtc-fpv#h264-streaming Here is my dirty workaround: https://github.com/oliverpool/tello-webrtc-fpv/blob/master/tello.go#L65-L90

I think it could be a nice demo with a H.264+WebRTC (I have no idea how feasible such demo is).

kevmo314 commented 1 year ago

Thanks, glad you enjoyed it! Yes, I think building H264 from scratch is my next goal. It's definitely feasible to build something compact as a learning exercise, but I need to figure out how to structure the lessons incrementally so it's not too overwhelming. H264 is still a rather complex beast. :)

H264 + WebRTC is definitely demoable, however doing WebRTC from scratch probably isn't. WebRTC I think is a lot more complex than H264 and pion does a good job of at least simplifying it somewhat.