I'm studying Computer Science and have completed both a coding bootcamp and fantastic programs like The Odin Project and FreeCodeCamp. Now, I have a project idea that involves video and sound, but I'm unsure about where to start. I want to understand how video and sound encoding and decoding work, as well as how to send this information across a network. I'm really keen on grasping the concepts rather than just using existing libraries. Any suggestions on how to kick things off?
4 Answers
Don't forget to leverage Google and AI tools for quick answers or further learning resources. Also, what programming language are you considering for your project?
Consider starting with a library that suits your project needs. Once you get comfortable with it, you can refactor parts or even replace them with your own implementations. Keep your project scope manageable to avoid feeling overwhelmed.
It's a great idea to start with learning about codecs and streaming protocols. I found that diving into compression was crucial for working effectively with audio and video.
If your goal is to really understand how audio and video systems function, begin with the fundamentals. Learning how PCM audio works and how video frames are stored is key. Once you grasp these basics, get hands-on by building simple encoders and decoders to understand compression. After that, you can explore networking to send audio or video data effectively. This way, tools like FFmpeg will make more sense as you’ll have real-world context to compare your understanding against.

Totally agree! But make sure you are clear about how deep you want to go with your learning. If you're using languages like JavaScript or Python, you can still build interesting streaming experiments and grasp essential concepts, but for a deeper understanding, consider moving to lower-level languages eventually.