Creating a Linux-Compatible AWS Lambda Layer on Windows

I'm new to AWS and have started building my first Lambda function using Python 3.13. I learned that I can include libraries by using layers. So far, I've set up layers by creating a virtual environment, installing the necessary packages, and copying the package folders into a "python" directory at the root level of a zip file. However, I noticed some guidance suggesting I should also include my lambda_function.py in the root of this zip, which confuses me. Do I need to update the layer zip every time I modify my function code? While it worked for most of my packages without including lambda_function.py, I'm facing issues with the 'cryptography' package and receiving the error about importing 'exceptions' from 'cryptography.hazmat.bindings._rust'. From my research, it seems 'cryptography' relies on my local architecture, which complicates things since I'm on Windows and need to create a Linux-based layer for Lambda. Is there a way to build this layer on a Windows machine, or do I need to use Docker? Any clarity on this would be greatly appreciated!