How can I create a Linux-based AWS Lambda layer on a Windows machine?

I've recently started working with AWS and built my first Lambda function using Python 3.13. I've read that I can include dependencies through layers. My current process involves creating a virtual environment locally, installing the necessary packages, and then copying them into a 'python' folder at the root of a zip file. I've seen suggestions that I should also add my lambda_function.py to the root of the zip, but I'm not sure why that's necessary. Do I need to update the layer zip every time I modify the function code? Although it worked for most packages without the lambda_function.py, I'm facing issues with the cryptography package. The error I keep getting is: 'cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)'. I've read that cryptography is dependent on the architecture of the machine it's built on, which complicates things since I can't just package it on my Windows machine for use in Lambda's Linux environment. Is there a method to create a Linux-compatible layer on Windows? I'd prefer not to dive into Docker if I can avoid it, but I'm open to suggestions! Thanks for any guidance!