You can install Git Bash for Windows and start from there. It gives you a shell that emulates POSIX behavior (although don’t expect WSL levels of seamlessness), and is enough for simple Git usage. OpenSSH and Git and Vim all work similarly, albeit a bit janky.
But even then there are quite some SSH-related workflow stoppers in Windows, particularly when you use Git LFS. Git LFS haven’t fixed the problem where you get multiple password prompts (I usually get 4~5) just to push/pull anything. The overall workflow is painful if you’re self-hosting and avoiding using any services from Github.