I didn’t even realize I was pushing all my (uncountable) git directories when FTP’ing. But Filezilla appears not to have a default filter for git directories. Luckily it’s easy to create one:
In Filezilla 3.5.3 go to View > Filename filters… and add a filter with the following settings:
Done, happy FTP’ing!