The label "Login using Facebook" is set in the language file for the module. For English, you can find that:
language/en-GB/en-GB.mod_jfbclogin.ini
Find the line:
LOGIN USING FACEBOOK=Login using Facebook
Then change the right hand side to whatever you want. You can make the right side blank if you want no text (Leave the left capitalized side)
Hope this helps!