Generally if you're running into speed issues, the first thing we'd recommend is disabling the profile import, like you've done. If the problem persists, it almost always indicates a server configuration issue that's adding extra delay.
The most common issue in that case is when IPv6 is mis-configured. The initial request to Facebook tries to go out on IPv6, times out, and then IPv4 is fallen back to and is quick.
To test this, I'd recommend checking out
this post
. There's a code change in that file that will disable IPv6 checks *for Facebook*. The file to edit is /administrator/components/com_jfbconnect/assets/facebook-api/base_facebook.php file, around line 177 (that's mentioned a few posts up from the one I linked to).
Hopefully that change will get Facebook going for you.. but either way, let us know, as knowing that will help us determine how to fix other social networks, if necessary.
Thanks,
Alex