Which OS X version do you use? As I explained in my Mac 64-bit client FAQ (link in my sig below), the client now needs to compile the shaders every time, instead of caching them on disk. If you're still on 10.9 Mavericks, consider upgrading.
Controller usage in the Mac client is officially still in a beta state, as is noted in the corresponding UI menu. So there's bound to be some issues for the time being. My own experiments proved to be unsuccessful, as OS X tended to forget the Bluetooth pairing with the PS3 controller I had available.