Here is a guild finding website that you can search specifically for faction and server.
If your looking for Xbox One NA Server with The Ebonheart Pact I invite you join The Neighborhood Watch, send message to x302x or MountedBeast for Invite or reply with GT.
Join The Neighborhood Watch and cleanse the roads of Cyrodiil in the name of the Ebonheart Pact on Xbox One. Send message to GT: x3o2x or Mountedbeast for invite