If you go to the edf web site, you can create a ID and password for yourself to give you access to the client area(click the question mark next to the box marked 'identifiant'). You will need the long account number from your bill to set this up. Once done, you can go to 'espace client' and pay directly. Bon chance
Call EDF (number on the bill you received) and give them your bank details (R.I.B.), they will debit you automatically. You can find your R.I.B. in your checkbook. Keep a copy of it as it is asked for often in auto payments.
If you currently live outside France you might have trouble phoning because a lot of utility companies now use freephone numbers and these will not work from outside the country. We had this with Orange for our landline.
To set up internet access we needed to follow a link in an email. The link did not work because the security settings on the site would not allow access from a foreign server. The other alternative was to sign in using the customer account no., which was in the mailbox in France. The customer service phone number did not work.
Eventually our landlord was able to plead emergency and get the postman to open our mailbox so he could get our customer number off the bill. Not ideal.
Signing in from a foreign server is fine, by the way.
I suggest you consider a French bank account. You could fund that directly or through a money transfer service and use it to pay all of your new house bills.
I found Credit Agricole in my area to be fine. I understand they have a BRITLINE account you could use to get English speaking support. I didn't bother just went to my local branch and opened an account there.