You can also set your operating system keyboard input layout to include all the grammatical punctuation. My keyboard is set to English (United States - International). It takes a little getting used to but I like it much more. I feel like I'm actually functioning in French rather than pretending. In my OS it's: Control Panel->Regional and Language Options->Language->Details->Add. At this point select English- US International, apply->ok->apply. Your system may be different, but this should help.
For example, when you want to insert accents use "apostrophe e" for é, "apostrophe c" for ç, "` a" for à, "shift 6 e" for ê, etc. Search for a full explanation of all the functions of the international keyboard if you decide to use it. You don't have to hold anything down between apostrophe and e to get é. The only catch is, to write "C'est" instead of "Cést" you have to press the space bar after the apostrophe, otherwise your keyboard will interpret the apostrophe e as é. The same goes for quotation marks which might accidentally come out ë if you don't add the extra space.