The ampersand: its history, name and when to use & in APA

Where the & came from, why it is called an ampersand, whether it was the 27th letter, and when APA, Harvard and MLA write & or and.