John F. Kennedy Shakes hands with Father Richard J. Casey after attending Mass at Holy Trinity Church.
On March 4, 1933, the pre-swearing in service of Franklin D. Roosevelt set a precedent that has been followed by Presidents ever since. Franklin Roosevelt was not the first President to attend church on Inauguration Day, however. In 1789, George Washington attended a service at St. Paul's Chapel in New York City immediately following his swearing-in ceremony.
President-elect John F. Kennedy shakes hands with Father Richard J. Casey, the Pastor, after attending Mass at Holy Trinity Church prior to inauguration ceremonies, January 20, 1961 (Library of Congress).
Library of Congress. Prints and Photographs Division. Reproduction number: LC-USZ62-70671 (b&w film copy neg). http://inaugural.senate.gov/history/daysevents/morningworshipservice.cfm