In the 1850 census of Rutherford Co. TN, William J. Lytle was listed as an innkeeper. The following is his census entry showing the listing of people enumerated there.
| Name | Age | Gender | Occupation | Value of Real Estate | Place of Birth |
|---|---|---|---|---|---|
| William J. Lytle | 38 | M | Inn Keeper | $3000 | TN |
| Mary Lytle | 33 | F | TN | ||
| Micha? W. Smith | 16 | F | TN | ||
| Robert J. Smith | 28 | M | Bar Keep | TN | |
| Henryetta Thompson | 19 | F | TN | ||
| Virginia S. Reeves | 5 | F | TN | ||
| Robert Hatton | 55 | M | Methodis E. Preacher | KY | |
| Margarett Hatton | 50 | F | TN | ||
| Margarett Hatton | 16 | F | TN | ||
| Biley Payton | 6 | M | TN | ||
| W. H. Lytle | 22 | M | Physician | TN | |
| Levinia Lytle | 19 | F | TN | ||
| Thomas Walsh | 35 | M | Dentist | KY | |
| Anne E. Walsh | 21 | F | TN | ||
| Catherine Walsh | 1 | F | TN | ||
| William A. Reed | 29 | M | Merchant | TN | |
| Martha Reed | 20 | F | TN | ||
| Wm. Reed | 1 | M | TN | ||
| Joseph Caran | 39 | M | Dancing Master | Ohio | |
| Robert Cary | 28 | M | VA | ||
| Seth Suttle | 34 | M | Clerk | VA | |
| S. P. Crista | 42 | M | Merchant | $25 | KY |
| Saml Parker | 45 | M | Note Shaver | TN | |
| James M. Avant | 33 | M | Lawyer | $700 | AL |
| Isaac Miller | 55 | M | Note Shaver | VA | |
| John M. Knight | 31 | M | Merchant | TN | |
| Joseph Spence | 24 | M | Merchant | TN | |
| A. T. Reeves | 30 | M | County Register | TN | |
| James Seales? | 28 | M | Clerk | TN | |
| John McCrary | 26 | M | Clerk | Ireland | |
| John Gordan | 24 | M | Clerk | TN | |
| Jacob Carrols | 30 | M | Stage Driver | TN | |
| _____ (sic) Hale | 26 | M | Stage Driver | TN | |
| James Yearwood | 29 | M | Stage Driver | TN | |
| Thomas Barkley | 21 | M | Stage Driver | TN |