Do it.

If you think shoving two lives into one is impossible, then let me assure you, it is possible.
If you believe sacrificing one life for another is the only option, then let me assure you, there are probably other options.
If you think the secrets you scribble about from those deepest dreams, those most sacred corners of the mind that convention screams are "unrealistic" will be legible in 20 years, let me assure you, they fade and tatter.
If you read a person from a first impression, then you're missing the story.
We all have something else pulsing beneath the surface.

I met a woman who dreams of farming but reality limits her space to a city apartment.  She researched her options and joined a community garden where she spends every evening now with both hands in the dirt, growing plants, meeting neighbors, and setting roots down where she's planted for now.  She takes pictures of her growing tomatoes and marks their progress like we mark children's growth on door frames.  

This life is short.  Make it glorious.  Spill your guts out into the world and make an effort, every day, to take a chance towards what you're dreaming.  Don't trip over your own excuses or justify the obstacles.  Just make an effort, however small.
I tip my hat to you for trying.