No matter what medium you create in, or how isolated you may feel, there's always going to be a certain level of influence upon your work. Picasso's greatest influence was supposedly El Greco, Beethoven was influenced by Mozart, The Beatles admitted that they were influenced by people like Smokey Robinson and Chuck Berry, though you can't hear it in their work. Who are your greatest influences? Do you feel guilty when you sense their style coming out, or do you think it's only natural and nothing to be concerned about?
I think it's perfectly fine for someone to be influenced, and I say, don't fight it. First of all, we see a little bit of ourselves in them, and then we emulate, and then we compare. They did the same thing, and so did everyone else before them. It's like parenting, we need structure and guidance in the creative world so that we can feel free, later on, to break the rules and to create on our own. We need to know that our ideas aren't ridiculous, that someone else found a way to make them work.
I would never suggest copying another writer or artist. But I would suggest emulating their style if it fits yours. We all need mentors. Pick the best and allow yourself to learn from their greatness.