Will Being with the Poor Turns you to Poor as well?

Its true that making friendship with the poor will turn you to poor. Right from the day beginning problems, sorrows and more are the main reasons for being poor. Money is lost if we are with a financially poor man, character is lost by being with a characterless man and even education or knowledge is lost by being with a knowledge less man.
Hence its many times said that we should always be with people above our abilities.