The player who controlled Barishi when it left the battlefield is the player who controls the ability. It doesn't matter whose graveyard Barishi is put into.

If Barishi isn't in your graveyard by the time the ability resolves, you still shuffle all creature cards from your graveyard into your library.