When I lived in The Netherlands and spoke Portuguese (with an accent from Portugal) on the phone, sometimes people asked me “What Eastern European language is that?”.
Of course that confusion only ever arises for people who are not familiar with neither Portuguese nor Slavic languages.
That said, Portuguese with a Brasilian accent totally doesn’t sound like some undefined EE language, since consonants aren’t spoken anywhere as hard as with a Portuguese accent.