Out of nowhere when I look at my imported csv I see Greek alphabet (as seen in the example image).
- The csv file itself is in Latin, encoding shouldn't be the problem
- In the RStudio options I have English language
- When I copy the text and paste it, its in Latin alphabet again

So the solution was to install "Dejavu Sans" font.