I had a couple of files show up in a project that weren’t utf-8 encoded and needed to be converted. In the past, I found detecting encoding and converting from one encoding to another to be an arcane and challenging task. This morning it only took a few tries on Google and, a few superuser.com answers later, I was good to go.
I was quickly able to determine that the CSV file in question was encoded with
utf-16le by using the following command:
Converting to UTF-8
Converting the file to a new encoding was just as easy:
The commands above were sourced from the following superuser questions and accepted answers: