System.IO and System.Directory functions not Unicode-aware under Windows

[shu]

Under Windows, System.Directory.getDirectoryContents seems to apply encoding conversions on filenames at the syscall level.

I have several files with Japanese names, but my default program locale is English. Unicode-aware applications (that is, most modern Windows programs) have no problems with this. Calling getDirectoryContents on a folder with Japanese names, however, returns strings consisted of question marks "???".

If I switch the default program locale to, say, Japanese, then the files are returned in ShiftJIS, but I lose information such as accented Latin characters.

[YitzGale]

This is a more general problem - summary changed to reflect that.

See detailed discussion in this thread:  http://www.haskell.org/pipermail/haskell-cafe/2009-June/062795.html

Besides getDirectoryContents, at least the following functions also need to be fixed, because they are ACP-only:

openFile c_stat c_chmod c_SearchPath c_SHGetFolderPath

[YitzGale]

This change needs to be coordinated with #3308 ("getArgs should return Unicode on Windows") so that it will still work to read a file path from the command line and use it to access files.

See also #3307 ("System.IO and System.Directory functions not Unicode-aware under Unix").

[simonmar]

I have done openFile, getDirectoryContents, and everything that uses c_stat.

libraries/base:

Thu Jun 18 06:54:58 PDT 2009  Simon Marlow <marlowsd@gmail.com>
  * Windows: Unicode openFile and stat functions

libraries/Win32:

Thu Jun 18 03:19:31 PDT 2009  Simon Marlow <marlowsd@gmail.com>
  * add findFirstFile, findNextFile, findClose

libraries/directory:

Thu Jun 18 06:48:58 PDT 2009  Simon Marlow <marlowsd@gmail.com>
  * Windows: Unicode getDirectoryContents and setPermissions

[simonmar]

These changes are now complete.

libraries/Win32:

Mon Jun 29 03:47:50 PDT 2009  Simon Marlow <marlowsd@gmail.com>
  * add SHGetFolderPath support

libraries/directory:

Mon Jun 29 04:26:04 PDT 2009  Simon Marlow <marlowsd@gmail.com>
  * move Win32 SearchPath and SHGetFolderPath into the Win32 package