C помощью программки App.merge можно объединять, за одно и дубли удаляются:

http://home.btconnect.com/md5decrypter/App.Merge.zip

Command format:

App.Merge.exe o="output-file.txt" t=4 [options] ... "word-list1.txt" "word-list2.lst" "directory1" ...

o=[out-file] - Output file.

t=[threads] - Used to speed sorting up only.

c=[mem] - Used to control how much RAM memory to use in MB. Default is 1024. Capped at 3072.

min=[num] - Minimum word length. Default = 1

max=[num] - Maximum word length. Default = 4096.