I have several text files that have partially intersecting contents. I want to combine them in the manner to have all contents in one file, but have as little duplicates as possible. This tool not has to process all files at once, I'll be satisfied with processing file pairs one by one.
The main problem is when I'm using tools like Compare++ or SmartSynchronize and kdiff3 they are trying to overwrite some blocks in one file with blocks from other, while other times, just add blocks, as needed. Most of times they even correctly find place where text must be inserted.
Thought files are large, I'm even ready to merge them in manual mode, but I lack the function that allows me to add the block from, say, right panel to left panel instead of replacing it. Some blocks "recommended" for replace make some sense, others seem random.
I don't want to replace one string to another when they are completely different, I want to have both those strings in resulting file!
For sure, the tool must be as 'smart' as possible in detecting places for insertion. Because lines of text may be arranged arbitrary, in the next case
A B
B C
C A
the tool must not treat A from right panel as diff and must clearly understand, that it is the same A as in left panel.
Platform is Windows.
Is there good tool to find (almost) duplicate blocks inside a single file? Like having some "fuzziness" preset, allowing blocks to differ by N symbols.
edit