I Want to remove repeating rows from text file

Asked By ShaheenIqbal20 110 points N/A Posted on - 07/16/2011

Respected members,

I have 92 MB text file and here is many rows that repeats and i want to remove repeating rows for this. I download this software from internet "Remove (Delete) Duplicate Lines & Words In Multiple Text Files S.exe" but this is not registered you tell me from where i can download its registered version or tell me other solution which you think this is best. If you provide me any software then that software should be registered.

Requirements:

1) Provide me registered version software if you can't provide registered version of this software you don't give answer.

2) Provide me some video tutorial or snapshot tutorial about its usage.

Regards.

• Status: Open
• Question Views: 1076
• Answer Count: 1
• Vote Up 0 Vote Down

• Answer Accepted: No
• Question Category: Web

Answered By WsaENoTsoCK 5 points N/A #83669

I Want to remove repeating rows from text file

I'm going to assume that you are using Windows.

In windows there is a batch file scripting function. Therefore there is not need for a program to solve your problem.

 

Instead create a new file with the following codes:

 

@echo off

setlocal

if {%1} EQU {} goto syntax

if not exist %1 goto syntax

set file=%1

set file="%file:"=%"

set work=%TEMP%%~nx1

set work="%work:"=%"

set work=%work:\=%

sort %file% /O %work%

del /f /q %file%

for /f "Tokens=*" %%s in ('type %work%') do set record=%%s&call :output 

endlocal

goto :EOF

:syntax

@echo ***************************

@echo Syntax: SortDup Input_File 

@echo ***************************

endlocal

goto :EOF

:output

if not defined prev_rec goto write

if "%record%" EQU "%prev_rec%" goto :EOF

:write

@echo %record%>>%file%

set prev_rec=%record%

 

Save it as "SortDup.bat".

 

To use it, place it in the same folder as the text file that you wish to edit. Then open the command prompt, go into the location of the file is and type the following:

 

SortDup.bat somefile.txt

 

Replace somefile.txt with the text file name.

About WsaENoTsoCK

Questions
0

Answers
8

Best Answers
3

• Vote Up 0 Vote Down

• Posted on - 07/22/2011
• Question Category: Web