Clean html source file

[darioit]

It's possible clean html file from:

H:\www.google.com\list.html:<a href="//http://cdimage.debian.org/debian-cd/6.0.6/i386/iso-cd/debian-6.0.6-i386-CD-1.iso" target="_blank">http://cdimage.debian.org/debian-cd/6.0.6/i386/iso-cd/debian-6.0.6-i386-CD-1.iso.html</a>
H:\www.google.com\list.html:<a href="//http://cdimage.debian.org/debian-cd/6.0.6/i386/iso-cd/debian-6.0.6-i386-CD-2.iso" target="_blank">http://cdimage.debian.org/debian-cd/6.0.6/i386/iso-cd/debian-6.0.6-i386-CD-2.iso.html</a>

to:

http://cdimage.debian.org/debian-cd/6.0.6/i386/iso-cd/debian-6.0.6-i386-CD-1.iso
http://cdimage.debian.org/debian-cd/6.0 ... 6-CD-2.iso

Regards
Dario

[abc0502]

Is it only like that or this is just a sample of the html file?

If you accept using 3rd Party tool, You can Use the Regular Expressions with SED to do that.
or Consider another language like python with the help of "BeautifulSoup" library

[darioit]

what I need is exactly like that example, but with many line

I can use also Sed or awk to manipulate string

[abc0502]

If it as you say just like this but has many lines, it can be done by using only batch files, but just a question,
is this words "H:\www.google.com\list.html:" part of the content of the html file or not ?

and is it in one line, i mean each two lines from the above are one line?

[abc0502]

This code Assumes that each two lines are in fact one.

Change the location of the file variable "2nd line" to match the location of your file.

Code: Select all

@echo off
Set "file=D:\test\file.txt"
Setlocal EnableDelayedExpansion
For /F "tokens=2 delims= " %%a in ('TYPE "%file%"') Do (
   Set "line=%%a"
   Echo !line:~8,-1!>>Modified_list.txt
   )
pause

Here we use the space as a delims and then remove the first 8 characters and the last quote sign.
and will generate a list of the link in a txt file in the same location the batch file exist.

[darioit]

If it as you say just like this but has many lines, it can be done by using only batch files, but just a question,
is this words "H:\www.google.com\list.html:" part of the content of the html file or not ?

and is it in one line, i mean each two lines from the above are one line?

It's a source of code "H:\www.google.com\list.html" before I made a

findstr.exe "\<iso*" C:\http_source.txt > list.txt

[darioit]

This code Assumes that each two lines are in fact one.

Change the location of the file variable "2nd line" to match the location of your file.

Code: Select all

@echo off
Set "file=D:\test\file.txt"
Setlocal EnableDelayedExpansion
For /F "tokens=2 delims= " %%a in ('TYPE "%file%"') Do (
   Set "line=%%a"
   Echo !line:~8,-1!>>Modified_list.txt
   )
pause

Here we use the space as a delims and then remove the first 8 characters and the last quote sign.
and will generate a list of the link in a txt file in the same location the batch file exist.

Sorry my goal is to clean this raw

H:\www.google.com\list.html:<a href="//http://cdimage.debian.org/debian-cd/6.0.6/i386/iso-cd/debian-6.0.6-i386-CD-1.iso" target="_blank">http://cdimage.debian.org/debian-cd/6.0.6/i386/iso-cd/debian-6.0.6-i386-CD-1.iso.html</a>

to this:

http://cdimage.debian.org/debian-cd/6.0 ... 6-CD-1.iso

without

H:\www.google.com\list.html:<a href="

and without

" target="_blank">http://cdimage.debian.org/debian-cd/6.0.6/i386/iso-cd/debian-6.0.6-i386-CD-1.iso.html</a>

But the problem is not the fix position, the lenght could change in each line

[darioit]

Now is better

call clean.bat fileinp.txt fileout.txt

Code: Select all

@echo off
Set "file=%1"
Setlocal EnableDelayedExpansion
For /F "tokens=2 delims= " %%a in ('TYPE "%file%"') Do (
   Set "line=%%a"
   Echo !line:~6,-1!>>%2
   )
pause

Thanks to all
Regards
Dario

[foxidrive]

This free tool is useful to extract URLS:

Geturls.exe

Version 1.0, Copyright (C)2001 Frank P. Westlake
Extracts URL's beginning with "http://" or "ftp://" from a stream and
prints to STDOUT.

program | GetURLs [/e:"string"] [/s:"string"]

/e Additional ending delimiters.
/s An additional beginning string to match.

The URL is expected to be ended with white space, a double quote, one of the
angle brackets '<' or '>', or one of the characters in the string identified by
the /e switch.

[Squashman]

Frank has made a lot of good tools over the years.

[foxidrive]

+1 on that